2024-05-08T19:08:18.945 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T19:08:18.945 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697948 --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} --name pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi --verbose --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697948/orig.config.yaml 2024-05-08T19:08:18.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T19:08:19.087 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697948 branch: wip-pdonnell-testing-20240508.150423-reef description: fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} email: pdonnell@redhat.com first_in_suite: false job_id: '7697948' kclient-workload: sequential: - kclient: - client.1 - workunit: clients: client.1: - suites/dbench.sh kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-pdonnell-testing-20240508.150423-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.150423-reef sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 7186 sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 sleep_before_teardown: 0 subset: 275/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.150423-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEPKkt+WArhvOQJjff/uHnM/OjL7PpRk/VQR0dDfcerGAkuKcP3mvAeTdO0UJXkEpOZKaCjXMIZSU1LJQH3vodQ= smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFgrPPJJ6jkXZTjldT28bd8yyRW60ux9ezNzibQ7ducMY3uyn1NWH6wEuc9sV+buWzdbtCYGOfYO0PEL17I4SeE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - parallel: - user-workload - kclient-workload teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_19:02:00 tube: smithi user: pdonnell user-workload: sequential: - ceph-fuse: - client.0 - workunit: clients: client.0: - suites/iozone.sh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T19:08:19.087 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa; will attempt to use it 2024-05-08T19:08:19.088 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa/tasks 2024-05-08T19:08:19.088 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T19:08:19.090 INFO:teuthology.task.internal:Checking packages... 2024-05-08T19:08:19.114 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'd21e4f961318b56f0d915caa2490c3711bf13c34' 2024-05-08T19:08:19.114 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T19:08:19.114 INFO:teuthology.packaging:ref: None 2024-05-08T19:08:19.115 INFO:teuthology.packaging:tag: None 2024-05-08T19:08:19.115 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.150423-reef 2024-05-08T19:08:19.115 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:08:19.115 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20240508.150423-reef 2024-05-08T19:08:19.441 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1322.gd21e4f96 2024-05-08T19:08:19.443 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T19:08:19.450 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T19:08:19.450 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T19:08:19.462 INFO:teuthology.task.internal:Saving configuration 2024-05-08T19:08:19.478 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T19:08:19.489 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T19:08:19.513 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697948', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 19:03:18.824624', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEPKkt+WArhvOQJjff/uHnM/OjL7PpRk/VQR0dDfcerGAkuKcP3mvAeTdO0UJXkEpOZKaCjXMIZSU1LJQH3vodQ='} 2024-05-08T19:08:19.538 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697948', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 19:03:18.826441', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFgrPPJJ6jkXZTjldT28bd8yyRW60ux9ezNzibQ7ducMY3uyn1NWH6wEuc9sV+buWzdbtCYGOfYO0PEL17I4SeE='} 2024-05-08T19:08:19.539 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T19:08:19.549 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-08T19:08:19.549 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-05-08T19:08:19.550 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T19:08:19.663 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0951468160>, signals=[15]) 2024-05-08T19:08:19.663 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T19:08:19.674 INFO:teuthology.task.internal:Opening connections... 2024-05-08T19:08:19.674 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-05-08T19:08:19.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T19:08:19.751 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2024-05-08T19:08:19.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T19:08:19.832 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T19:08:19.841 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-05-08T19:08:19.862 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-05-08T19:08:19.863 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-05-08T19:08:19.923 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T19:08:19.923 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T19:08:19.923 INFO:teuthology.orchestra.run.smithi047.stdout:ID="rhel" 2024-05-08T19:08:19.923 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="fedora" 2024-05-08T19:08:19.923 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="8.6" 2024-05-08T19:08:19.923 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el8" 2024-05-08T19:08:19.923 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T19:08:19.923 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-05-08T19:08:19.923 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T19:08:19.923 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T19:08:19.923 INFO:teuthology.orchestra.run.smithi047.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T19:08:19.924 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T19:08:19.924 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:08:19.924 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T19:08:19.924 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T19:08:19.924 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T19:08:19.924 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T19:08:19.924 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-05-08T19:08:19.965 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-05-08T19:08:19.986 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-05-08T19:08:19.986 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-05-08T19:08:20.049 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T19:08:20.049 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T19:08:20.049 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel" 2024-05-08T19:08:20.049 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora" 2024-05-08T19:08:20.049 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.6" 2024-05-08T19:08:20.049 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2024-05-08T19:08:20.049 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T19:08:20.049 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-05-08T19:08:20.049 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T19:08:20.049 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T19:08:20.049 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T19:08:20.050 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T19:08:20.050 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:08:20.050 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T19:08:20.050 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T19:08:20.050 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T19:08:20.050 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T19:08:20.050 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-05-08T19:08:20.081 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T19:08:20.097 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T19:08:20.107 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T19:08:20.108 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-05-08T19:08:20.110 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2024-05-08T19:08:20.130 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T19:08:20.141 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T19:08:20.141 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-05-08T19:08:20.170 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2024-05-08T19:08:20.197 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T19:08:20.256 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T19:08:20.276 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-08T19:08:20.276 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}} 2024-05-08T19:08:20.276 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-05-08T19:08:20.276 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T19:08:20.277 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T19:08:20.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T19:08:20.296 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-05-08T19:08:20.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T19:08:20.297 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-05-08T19:08:20.357 INFO:teuthology.orchestra.run.smithi047.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-05-08T19:08:20.358 INFO:teuthology.task.kernel:Running kernel on smithi047: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T19:08:20.358 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum install -y kernel 2024-05-08T19:08:20.359 INFO:teuthology.orchestra.run.smithi177.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-05-08T19:08:20.360 INFO:teuthology.task.kernel:Running kernel on smithi177: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T19:08:20.360 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum install -y kernel 2024-05-08T19:08:21.905 INFO:teuthology.orchestra.run.smithi177.stdout:Updating Subscription Management repositories. 2024-05-08T19:08:21.905 INFO:teuthology.orchestra.run.smithi177.stdout:Unable to read consumer identity 2024-05-08T19:08:22.021 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:08:22.021 INFO:teuthology.orchestra.run.smithi177.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T19:08:22.021 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:08:22.082 INFO:teuthology.orchestra.run.smithi047.stdout:Updating Subscription Management repositories. 2024-05-08T19:08:22.082 INFO:teuthology.orchestra.run.smithi047.stdout:Unable to read consumer identity 2024-05-08T19:08:22.200 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:08:22.200 INFO:teuthology.orchestra.run.smithi047.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T19:08:22.200 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:08:24.010 INFO:teuthology.orchestra.run.smithi177.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2024-05-08T19:08:24.122 INFO:teuthology.orchestra.run.smithi047.stdout:Copr repo for python3-asyncssh owned by ceph 10 kB/s | 3.5 kB 00:00 2024-05-08T19:08:24.727 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2024-05-08T19:08:24.964 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2024-05-08T19:08:28.452 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 339 kB/s | 24 kB 00:00 2024-05-08T19:08:28.839 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 429 kB/s | 24 kB 00:00 2024-05-08T19:08:29.416 INFO:teuthology.orchestra.run.smithi177.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-05-08T19:08:29.416 INFO:teuthology.orchestra.run.smithi177.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-05-08T19:08:29.494 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-05-08T19:08:29.495 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-05-08T19:08:29.495 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-05-08T19:08:29.623 DEBUG:teuthology.orchestra.run.smithi177:> echo no | sudo yum reinstall kernel || true 2024-05-08T19:08:29.625 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-05-08T19:08:29.625 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-05-08T19:08:29.705 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-05-08T19:08:29.706 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-05-08T19:08:29.707 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-05-08T19:08:29.874 DEBUG:teuthology.orchestra.run.smithi047:> echo no | sudo yum reinstall kernel || true 2024-05-08T19:08:30.002 INFO:teuthology.orchestra.run.smithi177.stdout:Updating Subscription Management repositories. 2024-05-08T19:08:30.003 INFO:teuthology.orchestra.run.smithi177.stdout:Unable to read consumer identity 2024-05-08T19:08:30.068 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:08:30.069 INFO:teuthology.orchestra.run.smithi177.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T19:08:30.069 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:08:30.232 INFO:teuthology.orchestra.run.smithi047.stdout:Updating Subscription Management repositories. 2024-05-08T19:08:30.232 INFO:teuthology.orchestra.run.smithi047.stdout:Unable to read consumer identity 2024-05-08T19:08:30.285 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:08:30.285 INFO:teuthology.orchestra.run.smithi047.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T19:08:30.285 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:08:30.387 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:00:02 ago on Wed 08 May 2024 07:08:28 PM UTC. 2024-05-08T19:08:30.483 INFO:teuthology.orchestra.run.smithi177.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T19:08:30.490 INFO:teuthology.orchestra.run.smithi177.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T19:08:30.528 INFO:teuthology.orchestra.run.smithi177.stderr:Error: No packages marked for reinstall. 2024-05-08T19:08:30.575 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum reinstall -y kernel || true 2024-05-08T19:08:30.614 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:02 ago on Wed 08 May 2024 07:08:28 PM UTC. 2024-05-08T19:08:30.694 INFO:teuthology.orchestra.run.smithi047.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T19:08:30.704 INFO:teuthology.orchestra.run.smithi047.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T19:08:30.749 INFO:teuthology.orchestra.run.smithi047.stderr:Error: No packages marked for reinstall. 2024-05-08T19:08:30.798 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum reinstall -y kernel || true 2024-05-08T19:08:30.908 INFO:teuthology.orchestra.run.smithi177.stdout:Updating Subscription Management repositories. 2024-05-08T19:08:30.908 INFO:teuthology.orchestra.run.smithi177.stdout:Unable to read consumer identity 2024-05-08T19:08:30.968 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:08:30.968 INFO:teuthology.orchestra.run.smithi177.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T19:08:30.968 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:08:31.152 INFO:teuthology.orchestra.run.smithi047.stdout:Updating Subscription Management repositories. 2024-05-08T19:08:31.152 INFO:teuthology.orchestra.run.smithi047.stdout:Unable to read consumer identity 2024-05-08T19:08:31.210 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:08:31.210 INFO:teuthology.orchestra.run.smithi047.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T19:08:31.210 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:08:31.266 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:00:03 ago on Wed 08 May 2024 07:08:28 PM UTC. 2024-05-08T19:08:31.329 INFO:teuthology.orchestra.run.smithi177.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T19:08:31.329 INFO:teuthology.orchestra.run.smithi177.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T19:08:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:Error: No packages marked for reinstall. 2024-05-08T19:08:31.406 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T19:08:31.525 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:03 ago on Wed 08 May 2024 07:08:28 PM UTC. 2024-05-08T19:08:31.569 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-05-08T19:08:31.570 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T19:08:31.570 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-08T19:08:31.570 DEBUG:teuthology.parallel:result is None 2024-05-08T19:08:31.593 INFO:teuthology.orchestra.run.smithi047.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T19:08:31.593 INFO:teuthology.orchestra.run.smithi047.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T19:08:31.630 INFO:teuthology.orchestra.run.smithi047.stderr:Error: No packages marked for reinstall. 2024-05-08T19:08:31.677 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T19:08:31.837 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-05-08T19:08:31.838 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T19:08:31.838 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-08T19:08:31.838 DEBUG:teuthology.parallel:result is None 2024-05-08T19:08:31.838 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T19:08:31.850 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T19:08:31.850 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T19:08:31.852 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T19:08:31.869 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T19:08:31.876 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T19:08:31.894 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T19:08:31.894 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T19:08:31.910 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T19:08:31.952 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T19:08:31.959 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T19:08:31.959 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T19:08:31.978 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T19:08:32.004 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:08:32.018 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:08:32.028 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:08:32.046 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:08:32.047 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T19:08:32.056 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T19:08:32.056 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T19:08:32.062 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T19:08:32.113 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T19:08:32.124 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T19:08:32.124 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T19:08:32.130 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T19:08:32.170 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T19:08:32.228 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T19:08:32.286 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T19:08:32.370 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T19:08:32.413 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:08:32.413 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T19:08:32.480 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T19:08:32.524 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T19:08:32.624 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T19:08:32.667 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T19:08:32.710 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:08:32.710 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T19:08:32.776 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-05-08T19:08:32.778 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2024-05-08T19:08:32.825 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T19:08:32.862 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T19:08:33.115 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T19:08:33.124 INFO:teuthology.task.internal:Starting timer... 2024-05-08T19:08:33.124 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T19:08:33.170 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T19:08:33.183 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2024-05-08T19:08:33.184 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-05-08T19:08:33.245 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-05-08T19:08:33.247 DEBUG:teuthology.orchestra.run.smithi177:> sudo service auditd rotate 2024-05-08T19:08:33.330 INFO:teuthology.orchestra.run.smithi177.stdout:Rotating logs: 2024-05-08T19:08:33.332 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T19:08:33.332 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-05-08T19:08:33.358 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-05-08T19:08:33.358 DEBUG:teuthology.orchestra.run.smithi177:> /usr/sbin/getenforce 2024-05-08T19:08:33.377 INFO:teuthology.orchestra.run.smithi177.stdout:Permissive 2024-05-08T19:08:33.377 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi047.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi177.front.sepia.ceph.com': 'permissive'} 2024-05-08T19:08:33.377 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T19:08:33.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T19:08:33.426 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T19:08:33.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T19:08:33.453 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T19:08:33.454 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-05-08T19:08:33.493 DEBUG:teuthology.orchestra.run.smithi177:> sudo /usr/sbin/setenforce permissive 2024-05-08T19:08:33.521 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T19:08:33.533 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T19:08:33.550 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T19:08:33.551 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi047.front.sepia.ceph.com,smithi177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T19:18:26.926 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi177.front.sepia.ceph.com')] 2024-05-08T19:18:26.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-08T19:18:26.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T19:18:27.005 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-05-08T19:18:27.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-08T19:18:27.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-05-08T19:18:27.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T19:18:27.149 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-05-08T19:18:27.222 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-05-08T19:18:27.223 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T19:18:27.233 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T19:18:27.233 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T19:18:27.234 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T19:18:27.236 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T19:18:27.236 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T19:18:27.267 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T19:18:27.283 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T19:18:27.297 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T19:18:27.312 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T19:18:27.359 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-05-08T19:18:27.372 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-05-08T19:18:27.381 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: ntpd: command not found 2024-05-08T19:18:27.387 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T19:18:27.394 INFO:teuthology.orchestra.run.smithi177.stdout:506 Cannot talk to daemon 2024-05-08T19:18:27.402 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T19:18:27.410 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T19:18:27.423 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T19:18:27.476 INFO:teuthology.orchestra.run.smithi047.stderr:bash: ntpq: command not found 2024-05-08T19:18:27.481 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T19:18:27.481 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-05-08T19:18:27.481 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:18:27.481 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:18:27.481 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:18:27.481 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:18:27.501 INFO:teuthology.orchestra.run.smithi177.stderr:bash: ntpq: command not found 2024-05-08T19:18:27.505 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T19:18:27.505 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-05-08T19:18:27.505 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:18:27.506 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:18:27.506 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:18:27.506 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:18:27.507 INFO:teuthology.run_tasks:Running task install... 2024-05-08T19:18:27.516 DEBUG:teuthology.task.install:project ceph 2024-05-08T19:18:27.516 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}} 2024-05-08T19:18:27.516 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'} 2024-05-08T19:18:27.516 INFO:teuthology.task.install:Using flavor: default 2024-05-08T19:18:27.522 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T19:18:27.522 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-05-08T19:18:27.523 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T19:18:27.523 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:18:27.526 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T19:18:27.526 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:18:27.741 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T19:18:27.741 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T19:18:27.754 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T19:18:27.754 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T19:18:27.850 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T19:18:27.851 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:18:27.851 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T19:18:27.864 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T19:18:27.865 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:18:27.865 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T19:18:27.881 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T19:18:27.881 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T19:18:27.893 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T19:18:27.894 DEBUG:teuthology.orchestra.run.smithi177:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T19:18:27.951 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T19:18:27.964 DEBUG:teuthology.orchestra.run.smithi177:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T19:18:28.031 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T19:18:28.043 DEBUG:teuthology.orchestra.run.smithi177:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T19:18:28.098 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-05-08T19:18:28.100 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-05-08T19:18:28.110 INFO:teuthology.orchestra.run.smithi177.stdout:check_obsoletes = 1 2024-05-08T19:18:28.111 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum clean all 2024-05-08T19:18:28.486 INFO:teuthology.orchestra.run.smithi177.stdout:Updating Subscription Management repositories. 2024-05-08T19:18:28.495 INFO:teuthology.orchestra.run.smithi047.stdout:Updating Subscription Management repositories. 2024-05-08T19:18:29.895 INFO:teuthology.orchestra.run.smithi047.stdout:63 files removed 2024-05-08T19:18:29.943 INFO:teuthology.orchestra.run.smithi177.stdout:63 files removed 2024-05-08T19:18:29.948 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T19:18:29.995 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T19:18:30.302 INFO:teuthology.orchestra.run.smithi047.stdout:Updating Subscription Management repositories. 2024-05-08T19:18:30.331 INFO:teuthology.orchestra.run.smithi177.stdout:Updating Subscription Management repositories. 2024-05-08T19:18:32.105 INFO:teuthology.orchestra.run.smithi177.stdout:ceph packages for x86_64 329 kB/s | 80 kB 00:00 2024-05-08T19:18:32.294 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 207 kB/s | 80 kB 00:00 2024-05-08T19:18:32.481 INFO:teuthology.orchestra.run.smithi177.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-05-08T19:18:32.661 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-05-08T19:18:32.823 INFO:teuthology.orchestra.run.smithi177.stdout:ceph source packages 4.7 kB/s | 1.5 kB 00:00 2024-05-08T19:18:32.978 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 5.2 kB/s | 1.5 kB 00:00 2024-05-08T19:18:33.016 INFO:teuthology.orchestra.run.smithi177.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2024-05-08T19:18:33.129 INFO:teuthology.orchestra.run.smithi047.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2024-05-08T19:18:34.032 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2024-05-08T19:18:34.369 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2024-05-08T19:18:37.855 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 252 kB/s | 24 kB 00:00 2024-05-08T19:18:38.016 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 389 kB/s | 24 kB 00:00 2024-05-08T19:18:38.540 INFO:teuthology.orchestra.run.smithi047.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 15 MB/s | 8.8 MB 00:00 2024-05-08T19:18:38.710 INFO:teuthology.orchestra.run.smithi177.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-05-08T19:18:41.499 INFO:teuthology.orchestra.run.smithi047.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 61 MB 00:01 2024-05-08T19:18:41.746 INFO:teuthology.orchestra.run.smithi177.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 44 MB/s | 67 MB 00:01 2024-05-08T19:18:52.654 INFO:teuthology.orchestra.run.smithi177.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 49 MB/s | 61 MB 00:01 2024-05-08T19:18:53.867 INFO:teuthology.orchestra.run.smithi047.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 46 MB/s | 67 MB 00:01 2024-05-08T19:19:08.227 INFO:teuthology.orchestra.run.smithi177.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T19:19:08.229 INFO:teuthology.orchestra.run.smithi177.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T19:19:08.248 INFO:teuthology.orchestra.run.smithi177.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T19:19:08.249 INFO:teuthology.orchestra.run.smithi177.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T19:19:08.251 INFO:teuthology.orchestra.run.smithi177.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T19:19:08.252 INFO:teuthology.orchestra.run.smithi177.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T19:19:08.255 INFO:teuthology.orchestra.run.smithi177.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T19:19:08.259 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T19:19:08.261 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T19:19:08.479 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-05-08T19:19:08.493 INFO:teuthology.orchestra.run.smithi177.stdout:=================================================================================================================================== 2024-05-08T19:19:08.494 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-05-08T19:19:08.494 INFO:teuthology.orchestra.run.smithi177.stdout:=================================================================================================================================== 2024-05-08T19:19:08.494 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-05-08T19:19:08.494 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T19:19:08.494 INFO:teuthology.orchestra.run.smithi177.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T19:19:08.494 INFO:teuthology.orchestra.run.smithi177.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T19:19:08.494 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T19:19:08.494 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T19:19:08.494 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T19:19:08.494 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T19:19:08.494 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T19:19:08.495 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T19:19:08.495 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T19:19:08.495 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T19:19:08.495 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T19:19:08.495 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T19:19:08.495 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T19:19:08.495 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T19:19:08.495 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T19:19:08.495 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T19:19:08.495 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T19:19:08.495 INFO:teuthology.orchestra.run.smithi177.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T19:19:08.495 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T19:19:08.496 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T19:19:08.496 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T19:19:08.496 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T19:19:08.496 INFO:teuthology.orchestra.run.smithi177.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T19:19:08.496 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T19:19:08.496 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T19:19:08.496 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T19:19:08.496 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T19:19:08.496 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T19:19:08.496 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T19:19:08.496 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T19:19:08.496 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T19:19:08.496 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T19:19:08.497 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T19:19:08.497 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T19:19:08.497 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T19:19:08.497 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T19:19:08.497 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrading: 2024-05-08T19:19:08.497 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T19:19:08.497 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T19:19:08.497 INFO:teuthology.orchestra.run.smithi177.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T19:19:08.497 INFO:teuthology.orchestra.run.smithi177.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T19:19:08.497 INFO:teuthology.orchestra.run.smithi177.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T19:19:08.497 INFO:teuthology.orchestra.run.smithi177.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T19:19:08.497 INFO:teuthology.orchestra.run.smithi177.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T19:19:08.497 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T19:19:08.497 INFO:teuthology.orchestra.run.smithi177.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T19:19:08.498 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T19:19:08.498 INFO:teuthology.orchestra.run.smithi177.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T19:19:08.498 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T19:19:08.498 INFO:teuthology.orchestra.run.smithi177.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T19:19:08.498 INFO:teuthology.orchestra.run.smithi177.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T19:19:08.498 INFO:teuthology.orchestra.run.smithi177.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T19:19:08.498 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T19:19:08.498 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-05-08T19:19:08.498 INFO:teuthology.orchestra.run.smithi177.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T19:19:08.498 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T19:19:08.498 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T19:19:08.498 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T19:19:08.498 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T19:19:08.499 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T19:19:08.499 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T19:19:08.499 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T19:19:08.499 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T19:19:08.499 INFO:teuthology.orchestra.run.smithi177.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T19:19:08.499 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T19:19:08.499 INFO:teuthology.orchestra.run.smithi177.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T19:19:08.499 INFO:teuthology.orchestra.run.smithi177.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T19:19:08.499 INFO:teuthology.orchestra.run.smithi177.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T19:19:08.499 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T19:19:08.499 INFO:teuthology.orchestra.run.smithi177.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T19:19:08.499 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T19:19:08.499 INFO:teuthology.orchestra.run.smithi177.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T19:19:08.500 INFO:teuthology.orchestra.run.smithi177.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T19:19:08.500 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T19:19:08.500 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T19:19:08.500 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T19:19:08.500 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T19:19:08.500 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T19:19:08.500 INFO:teuthology.orchestra.run.smithi177.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T19:19:08.500 INFO:teuthology.orchestra.run.smithi177.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T19:19:08.500 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T19:19:08.500 INFO:teuthology.orchestra.run.smithi177.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T19:19:08.500 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T19:19:08.500 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T19:19:08.500 INFO:teuthology.orchestra.run.smithi177.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T19:19:08.500 INFO:teuthology.orchestra.run.smithi177.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T19:19:08.501 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T19:19:08.501 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T19:19:08.501 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T19:19:08.501 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T19:19:08.501 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T19:19:08.501 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T19:19:08.501 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T19:19:08.501 INFO:teuthology.orchestra.run.smithi177.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T19:19:08.501 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T19:19:08.501 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T19:19:08.501 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T19:19:08.501 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T19:19:08.501 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T19:19:08.501 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T19:19:08.501 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T19:19:08.502 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T19:19:08.502 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T19:19:08.502 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T19:19:08.502 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T19:19:08.502 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T19:19:08.502 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T19:19:08.502 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T19:19:08.502 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T19:19:08.502 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T19:19:08.502 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T19:19:08.502 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T19:19:08.502 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T19:19:08.502 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T19:19:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T19:19:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T19:19:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T19:19:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T19:19:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T19:19:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T19:19:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T19:19:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T19:19:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T19:19:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T19:19:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T19:19:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T19:19:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T19:19:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T19:19:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T19:19:08.504 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T19:19:08.504 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T19:19:08.504 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T19:19:08.504 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T19:19:08.504 INFO:teuthology.orchestra.run.smithi177.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T19:19:08.504 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T19:19:08.504 INFO:teuthology.orchestra.run.smithi177.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T19:19:08.504 INFO:teuthology.orchestra.run.smithi177.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T19:19:08.504 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T19:19:08.504 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T19:19:08.504 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T19:19:08.504 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T19:19:08.504 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T19:19:08.505 INFO:teuthology.orchestra.run.smithi177.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T19:19:08.505 INFO:teuthology.orchestra.run.smithi177.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T19:19:08.505 INFO:teuthology.orchestra.run.smithi177.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T19:19:08.505 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T19:19:08.505 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T19:19:08.505 INFO:teuthology.orchestra.run.smithi177.stdout:Enabling module streams: 2024-05-08T19:19:08.505 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql 10 2024-05-08T19:19:08.505 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:19:08.505 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-05-08T19:19:08.505 INFO:teuthology.orchestra.run.smithi177.stdout:=================================================================================================================================== 2024-05-08T19:19:08.505 INFO:teuthology.orchestra.run.smithi177.stdout:Install 130 Packages 2024-05-08T19:19:08.505 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrade 16 Packages 2024-05-08T19:19:08.505 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:19:08.506 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 215 M 2024-05-08T19:19:08.506 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-05-08T19:19:09.004 INFO:teuthology.orchestra.run.smithi177.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2024-05-08T19:19:09.620 INFO:teuthology.orchestra.run.smithi177.stdout:(2/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.4 MB/s | 860 kB 00:00 2024-05-08T19:19:09.746 INFO:teuthology.orchestra.run.smithi177.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 1.3 MB/s | 166 kB 00:00 2024-05-08T19:19:09.896 INFO:teuthology.orchestra.run.smithi177.stdout:(4/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 4.4 MB/s | 5.5 MB 00:01 2024-05-08T19:19:10.092 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T19:19:10.094 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T19:19:10.114 INFO:teuthology.orchestra.run.smithi047.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T19:19:10.115 INFO:teuthology.orchestra.run.smithi047.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T19:19:10.117 INFO:teuthology.orchestra.run.smithi047.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T19:19:10.118 INFO:teuthology.orchestra.run.smithi047.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T19:19:10.121 INFO:teuthology.orchestra.run.smithi047.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T19:19:10.126 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T19:19:10.127 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T19:19:10.129 INFO:teuthology.orchestra.run.smithi177.stdout:(5/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 6.7 MB/s | 1.6 MB 00:00 2024-05-08T19:19:10.361 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-05-08T19:19:10.376 INFO:teuthology.orchestra.run.smithi047.stdout:=================================================================================================================================== 2024-05-08T19:19:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-05-08T19:19:10.376 INFO:teuthology.orchestra.run.smithi047.stdout:=================================================================================================================================== 2024-05-08T19:19:10.376 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-05-08T19:19:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T19:19:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T19:19:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T19:19:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T19:19:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T19:19:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T19:19:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T19:19:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T19:19:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T19:19:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T19:19:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T19:19:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T19:19:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T19:19:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T19:19:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T19:19:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T19:19:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T19:19:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T19:19:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T19:19:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T19:19:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T19:19:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T19:19:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T19:19:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T19:19:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T19:19:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T19:19:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T19:19:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T19:19:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T19:19:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T19:19:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T19:19:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T19:19:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T19:19:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T19:19:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T19:19:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T19:19:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T19:19:10.379 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-05-08T19:19:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T19:19:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T19:19:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T19:19:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T19:19:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T19:19:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T19:19:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T19:19:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T19:19:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T19:19:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T19:19:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T19:19:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T19:19:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T19:19:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T19:19:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T19:19:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T19:19:10.380 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-05-08T19:19:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T19:19:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T19:19:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T19:19:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T19:19:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T19:19:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T19:19:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T19:19:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T19:19:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T19:19:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T19:19:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T19:19:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T19:19:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T19:19:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T19:19:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T19:19:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T19:19:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T19:19:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T19:19:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T19:19:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T19:19:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T19:19:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T19:19:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T19:19:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T19:19:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T19:19:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T19:19:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T19:19:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T19:19:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T19:19:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T19:19:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T19:19:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T19:19:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T19:19:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T19:19:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T19:19:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T19:19:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T19:19:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T19:19:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T19:19:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T19:19:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T19:19:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T19:19:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T19:19:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T19:19:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T19:19:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T19:19:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T19:19:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T19:19:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T19:19:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T19:19:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T19:19:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T19:19:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T19:19:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T19:19:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T19:19:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T19:19:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T19:19:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T19:19:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T19:19:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T19:19:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T19:19:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T19:19:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T19:19:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T19:19:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T19:19:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T19:19:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T19:19:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T19:19:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T19:19:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T19:19:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T19:19:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T19:19:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T19:19:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T19:19:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T19:19:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T19:19:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T19:19:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T19:19:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T19:19:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T19:19:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T19:19:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T19:19:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T19:19:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T19:19:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T19:19:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T19:19:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T19:19:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T19:19:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T19:19:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T19:19:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T19:19:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T19:19:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T19:19:10.387 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling module streams: 2024-05-08T19:19:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql 10 2024-05-08T19:19:10.388 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:19:10.388 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-05-08T19:19:10.388 INFO:teuthology.orchestra.run.smithi047.stdout:=================================================================================================================================== 2024-05-08T19:19:10.388 INFO:teuthology.orchestra.run.smithi047.stdout:Install 130 Packages 2024-05-08T19:19:10.388 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 16 Packages 2024-05-08T19:19:10.388 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:19:10.388 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 215 M 2024-05-08T19:19:10.388 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-05-08T19:19:10.538 INFO:teuthology.orchestra.run.smithi177.stdout:(6/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 2.9 MB/s | 2.3 MB 00:00 2024-05-08T19:19:10.722 INFO:teuthology.orchestra.run.smithi177.stdout:(7/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 8.2 MB/s | 4.8 MB 00:00 2024-05-08T19:19:11.034 INFO:teuthology.orchestra.run.smithi047.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2024-05-08T19:19:12.192 INFO:teuthology.orchestra.run.smithi047.stdout:(2/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 743 kB/s | 860 kB 00:01 2024-05-08T19:19:12.376 INFO:teuthology.orchestra.run.smithi047.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 905 kB/s | 166 kB 00:00 2024-05-08T19:19:12.655 INFO:teuthology.orchestra.run.smithi177.stdout:(8/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el8 6.8 MB/s | 13 MB 00:01 2024-05-08T19:19:12.780 INFO:teuthology.orchestra.run.smithi177.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 195 kB/s | 24 kB 00:00 2024-05-08T19:19:13.231 INFO:teuthology.orchestra.run.smithi177.stdout:(10/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x8 6.8 MB/s | 18 MB 00:02 2024-05-08T19:19:13.284 INFO:teuthology.orchestra.run.smithi047.stdout:(4/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 2.5 MB/s | 2.3 MB 00:00 2024-05-08T19:19:13.339 INFO:teuthology.orchestra.run.smithi177.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 2.4 MB/s | 261 kB 00:00 2024-05-08T19:19:13.439 INFO:teuthology.orchestra.run.smithi177.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 310 kB/s | 31 kB 00:00 2024-05-08T19:19:13.576 INFO:teuthology.orchestra.run.smithi047.stdout:(5/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 5.4 MB/s | 1.6 MB 00:00 2024-05-08T19:19:13.589 INFO:teuthology.orchestra.run.smithi177.stdout:(13/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 5.1 MB/s | 782 kB 00:00 2024-05-08T19:19:13.707 INFO:teuthology.orchestra.run.smithi177.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 1.2 MB/s | 142 kB 00:00 2024-05-08T19:19:13.824 INFO:teuthology.orchestra.run.smithi177.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 1.2 MB/s | 139 kB 00:00 2024-05-08T19:19:13.932 INFO:teuthology.orchestra.run.smithi177.stdout:(16/146): libradosstriper1-18.2.2-1322.gd21e4f9 4.3 MB/s | 474 kB 00:00 2024-05-08T19:19:14.276 INFO:teuthology.orchestra.run.smithi047.stdout:(6/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 6.9 MB/s | 4.8 MB 00:00 2024-05-08T19:19:14.627 INFO:teuthology.orchestra.run.smithi047.stdout:(7/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 1.4 MB/s | 5.5 MB 00:03 2024-05-08T19:19:14.649 INFO:teuthology.orchestra.run.smithi177.stdout:(17/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 9.1 MB/s | 6.5 MB 00:00 2024-05-08T19:19:14.716 INFO:teuthology.orchestra.run.smithi177.stdout:(18/146): python3-ceph-argparse-18.2.2-1322.gd2 674 kB/s | 45 kB 00:00 2024-05-08T19:19:14.817 INFO:teuthology.orchestra.run.smithi177.stdout:(19/146): python3-ceph-common-18.2.2-1322.gd21e 1.3 MB/s | 129 kB 00:00 2024-05-08T19:19:14.925 INFO:teuthology.orchestra.run.smithi177.stdout:(20/146): python3-cephfs-18.2.2-1322.gd21e4f96. 1.8 MB/s | 197 kB 00:00 2024-05-08T19:19:15.042 INFO:teuthology.orchestra.run.smithi177.stdout:(21/146): python3-rados-18.2.2-1322.gd21e4f96.e 3.1 MB/s | 370 kB 00:00 2024-05-08T19:19:15.159 INFO:teuthology.orchestra.run.smithi177.stdout:(22/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 3.1 MB/s | 365 kB 00:00 2024-05-08T19:19:15.243 INFO:teuthology.orchestra.run.smithi177.stdout:(23/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 1.3 MB/s | 107 kB 00:00 2024-05-08T19:19:15.334 INFO:teuthology.orchestra.run.smithi177.stdout:(24/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.0 MB/s | 95 kB 00:00 2024-05-08T19:19:15.768 INFO:teuthology.orchestra.run.smithi177.stdout:(25/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 8.0 MB/s | 3.5 MB 00:00 2024-05-08T19:19:15.885 INFO:teuthology.orchestra.run.smithi177.stdout:(26/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 1.5 MB/s | 181 kB 00:00 2024-05-08T19:19:16.002 INFO:teuthology.orchestra.run.smithi177.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1322.g 208 kB/s | 24 kB 00:00 2024-05-08T19:19:16.086 INFO:teuthology.orchestra.run.smithi177.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 1.6 MB/s | 138 kB 00:00 2024-05-08T19:19:16.160 INFO:teuthology.orchestra.run.smithi047.stdout:(8/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x86 9.8 MB/s | 18 MB 00:01 2024-05-08T19:19:16.235 INFO:teuthology.orchestra.run.smithi047.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 325 kB/s | 24 kB 00:00 2024-05-08T19:19:16.469 INFO:teuthology.orchestra.run.smithi177.stdout:(29/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 9.2 MB/s | 3.5 MB 00:00 2024-05-08T19:19:16.803 INFO:teuthology.orchestra.run.smithi177.stdout:(30/146): ceph-common-18.2.2-1322.gd21e4f96.el8 2.7 MB/s | 22 MB 00:08 2024-05-08T19:19:17.086 INFO:teuthology.orchestra.run.smithi177.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 867 kB/s | 245 kB 00:00 2024-05-08T19:19:17.178 INFO:teuthology.orchestra.run.smithi177.stdout:(32/146): ceph-mgr-diskprediction-local-18.2.2- 10 MB/s | 7.4 MB 00:00 2024-05-08T19:19:17.203 INFO:teuthology.orchestra.run.smithi177.stdout:(33/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 420 kB/s | 49 kB 00:00 2024-05-08T19:19:17.245 INFO:teuthology.orchestra.run.smithi177.stdout:(34/146): ceph-prometheus-alerts-18.2.2-1322.gd 244 kB/s | 16 kB 00:00 2024-05-08T19:19:17.337 INFO:teuthology.orchestra.run.smithi177.stdout:(35/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 1.8 MB/s | 170 kB 00:00 2024-05-08T19:19:17.362 INFO:teuthology.orchestra.run.smithi177.stdout:(36/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 1.6 MB/s | 263 kB 00:00 2024-05-08T19:19:17.421 INFO:teuthology.orchestra.run.smithi177.stdout:(37/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 216 kB/s | 18 kB 00:00 2024-05-08T19:19:17.597 INFO:teuthology.orchestra.run.smithi177.stdout:(38/146): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2024-05-08T19:19:17.622 INFO:teuthology.orchestra.run.smithi177.stdout:(39/146): liboath-2.6.2-3.el8.x86_64.rpm 294 kB/s | 59 kB 00:00 2024-05-08T19:19:17.647 INFO:teuthology.orchestra.run.smithi177.stdout:(40/146): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2024-05-08T19:19:17.697 INFO:teuthology.orchestra.run.smithi177.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 871 kB/s | 44 kB 00:00 2024-05-08T19:19:17.748 INFO:teuthology.orchestra.run.smithi177.stdout:(42/146): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2024-05-08T19:19:17.773 INFO:teuthology.orchestra.run.smithi177.stdout:(43/146): python3-asyncssh-2.7.0-2.el8.noarch.r 3.1 MB/s | 476 kB 00:00 2024-05-08T19:19:17.798 INFO:teuthology.orchestra.run.smithi177.stdout:(44/146): python3-cachetools-3.1.1-4.el8.noarch 656 kB/s | 33 kB 00:00 2024-05-08T19:19:17.815 INFO:teuthology.orchestra.run.smithi177.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 388 kB/s | 16 kB 00:00 2024-05-08T19:19:17.882 INFO:teuthology.orchestra.run.smithi177.stdout:(46/146): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2024-05-08T19:19:17.933 INFO:teuthology.orchestra.run.smithi177.stdout:(47/146): python3-cherrypy-18.4.0-1.el8.noarch. 3.2 MB/s | 384 kB 00:00 2024-05-08T19:19:17.958 INFO:teuthology.orchestra.run.smithi177.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2024-05-08T19:19:17.975 INFO:teuthology.orchestra.run.smithi177.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 265 kB/s | 11 kB 00:00 2024-05-08T19:19:18.000 INFO:teuthology.orchestra.run.smithi177.stdout:(50/146): python3-jaraco-functools-2.0-4.el8.no 421 kB/s | 18 kB 00:00 2024-05-08T19:19:18.042 INFO:teuthology.orchestra.run.smithi177.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 1.1 MB/s | 49 kB 00:00 2024-05-08T19:19:18.111 INFO:teuthology.orchestra.run.smithi177.stdout:(52/146): python3-more-itertools-7.2.0-3.el8.no 851 kB/s | 59 kB 00:00 2024-05-08T19:19:18.168 INFO:teuthology.orchestra.run.smithi177.stdout:(53/146): python3-natsort-7.1.1-2.el8.noarch.rp 1.1 MB/s | 60 kB 00:00 2024-05-08T19:19:18.201 INFO:teuthology.orchestra.run.smithi177.stdout:(54/146): python3-kubernetes-11.0.0-6.el8.noarc 5.2 MB/s | 1.2 MB 00:00 2024-05-08T19:19:18.226 INFO:teuthology.orchestra.run.smithi177.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2024-05-08T19:19:18.243 INFO:teuthology.orchestra.run.smithi177.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 373 kB/s | 16 kB 00:00 2024-05-08T19:19:18.277 INFO:teuthology.orchestra.run.smithi177.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 670 kB/s | 34 kB 00:00 2024-05-08T19:19:18.302 INFO:teuthology.orchestra.run.smithi177.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2024-05-08T19:19:18.327 INFO:teuthology.orchestra.run.smithi177.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2024-05-08T19:19:18.403 INFO:teuthology.orchestra.run.smithi177.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2024-05-08T19:19:18.428 INFO:teuthology.orchestra.run.smithi177.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2024-05-08T19:19:18.453 INFO:teuthology.orchestra.run.smithi177.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 583 kB/s | 29 kB 00:00 2024-05-08T19:19:18.479 INFO:teuthology.orchestra.run.smithi177.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 549 kB/s | 27 kB 00:00 2024-05-08T19:19:18.529 INFO:teuthology.orchestra.run.smithi177.stdout:(64/146): python3-waitress-1.4.3-1.el8.noarch.r 3.3 MB/s | 255 kB 00:00 2024-05-08T19:19:18.554 INFO:teuthology.orchestra.run.smithi177.stdout:(65/146): python3-webob-1.8.5-1.el8.1.noarch.rp 3.3 MB/s | 251 kB 00:00 2024-05-08T19:19:18.579 INFO:teuthology.orchestra.run.smithi177.stdout:(66/146): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2024-05-08T19:19:18.605 INFO:teuthology.orchestra.run.smithi177.stdout:(67/146): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2024-05-08T19:19:18.655 INFO:teuthology.orchestra.run.smithi177.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2024-05-08T19:19:18.680 INFO:teuthology.orchestra.run.smithi177.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-05-08T19:19:18.806 INFO:teuthology.orchestra.run.smithi177.stdout:(70/146): thrift-0.13.0-2.el8.x86_64.rpm 8.7 MB/s | 1.7 MB 00:00 2024-05-08T19:19:18.998 INFO:teuthology.orchestra.run.smithi177.stdout:(71/146): python3-packaging-16.8-9.el8.noarch.r 152 kB/s | 48 kB 00:00 2024-05-08T19:19:19.082 INFO:teuthology.orchestra.run.smithi177.stdout:(72/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 65 kB/s | 18 kB 00:00 2024-05-08T19:19:19.265 INFO:teuthology.orchestra.run.smithi177.stdout:(73/146): python3-jwt-1.6.1-2.el8.noarch.rpm 160 kB/s | 43 kB 00:00 2024-05-08T19:19:19.365 INFO:teuthology.orchestra.run.smithi177.stdout:(74/146): python3-oauthlib-2.1.0-1.el8.noarch.r 546 kB/s | 155 kB 00:00 2024-05-08T19:19:19.491 INFO:teuthology.orchestra.run.smithi177.stdout:(75/146): python3-pycparser-2.14-14.el8.noarch. 485 kB/s | 109 kB 00:00 2024-05-08T19:19:19.518 INFO:teuthology.orchestra.run.smithi177.stdout:(76/146): python3-requests-oauthlib-1.0.0-1.el8 284 kB/s | 43 kB 00:00 2024-05-08T19:19:19.585 INFO:teuthology.orchestra.run.smithi047.stdout:(10/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el 2.6 MB/s | 13 MB 00:04 2024-05-08T19:19:19.719 INFO:teuthology.orchestra.run.smithi047.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 1.9 MB/s | 261 kB 00:00 2024-05-08T19:19:19.741 INFO:teuthology.orchestra.run.smithi177.stdout:(77/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 75 kB/s | 19 kB 00:00 2024-05-08T19:19:19.761 INFO:teuthology.orchestra.run.smithi047.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 746 kB/s | 31 kB 00:00 2024-05-08T19:19:20.042 INFO:teuthology.orchestra.run.smithi177.stdout:(78/146): pcre2-devel-10.32-2.el8.x86_64.rpm 2.0 MB/s | 605 kB 00:00 2024-05-08T19:19:20.044 INFO:teuthology.orchestra.run.smithi047.stdout:(13/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 2.7 MB/s | 782 kB 00:00 2024-05-08T19:19:20.067 INFO:teuthology.orchestra.run.smithi177.stdout:(79/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 80 kB/s | 44 kB 00:00 2024-05-08T19:19:20.111 INFO:teuthology.orchestra.run.smithi047.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 2.1 MB/s | 142 kB 00:00 2024-05-08T19:19:20.117 INFO:teuthology.orchestra.run.smithi177.stdout:(80/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2024-05-08T19:19:20.178 INFO:teuthology.orchestra.run.smithi047.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 2.0 MB/s | 139 kB 00:00 2024-05-08T19:19:20.184 INFO:teuthology.orchestra.run.smithi177.stdout:(81/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2024-05-08T19:19:20.371 INFO:teuthology.orchestra.run.smithi047.stdout:(16/146): libradosstriper1-18.2.2-1322.gd21e4f9 2.4 MB/s | 474 kB 00:00 2024-05-08T19:19:20.384 INFO:teuthology.orchestra.run.smithi177.stdout:(82/146): libselinux-devel-2.9-5.el8.x86_64.rpm 749 kB/s | 200 kB 00:00 2024-05-08T19:19:20.526 INFO:teuthology.orchestra.run.smithi177.stdout:(83/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 141 kB/s | 48 kB 00:00 2024-05-08T19:19:21.010 INFO:teuthology.orchestra.run.smithi177.stdout:(84/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 5.7 MB/s | 47 MB 00:08 2024-05-08T19:19:21.035 INFO:teuthology.orchestra.run.smithi177.stdout:(85/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 113 kB/s | 58 kB 00:00 2024-05-08T19:19:21.060 INFO:teuthology.orchestra.run.smithi177.stdout:(86/146): libsepol-devel-2.9-3.el8.x86_64.rpm 129 kB/s | 87 kB 00:00 2024-05-08T19:19:21.154 INFO:teuthology.orchestra.run.smithi177.stdout:(87/146): libgfortran-8.5.0-20.el8.x86_64.rpm 6.9 MB/s | 645 kB 00:00 2024-05-08T19:19:21.277 INFO:teuthology.orchestra.run.smithi177.stdout:(88/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2024-05-08T19:19:21.428 INFO:teuthology.orchestra.run.smithi177.stdout:(89/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2024-05-08T19:19:21.453 INFO:teuthology.orchestra.run.smithi177.stdout:(90/146): fuse-2.9.7-17.el8.x86_64.rpm 202 kB/s | 83 kB 00:00 2024-05-08T19:19:21.507 INFO:teuthology.orchestra.run.smithi177.stdout:(91/146): libcom_err-devel-1.45.6-4.el8.x86_64. 78 kB/s | 39 kB 00:00 2024-05-08T19:19:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:(17/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 8.6 MB/s | 47 MB 00:05 2024-05-08T19:19:21.703 INFO:teuthology.orchestra.run.smithi177.stdout:(92/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 2.8 MB/s | 562 kB 00:00 2024-05-08T19:19:21.729 INFO:teuthology.orchestra.run.smithi177.stdout:(93/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 241 kB/s | 73 kB 00:00 2024-05-08T19:19:21.779 INFO:teuthology.orchestra.run.smithi177.stdout:(94/146): elfutils-libelf-devel-0.189-3.el8.x86 189 kB/s | 62 kB 00:00 2024-05-08T19:19:21.787 INFO:teuthology.orchestra.run.smithi047.stdout:(18/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 4.6 MB/s | 6.5 MB 00:01 2024-05-08T19:19:21.813 INFO:teuthology.orchestra.run.smithi047.stdout:(19/146): python3-ceph-argparse-18.2.2-1322.gd2 382 kB/s | 45 kB 00:00 2024-05-08T19:19:21.838 INFO:teuthology.orchestra.run.smithi047.stdout:(20/146): python3-ceph-common-18.2.2-1322.gd21e 2.5 MB/s | 129 kB 00:00 2024-05-08T19:19:21.854 INFO:teuthology.orchestra.run.smithi177.stdout:(95/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 377 kB/s | 47 kB 00:00 2024-05-08T19:19:21.880 INFO:teuthology.orchestra.run.smithi047.stdout:(21/146): python3-cephfs-18.2.2-1322.gd21e4f96. 2.9 MB/s | 197 kB 00:00 2024-05-08T19:19:21.896 INFO:teuthology.orchestra.run.smithi177.stdout:(96/146): python3-cryptography-3.2.1-7.el8_9.x8 4.7 MB/s | 559 kB 00:00 2024-05-08T19:19:21.905 INFO:teuthology.orchestra.run.smithi047.stdout:(22/146): python3-rados-18.2.2-1322.gd21e4f96.e 5.4 MB/s | 370 kB 00:00 2024-05-08T19:19:21.956 INFO:teuthology.orchestra.run.smithi047.stdout:(23/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 4.7 MB/s | 365 kB 00:00 2024-05-08T19:19:21.963 INFO:teuthology.orchestra.run.smithi177.stdout:(97/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 9.0 MB/s | 2.3 MB 00:00 2024-05-08T19:19:22.006 INFO:teuthology.orchestra.run.smithi047.stdout:(24/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 1.0 MB/s | 107 kB 00:00 2024-05-08T19:19:22.031 INFO:teuthology.orchestra.run.smithi047.stdout:(25/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.2 MB/s | 95 kB 00:00 2024-05-08T19:19:22.082 INFO:teuthology.orchestra.run.smithi047.stdout:(26/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 3.6 MB/s | 181 kB 00:00 2024-05-08T19:19:22.105 INFO:teuthology.orchestra.run.smithi177.stdout:(98/146): NetworkManager-initscripts-updown-1.4 576 kB/s | 144 kB 00:00 2024-05-08T19:19:22.132 INFO:teuthology.orchestra.run.smithi047.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1322.g 487 kB/s | 24 kB 00:00 2024-05-08T19:19:22.147 INFO:teuthology.orchestra.run.smithi177.stdout:(99/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 399 kB/s | 100 kB 00:00 2024-05-08T19:19:22.164 INFO:teuthology.orchestra.run.smithi177.stdout:(100/146): python3-jsonpointer-1.10-11.el8.noar 100 kB/s | 20 kB 00:00 2024-05-08T19:19:22.190 INFO:teuthology.orchestra.run.smithi047.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 2.3 MB/s | 138 kB 00:00 2024-05-08T19:19:22.198 INFO:teuthology.orchestra.run.smithi177.stdout:(101/146): python3-prettytable-0.7.2-14.el8.noa 476 kB/s | 44 kB 00:00 2024-05-08T19:19:22.323 INFO:teuthology.orchestra.run.smithi177.stdout:(102/146): python3-jsonpatch-1.21-2.el8.noarch. 167 kB/s | 27 kB 00:00 2024-05-08T19:19:22.348 INFO:teuthology.orchestra.run.smithi177.stdout:(103/146): python3-pyasn1-modules-0.3.7-6.el8.n 548 kB/s | 110 kB 00:00 2024-05-08T19:19:22.373 INFO:teuthology.orchestra.run.smithi177.stdout:(104/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 720 kB/s | 126 kB 00:00 2024-05-08T19:19:22.465 INFO:teuthology.orchestra.run.smithi177.stdout:(105/146): python3-werkzeug-0.12.2-4.el8.noarch 3.1 MB/s | 457 kB 00:00 2024-05-08T19:19:22.524 INFO:teuthology.orchestra.run.smithi177.stdout:(106/146): flex-2.6.1-9.el8.x86_64.rpm 2.1 MB/s | 320 kB 00:00 2024-05-08T19:19:22.583 INFO:teuthology.orchestra.run.smithi177.stdout:(107/146): bison-3.0.4-10.el8.x86_64.rpm 2.9 MB/s | 688 kB 00:00 2024-05-08T19:19:22.616 INFO:teuthology.orchestra.run.smithi177.stdout:(108/146): libtool-2.4.6-25.el8.x86_64.rpm 4.6 MB/s | 709 kB 00:00 2024-05-08T19:19:22.707 INFO:teuthology.orchestra.run.smithi047.stdout:(29/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 6.8 MB/s | 3.5 MB 00:00 2024-05-08T19:19:22.708 INFO:teuthology.orchestra.run.smithi177.stdout:(109/146): python3-markupsafe-0.23-19.el8.x86_6 211 kB/s | 39 kB 00:00 2024-05-08T19:19:22.733 INFO:teuthology.orchestra.run.smithi177.stdout:(110/146): uuid-1.6.2-43.el8.x86_64.rpm 547 kB/s | 64 kB 00:00 2024-05-08T19:19:22.759 INFO:teuthology.orchestra.run.smithi177.stdout:(111/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.4 MB/s | 259 kB 00:00 2024-05-08T19:19:22.807 INFO:teuthology.orchestra.run.smithi047.stdout:(30/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 4.3 MB/s | 3.5 MB 00:00 2024-05-08T19:19:22.867 INFO:teuthology.orchestra.run.smithi177.stdout:(112/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 652 kB/s | 103 kB 00:00 2024-05-08T19:19:22.901 INFO:teuthology.orchestra.run.smithi177.stdout:(113/146): python3-jinja2-2.10.1-3.el8.noarch.r 3.7 MB/s | 538 kB 00:00 2024-05-08T19:19:22.949 INFO:teuthology.orchestra.run.smithi047.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 1.7 MB/s | 245 kB 00:00 2024-05-08T19:19:23.018 INFO:teuthology.orchestra.run.smithi177.stdout:(114/146): python3-numpy-1.14.3-10.el8.x86_64.r 25 MB/s | 3.7 MB 00:00 2024-05-08T19:19:23.033 INFO:teuthology.orchestra.run.smithi047.stdout:(32/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 590 kB/s | 49 kB 00:00 2024-05-08T19:19:23.051 INFO:teuthology.orchestra.run.smithi177.stdout:(115/146): socat-1.7.4.1-1.el8.x86_64.rpm 2.1 MB/s | 323 kB 00:00 2024-05-08T19:19:23.100 INFO:teuthology.orchestra.run.smithi047.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1322.gd 244 kB/s | 16 kB 00:00 2024-05-08T19:19:23.143 INFO:teuthology.orchestra.run.smithi177.stdout:(116/146): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2024-05-08T19:19:23.160 INFO:teuthology.orchestra.run.smithi177.stdout:(117/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.6 MB/s | 225 kB 00:00 2024-05-08T19:19:23.234 INFO:teuthology.orchestra.run.smithi047.stdout:(34/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 1.9 MB/s | 263 kB 00:00 2024-05-08T19:19:23.252 INFO:teuthology.orchestra.run.smithi177.stdout:(118/146): librdkafka-0.11.4-3.el8.x86_64.rpm 1.7 MB/s | 354 kB 00:00 2024-05-08T19:19:23.301 INFO:teuthology.orchestra.run.smithi047.stdout:(35/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 2.5 MB/s | 170 kB 00:00 2024-05-08T19:19:23.351 INFO:teuthology.orchestra.run.smithi047.stdout:(36/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 363 kB/s | 18 kB 00:00 2024-05-08T19:19:23.394 INFO:teuthology.orchestra.run.smithi177.stdout:(119/146): openblas-threads-0.3.15-6.el8.x86_64 21 MB/s | 5.2 MB 00:00 2024-05-08T19:19:23.419 INFO:teuthology.orchestra.run.smithi177.stdout:(120/146): python3-mako-1.0.6-14.el8.noarch.rpm 606 kB/s | 157 kB 00:00 2024-05-08T19:19:23.528 INFO:teuthology.orchestra.run.smithi177.stdout:(121/146): openblas-0.3.15-6.el8.x86_64.rpm 18 MB/s | 5.0 MB 00:00 2024-05-08T19:19:23.570 INFO:teuthology.orchestra.run.smithi177.stdout:(122/146): automake-1.16.1-8.el8.noarch.rpm 4.0 MB/s | 714 kB 00:00 2024-05-08T19:19:23.622 INFO:teuthology.orchestra.run.smithi177.stdout:(123/146): libpq-13.11-1.el8.x86_64.rpm 977 kB/s | 198 kB 00:00 2024-05-08T19:19:23.626 INFO:teuthology.orchestra.run.smithi047.stdout:(37/146): ceph-mgr-diskprediction-local-18.2.2- 8.1 MB/s | 7.4 MB 00:00 2024-05-08T19:19:23.654 INFO:teuthology.orchestra.run.smithi177.stdout:(124/146): jq-1.6-7.el8.x86_64.rpm 1.6 MB/s | 202 kB 00:00 2024-05-08T19:19:23.685 INFO:teuthology.orchestra.run.smithi047.stdout:(38/146): gperftools-libs-2.7-9.el8.x86_64.rpm 918 kB/s | 306 kB 00:00 2024-05-08T19:19:23.687 INFO:teuthology.orchestra.run.smithi177.stdout:(125/146): python3-pytz-2017.2-11.el8.noarch.rp 463 kB/s | 54 kB 00:00 2024-05-08T19:19:23.763 INFO:teuthology.orchestra.run.smithi177.stdout:(126/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-08T19:19:23.846 INFO:teuthology.orchestra.run.smithi177.stdout:(127/146): postgresql-10.23-4.module+el8.9.0+21 9.5 MB/s | 1.5 MB 00:00 2024-05-08T19:19:23.913 INFO:teuthology.orchestra.run.smithi177.stdout:(128/146): postgresql-contrib-10.23-4.module+el 5.3 MB/s | 812 kB 00:00 2024-05-08T19:19:23.960 INFO:teuthology.orchestra.run.smithi047.stdout:(39/146): ceph-common-18.2.2-1322.gd21e4f96.el8 1.6 MB/s | 22 MB 00:13 2024-05-08T19:19:23.977 INFO:teuthology.orchestra.run.smithi047.stdout:(40/146): liboath-2.6.2-3.el8.x86_64.rpm 168 kB/s | 59 kB 00:00 2024-05-08T19:19:23.994 INFO:teuthology.orchestra.run.smithi047.stdout:(41/146): libunwind-1.3.1-3.el8.x86_64.rpm 243 kB/s | 75 kB 00:00 2024-05-08T19:19:24.044 INFO:teuthology.orchestra.run.smithi047.stdout:(42/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 653 kB/s | 44 kB 00:00 2024-05-08T19:19:24.063 INFO:teuthology.orchestra.run.smithi177.stdout:(129/146): python3-scipy-1.0.0-21.module+el8.9. 31 MB/s | 14 MB 00:00 2024-05-08T19:19:24.136 INFO:teuthology.orchestra.run.smithi047.stdout:(43/146): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2024-05-08T19:19:24.153 INFO:teuthology.orchestra.run.smithi047.stdout:(44/146): python3-cachetools-3.1.1-4.el8.noarch 304 kB/s | 33 kB 00:00 2024-05-08T19:19:24.195 INFO:teuthology.orchestra.run.smithi047.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 277 kB/s | 16 kB 00:00 2024-05-08T19:19:24.205 INFO:teuthology.orchestra.run.smithi177.stdout:(130/146): postgresql-server-10.23-4.module+el8 14 MB/s | 5.1 MB 00:00 2024-05-08T19:19:24.229 INFO:teuthology.orchestra.run.smithi047.stdout:(46/146): python3-asyncssh-2.7.0-2.el8.noarch.r 1.7 MB/s | 476 kB 00:00 2024-05-08T19:19:24.287 INFO:teuthology.orchestra.run.smithi047.stdout:(47/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2024-05-08T19:19:24.313 INFO:teuthology.orchestra.run.smithi047.stdout:(48/146): python3-cherrypy-18.4.0-1.el8.noarch. 3.2 MB/s | 384 kB 00:00 2024-05-08T19:19:24.331 INFO:teuthology.orchestra.run.smithi177.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.8 MB/s | 232 kB 00:00 2024-05-08T19:19:24.338 INFO:teuthology.orchestra.run.smithi047.stdout:(49/146): python3-google-auth-1.1.1-10.el8.noar 747 kB/s | 81 kB 00:00 2024-05-08T19:19:24.380 INFO:teuthology.orchestra.run.smithi047.stdout:(50/146): python3-jaraco-6.2-6.el8.noarch.rpm 120 kB/s | 11 kB 00:00 2024-05-08T19:19:24.434 INFO:teuthology.orchestra.run.smithi047.stdout:(51/146): python3-jaraco-functools-2.0-4.el8.no 146 kB/s | 18 kB 00:00 2024-05-08T19:19:24.555 INFO:teuthology.orchestra.run.smithi047.stdout:(52/146): python3-kubernetes-11.0.0-6.el8.noarc 5.4 MB/s | 1.2 MB 00:00 2024-05-08T19:19:24.581 INFO:teuthology.orchestra.run.smithi047.stdout:(53/146): python3-logutils-0.3.5-11.el8.noarch. 243 kB/s | 49 kB 00:00 2024-05-08T19:19:24.606 INFO:teuthology.orchestra.run.smithi047.stdout:(54/146): python3-more-itertools-7.2.0-3.el8.no 341 kB/s | 59 kB 00:00 2024-05-08T19:19:24.631 INFO:teuthology.orchestra.run.smithi047.stdout:(55/146): python3-natsort-7.1.1-2.el8.noarch.rp 799 kB/s | 60 kB 00:00 2024-05-08T19:19:24.681 INFO:teuthology.orchestra.run.smithi047.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2024-05-08T19:19:24.706 INFO:teuthology.orchestra.run.smithi047.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 448 kB/s | 34 kB 00:00 2024-05-08T19:19:24.763 INFO:teuthology.orchestra.run.smithi177.stdout:(132/146): librados2-18.2.2-1322.gd21e4f96.el8. 4.4 MB/s | 3.7 MB 00:00 2024-05-08T19:19:24.765 INFO:teuthology.orchestra.run.smithi047.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2024-05-08T19:19:24.790 INFO:teuthology.orchestra.run.smithi047.stdout:(59/146): python3-pecan-1.3.2-9.el8.noarch.rpm 1.5 MB/s | 283 kB 00:00 2024-05-08T19:19:24.807 INFO:teuthology.orchestra.run.smithi047.stdout:(60/146): python3-rsa-4.9-2.el8.noarch.rpm 639 kB/s | 64 kB 00:00 2024-05-08T19:19:24.833 INFO:teuthology.orchestra.run.smithi047.stdout:(61/146): python3-simplegeneric-0.8.1-17.el8.no 279 kB/s | 19 kB 00:00 2024-05-08T19:19:24.834 INFO:teuthology.orchestra.run.smithi177.stdout:(133/146): elfutils-libs-0.189-3.el8.x86_64.rpm 605 kB/s | 303 kB 00:00 2024-05-08T19:19:24.858 INFO:teuthology.orchestra.run.smithi047.stdout:(62/146): python3-singledispatch-3.4.0.3-18.el8 356 kB/s | 24 kB 00:00 2024-05-08T19:19:24.883 INFO:teuthology.orchestra.run.smithi047.stdout:(63/146): python3-tempora-1.14.1-5.el8.noarch.r 388 kB/s | 29 kB 00:00 2024-05-08T19:19:24.906 INFO:teuthology.orchestra.run.smithi177.stdout:(134/146): iproute-6.2.0-5.el8_9.x86_64.rpm 5.8 MB/s | 854 kB 00:00 2024-05-08T19:19:24.908 INFO:teuthology.orchestra.run.smithi047.stdout:(64/146): python3-trustme-0.6.0-4.el8.noarch.rp 365 kB/s | 27 kB 00:00 2024-05-08T19:19:24.950 INFO:teuthology.orchestra.run.smithi047.stdout:(65/146): python3-webob-1.8.5-1.el8.1.noarch.rp 3.7 MB/s | 251 kB 00:00 2024-05-08T19:19:24.975 INFO:teuthology.orchestra.run.smithi047.stdout:(66/146): python3-websocket-client-0.56.0-5.el8 918 kB/s | 61 kB 00:00 2024-05-08T19:19:24.984 INFO:teuthology.orchestra.run.smithi177.stdout:(135/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 3.9 MB/s | 3.6 MB 00:00 2024-05-08T19:19:25.001 INFO:teuthology.orchestra.run.smithi047.stdout:(67/146): python3-waitress-1.4.3-1.el8.noarch.r 1.7 MB/s | 255 kB 00:00 2024-05-08T19:19:25.024 INFO:teuthology.orchestra.run.smithi177.stdout:(136/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.6 MB/s | 711 kB 00:00 2024-05-08T19:19:25.049 INFO:teuthology.orchestra.run.smithi047.stdout:(68/146): python3-webtest-2.0.33-1.el8.noarch.r 871 kB/s | 85 kB 00:00 2024-05-08T19:19:25.074 INFO:teuthology.orchestra.run.smithi177.stdout:(137/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 3.6 MB/s | 333 kB 00:00 2024-05-08T19:19:25.076 INFO:teuthology.orchestra.run.smithi047.stdout:(69/146): python3-zc-lockfile-2.0-2.el8.noarch. 228 kB/s | 23 kB 00:00 2024-05-08T19:19:25.107 INFO:teuthology.orchestra.run.smithi177.stdout:(138/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 7.3 MB/s | 1.5 MB 00:00 2024-05-08T19:19:25.110 INFO:teuthology.orchestra.run.smithi047.stdout:(70/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.1 MB/s | 70 kB 00:00 2024-05-08T19:19:25.150 INFO:teuthology.orchestra.run.smithi177.stdout:(139/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 8.5 MB/s | 1.1 MB 00:00 2024-05-08T19:19:25.217 INFO:teuthology.orchestra.run.smithi177.stdout:(140/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.5 MB/s | 221 kB 00:00 2024-05-08T19:19:25.252 INFO:teuthology.orchestra.run.smithi047.stdout:(71/146): python3-packaging-16.8-9.el8.noarch.r 275 kB/s | 48 kB 00:00 2024-05-08T19:19:25.317 INFO:teuthology.orchestra.run.smithi177.stdout:(141/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.8 MB/s | 180 kB 00:00 2024-05-08T19:19:25.342 INFO:teuthology.orchestra.run.smithi177.stdout:(142/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.1 MB/s | 254 kB 00:00 2024-05-08T19:19:25.369 INFO:teuthology.orchestra.run.smithi047.stdout:(72/146): python3-jsonpointer-1.10-11.el8.noarc 80 kB/s | 20 kB 00:00 2024-05-08T19:19:25.392 INFO:teuthology.orchestra.run.smithi177.stdout:(143/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 977 kB/s | 237 kB 00:00 2024-05-08T19:19:25.402 INFO:teuthology.orchestra.run.smithi047.stdout:(73/146): thrift-0.13.0-2.el8.x86_64.rpm 4.3 MB/s | 1.7 MB 00:00 2024-05-08T19:19:25.428 INFO:teuthology.orchestra.run.smithi047.stdout:(74/146): python3-prettytable-0.7.2-14.el8.noar 250 kB/s | 44 kB 00:00 2024-05-08T19:19:25.459 INFO:teuthology.orchestra.run.smithi177.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 697 kB/s | 99 kB 00:00 2024-05-08T19:19:25.561 INFO:teuthology.orchestra.run.smithi047.stdout:(75/146): python3-pyasn1-modules-0.3.7-6.el8.no 573 kB/s | 110 kB 00:00 2024-05-08T19:19:25.568 INFO:teuthology.orchestra.run.smithi177.stdout:(145/146): util-linux-2.32.1-44.el8_9.1.x86_64. 11 MB/s | 2.5 MB 00:00 2024-05-08T19:19:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:(76/146): python3-pyasn1-0.3.7-6.el8.noarch.rpm 841 kB/s | 126 kB 00:00 2024-05-08T19:19:25.593 INFO:teuthology.orchestra.run.smithi177.stdout:(146/146): util-linux-user-2.32.1-44.el8_9.1.x8 513 kB/s | 103 kB 00:00 2024-05-08T19:19:25.596 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-05-08T19:19:25.596 INFO:teuthology.orchestra.run.smithi177.stdout:Total 13 MB/s | 215 MB 00:17 2024-05-08T19:19:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:(77/146): python3-jsonpatch-1.21-2.el8.noarch.r 96 kB/s | 27 kB 00:00 2024-05-08T19:19:25.721 INFO:teuthology.orchestra.run.smithi047.stdout:(78/146): python3-werkzeug-0.12.2-4.el8.noarch. 2.8 MB/s | 457 kB 00:00 2024-05-08T19:19:25.763 INFO:teuthology.orchestra.run.smithi047.stdout:(79/146): bison-3.0.4-10.el8.x86_64.rpm 3.8 MB/s | 688 kB 00:00 2024-05-08T19:19:25.804 INFO:teuthology.orchestra.run.smithi047.stdout:(80/146): flex-2.6.1-9.el8.x86_64.rpm 2.5 MB/s | 320 kB 00:00 2024-05-08T19:19:25.855 INFO:teuthology.orchestra.run.smithi047.stdout:(81/146): python3-markupsafe-0.23-19.el8.x86_64 422 kB/s | 39 kB 00:00 2024-05-08T19:19:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:(82/146): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2024-05-08T19:19:25.914 INFO:teuthology.orchestra.run.smithi047.stdout:(83/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2024-05-08T19:19:26.006 INFO:teuthology.orchestra.run.smithi047.stdout:(84/146): uuid-1.6.2-43.el8.x86_64.rpm 425 kB/s | 64 kB 00:00 2024-05-08T19:19:26.031 INFO:teuthology.orchestra.run.smithi047.stdout:(85/146): python3-pyOpenSSL-19.0.0-1.el8.noarch 688 kB/s | 103 kB 00:00 2024-05-08T19:19:26.156 INFO:teuthology.orchestra.run.smithi047.stdout:(86/146): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2024-05-08T19:19:26.190 INFO:teuthology.orchestra.run.smithi047.stdout:(87/146): python3-jinja2-2.10.1-3.el8.noarch.rp 2.9 MB/s | 538 kB 00:00 2024-05-08T19:19:26.357 INFO:teuthology.orchestra.run.smithi047.stdout:(88/146): socat-1.7.4.1-1.el8.x86_64.rpm 1.6 MB/s | 323 kB 00:00 2024-05-08T19:19:26.382 INFO:teuthology.orchestra.run.smithi047.stdout:(89/146): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.1 MB/s | 225 kB 00:00 2024-05-08T19:19:26.441 INFO:teuthology.orchestra.run.smithi047.stdout:(90/146): python3-numpy-1.14.3-10.el8.x86_64.rp 9.1 MB/s | 3.7 MB 00:00 2024-05-08T19:19:26.491 INFO:teuthology.orchestra.run.smithi047.stdout:(91/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.6 MB/s | 354 kB 00:00 2024-05-08T19:19:26.600 INFO:teuthology.orchestra.run.smithi047.stdout:(92/146): python3-mako-1.0.6-14.el8.noarch.rpm 990 kB/s | 157 kB 00:00 2024-05-08T19:19:26.694 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-05-08T19:19:26.708 INFO:teuthology.orchestra.run.smithi047.stdout:(93/146): openblas-threads-0.3.15-6.el8.x86_64. 16 MB/s | 5.2 MB 00:00 2024-05-08T19:19:26.750 INFO:teuthology.orchestra.run.smithi047.stdout:(94/146): automake-1.16.1-8.el8.noarch.rpm 4.7 MB/s | 714 kB 00:00 2024-05-08T19:19:26.842 INFO:teuthology.orchestra.run.smithi047.stdout:(95/146): openblas-0.3.15-6.el8.x86_64.rpm 14 MB/s | 5.0 MB 00:00 2024-05-08T19:19:26.892 INFO:teuthology.orchestra.run.smithi047.stdout:(96/146): jq-1.6-7.el8.x86_64.rpm 1.4 MB/s | 202 kB 00:00 2024-05-08T19:19:26.918 INFO:teuthology.orchestra.run.smithi047.stdout:(97/146): libpq-13.11-1.el8.x86_64.rpm 947 kB/s | 198 kB 00:00 2024-05-08T19:19:26.976 INFO:teuthology.orchestra.run.smithi047.stdout:(98/146): python3-pytz-2017.2-11.el8.noarch.rpm 405 kB/s | 54 kB 00:00 2024-05-08T19:19:27.051 INFO:teuthology.orchestra.run.smithi047.stdout:(99/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-05-08T19:19:27.089 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-05-08T19:19:27.089 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-05-08T19:19:27.202 INFO:teuthology.orchestra.run.smithi047.stdout:(100/146): postgresql-10.23-4.module+el8.9.0+21 6.7 MB/s | 1.5 MB 00:00 2024-05-08T19:19:27.243 INFO:teuthology.orchestra.run.smithi047.stdout:(101/146): postgresql-contrib-10.23-4.module+el 4.1 MB/s | 812 kB 00:00 2024-05-08T19:19:27.419 INFO:teuthology.orchestra.run.smithi047.stdout:(102/146): python3-scipy-1.0.0-21.module+el8.9. 26 MB/s | 14 MB 00:00 2024-05-08T19:19:27.444 INFO:teuthology.orchestra.run.smithi047.stdout:(103/146): libverto-devel-0.3.0-5.el8.x86_64.rp 89 kB/s | 18 kB 00:00 2024-05-08T19:19:27.503 INFO:teuthology.orchestra.run.smithi047.stdout:(104/146): python3-jwt-1.6.1-2.el8.noarch.rpm 511 kB/s | 43 kB 00:00 2024-05-08T19:19:27.620 INFO:teuthology.orchestra.run.smithi047.stdout:(105/146): postgresql-server-10.23-4.module+el8 12 MB/s | 5.1 MB 00:00 2024-05-08T19:19:27.645 INFO:teuthology.orchestra.run.smithi047.stdout:(106/146): python3-pycparser-2.14-14.el8.noarch 768 kB/s | 109 kB 00:00 2024-05-08T19:19:27.670 INFO:teuthology.orchestra.run.smithi047.stdout:(107/146): python3-oauthlib-2.1.0-1.el8.noarch. 685 kB/s | 155 kB 00:00 2024-05-08T19:19:27.745 INFO:teuthology.orchestra.run.smithi047.stdout:(108/146): python3-requests-oauthlib-1.0.0-1.el 340 kB/s | 43 kB 00:00 2024-05-08T19:19:27.797 INFO:teuthology.orchestra.run.smithi047.stdout:(109/146): libaio-devel-0.3.112-1.el8.x86_64.rp 123 kB/s | 19 kB 00:00 2024-05-08T19:19:27.829 INFO:teuthology.orchestra.run.smithi047.stdout:(110/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 276 kB/s | 44 kB 00:00 2024-05-08T19:19:27.855 INFO:teuthology.orchestra.run.smithi047.stdout:(111/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.9 MB/s | 229 kB 00:00 2024-05-08T19:19:27.914 INFO:teuthology.orchestra.run.smithi047.stdout:(112/146): pcre2-devel-10.32-2.el8.x86_64.rpm 3.5 MB/s | 605 kB 00:00 2024-05-08T19:19:27.938 INFO:teuthology.orchestra.run.smithi047.stdout:(113/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2024-05-08T19:19:27.964 INFO:teuthology.orchestra.run.smithi047.stdout:(114/146): libselinux-devel-2.9-5.el8.x86_64.rp 1.8 MB/s | 200 kB 00:00 2024-05-08T19:19:27.997 INFO:teuthology.orchestra.run.smithi047.stdout:(115/146): keyutils-libs-devel-1.5.10-9.el8.x86 574 kB/s | 48 kB 00:00 2024-05-08T19:19:28.023 INFO:teuthology.orchestra.run.smithi047.stdout:(116/146): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2024-05-08T19:19:28.123 INFO:teuthology.orchestra.run.smithi047.stdout:(117/146): zlib-devel-1.2.11-18.el8_5.x86_64.rp 363 kB/s | 58 kB 00:00 2024-05-08T19:19:28.148 INFO:teuthology.orchestra.run.smithi047.stdout:(118/146): libcom_err-devel-1.45.6-4.el8.x86_64 256 kB/s | 39 kB 00:00 2024-05-08T19:19:28.165 INFO:teuthology.orchestra.run.smithi047.stdout:(119/146): fuse-2.9.7-17.el8.x86_64.rpm 584 kB/s | 83 kB 00:00 2024-05-08T19:19:28.257 INFO:teuthology.orchestra.run.smithi047.stdout:(120/146): libgfortran-8.5.0-20.el8.x86_64.rpm 4.7 MB/s | 645 kB 00:00 2024-05-08T19:19:28.274 INFO:teuthology.orchestra.run.smithi047.stdout:(121/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2024-05-08T19:19:28.300 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-05-08T19:19:28.311 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-05-08T19:19:28.358 INFO:teuthology.orchestra.run.smithi047.stdout:(122/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.2 MB/s | 238 kB 00:00 2024-05-08T19:19:28.458 INFO:teuthology.orchestra.run.smithi047.stdout:(123/146): elfutils-libelf-devel-0.189-3.el8.x8 336 kB/s | 62 kB 00:00 2024-05-08T19:19:28.483 INFO:teuthology.orchestra.run.smithi047.stdout:(124/146): xfsprogs-devel-5.0.0-12.el8.x86_64.r 322 kB/s | 73 kB 00:00 2024-05-08T19:19:28.517 INFO:teuthology.orchestra.run.smithi047.stdout:(125/146): krb5-devel-1.18.2-26.el8_9.x86_64.rp 3.5 MB/s | 562 kB 00:00 2024-05-08T19:19:28.625 INFO:teuthology.orchestra.run.smithi047.stdout:(126/146): openssl-devel-1.1.1k-12.el8_9.x86_64 14 MB/s | 2.3 MB 00:00 2024-05-08T19:19:28.651 INFO:teuthology.orchestra.run.smithi047.stdout:(127/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 281 kB/s | 47 kB 00:00 2024-05-08T19:19:28.706 INFO:teuthology.orchestra.run.smithi047.stdout:(128/146): python3-cryptography-3.2.1-7.el8_9.x 2.9 MB/s | 559 kB 00:00 2024-05-08T19:19:28.768 INFO:teuthology.orchestra.run.smithi047.stdout:(129/146): NetworkManager-initscripts-updown-1. 1.0 MB/s | 144 kB 00:00 2024-05-08T19:19:28.801 INFO:teuthology.orchestra.run.smithi047.stdout:(130/146): libuuid-devel-2.32.1-44.el8_9.1.x86_ 665 kB/s | 100 kB 00:00 2024-05-08T19:19:28.968 INFO:teuthology.orchestra.run.smithi047.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.4 MB/s | 232 kB 00:00 2024-05-08T19:19:29.118 INFO:teuthology.orchestra.run.smithi047.stdout:(132/146): librados2-18.2.2-1322.gd21e4f96.el8. 9.0 MB/s | 3.7 MB 00:00 2024-05-08T19:19:29.144 INFO:teuthology.orchestra.run.smithi047.stdout:(133/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.7 MB/s | 303 kB 00:00 2024-05-08T19:19:29.352 INFO:teuthology.orchestra.run.smithi047.stdout:(134/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 6.1 MB/s | 3.6 MB 00:00 2024-05-08T19:19:29.394 INFO:teuthology.orchestra.run.smithi047.stdout:(135/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 2.8 MB/s | 711 kB 00:00 2024-05-08T19:19:29.436 INFO:teuthology.orchestra.run.smithi047.stdout:(136/146): iproute-6.2.0-5.el8_9.x86_64.rpm 2.6 MB/s | 854 kB 00:00 2024-05-08T19:19:29.545 INFO:teuthology.orchestra.run.smithi047.stdout:(137/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.2 MB/s | 333 kB 00:00 2024-05-08T19:19:29.616 INFO:teuthology.orchestra.run.smithi047.stdout:(138/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 5.6 MB/s | 1.5 MB 00:00 2024-05-08T19:19:29.654 INFO:teuthology.orchestra.run.smithi047.stdout:(139/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 2.0 MB/s | 221 kB 00:00 2024-05-08T19:19:29.696 INFO:teuthology.orchestra.run.smithi047.stdout:(140/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 4.1 MB/s | 1.1 MB 00:00 2024-05-08T19:19:29.771 INFO:teuthology.orchestra.run.smithi047.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.6 MB/s | 254 kB 00:00 2024-05-08T19:19:29.796 INFO:teuthology.orchestra.run.smithi047.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.6 MB/s | 237 kB 00:00 2024-05-08T19:19:29.822 INFO:teuthology.orchestra.run.smithi047.stdout:(143/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.4 MB/s | 180 kB 00:00 2024-05-08T19:19:29.847 INFO:teuthology.orchestra.run.smithi047.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 1.3 MB/s | 99 kB 00:00 2024-05-08T19:19:29.936 INFO:teuthology.orchestra.run.smithi047.stdout:(145/146): util-linux-user-2.32.1-44.el8_9.1.x8 905 kB/s | 103 kB 00:00 2024-05-08T19:19:30.006 INFO:teuthology.orchestra.run.smithi047.stdout:(146/146): util-linux-2.32.1-44.el8_9.1.x86_64. 12 MB/s | 2.5 MB 00:00 2024-05-08T19:19:30.009 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-05-08T19:19:30.009 INFO:teuthology.orchestra.run.smithi047.stdout:Total 11 MB/s | 215 MB 00:19 2024-05-08T19:19:31.112 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-05-08T19:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-05-08T19:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-05-08T19:19:32.803 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-05-08T19:19:32.814 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-05-08T19:19:34.129 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-05-08T19:19:34.265 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T19:19:34.544 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T19:19:34.799 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T19:19:35.041 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T19:19:35.802 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T19:19:35.878 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T19:19:36.070 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T19:19:36.139 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T19:19:36.333 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T19:19:36.511 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-05-08T19:19:36.706 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T19:19:36.806 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T19:19:37.019 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T19:19:37.455 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T19:19:37.653 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T19:19:38.043 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T19:19:38.244 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T19:19:38.371 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T19:19:38.580 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T19:19:38.657 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T19:19:38.907 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-05-08T19:19:38.971 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T19:19:39.050 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T19:19:39.252 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T19:19:39.334 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T19:19:39.340 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T19:19:39.547 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T19:19:39.550 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T19:19:39.756 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T19:19:39.772 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T19:19:39.934 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T19:19:39.947 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T19:19:40.008 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T19:19:40.193 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T19:19:40.252 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T19:19:40.355 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T19:19:40.494 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T19:19:40.598 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T19:19:40.685 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/162 2024-05-08T19:19:40.727 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T19:19:40.786 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/162 2024-05-08T19:19:40.832 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T19:19:40.985 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T19:19:40.991 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 7/162 2024-05-08T19:19:41.046 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T19:19:41.210 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T19:19:41.247 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-05-08T19:19:41.561 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-05-08T19:19:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T19:19:41.840 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-05-08T19:19:41.868 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T19:19:42.052 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T19:19:42.170 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T19:19:42.270 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T19:19:42.335 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T19:19:42.460 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T19:19:42.580 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T19:19:42.759 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T19:19:42.840 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T19:19:42.958 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T19:19:43.135 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T19:19:43.161 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T19:19:43.384 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T19:19:43.471 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T19:19:43.659 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T19:19:43.746 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T19:19:43.900 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T19:19:43.927 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T19:19:44.071 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T19:19:44.485 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T19:19:44.602 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T19:19:44.680 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T19:19:44.834 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T19:19:44.916 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-05-08T19:19:44.923 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T19:19:45.101 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T19:19:45.124 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-05-08T19:19:45.160 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T19:19:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/162 2024-05-08T19:19:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T19:19:45.475 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/162 2024-05-08T19:19:45.574 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T19:19:45.659 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/162 2024-05-08T19:19:45.745 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T19:19:46.031 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T19:19:46.284 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T19:19:46.327 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/162 2024-05-08T19:19:46.517 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-05-08T19:19:47.190 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-05-08T19:19:47.375 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.15-6.el8.x86_64 24/162 2024-05-08T19:19:48.021 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T19:19:48.111 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 24/162 2024-05-08T19:19:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/162 2024-05-08T19:19:48.403 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-05-08T19:19:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 26/162 2024-05-08T19:19:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/162 2024-05-08T19:19:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/162 2024-05-08T19:19:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/162 2024-05-08T19:19:49.365 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-05-08T19:19:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T19:19:49.722 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-05-08T19:19:49.749 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T19:19:49.896 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T19:19:50.001 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-05-08T19:19:50.168 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T19:19:50.263 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T19:19:50.444 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T19:19:50.701 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T19:19:50.924 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T19:19:51.150 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T19:19:51.194 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/162 2024-05-08T19:19:51.213 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T19:19:51.450 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T19:19:51.524 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T19:19:51.531 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/162 2024-05-08T19:19:51.781 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T19:19:51.795 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/162 2024-05-08T19:19:52.000 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-05-08T19:19:52.020 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T19:19:52.275 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T19:19:52.743 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T19:19:53.067 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T19:19:53.095 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T19:19:53.333 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T19:19:53.395 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T19:19:53.677 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-05-08T19:19:53.892 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-05-08T19:19:53.984 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-05-08T19:19:54.125 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T19:19:54.180 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T19:19:54.319 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 38/162 2024-05-08T19:19:54.373 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-05-08T19:19:54.556 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T19:19:54.557 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-05-08T19:19:54.759 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-05-08T19:19:54.787 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T19:19:54.982 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T19:19:55.003 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/162 2024-05-08T19:19:55.200 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T19:19:55.237 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/162 2024-05-08T19:19:55.433 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T19:19:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/162 2024-05-08T19:19:55.520 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T19:19:55.653 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/162 2024-05-08T19:19:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T19:19:55.806 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T19:19:55.895 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/162 2024-05-08T19:19:56.050 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T19:19:56.214 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/162 2024-05-08T19:19:56.261 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T19:19:56.466 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T19:19:56.504 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/162 2024-05-08T19:19:56.746 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/162 2024-05-08T19:19:56.920 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/162 2024-05-08T19:19:56.980 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T19:19:57.160 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/162 2024-05-08T19:19:57.433 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T19:19:57.454 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T19:19:57.591 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/162 2024-05-08T19:19:57.654 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.7-17.el8.x86_64 49/162 2024-05-08T19:19:57.852 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 67/162 2024-05-08T19:19:57.867 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 50/162 2024-05-08T19:19:58.039 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/162 2024-05-08T19:19:58.156 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/162 2024-05-08T19:19:58.254 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/162 2024-05-08T19:19:58.365 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 69/162 2024-05-08T19:19:58.463 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/162 2024-05-08T19:19:58.558 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/162 2024-05-08T19:19:58.766 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 54/162 2024-05-08T19:19:58.811 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 71/162 2024-05-08T19:19:59.006 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 55/162 2024-05-08T19:19:59.095 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2024-05-08T19:19:59.229 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 56/162 2024-05-08T19:19:59.349 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2024-05-08T19:19:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 57/162 2024-05-08T19:19:59.610 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/162 2024-05-08T19:19:59.613 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 58/162 2024-05-08T19:19:59.820 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/162 2024-05-08T19:20:00.016 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 59/162 2024-05-08T19:20:00.091 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/162 2024-05-08T19:20:00.258 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-05-08T19:20:00.320 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 60/162 2024-05-08T19:20:00.456 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T19:20:00.600 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 61/162 2024-05-08T19:20:00.672 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T19:20:00.799 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 62/162 2024-05-08T19:20:00.948 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T19:20:01.012 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/162 2024-05-08T19:20:01.180 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T19:20:01.245 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 64/162 2024-05-08T19:20:01.411 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T19:20:01.515 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 65/162 2024-05-08T19:20:01.558 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T19:20:01.735 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 66/162 2024-05-08T19:20:01.788 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T19:20:01.952 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/162 2024-05-08T19:20:02.036 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T19:20:02.189 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 68/162 2024-05-08T19:20:02.258 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T19:20:02.477 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T19:20:02.479 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 69/162 2024-05-08T19:20:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T19:20:02.665 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-05-08T19:20:02.773 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-05-08T19:20:02.874 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T19:20:03.048 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : jq-1.6-7.el8.x86_64 71/162 2024-05-08T19:20:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T19:20:03.284 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : automake-1.16.1-8.el8.noarch 72/162 2024-05-08T19:20:03.336 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T19:20:03.482 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : uuid-1.6.2-43.el8.x86_64 73/162 2024-05-08T19:20:03.558 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 73/162 2024-05-08T19:20:03.600 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T19:20:03.740 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-05-08T19:20:03.864 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T19:20:03.907 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 75/162 2024-05-08T19:20:04.064 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T19:20:04.120 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-05-08T19:20:04.314 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T19:20:04.334 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-05-08T19:20:04.491 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T19:20:04.724 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T19:20:04.994 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T19:20:05.231 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T19:20:05.410 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T19:20:05.411 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T19:20:05.602 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T19:20:05.795 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T19:20:05.810 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T19:20:06.021 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T19:20:06.046 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T19:20:06.252 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T19:20:06.410 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T19:20:06.422 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T19:20:06.613 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T19:20:06.864 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T19:20:07.069 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T19:20:07.265 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T19:20:07.279 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T19:20:07.474 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T19:20:07.576 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T19:20:07.849 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T19:20:08.024 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T19:20:08.234 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T19:20:08.262 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T19:20:08.430 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T19:20:08.503 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T19:20:08.722 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T19:20:09.383 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T19:20:09.704 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T19:20:09.891 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T19:20:10.371 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T19:20:10.657 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T19:20:10.875 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T19:20:11.663 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T19:20:11.847 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T19:20:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T19:20:12.123 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T19:20:12.401 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T19:20:12.863 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T19:20:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T19:20:13.754 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T19:20:13.839 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T19:20:14.029 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T19:20:16.616 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T19:20:16.872 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T19:20:17.502 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T19:20:17.796 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T19:20:17.880 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T19:20:18.038 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T19:20:33.419 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T19:20:33.420 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /sys 2024-05-08T19:20:33.420 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /proc 2024-05-08T19:20:33.420 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /dev 2024-05-08T19:20:33.420 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /run 2024-05-08T19:20:33.420 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /mnt 2024-05-08T19:20:33.420 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /var/tmp 2024-05-08T19:20:33.420 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /home 2024-05-08T19:20:33.420 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /tmp 2024-05-08T19:20:33.420 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /dev 2024-05-08T19:20:33.420 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:20:33.818 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T19:20:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T19:20:35.700 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T19:20:35.918 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T19:20:36.117 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T19:20:36.592 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T19:20:36.750 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T19:20:36.769 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T19:20:38.296 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T19:20:38.296 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-05-08T19:20:38.296 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-05-08T19:20:38.296 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /dev 2024-05-08T19:20:38.296 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /run 2024-05-08T19:20:38.297 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-05-08T19:20:38.297 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-05-08T19:20:38.297 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-05-08T19:20:38.297 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-05-08T19:20:38.297 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /dev 2024-05-08T19:20:38.297 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:20:38.678 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T19:20:38.751 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T19:20:38.910 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T19:20:39.057 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T19:20:39.351 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T19:20:39.642 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T19:20:40.429 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T19:20:40.626 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T19:20:40.682 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T19:20:40.858 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T19:20:40.965 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T19:20:41.185 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T19:20:41.693 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T19:20:41.860 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T19:20:41.879 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T19:20:41.931 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T19:20:42.091 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T19:20:42.185 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T19:20:42.604 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T19:20:42.790 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T19:20:42.829 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T19:20:43.032 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T19:20:43.045 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T19:20:43.823 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T19:20:43.984 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T19:20:44.075 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T19:20:44.313 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T19:20:44.331 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T19:20:44.506 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T19:20:44.541 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T19:20:44.585 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T19:20:44.749 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T19:20:44.793 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T19:20:44.991 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T19:20:45.338 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T19:20:45.540 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T19:20:45.684 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T19:20:45.909 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T19:20:46.942 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T19:20:47.118 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T19:20:47.217 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T19:20:47.572 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T19:20:47.734 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T19:20:47.775 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T19:20:47.951 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T19:20:47.965 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T19:20:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T19:20:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T19:20:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T19:20:49.851 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T19:20:49.899 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T19:20:49.997 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T19:20:50.093 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T19:20:50.466 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T19:20:50.626 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T19:20:50.955 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T19:20:51.277 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-05-08T19:20:51.606 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-05-08T19:20:51.965 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 129/162 2024-05-08T19:20:52.300 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-05-08T19:20:52.514 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T19:20:52.528 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T19:20:52.775 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T19:20:52.985 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T19:20:53.157 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T19:20:55.389 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T19:20:55.513 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T19:20:55.823 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T19:20:55.834 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T19:20:55.862 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T19:20:56.156 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 127/162 2024-05-08T19:20:56.343 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T19:20:56.383 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libtool-2.4.6-25.el8.x86_64 128/162 2024-05-08T19:20:56.721 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T19:20:56.943 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T19:20:57.136 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 128/162 2024-05-08T19:20:57.146 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T19:20:57.372 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T19:20:57.413 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 129/162 2024-05-08T19:20:57.680 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T19:20:57.688 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 130/162 2024-05-08T19:20:57.890 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T19:20:58.017 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T19:20:58.111 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T19:20:58.238 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T19:20:58.302 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T19:20:58.315 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T19:20:58.509 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T19:20:58.563 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T19:20:58.577 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T19:20:58.796 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T19:20:58.806 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T19:20:58.999 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-05-08T19:20:59.158 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T19:20:59.374 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T19:20:59.542 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T19:20:59.542 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T19:20:59.816 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T19:20:59.817 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T19:21:00.075 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T19:21:00.075 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T19:21:00.344 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T19:21:00.615 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T19:21:00.799 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T19:21:00.918 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T19:21:01.048 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T19:21:01.048 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T19:21:01.225 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T19:21:01.264 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T19:21:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T19:21:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T19:21:01.548 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T19:21:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T19:21:01.719 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T19:21:01.799 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T19:21:01.799 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T19:21:02.073 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T19:21:02.073 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T19:21:02.075 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T19:21:02.307 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T19:21:02.312 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T19:21:02.507 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T19:21:02.507 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T19:21:02.517 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T19:21:02.750 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T19:21:03.160 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T19:21:03.446 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T19:21:03.446 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T19:21:03.446 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T19:21:03.446 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T19:21:03.446 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T19:21:03.446 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T19:21:03.446 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T19:21:03.446 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T19:21:03.446 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T19:21:03.446 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T19:21:03.446 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T19:21:03.447 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T19:21:03.447 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T19:21:03.447 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T19:21:03.447 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T19:21:03.447 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T19:21:03.447 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T19:21:03.447 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T19:21:03.447 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T19:21:03.447 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T19:21:03.447 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T19:21:03.447 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T19:21:03.447 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T19:21:03.447 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T19:21:03.447 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T19:21:03.448 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T19:21:03.448 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T19:21:03.448 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T19:21:03.448 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T19:21:03.448 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T19:21:03.448 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T19:21:03.448 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T19:21:03.448 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T19:21:03.448 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T19:21:03.448 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T19:21:03.448 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T19:21:03.448 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T19:21:03.448 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T19:21:03.448 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T19:21:03.449 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T19:21:03.449 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T19:21:03.449 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T19:21:03.449 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T19:21:03.449 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T19:21:03.449 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T19:21:03.449 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T19:21:03.449 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T19:21:03.449 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T19:21:03.449 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T19:21:03.449 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T19:21:03.449 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T19:21:03.449 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T19:21:03.450 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T19:21:03.450 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T19:21:03.450 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T19:21:03.450 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T19:21:03.450 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T19:21:03.450 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T19:21:03.450 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T19:21:03.450 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T19:21:03.450 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T19:21:03.450 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T19:21:03.450 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T19:21:03.450 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T19:21:03.450 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T19:21:03.450 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T19:21:03.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T19:21:03.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T19:21:03.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T19:21:03.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T19:21:03.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T19:21:03.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T19:21:03.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-05-08T19:21:03.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2024-05-08T19:21:03.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2024-05-08T19:21:03.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2024-05-08T19:21:03.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2024-05-08T19:21:03.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2024-05-08T19:21:03.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2024-05-08T19:21:03.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2024-05-08T19:21:03.452 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2024-05-08T19:21:03.452 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2024-05-08T19:21:03.452 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2024-05-08T19:21:03.452 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2024-05-08T19:21:03.452 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2024-05-08T19:21:03.452 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2024-05-08T19:21:03.452 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2024-05-08T19:21:03.452 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2024-05-08T19:21:03.452 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/162 2024-05-08T19:21:03.452 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/162 2024-05-08T19:21:03.452 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/162 2024-05-08T19:21:03.452 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/162 2024-05-08T19:21:03.452 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 92/162 2024-05-08T19:21:03.452 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 93/162 2024-05-08T19:21:03.453 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 94/162 2024-05-08T19:21:03.453 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 95/162 2024-05-08T19:21:03.453 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 96/162 2024-05-08T19:21:03.453 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 97/162 2024-05-08T19:21:03.453 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 98/162 2024-05-08T19:21:03.453 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 99/162 2024-05-08T19:21:03.453 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-05-08T19:21:03.453 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-05-08T19:21:03.453 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-05-08T19:21:03.453 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-05-08T19:21:03.453 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-05-08T19:21:03.453 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-05-08T19:21:03.453 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-05-08T19:21:03.453 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-05-08T19:21:03.454 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-05-08T19:21:03.454 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-05-08T19:21:03.454 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-05-08T19:21:03.454 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-05-08T19:21:03.454 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-05-08T19:21:03.454 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-05-08T19:21:03.454 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-05-08T19:21:03.454 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-05-08T19:21:03.454 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-05-08T19:21:03.454 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-05-08T19:21:03.454 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-05-08T19:21:03.454 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-05-08T19:21:03.454 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-05-08T19:21:03.454 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-05-08T19:21:03.455 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-05-08T19:21:03.455 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-05-08T19:21:03.455 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-05-08T19:21:03.455 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-05-08T19:21:03.455 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-05-08T19:21:03.455 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-05-08T19:21:03.455 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-05-08T19:21:03.455 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-05-08T19:21:03.455 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-05-08T19:21:03.455 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T19:21:03.455 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T19:21:03.455 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T19:21:03.455 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T19:21:03.455 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T19:21:03.455 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T19:21:03.456 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T19:21:03.456 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T19:21:03.456 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T19:21:03.456 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T19:21:03.456 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T19:21:03.456 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T19:21:03.456 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T19:21:03.456 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T19:21:03.456 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T19:21:03.456 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T19:21:03.456 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T19:21:03.456 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T19:21:03.456 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T19:21:03.456 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T19:21:03.457 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T19:21:03.457 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T19:21:03.457 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T19:21:03.457 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T19:21:03.457 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T19:21:03.457 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T19:21:03.457 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T19:21:03.457 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T19:21:03.457 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T19:21:03.457 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T19:21:03.457 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T19:21:03.458 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T19:21:03.590 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-05-08T19:21:03.602 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-05-08T19:21:03.839 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 144/162 2024-05-08T19:21:04.074 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flex-2.6.1-9.el8.x86_64 145/162 2024-05-08T19:21:04.159 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 145/162 2024-05-08T19:21:04.365 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : bison-3.0.4-10.el8.x86_64 146/162 2024-05-08T19:21:04.380 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 146/162 2024-05-08T19:21:04.528 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T19:21:04.734 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T19:21:04.903 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T19:21:04.903 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T19:21:05.152 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T19:21:05.152 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T19:21:05.361 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T19:21:05.361 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T19:21:05.605 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T19:21:05.834 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T19:21:05.986 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T19:21:06.259 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T19:21:06.259 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T19:21:06.502 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T19:21:06.502 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T19:21:06.760 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T19:21:06.760 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T19:21:06.959 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T19:21:06.960 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T19:21:07.201 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T19:21:07.201 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T19:21:07.443 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T19:21:07.576 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T19:21:07.576 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T19:21:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T19:21:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T19:21:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T19:21:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T19:21:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T19:21:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T19:21:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T19:21:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T19:21:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T19:21:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T19:21:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T19:21:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T19:21:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T19:21:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T19:21:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T19:21:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T19:21:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T19:21:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T19:21:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T19:21:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T19:21:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T19:21:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T19:21:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T19:21:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T19:21:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T19:21:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T19:21:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T19:21:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T19:21:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T19:21:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T19:21:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T19:21:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T19:21:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T19:21:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T19:21:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T19:21:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T19:21:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T19:21:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T19:21:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T19:21:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T19:21:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T19:21:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T19:21:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T19:21:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T19:21:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T19:21:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T19:21:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T19:21:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T19:21:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T19:21:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T19:21:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T19:21:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T19:21:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T19:21:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T19:21:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T19:21:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T19:21:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T19:21:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T19:21:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T19:21:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T19:21:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T19:21:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T19:21:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T19:21:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T19:21:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T19:21:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T19:21:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T19:21:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T19:21:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T19:21:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T19:21:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T19:21:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T19:21:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-05-08T19:21:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 73/162 2024-05-08T19:21:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-05-08T19:21:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 75/162 2024-05-08T19:21:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-05-08T19:21:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 77/162 2024-05-08T19:21:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 78/162 2024-05-08T19:21:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : bison-3.0.4-10.el8.x86_64 79/162 2024-05-08T19:21:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flex-2.6.1-9.el8.x86_64 80/162 2024-05-08T19:21:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 81/162 2024-05-08T19:21:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 82/162 2024-05-08T19:21:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 83/162 2024-05-08T19:21:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 84/162 2024-05-08T19:21:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 85/162 2024-05-08T19:21:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 86/162 2024-05-08T19:21:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 87/162 2024-05-08T19:21:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 88/162 2024-05-08T19:21:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 89/162 2024-05-08T19:21:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 90/162 2024-05-08T19:21:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 91/162 2024-05-08T19:21:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 92/162 2024-05-08T19:21:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 93/162 2024-05-08T19:21:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 94/162 2024-05-08T19:21:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : automake-1.16.1-8.el8.noarch 95/162 2024-05-08T19:21:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpq-13.11-1.el8.x86_64 96/162 2024-05-08T19:21:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : jq-1.6-7.el8.x86_64 97/162 2024-05-08T19:21:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 98/162 2024-05-08T19:21:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 99/162 2024-05-08T19:21:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 100/162 2024-05-08T19:21:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 101/162 2024-05-08T19:21:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 102/162 2024-05-08T19:21:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 103/162 2024-05-08T19:21:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 104/162 2024-05-08T19:21:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/162 2024-05-08T19:21:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 106/162 2024-05-08T19:21:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 107/162 2024-05-08T19:21:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 108/162 2024-05-08T19:21:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 109/162 2024-05-08T19:21:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 110/162 2024-05-08T19:21:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 111/162 2024-05-08T19:21:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 112/162 2024-05-08T19:21:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 113/162 2024-05-08T19:21:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 114/162 2024-05-08T19:21:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 115/162 2024-05-08T19:21:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 116/162 2024-05-08T19:21:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/162 2024-05-08T19:21:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/162 2024-05-08T19:21:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 119/162 2024-05-08T19:21:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 120/162 2024-05-08T19:21:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 121/162 2024-05-08T19:21:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 122/162 2024-05-08T19:21:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 123/162 2024-05-08T19:21:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 124/162 2024-05-08T19:21:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 125/162 2024-05-08T19:21:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 126/162 2024-05-08T19:21:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 127/162 2024-05-08T19:21:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 128/162 2024-05-08T19:21:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 129/162 2024-05-08T19:21:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 130/162 2024-05-08T19:21:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T19:21:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T19:21:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T19:21:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T19:21:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T19:21:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T19:21:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T19:21:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T19:21:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T19:21:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T19:21:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T19:21:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T19:21:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T19:21:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T19:21:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T19:21:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T19:21:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T19:21:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T19:21:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T19:21:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T19:21:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T19:21:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T19:21:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T19:21:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T19:21:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T19:21:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T19:21:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T19:21:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T19:21:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T19:21:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T19:21:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T19:21:15.187 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T19:21:15.187 INFO:teuthology.orchestra.run.smithi177.stdout:Installed products updated. 2024-05-08T19:21:16.581 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:16.581 INFO:teuthology.orchestra.run.smithi177.stdout:Upgraded: 2024-05-08T19:21:16.581 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T19:21:16.582 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T19:21:16.582 INFO:teuthology.orchestra.run.smithi177.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T19:21:16.582 INFO:teuthology.orchestra.run.smithi177.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:16.582 INFO:teuthology.orchestra.run.smithi177.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:16.582 INFO:teuthology.orchestra.run.smithi177.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:16.582 INFO:teuthology.orchestra.run.smithi177.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.582 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.582 INFO:teuthology.orchestra.run.smithi177.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:16.582 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:16.582 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T19:21:16.582 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T19:21:16.582 INFO:teuthology.orchestra.run.smithi177.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:16.582 INFO:teuthology.orchestra.run.smithi177.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:16.582 INFO:teuthology.orchestra.run.smithi177.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T19:21:16.583 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T19:21:16.583 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-05-08T19:21:16.583 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T19:21:16.583 INFO:teuthology.orchestra.run.smithi177.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T19:21:16.583 INFO:teuthology.orchestra.run.smithi177.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T19:21:16.583 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.583 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.583 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.583 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.583 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:16.583 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.583 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.583 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.583 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:16.584 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:16.584 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:16.584 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:16.584 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:16.584 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.584 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.584 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:16.584 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.584 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.584 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.584 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:16.584 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:16.584 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.585 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:16.585 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T19:21:16.585 INFO:teuthology.orchestra.run.smithi177.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T19:21:16.585 INFO:teuthology.orchestra.run.smithi177.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T19:21:16.585 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T19:21:16.585 INFO:teuthology.orchestra.run.smithi177.stdout: jq-1.6-7.el8.x86_64 2024-05-08T19:21:16.585 INFO:teuthology.orchestra.run.smithi177.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T19:21:16.585 INFO:teuthology.orchestra.run.smithi177.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T19:21:16.585 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T19:21:16.585 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.585 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.586 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.586 INFO:teuthology.orchestra.run.smithi177.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T19:21:16.586 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T19:21:16.586 INFO:teuthology.orchestra.run.smithi177.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T19:21:16.586 INFO:teuthology.orchestra.run.smithi177.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T19:21:16.586 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T19:21:16.586 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T19:21:16.586 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.586 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.586 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T19:21:16.586 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.586 INFO:teuthology.orchestra.run.smithi177.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T19:21:16.586 INFO:teuthology.orchestra.run.smithi177.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T19:21:16.587 INFO:teuthology.orchestra.run.smithi177.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T19:21:16.587 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T19:21:16.587 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:16.587 INFO:teuthology.orchestra.run.smithi177.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T19:21:16.587 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T19:21:16.587 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T19:21:16.587 INFO:teuthology.orchestra.run.smithi177.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T19:21:16.587 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T19:21:16.587 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T19:21:16.587 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T19:21:16.587 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T19:21:16.587 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T19:21:16.587 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T19:21:16.587 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T19:21:16.588 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T19:21:16.588 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T19:21:16.588 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T19:21:16.588 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T19:21:16.588 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T19:21:16.588 INFO:teuthology.orchestra.run.smithi177.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T19:21:16.588 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T19:21:16.588 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.588 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.588 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T19:21:16.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T19:21:16.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T19:21:16.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T19:21:16.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T19:21:16.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T19:21:16.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T19:21:16.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T19:21:16.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T19:21:16.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T19:21:16.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T19:21:16.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T19:21:16.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T19:21:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T19:21:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T19:21:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T19:21:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T19:21:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T19:21:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T19:21:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T19:21:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T19:21:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T19:21:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T19:21:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T19:21:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T19:21:16.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T19:21:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T19:21:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T19:21:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T19:21:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T19:21:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T19:21:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T19:21:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T19:21:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T19:21:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T19:21:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T19:21:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T19:21:16.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T19:21:16.592 INFO:teuthology.orchestra.run.smithi177.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T19:21:16.592 INFO:teuthology.orchestra.run.smithi177.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T19:21:16.592 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T19:21:16.592 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T19:21:16.592 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T19:21:16.592 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T19:21:16.592 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T19:21:16.592 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.592 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.593 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:16.593 INFO:teuthology.orchestra.run.smithi177.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T19:21:16.593 INFO:teuthology.orchestra.run.smithi177.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T19:21:16.593 INFO:teuthology.orchestra.run.smithi177.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T19:21:16.593 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T19:21:16.593 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T19:21:16.593 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T19:21:16.594 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:16.594 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-05-08T19:21:17.097 DEBUG:teuthology.parallel:result is None 2024-05-08T19:21:22.055 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T19:21:22.055 INFO:teuthology.orchestra.run.smithi047.stdout:Installed products updated. 2024-05-08T19:21:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:22.716 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-05-08T19:21:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T19:21:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T19:21:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T19:21:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:22.716 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T19:21:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T19:21:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T19:21:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T19:21:22.717 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-05-08T19:21:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T19:21:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T19:21:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T19:21:22.717 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:22.718 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:21:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T19:21:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T19:21:22.719 INFO:teuthology.orchestra.run.smithi047.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T19:21:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T19:21:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: jq-1.6-7.el8.x86_64 2024-05-08T19:21:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T19:21:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T19:21:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T19:21:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T19:21:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T19:21:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T19:21:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T19:21:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T19:21:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T19:21:22.720 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T19:21:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T19:21:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T19:21:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T19:21:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T19:21:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:21:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T19:21:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T19:21:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T19:21:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T19:21:22.721 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T19:21:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T19:21:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T19:21:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T19:21:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T19:21:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T19:21:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T19:21:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T19:21:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T19:21:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T19:21:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T19:21:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T19:21:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T19:21:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T19:21:22.722 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T19:21:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T19:21:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T19:21:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T19:21:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T19:21:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T19:21:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T19:21:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T19:21:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T19:21:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T19:21:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T19:21:22.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T19:21:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T19:21:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T19:21:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T19:21:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T19:21:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T19:21:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T19:21:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T19:21:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T19:21:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T19:21:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T19:21:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T19:21:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T19:21:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T19:21:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T19:21:22.724 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T19:21:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T19:21:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T19:21:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T19:21:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T19:21:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T19:21:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T19:21:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T19:21:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T19:21:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T19:21:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T19:21:22.725 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T19:21:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T19:21:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T19:21:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T19:21:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T19:21:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T19:21:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T19:21:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T19:21:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:21:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T19:21:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T19:21:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T19:21:22.726 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T19:21:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T19:21:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T19:21:22.727 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:22.727 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-05-08T19:21:22.955 DEBUG:teuthology.parallel:result is None 2024-05-08T19:21:22.956 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:21:23.187 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T19:21:23.211 INFO:teuthology.orchestra.run.smithi047.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T19:21:23.212 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T19:21:23.212 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T19:21:23.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:21:23.432 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T19:21:23.461 INFO:teuthology.orchestra.run.smithi177.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T19:21:23.461 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T19:21:23.461 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T19:21:23.463 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T19:21:23.463 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:23.464 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T19:21:23.510 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:23.510 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T19:21:23.558 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T19:21:23.558 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:23.558 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T19:21:23.587 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T19:21:23.655 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:23.655 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T19:21:23.687 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T19:21:23.759 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T19:21:23.759 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:23.759 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T19:21:23.788 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T19:21:23.856 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:23.856 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T19:21:23.886 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T19:21:23.957 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T19:21:23.958 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:23.958 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T19:21:23.986 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T19:21:24.053 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:24.054 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T19:21:24.084 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T19:21:24.154 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T19:21:24.244 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T19:21:24.244 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /var/log/ceph 2024-05-08T19:21:24.247 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /var/log/ceph 2024-05-08T19:21:24.276 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T19:21:24.276 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T19:21:24.315 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T19:21:24.345 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T19:21:24.345 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T19:21:24.383 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T19:21:24.419 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-08T19:21:24.420 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-08T19:21:24.420 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-08T19:21:24.420 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:24.420 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T19:21:24.466 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T19:21:24.577 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-08T19:21:24.605 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:24.606 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T19:21:24.623 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T19:21:24.738 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-08T19:21:24.770 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T19:21:24.771 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T19:21:24.771 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697948', 'branch': 'wip-pdonnell-testing-20240508.150423-reef', 'description': 'fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7697948', 'kclient-workload': {'sequential': [{'kclient': ['client.1']}, {'workunit': {'clients': {'client.1': ['suites/dbench.sh']}}}]}, 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240508.150423-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240508.150423-reef', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 65, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 7186, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'sleep_before_teardown': 0, 'subset': '275/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240508.150423-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEPKkt+WArhvOQJjff/uHnM/OjL7PpRk/VQR0dDfcerGAkuKcP3mvAeTdO0UJXkEpOZKaCjXMIZSU1LJQH3vodQ=', 'smithi177.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFgrPPJJ6jkXZTjldT28bd8yyRW60ux9ezNzibQ7ducMY3uyn1NWH6wEuc9sV+buWzdbtCYGOfYO0PEL17I4SeE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'parallel': ['user-workload', 'kclient-workload']}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_19:02:00', 'tube': 'smithi', 'user': 'pdonnell', 'user-workload': {'sequential': [{'ceph-fuse': ['client.0']}, {'workunit': {'clients': {'client.0': ['suites/iozone.sh']}}}]}, 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T19:21:24.771 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T19:21:24.774 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T19:21:24.822 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T19:21:24.832 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T19:21:24.888 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:24.888 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T19:21:24.916 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T19:21:24.917 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-05-08T19:21:24.974 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T19:21:24.975 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:21:24.975 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 179790 Links: 1 2024-05-08T19:21:24.975 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:21:24.975 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:21:24.975 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-08 19:21:08.136057225 +0000 2024-05-08T19:21:24.975 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-08 19:17:41.538693466 +0000 2024-05-08T19:21:24.975 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-08 19:17:41.538693466 +0000 2024-05-08T19:21:24.975 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-05-08T19:21:24.975 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T19:21:25.040 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-08T19:21:25.040 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-08T19:21:25.040 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000104597 s, 4.9 MB/s 2024-05-08T19:21:25.041 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T19:21:25.100 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-05-08T19:21:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T19:21:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:21:25.159 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 184658 Links: 1 2024-05-08T19:21:25.159 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:21:25.159 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:21:25.159 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-08 19:21:08.136057225 +0000 2024-05-08T19:21:25.159 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-08 19:17:41.886685903 +0000 2024-05-08T19:21:25.159 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-08 19:17:41.886685903 +0000 2024-05-08T19:21:25.159 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-05-08T19:21:25.159 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T19:21:25.225 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-08T19:21:25.225 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-08T19:21:25.225 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 8.464e-05 s, 6.0 MB/s 2024-05-08T19:21:25.226 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T19:21:25.284 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-05-08T19:21:25.341 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T19:21:25.342 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:21:25.342 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 184748 Links: 1 2024-05-08T19:21:25.342 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:21:25.342 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:21:25.342 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-08 19:21:08.136057225 +0000 2024-05-08T19:21:25.342 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-08 19:17:42.270677557 +0000 2024-05-08T19:21:25.342 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-08 19:17:42.270677557 +0000 2024-05-08T19:21:25.342 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-05-08T19:21:25.342 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T19:21:25.407 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-08T19:21:25.408 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-08T19:21:25.408 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000122253 s, 4.2 MB/s 2024-05-08T19:21:25.409 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T19:21:25.468 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-05-08T19:21:25.526 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T19:21:25.526 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:21:25.527 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 178965 Links: 1 2024-05-08T19:21:25.527 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:21:25.527 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:21:25.527 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-08 19:21:08.136057225 +0000 2024-05-08T19:21:25.527 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-08 19:17:42.613670103 +0000 2024-05-08T19:21:25.527 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-08 19:17:42.613670103 +0000 2024-05-08T19:21:25.527 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-05-08T19:21:25.527 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T19:21:25.592 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-08T19:21:25.593 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-08T19:21:25.593 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.0001017 s, 5.0 MB/s 2024-05-08T19:21:25.594 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T19:21:25.652 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T19:21:25.652 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:25.652 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T19:21:25.672 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T19:21:25.672 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2024-05-08T19:21:25.731 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T19:21:25.731 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:21:25.732 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 182509 Links: 1 2024-05-08T19:21:25.732 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:21:25.732 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:21:25.732 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-05-08 19:21:03.084601825 +0000 2024-05-08T19:21:25.732 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-05-08 19:17:14.631792014 +0000 2024-05-08T19:21:25.732 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-05-08 19:17:14.631792014 +0000 2024-05-08T19:21:25.732 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2024-05-08T19:21:25.732 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T19:21:25.799 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-05-08T19:21:25.799 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-05-08T19:21:25.799 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000246452 s, 2.1 MB/s 2024-05-08T19:21:25.800 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T19:21:25.860 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2024-05-08T19:21:25.919 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T19:21:25.919 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:21:25.920 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 181457 Links: 1 2024-05-08T19:21:25.920 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:21:25.920 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:21:25.920 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-05-08 19:21:03.084601825 +0000 2024-05-08T19:21:25.920 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-05-08 19:17:14.969782384 +0000 2024-05-08T19:21:25.920 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-05-08 19:17:14.969782384 +0000 2024-05-08T19:21:25.920 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2024-05-08T19:21:25.920 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T19:21:25.986 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-05-08T19:21:25.986 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-05-08T19:21:25.986 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000252703 s, 2.0 MB/s 2024-05-08T19:21:25.987 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T19:21:26.046 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2024-05-08T19:21:26.104 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T19:21:26.104 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:21:26.104 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 181519 Links: 1 2024-05-08T19:21:26.104 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:21:26.104 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:21:26.104 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-05-08 19:21:03.084601825 +0000 2024-05-08T19:21:26.104 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-05-08 19:17:15.333772013 +0000 2024-05-08T19:21:26.104 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-05-08 19:17:15.333772013 +0000 2024-05-08T19:21:26.104 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2024-05-08T19:21:26.105 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T19:21:26.170 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-05-08T19:21:26.170 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-05-08T19:21:26.170 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000187995 s, 2.7 MB/s 2024-05-08T19:21:26.171 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T19:21:26.229 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2024-05-08T19:21:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T19:21:26.287 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:21:26.287 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 181142 Links: 1 2024-05-08T19:21:26.287 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:21:26.287 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:21:26.287 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-05-08 19:21:03.084601825 +0000 2024-05-08T19:21:26.288 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-05-08 19:17:15.690761841 +0000 2024-05-08T19:21:26.288 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-05-08 19:17:15.690761841 +0000 2024-05-08T19:21:26.288 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2024-05-08T19:21:26.288 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T19:21:26.352 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-05-08T19:21:26.353 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-05-08T19:21:26.353 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000233617 s, 2.2 MB/s 2024-05-08T19:21:26.354 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T19:21:26.413 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T19:21:26.413 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T19:21:26.413 INFO:tasks.ceph:Generating config... 2024-05-08T19:21:26.415 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-08T19:21:26.415 INFO:tasks.ceph:[client] debug client = 20 2024-05-08T19:21:26.415 INFO:tasks.ceph:[client] debug ms = 1 2024-05-08T19:21:26.415 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-08T19:21:26.415 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-08T19:21:26.415 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-08T19:21:26.415 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-08T19:21:26.415 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-08T19:21:26.416 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-08T19:21:26.416 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-08T19:21:26.416 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-08T19:21:26.416 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-08T19:21:26.416 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-08T19:21:26.416 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-08T19:21:26.416 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-08T19:21:26.416 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-08T19:21:26.416 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T19:21:26.416 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T19:21:26.416 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T19:21:26.416 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T19:21:26.416 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T19:21:26.417 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-08T19:21:26.417 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-08T19:21:26.417 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-05-08T19:21:26.417 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-08T19:21:26.417 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-08T19:21:26.417 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-08T19:21:26.417 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T19:21:26.417 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T19:21:26.417 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-08T19:21:26.417 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-08T19:21:26.417 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-08T19:21:26.418 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-08T19:21:26.418 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-08T19:21:26.418 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-08T19:21:26.418 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-08T19:21:26.418 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-05-08T19:21:26.418 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T19:21:26.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T19:21:26.515 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T19:21:26.518 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T19:21:26.571 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T19:21:26.600 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.47'), ('mon.b', '172.21.15.177'), ('mon.c', '[v2:172.21.15.177:3301,v1:172.21.15.177:6790]')] 2024-05-08T19:21:26.601 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.47,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-08T19:21:26.601 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:26.602 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T19:21:26.659 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.47 --add b 172.21.15.177 --addv c '[v2:172.21.15.177:3301,v1:172.21.15.177:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T19:21:26.748 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T19:21:26.748 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: generated fsid e1596084-137b-43d3-b844-c72a72dda1f6 2024-05-08T19:21:26.748 INFO:teuthology.orchestra.run.smithi047.stdout:setting min_mon_release = pacific 2024-05-08T19:21:26.748 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 0 2024-05-08T19:21:26.749 INFO:teuthology.orchestra.run.smithi047.stdout:fsid e1596084-137b-43d3-b844-c72a72dda1f6 2024-05-08T19:21:26.749 INFO:teuthology.orchestra.run.smithi047.stdout:last_changed 2024-05-08T19:21:26.757562+0000 2024-05-08T19:21:26.749 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-05-08T19:21:26.757562+0000 2024-05-08T19:21:26.749 INFO:teuthology.orchestra.run.smithi047.stdout:min_mon_release 16 (pacific) 2024-05-08T19:21:26.749 INFO:teuthology.orchestra.run.smithi047.stdout:election_strategy: 1 2024-05-08T19:21:26.749 INFO:teuthology.orchestra.run.smithi047.stdout:0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-05-08T19:21:26.749 INFO:teuthology.orchestra.run.smithi047.stdout:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-05-08T19:21:26.749 INFO:teuthology.orchestra.run.smithi047.stdout:2: [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] mon.c 2024-05-08T19:21:26.749 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-08T19:21:26.750 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T19:21:26.768 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e1596084-137b-43d3-b844-c72a72dda1f6... 2024-05-08T19:21:26.768 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T19:21:26.810 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T19:21:26.855 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-05-08T19:21:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-05-08T19:21:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T19:21:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-05-08T19:21:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-05-08T19:21:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-05-08T19:21:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-05-08T19:21:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-05-08T19:21:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-05-08T19:21:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-05-08T19:21:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T19:21:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-05-08T19:21:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T19:21:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T19:21:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-05-08T19:21:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-05-08T19:21:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-05-08T19:21:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-05-08T19:21:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-05-08T19:21:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-05-08T19:21:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-05-08T19:21:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-05-08T19:21:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T19:21:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T19:21:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-05-08T19:21:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T19:21:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-05-08T19:21:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-05-08T19:21:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-05-08T19:21:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-05-08T19:21:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-05-08T19:21:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = "172.21.15.47,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-05-08T19:21:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on skipped message = False 2024-05-08T19:21:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = e1596084-137b-43d3-b844-c72a72dda1f6 2024-05-08T19:21:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.858 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-05-08T19:21:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-05-08T19:21:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-05-08T19:21:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-05-08T19:21:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-05-08T19:21:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-05-08T19:21:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-05-08T19:21:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-05-08T19:21:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-05-08T19:21:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-05-08T19:21:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-05-08T19:21:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-05-08T19:21:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-05-08T19:21:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-05-08T19:21:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-05-08T19:21:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-05-08T19:21:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-05-08T19:21:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-05-08T19:21:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-05-08T19:21:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-05-08T19:21:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore compression mode = aggressive 2024-05-08T19:21:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-05-08T19:21:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 20 2024-05-08T19:21:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 20 2024-05-08T19:21:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-08T19:21:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-05-08T19:21:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 10 2024-05-08T19:21:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T19:21:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-05-08T19:21:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-05-08T19:21:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-05-08T19:21:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-05-08T19:21:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-08T19:21:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: osd shutdown pgref assert = True 2024-05-08T19:21:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.861 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-05-08T19:21:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-08T19:21:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-05-08T19:21:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-08T19:21:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-08T19:21:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-08T19:21:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-08T19:21:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-05-08T19:21:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.862 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-05-08T19:21:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-08T19:21:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-08T19:21:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-05-08T19:21:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-08T19:21:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-05-08T19:21:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-05-08T19:21:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-08T19:21:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-05-08T19:21:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-05-08T19:21:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-08T19:21:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T19:21:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T19:21:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T19:21:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T19:21:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T19:21:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T19:21:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-05-08T19:21:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-05-08T19:21:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-05-08T19:21:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: mon op complaint time = 120 2024-05-08T19:21:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:21:26.864 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-05-08T19:21:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-05-08T19:21:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-05-08T19:21:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-05-08T19:21:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T19:21:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T19:21:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: client mount timeout = 600 2024-05-08T19:21:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-05-08T19:21:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-08T19:21:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-08T19:21:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-08T19:21:26.864 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-05-08T19:21:26.864 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.b] 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.c] 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout:[mds] 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds = 20 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds balancer = 20 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug frag = True 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug scatterstat = True 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: mds op complaint time = 180 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: mds verify scatter = True 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-08T19:21:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-08T19:21:26.866 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2024-05-08T19:21:26.866 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2024-05-08T19:21:26.866 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T19:21:26.866 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2024-05-08T19:21:26.866 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.866 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2024-05-08T19:21:26.867 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.867 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2024-05-08T19:21:26.867 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.867 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2024-05-08T19:21:26.867 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2024-05-08T19:21:26.867 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.867 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2024-05-08T19:21:26.867 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2024-05-08T19:21:26.867 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.867 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T19:21:26.867 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2024-05-08T19:21:26.867 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.867 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T19:21:26.867 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T19:21:26.867 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.868 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2024-05-08T19:21:26.868 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.868 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2024-05-08T19:21:26.868 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2024-05-08T19:21:26.868 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2024-05-08T19:21:26.868 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2024-05-08T19:21:26.868 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2024-05-08T19:21:26.868 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2024-05-08T19:21:26.868 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2024-05-08T19:21:26.868 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T19:21:26.868 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T19:21:26.868 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2024-05-08T19:21:26.868 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.868 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T19:21:26.868 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.869 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2024-05-08T19:21:26.869 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.869 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2024-05-08T19:21:26.869 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.869 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2024-05-08T19:21:26.869 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2024-05-08T19:21:26.869 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2024-05-08T19:21:26.869 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "172.21.15.47,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-05-08T19:21:26.869 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on skipped message = False 2024-05-08T19:21:26.869 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = e1596084-137b-43d3-b844-c72a72dda1f6 2024-05-08T19:21:26.869 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.869 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2024-05-08T19:21:26.869 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2024-05-08T19:21:26.869 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.869 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2024-05-08T19:21:26.870 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2024-05-08T19:21:26.870 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2024-05-08T19:21:26.870 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.870 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2024-05-08T19:21:26.870 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2024-05-08T19:21:26.870 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.870 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2024-05-08T19:21:26.870 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2024-05-08T19:21:26.870 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2024-05-08T19:21:26.870 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.870 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2024-05-08T19:21:26.870 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2024-05-08T19:21:26.870 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.870 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2024-05-08T19:21:26.871 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.871 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2024-05-08T19:21:26.871 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.871 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2024-05-08T19:21:26.871 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.871 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2024-05-08T19:21:26.871 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2024-05-08T19:21:26.871 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.871 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2024-05-08T19:21:26.871 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2024-05-08T19:21:26.871 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2024-05-08T19:21:26.871 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore compression mode = aggressive 2024-05-08T19:21:26.871 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2024-05-08T19:21:26.871 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 20 2024-05-08T19:21:26.871 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 20 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 10 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout: osd shutdown pgref assert = True 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-05-08T19:21:26.872 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-05-08T19:21:26.873 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-05-08T19:21:26.873 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-05-08T19:21:26.873 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2024-05-08T19:21:26.873 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.873 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2024-05-08T19:21:26.873 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-05-08T19:21:26.873 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-05-08T19:21:26.873 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2024-05-08T19:21:26.873 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-05-08T19:21:26.873 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2024-05-08T19:21:26.873 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2024-05-08T19:21:26.873 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-05-08T19:21:26.873 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2024-05-08T19:21:26.873 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2024-05-08T19:21:26.873 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-05-08T19:21:26.874 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.874 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T19:21:26.874 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T19:21:26.874 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T19:21:26.874 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.874 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T19:21:26.874 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T19:21:26.874 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T19:21:26.874 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.874 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2024-05-08T19:21:26.874 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2024-05-08T19:21:26.874 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.874 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2024-05-08T19:21:26.874 INFO:teuthology.orchestra.run.smithi177.stdout: mon op complaint time = 120 2024-05-08T19:21:26.875 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-05-08T19:21:26.875 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2024-05-08T19:21:26.875 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2024-05-08T19:21:26.875 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2024-05-08T19:21:26.875 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2024-05-08T19:21:26.875 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T19:21:26.875 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T19:21:26.875 INFO:teuthology.orchestra.run.smithi177.stdout: client mount timeout = 600 2024-05-08T19:21:26.875 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2024-05-08T19:21:26.875 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-05-08T19:21:26.875 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-05-08T19:21:26.875 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-05-08T19:21:26.875 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2024-05-08T19:21:26.875 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2024-05-08T19:21:26.875 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2024-05-08T19:21:26.876 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2024-05-08T19:21:26.876 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2024-05-08T19:21:26.876 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2024-05-08T19:21:26.876 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2024-05-08T19:21:26.876 INFO:teuthology.orchestra.run.smithi177.stdout:[mds] 2024-05-08T19:21:26.876 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds = 20 2024-05-08T19:21:26.876 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds balancer = 20 2024-05-08T19:21:26.876 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-05-08T19:21:26.876 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug frag = True 2024-05-08T19:21:26.876 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug scatterstat = True 2024-05-08T19:21:26.876 INFO:teuthology.orchestra.run.smithi177.stdout: mds op complaint time = 180 2024-05-08T19:21:26.876 INFO:teuthology.orchestra.run.smithi177.stdout: mds verify scatter = True 2024-05-08T19:21:26.876 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-05-08T19:21:26.876 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-05-08T19:21:26.876 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-05-08T19:21:26.878 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T19:21:26.878 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T19:21:26.978 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T19:21:26.979 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:26.979 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T19:21:26.996 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:26.996 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T19:21:27.053 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi047.front.sepia.ceph.com 2024-05-08T19:21:27.053 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:27.053 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T19:21:27.053 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T19:21:27.170 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:27.170 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T19:21:27.219 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2024-05-08T19:21:27.219 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:27.219 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T19:21:27.220 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T19:21:27.257 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:27.257 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T19:21:27.314 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T19:21:27.314 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T19:21:27.314 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T19:21:27.370 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T19:21:27.372 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T19:21:27.458 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T19:21:27.461 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T19:21:27.462 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T19:21:27.517 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T19:21:27.520 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-08T19:21:27.547 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T19:21:27.644 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T19:21:27.647 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-08T19:21:27.673 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T19:21:27.728 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T19:21:27.731 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-08T19:21:27.758 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T19:21:27.852 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T19:21:27.854 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-08T19:21:27.881 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T19:21:27.881 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T19:21:27.927 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T19:21:27.940 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-08T19:21:27.984 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-08T19:21:27.997 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T19:21:27.997 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T19:21:27.997 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T19:21:28.025 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T19:21:28.025 INFO:tasks.ceph:role: osd.0 2024-05-08T19:21:28.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-08T19:21:28.025 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T19:21:28.091 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T19:21:28.092 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T19:21:28.092 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T19:21:28.092 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T19:21:28.092 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T19:21:28.092 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-08T19:21:28.092 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T19:21:28.092 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T19:21:28.092 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T19:21:28.092 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T19:21:28.114 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-08T19:21:28.116 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-08T19:21:28.116 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T19:21:28.197 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T19:21:28.270 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T19:21:28.337 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T19:21:28.337 INFO:tasks.ceph:role: osd.1 2024-05-08T19:21:28.338 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-08T19:21:28.338 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T19:21:28.406 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T19:21:28.406 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T19:21:28.406 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T19:21:28.406 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T19:21:28.406 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T19:21:28.406 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-08T19:21:28.406 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T19:21:28.406 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T19:21:28.406 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T19:21:28.407 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T19:21:28.431 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-08T19:21:28.433 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-08T19:21:28.433 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-08T19:21:28.513 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T19:21:28.585 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T19:21:28.653 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T19:21:28.653 INFO:tasks.ceph:role: osd.2 2024-05-08T19:21:28.653 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-08T19:21:28.653 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T19:21:28.720 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T19:21:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T19:21:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T19:21:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T19:21:28.720 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T19:21:28.720 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-08T19:21:28.720 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T19:21:28.720 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T19:21:28.721 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T19:21:28.721 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T19:21:28.745 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-08T19:21:28.747 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-08T19:21:28.747 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-08T19:21:28.827 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T19:21:28.899 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T19:21:28.968 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T19:21:28.968 INFO:tasks.ceph:role: osd.3 2024-05-08T19:21:28.968 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-08T19:21:28.969 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T19:21:29.036 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T19:21:29.036 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T19:21:29.036 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T19:21:29.036 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T19:21:29.036 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T19:21:29.036 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-08T19:21:29.036 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T19:21:29.036 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T19:21:29.036 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T19:21:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T19:21:29.058 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-08T19:21:29.060 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-08T19:21:29.060 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-08T19:21:29.140 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T19:21:29.211 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T19:21:29.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:29.307+0000 7f4afc91b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-08T19:21:29.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:29.307+0000 7f4afc91b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-08T19:21:29.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:29.307+0000 7f4afc91b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T19:21:29.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:29.307+0000 7f4afc91b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T19:21:29.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:29.307+0000 7f4afc91b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T19:21:29.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:29.308+0000 7f4afc91b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-08T19:21:32.146 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T19:21:32.179 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T19:21:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:32.282+0000 7f4b4709c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-08T19:21:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:32.283+0000 7f4b4709c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-08T19:21:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:32.283+0000 7f4b4709c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T19:21:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:32.283+0000 7f4b4709c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T19:21:32.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:32.283+0000 7f4b4709c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T19:21:32.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:32.283+0000 7f4b4709c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-08T19:21:35.122 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T19:21:35.156 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T19:21:35.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:35.257+0000 7fd7711017c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-08T19:21:35.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:35.257+0000 7fd7711017c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-08T19:21:35.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:35.257+0000 7fd7711017c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T19:21:35.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:35.257+0000 7fd7711017c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T19:21:35.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:35.257+0000 7fd7711017c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T19:21:35.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:35.257+0000 7fd7711017c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-08T19:21:38.098 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T19:21:38.131 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T19:21:38.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:38.234+0000 7f2fb54a97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-08T19:21:38.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:38.234+0000 7f2fb54a97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-08T19:21:38.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:38.234+0000 7f2fb54a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T19:21:38.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:38.235+0000 7f2fb54a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T19:21:38.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:38.235+0000 7f2fb54a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T19:21:38.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:38.235+0000 7f2fb54a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-08T19:21:41.074 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T19:21:41.107 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-08T19:21:41.139 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T19:21:41.139 INFO:tasks.ceph:role: osd.4 2024-05-08T19:21:41.139 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com 2024-05-08T19:21:41.139 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T19:21:41.217 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T19:21:41.217 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T19:21:41.217 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T19:21:41.217 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T19:21:41.217 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T19:21:41.217 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-05-08T19:21:41.217 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T19:21:41.217 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T19:21:41.217 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T19:21:41.217 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T19:21:41.653 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-05-08T19:21:41.655 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-05-08T19:21:41.655 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-08T19:21:41.843 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-08T19:21:41.881 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-08T19:21:41.951 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T19:21:41.952 INFO:tasks.ceph:role: osd.5 2024-05-08T19:21:41.952 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com 2024-05-08T19:21:41.952 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T19:21:42.028 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T19:21:42.028 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T19:21:42.028 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T19:21:42.029 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T19:21:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T19:21:42.029 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-05-08T19:21:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T19:21:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T19:21:42.029 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T19:21:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T19:21:42.435 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-05-08T19:21:42.437 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-05-08T19:21:42.437 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-08T19:21:42.549 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-08T19:21:42.583 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-08T19:21:42.653 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T19:21:42.653 INFO:tasks.ceph:role: osd.6 2024-05-08T19:21:42.653 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com 2024-05-08T19:21:42.653 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T19:21:42.729 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T19:21:42.730 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T19:21:42.730 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T19:21:42.730 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T19:21:42.730 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T19:21:42.730 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-05-08T19:21:42.730 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T19:21:42.730 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T19:21:42.730 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T19:21:42.730 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T19:21:43.173 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-05-08T19:21:43.176 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-05-08T19:21:43.176 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-08T19:21:43.353 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-08T19:21:43.391 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-08T19:21:43.461 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T19:21:43.461 INFO:tasks.ceph:role: osd.7 2024-05-08T19:21:43.461 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com 2024-05-08T19:21:43.461 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T19:21:43.537 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T19:21:43.538 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T19:21:43.538 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T19:21:43.538 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T19:21:43.538 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T19:21:43.538 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-05-08T19:21:43.538 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T19:21:43.538 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T19:21:43.539 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T19:21:43.539 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T19:21:43.966 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-05-08T19:21:43.968 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-05-08T19:21:43.969 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-08T19:21:44.153 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-08T19:21:44.188 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T19:21:44.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:44.287+0000 7f16867ee7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-08T19:21:44.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:44.287+0000 7f16867ee7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-08T19:21:44.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:44.287+0000 7f16867ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T19:21:44.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:44.287+0000 7f16867ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T19:21:44.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:44.287+0000 7f16867ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T19:21:44.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:44.287+0000 7f16867ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-08T19:21:47.133 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-08T19:21:47.165 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T19:21:47.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:47.266+0000 7f5cb28427c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-08T19:21:47.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:47.266+0000 7f5cb28427c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-08T19:21:47.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:47.266+0000 7f5cb28427c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T19:21:47.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:47.266+0000 7f5cb28427c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T19:21:47.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:47.266+0000 7f5cb28427c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T19:21:47.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:47.266+0000 7f5cb28427c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-08T19:21:50.103 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-08T19:21:50.136 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T19:21:50.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:50.237+0000 7fc09eca17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-08T19:21:50.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:50.237+0000 7fc09eca17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-08T19:21:50.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:50.237+0000 7fc09eca17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T19:21:50.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:50.237+0000 7fc09eca17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T19:21:50.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:50.237+0000 7fc09eca17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T19:21:50.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:50.238+0000 7fc09eca17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-08T19:21:53.082 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-08T19:21:53.114 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T19:21:53.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:53.215+0000 7ff35e9207c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-08T19:21:53.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:53.215+0000 7ff35e9207c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-08T19:21:53.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:53.215+0000 7ff35e9207c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T19:21:53.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:53.215+0000 7ff35e9207c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T19:21:53.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:53.215+0000 7ff35e9207c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T19:21:53.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:21:53.216+0000 7ff35e9207c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-08T19:21:54.774 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:21:54.776 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:21:56.050 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-08T19:21:56.082 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T19:21:56.082 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:56.082 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-08T19:21:56.117 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:56.117 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-08T19:21:56.190 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:56.190 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-08T19:21:56.261 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:56.261 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T19:21:56.333 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:56.333 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T19:21:56.403 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:56.403 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T19:21:56.472 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:56.473 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T19:21:56.542 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:56.543 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T19:21:56.578 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:56.578 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-08T19:21:56.650 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:56.650 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-08T19:21:56.722 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:56.722 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-08T19:21:56.790 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:56.791 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-08T19:21:56.859 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:56.860 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-08T19:21:56.928 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:56.928 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-08T19:21:56.996 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:21:56.996 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T19:21:57.017 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:21:57.018 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-08T19:21:57.055 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T19:21:57.055 DEBUG:teuthology.orchestra.run.smithi047:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T19:21:57.061 DEBUG:teuthology.orchestra.run.smithi177:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T19:21:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.y] 2024-05-08T19:21:57.098 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC30Dtm2SSbFhAAJDi6Vh5tb3XDQo1AKj1tHw== 2024-05-08T19:21:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-05-08T19:21:57.098 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC30DtmncRhHxAAJHTCOa7ib/4tJB82GXdntQ== 2024-05-08T19:21:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-05-08T19:21:57.098 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC30Dtmq1bxJhAAEcodgcColIr1KBgB7UMVsQ== 2024-05-08T19:21:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.0] 2024-05-08T19:21:57.098 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC50Dtm5nxnEhAA3BWmLLxtgXHphyGcoaEG1Q== 2024-05-08T19:21:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.1] 2024-05-08T19:21:57.099 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC80DtmUjTtEBAA9CS4lzQcdzUhpI3w0X4FDA== 2024-05-08T19:21:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.2] 2024-05-08T19:21:57.099 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC/0DtmU6djDxAAMcaKnJvWErVqnhL8hQ0q7A== 2024-05-08T19:21:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.3] 2024-05-08T19:21:57.099 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDC0DtmbYQPDhAAIV1JW/nFKs+5uwtj8Dp2vw== 2024-05-08T19:21:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.x] 2024-05-08T19:21:57.099 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC30DtmX2fmGxAAnKUgZeXQtRpPTsmCT6mCmw== 2024-05-08T19:21:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-05-08T19:21:57.099 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC30Dtm44H7KxAAdyV6JnRD85CMjYUXyTkbdw== 2024-05-08T19:21:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-05-08T19:21:57.099 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC30DtmZQdVMxAAbNZIZzULtEYwP9GirnWmKw== 2024-05-08T19:21:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.4] 2024-05-08T19:21:57.099 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDI0DtmdzczERAABRvvyPN1DqBRAjN5DCAUnQ== 2024-05-08T19:21:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.5] 2024-05-08T19:21:57.100 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDL0DtmUybhDxAArMjAL9fScRNolyU/ssdk2A== 2024-05-08T19:21:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.6] 2024-05-08T19:21:57.100 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDO0Dtm5qIrDhAACUWi5EAyXrMGe4PSEbTztQ== 2024-05-08T19:21:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.7] 2024-05-08T19:21:57.100 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDR0DtmbXfZDBAA7Y99fdj7WpIrsBhnwC3vKw== 2024-05-08T19:21:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-05-08T19:21:57.100 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC30DtmXZDNNxAAvbjB6E6VWoHMPvfOf3bYfg== 2024-05-08T19:21:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:[client.1] 2024-05-08T19:21:57.101 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC30DtmG0EzOxAARXgOYkXL9hRqqSevZ24uNQ== 2024-05-08T19:21:57.121 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.y] 2024-05-08T19:21:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQC30Dtm2SSbFhAAJDi6Vh5tb3XDQo1AKj1tHw== 2024-05-08T19:21:57.122 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2024-05-08T19:21:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQC30DtmncRhHxAAJHTCOa7ib/4tJB82GXdntQ== 2024-05-08T19:21:57.122 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2024-05-08T19:21:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQC30Dtmq1bxJhAAEcodgcColIr1KBgB7UMVsQ== 2024-05-08T19:21:57.122 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.0] 2024-05-08T19:21:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQC50Dtm5nxnEhAA3BWmLLxtgXHphyGcoaEG1Q== 2024-05-08T19:21:57.122 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.1] 2024-05-08T19:21:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQC80DtmUjTtEBAA9CS4lzQcdzUhpI3w0X4FDA== 2024-05-08T19:21:57.122 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.2] 2024-05-08T19:21:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQC/0DtmU6djDxAAMcaKnJvWErVqnhL8hQ0q7A== 2024-05-08T19:21:57.122 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.3] 2024-05-08T19:21:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDC0DtmbYQPDhAAIV1JW/nFKs+5uwtj8Dp2vw== 2024-05-08T19:21:57.123 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.x] 2024-05-08T19:21:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQC30DtmX2fmGxAAnKUgZeXQtRpPTsmCT6mCmw== 2024-05-08T19:21:57.123 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2024-05-08T19:21:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQC30Dtm44H7KxAAdyV6JnRD85CMjYUXyTkbdw== 2024-05-08T19:21:57.123 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2024-05-08T19:21:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQC30DtmZQdVMxAAbNZIZzULtEYwP9GirnWmKw== 2024-05-08T19:21:57.123 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.4] 2024-05-08T19:21:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDI0DtmdzczERAABRvvyPN1DqBRAjN5DCAUnQ== 2024-05-08T19:21:57.123 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.5] 2024-05-08T19:21:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDL0DtmUybhDxAArMjAL9fScRNolyU/ssdk2A== 2024-05-08T19:21:57.123 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.6] 2024-05-08T19:21:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDO0Dtm5qIrDhAACUWi5EAyXrMGe4PSEbTztQ== 2024-05-08T19:21:57.123 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.7] 2024-05-08T19:21:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDR0DtmbXfZDBAA7Y99fdj7WpIrsBhnwC3vKw== 2024-05-08T19:21:57.124 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2024-05-08T19:21:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQC30DtmXZDNNxAAvbjB6E6VWoHMPvfOf3bYfg== 2024-05-08T19:21:57.124 INFO:teuthology.orchestra.run.smithi177.stdout:[client.1] 2024-05-08T19:21:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQC30DtmG0EzOxAARXgOYkXL9hRqqSevZ24uNQ== 2024-05-08T19:21:57.125 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T19:21:57.145 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T19:21:57.220 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T19:21:57.222 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T19:21:57.281 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T19:21:57.283 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T19:21:57.342 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.344 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.398 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.400 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.454 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.456 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.511 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.513 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.567 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T19:21:57.569 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T19:21:57.623 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T19:21:57.625 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T19:21:57.683 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T19:21:57.687 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T19:21:57.744 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.747 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.801 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.803 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.858 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.860 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.914 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.916 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T19:21:57.970 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T19:21:57.972 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T19:21:58.029 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T19:21:58.032 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T19:21:58.089 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T19:21:58.089 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T19:21:58.117 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T19:21:58.217 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T19:21:58.245 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-08T19:21:58.273 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T19:21:58.371 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-08T19:21:58.398 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-08T19:21:58.465 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T19:21:58.564 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-08T19:21:58.596 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T19:21:58.598 DEBUG:teuthology.orchestra.run.smithi177:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T19:21:58.653 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T19:21:58.653 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T19:21:58.653 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T19:21:58.656 INFO:tasks.ceph.mon.a:Started 2024-05-08T19:21:58.656 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T19:21:58.656 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T19:21:58.701 INFO:tasks.ceph.mon.b:Started 2024-05-08T19:21:58.701 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T19:21:58.701 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T19:21:58.704 INFO:tasks.ceph.mon.c:Started 2024-05-08T19:21:58.704 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T19:21:58.704 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-08T19:21:58.705 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-08T19:21:58.708 INFO:tasks.ceph.mgr.y:Started 2024-05-08T19:21:58.708 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T19:21:58.708 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T19:21:58.710 INFO:tasks.ceph.mgr.x:Started 2024-05-08T19:21:58.710 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T19:21:58.711 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T19:21:58.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:58.847+0000 7ff3702ed700 1 Processor -- start 2024-05-08T19:21:58.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:58.847+0000 7ff3702ed700 1 -- start start 2024-05-08T19:21:58.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:58.848+0000 7ff3702ed700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff3680716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:21:58.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:58.848+0000 7ff3702ed700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff368155830 con 0x7ff368151690 2024-05-08T19:21:58.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:58.848+0000 7ff3702ed700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3680c1c60 con 0x7ff3680c37f0 2024-05-08T19:21:58.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:58.848+0000 7ff3702ed700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff368072bc0 con 0x7ff36814ebe0 2024-05-08T19:21:58.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:58.848+0000 7ff36e88a700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff368151690 0x7ff368151b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60104/0 (socket says 172.21.15.47:60104) 2024-05-08T19:21:58.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:58.848+0000 7ff36e88a700 1 -- 172.21.15.47:0/2960758742 learned_addr learned my addr 172.21.15.47:0/2960758742 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:21:58.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:58.848+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff3680716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:21:58.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:58.848+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 msgr2=0x7ff3680716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T19:21:58.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:58.848+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 msgr2=0x7ff3680716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T19:21:58.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:58.848+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff3680716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T19:21:58.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:58.848+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff3680716f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T19:21:59.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:59.049+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff3680716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:21:59.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:59.049+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 msgr2=0x7ff3680716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T19:21:59.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:59.049+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 msgr2=0x7ff3680716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T19:21:59.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:59.049+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff3680716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T19:21:59.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:59.049+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff3680716f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T19:21:59.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:59.450+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff3680716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:21:59.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:59.450+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 msgr2=0x7ff3680716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T19:21:59.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:59.450+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 msgr2=0x7ff3680716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T19:21:59.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:59.450+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff3680716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T19:21:59.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:21:59.450+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff3680716f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T19:22:00.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:00.251+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff3680716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:00.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:00.251+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 msgr2=0x7ff3680716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T19:22:00.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:00.251+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 msgr2=0x7ff3680716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T19:22:00.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:00.251+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff3680716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T19:22:00.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:00.251+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff3680716f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T19:22:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.848+0000 7ff35ffff700 1 -- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 msgr2=0x7ff3680716f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T19:22:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.848+0000 7ff35ffff700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff3680716f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.848+0000 7ff35ffff700 1 -- 172.21.15.47:0/2960758742 >> v1:172.21.15.177:6789/0 conn(0x7ff3680c37f0 legacy=0x7ff368071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.848+0000 7ff35ffff700 1 -- 172.21.15.47:0/2960758742 >> v1:172.21.15.47:6789/0 conn(0x7ff368151690 legacy=0x7ff368151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.848+0000 7ff35ffff700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.848+0000 7ff35ffff700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 0x7ff34c008710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.848+0000 7ff35ffff700 1 -- 172.21.15.47:0/2960758742 --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff368072bc0 con 0x7ff34c0037a0 2024-05-08T19:22:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.848+0000 7ff35ffff700 1 -- 172.21.15.47:0/2960758742 --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff34c008dc0 con 0x7ff34c006270 2024-05-08T19:22:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.848+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.848+0000 7ff36d888700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 0x7ff34c008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.848+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 msgr2=0x7ff34c005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T19:22:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.848+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 msgr2=0x7ff34c005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T19:22:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.848+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T19:22:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.849+0000 7ff36d888700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 msgr2=0x7ff34c008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T19:22:01.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.849+0000 7ff36d888700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 msgr2=0x7ff34c008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T19:22:01.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.849+0000 7ff36d888700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 0x7ff34c008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T19:22:01.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.849+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T19:22:01.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:01.849+0000 7ff36d888700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 0x7ff34c008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T19:22:02.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.050+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:02.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.050+0000 7ff36d888700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 0x7ff34c008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:02.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.050+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 msgr2=0x7ff34c005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T19:22:02.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.050+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 msgr2=0x7ff34c005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T19:22:02.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.050+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T19:22:02.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.050+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T19:22:02.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.050+0000 7ff36d888700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 msgr2=0x7ff34c008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T19:22:02.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.050+0000 7ff36d888700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 msgr2=0x7ff34c008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T19:22:02.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.050+0000 7ff36d888700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 0x7ff34c008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T19:22:02.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.050+0000 7ff36d888700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 0x7ff34c008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T19:22:02.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.451+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:02.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.451+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 msgr2=0x7ff34c005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T19:22:02.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.451+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 msgr2=0x7ff34c005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T19:22:02.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.451+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T19:22:02.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.451+0000 7ff36d888700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 0x7ff34c008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:02.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.451+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T19:22:02.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.451+0000 7ff36d888700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 msgr2=0x7ff34c008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T19:22:02.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.451+0000 7ff36d888700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 msgr2=0x7ff34c008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T19:22:02.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.451+0000 7ff36d888700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 0x7ff34c008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T19:22:02.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:02.451+0000 7ff36d888700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 0x7ff34c008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T19:22:03.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:03.252+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:03.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:03.252+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 msgr2=0x7ff34c005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T19:22:03.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:03.252+0000 7ff36e089700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 msgr2=0x7ff34c005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T19:22:03.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:03.252+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T19:22:03.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:03.252+0000 7ff36e089700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T19:22:03.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:03.252+0000 7ff36d888700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 0x7ff34c008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:03.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:03.252+0000 7ff36d888700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 msgr2=0x7ff34c008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T19:22:03.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:03.252+0000 7ff36d888700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 msgr2=0x7ff34c008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T19:22:03.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:03.252+0000 7ff36d888700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 0x7ff34c008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T19:22:03.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:03.252+0000 7ff36d888700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 0x7ff34c008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T19:22:04.495 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:04.502+0000 7fc1e8b05200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T19:22:04.500 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:04.508+0000 7f4db5ff9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T19:22:04.573 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:04.581+0000 7fc1e8b05200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T19:22:04.583 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:04.591+0000 7f4db5ff9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T19:22:04.645 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:04.653+0000 7fc1e8b05200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T19:22:04.660 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:04.668+0000 7f4db5ff9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T19:22:04.715 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:04.723+0000 7fc1e8b05200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T19:22:04.735 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:04.743+0000 7f4db5ff9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T19:22:04.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.848+0000 7ff35ffff700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 msgr2=0x7ff34c008710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T19:22:04.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.848+0000 7ff35ffff700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.177:3300/0 conn(0x7ff34c006270 0x7ff34c008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:04.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.848+0000 7ff35ffff700 1 -- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 msgr2=0x7ff34c005c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T19:22:04.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.848+0000 7ff35ffff700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:04.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.848+0000 7ff36e88a700 1 -- 172.21.15.47:0/2960758742 reap_dead start 2024-05-08T19:22:04.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.848+0000 7ff35ffff700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:04.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.848+0000 7ff35ffff700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff34c00e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:04.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.848+0000 7ff35ffff700 1 -- 172.21.15.47:0/2960758742 --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff368155b10 con 0x7ff368151690 2024-05-08T19:22:04.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.848+0000 7ff35ffff700 1 -- 172.21.15.47:0/2960758742 --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff368072bc0 con 0x7ff34c0037a0 2024-05-08T19:22:04.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.848+0000 7ff35ffff700 1 -- 172.21.15.47:0/2960758742 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c008dc0 con 0x7ff36814ebe0 2024-05-08T19:22:04.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.848+0000 7ff36d888700 1 --2- 172.21.15.47:0/2960758742 >> v2:172.21.15.47:3300/0 conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:04.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.849+0000 7ff36e88a700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff34c00e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:04.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.849+0000 7ff36d888700 1 -- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 msgr2=0x7ff34c00e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:04.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.849+0000 7ff36d888700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff34c00e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:04.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.849+0000 7ff36d888700 1 -- 172.21.15.47:0/2960758742 >> v1:172.21.15.47:6789/0 conn(0x7ff368151690 legacy=0x7ff34c00b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:04.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.849+0000 7ff36d888700 1 -- 172.21.15.47:0/2960758742 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c0067c0 con 0x7ff34c0037a0 2024-05-08T19:22:04.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.849+0000 7ff36d087700 1 -- 172.21.15.47:0/2960758742 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488243151 0 0) 0x7ff368155b10 con 0x7ff368151690 2024-05-08T19:22:04.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.849+0000 7ff36d888700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff34c0037a0 0x7ff34c005c20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff358007cc0 tx=0x7ff358005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b2ae217cc53c09 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:04.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.849+0000 7ff36d087700 1 -- 172.21.15.47:0/2960758742 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358016450 con 0x7ff34c0037a0 2024-05-08T19:22:04.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.849+0000 7ff36d087700 1 -- 172.21.15.47:0/2960758742 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3580165f0 con 0x7ff34c0037a0 2024-05-08T19:22:04.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.849+0000 7ff36d087700 1 -- 172.21.15.47:0/2960758742 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3580169a0 con 0x7ff34c0037a0 2024-05-08T19:22:04.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.850+0000 7ff3702ed700 1 -- 172.21.15.47:0/2960758742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff34c0037a0 msgr2=0x7ff34c005c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:04.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.850+0000 7ff3702ed700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff34c0037a0 0x7ff34c005c20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff358007cc0 tx=0x7ff358005610 comp rx=0 tx=0).stop 2024-05-08T19:22:04.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.850+0000 7ff3702ed700 1 -- 172.21.15.47:0/2960758742 shutdown_connections 2024-05-08T19:22:04.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.850+0000 7ff3702ed700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff34c0037a0 0x7ff34c005c20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:04.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.850+0000 7ff3702ed700 1 --2- 172.21.15.47:0/2960758742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff34c00e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:04.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.850+0000 7ff3702ed700 1 -- 172.21.15.47:0/2960758742 >> 172.21.15.47:0/2960758742 conn(0x7ff3680c71c0 msgr2=0x7ff3680c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:04.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.850+0000 7ff3702ed700 1 -- 172.21.15.47:0/2960758742 shutdown_connections 2024-05-08T19:22:04.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.850+0000 7ff3702ed700 1 -- 172.21.15.47:0/2960758742 wait complete. 2024-05-08T19:22:04.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.851+0000 7ff3702ed700 1 Processor -- start 2024-05-08T19:22:04.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.851+0000 7ff3702ed700 1 -- start start 2024-05-08T19:22:04.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.852+0000 7ff3702ed700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff34c0037a0 0x7ff3680c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:04.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.852+0000 7ff3702ed700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff368154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:04.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.852+0000 7ff3702ed700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368151690 0x7ff368149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:04.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.852+0000 7ff3702ed700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680bd180 con 0x7ff368151690 2024-05-08T19:22:04.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.852+0000 7ff3702ed700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680bcbc0 con 0x7ff34c0037a0 2024-05-08T19:22:04.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.852+0000 7ff3702ed700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680bcea0 con 0x7ff36814ebe0 2024-05-08T19:22:04.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.852+0000 7ff36e88a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368151690 0x7ff368149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:04.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.852+0000 7ff36e88a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368151690 0x7ff368149120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44222/0 (socket says 172.21.15.47:44222) 2024-05-08T19:22:04.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.852+0000 7ff36e88a700 1 -- 172.21.15.47:0/3336620516 learned_addr learned my addr 172.21.15.47:0/3336620516 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:04.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.852+0000 7ff36d888700 1 --2- 172.21.15.47:0/3336620516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff368154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:04.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.852+0000 7ff36e089700 1 --2- 172.21.15.47:0/3336620516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff34c0037a0 0x7ff3680c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:04.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.853+0000 7ff36e88a700 1 -- 172.21.15.47:0/3336620516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 msgr2=0x7ff368154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:04.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.853+0000 7ff36e88a700 1 --2- 172.21.15.47:0/3336620516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff368154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:04.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.853+0000 7ff36e88a700 1 -- 172.21.15.47:0/3336620516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff34c0037a0 msgr2=0x7ff3680c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:04.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.853+0000 7ff36e88a700 1 --2- 172.21.15.47:0/3336620516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff34c0037a0 0x7ff3680c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:04.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.853+0000 7ff36e88a700 1 -- 172.21.15.47:0/3336620516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35800f040 con 0x7ff368151690 2024-05-08T19:22:04.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.853+0000 7ff36e88a700 1 --2- 172.21.15.47:0/3336620516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368151690 0x7ff368149120 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff3680c4d80 tx=0x7ff36000f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:04.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.853+0000 7ff35effd700 1 -- 172.21.15.47:0/3336620516 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36000fbf0 con 0x7ff368151690 2024-05-08T19:22:04.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.853+0000 7ff35effd700 1 -- 172.21.15.47:0/3336620516 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36000fd50 con 0x7ff368151690 2024-05-08T19:22:04.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.853+0000 7ff3702ed700 1 -- 172.21.15.47:0/3336620516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3680bc280 con 0x7ff368151690 2024-05-08T19:22:04.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.853+0000 7ff35effd700 1 -- 172.21.15.47:0/3336620516 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff360013610 con 0x7ff368151690 2024-05-08T19:22:04.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.853+0000 7ff3702ed700 1 -- 172.21.15.47:0/3336620516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3680be230 con 0x7ff368151690 2024-05-08T19:22:04.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.853+0000 7ff35effd700 1 -- 172.21.15.47:0/3336620516 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff360013770 con 0x7ff368151690 2024-05-08T19:22:04.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.853+0000 7ff35effd700 1 -- 172.21.15.47:0/3336620516 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff36001d7d0 con 0x7ff368151690 2024-05-08T19:22:04.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.854+0000 7ff3702ed700 1 -- 172.21.15.47:0/3336620516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36814f500 con 0x7ff368151690 2024-05-08T19:22:04.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.857+0000 7ff35effd700 1 -- 172.21.15.47:0/3336620516 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7ff360013c00 con 0x7ff368151690 2024-05-08T19:22:04.887 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:04.894+0000 7fc1e8b05200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T19:22:04.918 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:04.926+0000 7f4db5ff9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T19:22:04.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.935+0000 7ff3702ed700 1 -- 172.21.15.47:0/3336620516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff3680a9400 con 0x7ff368151690 2024-05-08T19:22:04.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.938+0000 7ff35effd700 1 -- 172.21.15.47:0/3336620516 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff360013da0 con 0x7ff368151690 2024-05-08T19:22:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.939+0000 7ff3702ed700 1 -- 172.21.15.47:0/3336620516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368151690 msgr2=0x7ff368149120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.939+0000 7ff3702ed700 1 --2- 172.21.15.47:0/3336620516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368151690 0x7ff368149120 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff3680c4d80 tx=0x7ff36000f4b0 comp rx=0 tx=0).stop 2024-05-08T19:22:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.939+0000 7ff3702ed700 1 -- 172.21.15.47:0/3336620516 shutdown_connections 2024-05-08T19:22:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.939+0000 7ff3702ed700 1 --2- 172.21.15.47:0/3336620516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368151690 0x7ff368149120 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.939+0000 7ff3702ed700 1 --2- 172.21.15.47:0/3336620516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff34c0037a0 0x7ff3680c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.939+0000 7ff3702ed700 1 --2- 172.21.15.47:0/3336620516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff36814ebe0 0x7ff368154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.939+0000 7ff3702ed700 1 -- 172.21.15.47:0/3336620516 >> 172.21.15.47:0/3336620516 conn(0x7ff3680c71c0 msgr2=0x7ff3680c2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.940+0000 7ff3702ed700 1 -- 172.21.15.47:0/3336620516 shutdown_connections 2024-05-08T19:22:04.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:04.940+0000 7ff3702ed700 1 -- 172.21.15.47:0/3336620516 wait complete. 2024-05-08T19:22:04.933 INFO:teuthology.orchestra.run.smithi047.stderr:adjusted tunables profile to default 2024-05-08T19:22:04.948 INFO:tasks.ceph:check_enable_crimson: False 2024-05-08T19:22:04.948 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T19:22:04.949 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:22:04.949 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T19:22:04.977 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:22:04.977 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T19:22:05.046 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:22:05.046 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T19:22:05.053 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:05.061+0000 7fc1e8b05200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T19:22:05.102 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:05.111+0000 7f4db5ff9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T19:22:05.113 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:22:05.114 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T19:22:05.163 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:05.170+0000 7fc1e8b05200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T19:22:05.181 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:22:05.182 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-08T19:22:05.208 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:22:05.209 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-08T19:22:05.219 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:05.228+0000 7f4db5ff9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T19:22:05.262 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:05.269+0000 7fc1e8b05200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T19:22:05.279 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:22:05.280 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-08T19:22:05.319 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:05.327+0000 7f4db5ff9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T19:22:05.344 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:05.352+0000 7fc1e8b05200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T19:22:05.345 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:22:05.345 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-08T19:22:05.398 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:05.406+0000 7f4db5ff9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T19:22:05.412 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new ae9558d2-ca2c-4353-9301-2d6c9b86d611 0 2024-05-08T19:22:05.577 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:05.585+0000 7fc1e8b05200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T19:22:05.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.606+0000 7f15a533d700 1 Processor -- start 2024-05-08T19:22:05.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.606+0000 7f15a533d700 1 -- start start 2024-05-08T19:22:05.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f15a533d700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15a00c74e0 0x7f15a0070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:05.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f15a533d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15a00c78c0 0x7f15a006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:05.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f15a533d700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f15a00c46c0 0x7f15a00c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:05.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f15a533d700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a0071250 con 0x7f15a00c46c0 2024-05-08T19:22:05.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f15a533d700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a0153430 con 0x7f15a00c74e0 2024-05-08T19:22:05.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f15a533d700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a0153960 con 0x7f15a00c78c0 2024-05-08T19:22:05.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f159e7fc700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15a00c78c0 0x7f15a006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:05.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f159effd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15a00c74e0 0x7f15a0070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:05.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f159effd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15a00c74e0 0x7f15a0070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50428/0 (socket says 172.21.15.177:50428) 2024-05-08T19:22:05.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f159e7fc700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15a00c78c0 0x7f15a006ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:38148/0 (socket says 172.21.15.177:38148) 2024-05-08T19:22:05.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f159effd700 1 -- 172.21.15.177:0/3075305073 learned_addr learned my addr 172.21.15.177:0/3075305073 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-05-08T19:22:05.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f159f7fe700 1 --2- 172.21.15.177:0/3075305073 >> v2:172.21.15.47:3300/0 conn(0x7f15a00c46c0 0x7f15a00c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:05.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f159effd700 1 -- 172.21.15.177:0/3075305073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15a00c78c0 msgr2=0x7f15a006ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:05.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f159effd700 1 --2- 172.21.15.177:0/3075305073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15a00c78c0 0x7f15a006ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f159effd700 1 -- 172.21.15.177:0/3075305073 >> v2:172.21.15.47:3300/0 conn(0x7f15a00c46c0 msgr2=0x7f15a00c2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:05.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f159effd700 1 --2- 172.21.15.177:0/3075305073 >> v2:172.21.15.47:3300/0 conn(0x7f15a00c46c0 0x7f15a00c2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f159effd700 1 -- 172.21.15.177:0/3075305073 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a006eaf0 con 0x7f15a00c74e0 2024-05-08T19:22:05.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.607+0000 7f159effd700 1 --2- 172.21.15.177:0/3075305073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a00c74e0 0x7f15a0070d10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f15a0074470 tx=0x7f159000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b33634e60abfc180 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:05.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.608+0000 7f159dffb700 1 -- 172.21.15.177:0/3075305073 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159000e070 con 0x7f15a00c74e0 2024-05-08T19:22:05.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.608+0000 7f159dffb700 1 -- 172.21.15.177:0/3075305073 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159000b910 con 0x7f15a00c74e0 2024-05-08T19:22:05.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.608+0000 7f159dffb700 1 -- 172.21.15.177:0/3075305073 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159000bcc0 con 0x7f15a00c74e0 2024-05-08T19:22:05.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.608+0000 7f15a533d700 1 -- 172.21.15.177:0/3075305073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a00c74e0 msgr2=0x7f15a0070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:05.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.608+0000 7f15a533d700 1 --2- 172.21.15.177:0/3075305073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a00c74e0 0x7f15a0070d10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f15a0074470 tx=0x7f159000b330 comp rx=0 tx=0).stop 2024-05-08T19:22:05.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.608+0000 7f15a533d700 1 -- 172.21.15.177:0/3075305073 shutdown_connections 2024-05-08T19:22:05.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.608+0000 7f15a533d700 1 --2- 172.21.15.177:0/3075305073 >> v2:172.21.15.47:3300/0 conn(0x7f15a00c46c0 0x7f15a00c2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.608+0000 7f15a533d700 1 --2- 172.21.15.177:0/3075305073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a00c74e0 0x7f15a0070d10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.608+0000 7f15a533d700 1 --2- 172.21.15.177:0/3075305073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15a00c78c0 0x7f15a006ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.608+0000 7f15a533d700 1 -- 172.21.15.177:0/3075305073 >> 172.21.15.177:0/3075305073 conn(0x7f15a00a9ea0 msgr2=0x7f15a00aa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:05.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.608+0000 7f15a533d700 1 -- 172.21.15.177:0/3075305073 shutdown_connections 2024-05-08T19:22:05.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.608+0000 7f15a533d700 1 -- 172.21.15.177:0/3075305073 wait complete. 2024-05-08T19:22:05.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.610+0000 7f15a533d700 1 Processor -- start 2024-05-08T19:22:05.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.610+0000 7f15a533d700 1 -- start start 2024-05-08T19:22:05.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.610+0000 7f15a533d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15a00c46c0 0x7f15a0153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:05.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.610+0000 7f15a533d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a00c74e0 0x7f15a00ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:05.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.610+0000 7f15a533d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a00c78c0 0x7f15a0148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:05.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.610+0000 7f15a533d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a01ebdb0 con 0x7f15a00c74e0 2024-05-08T19:22:05.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.610+0000 7f15a533d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a014db50 con 0x7f15a00c78c0 2024-05-08T19:22:05.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.610+0000 7f15a533d700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a01ec240 con 0x7f15a00c46c0 2024-05-08T19:22:05.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.610+0000 7f159effd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15a00c46c0 0x7f15a0153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:05.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.610+0000 7f159f7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a00c78c0 0x7f15a0148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:05.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.610+0000 7f159effd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15a00c46c0 0x7f15a0153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:38158/0 (socket says 172.21.15.177:38158) 2024-05-08T19:22:05.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.610+0000 7f159effd700 1 -- 172.21.15.177:0/1046560281 learned_addr learned my addr 172.21.15.177:0/1046560281 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-05-08T19:22:05.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.610+0000 7f159e7fc700 1 --2- 172.21.15.177:0/1046560281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a00c74e0 0x7f15a00ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:05.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.611+0000 7f159effd700 1 -- 172.21.15.177:0/1046560281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a00c78c0 msgr2=0x7f15a0148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:05.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.611+0000 7f159effd700 1 --2- 172.21.15.177:0/1046560281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a00c78c0 0x7f15a0148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.611+0000 7f159effd700 1 -- 172.21.15.177:0/1046560281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a00c74e0 msgr2=0x7f15a00ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:05.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.611+0000 7f159effd700 1 --2- 172.21.15.177:0/1046560281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a00c74e0 0x7f15a00ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.611+0000 7f159effd700 1 -- 172.21.15.177:0/1046560281 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1590009b30 con 0x7f15a00c46c0 2024-05-08T19:22:05.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.611+0000 7f159f7fe700 1 --2- 172.21.15.177:0/1046560281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a00c78c0 0x7f15a0148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:05.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.611+0000 7f159effd700 1 --2- 172.21.15.177:0/1046560281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15a00c46c0 0x7f15a0153d20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f159000b370 tx=0x7f1590004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:05.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.611+0000 7f15977fe700 1 -- 172.21.15.177:0/1046560281 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15900092e0 con 0x7f15a00c46c0 2024-05-08T19:22:05.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.611+0000 7f15977fe700 1 -- 172.21.15.177:0/1046560281 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1590004250 con 0x7f15a00c46c0 2024-05-08T19:22:05.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.611+0000 7f15977fe700 1 -- 172.21.15.177:0/1046560281 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590004620 con 0x7f15a00c46c0 2024-05-08T19:22:05.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.611+0000 7f15a533d700 1 -- 172.21.15.177:0/1046560281 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a01eb480 con 0x7f15a00c46c0 2024-05-08T19:22:05.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.611+0000 7f15a533d700 1 -- 172.21.15.177:0/1046560281 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a01eba40 con 0x7f15a00c46c0 2024-05-08T19:22:05.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.611+0000 7f15977fe700 1 -- 172.21.15.177:0/1046560281 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f159001c440 con 0x7f15a00c46c0 2024-05-08T19:22:05.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.611+0000 7f15977fe700 1 -- 172.21.15.177:0/1046560281 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1590025750 con 0x7f15a00c46c0 2024-05-08T19:22:05.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.612+0000 7f15a533d700 1 -- 172.21.15.177:0/1046560281 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a01ebbd0 con 0x7f15a00c46c0 2024-05-08T19:22:05.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.614+0000 7f15977fe700 1 -- 172.21.15.177:0/1046560281 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f1590020030 con 0x7f15a00c46c0 2024-05-08T19:22:05.641 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:05.648+0000 7f4db5ff9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T19:22:05.652 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:05.659+0000 7fc1e8b05200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T19:22:05.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.699+0000 7f15a533d700 1 -- 172.21.15.177:0/1046560281 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ae9558d2-ca2c-4353-9301-2d6c9b86d611", "id": 0} v 0) v1 -- 0x7f15a004ec60 con 0x7f15a00c46c0 2024-05-08T19:22:05.695 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.703+0000 7f15977fe700 1 -- 172.21.15.177:0/1046560281 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ae9558d2-ca2c-4353-9301-2d6c9b86d611", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f15900330b0 con 0x7f15a00c46c0 2024-05-08T19:22:05.695 INFO:teuthology.orchestra.run.smithi177.stdout:0 2024-05-08T19:22:05.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.703+0000 7f15a533d700 1 -- 172.21.15.177:0/1046560281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15a00c46c0 msgr2=0x7f15a0153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:05.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.703+0000 7f15a533d700 1 --2- 172.21.15.177:0/1046560281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15a00c46c0 0x7f15a0153d20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f159000b370 tx=0x7f1590004ad0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.704+0000 7f15a533d700 1 -- 172.21.15.177:0/1046560281 shutdown_connections 2024-05-08T19:22:05.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.704+0000 7f15a533d700 1 --2- 172.21.15.177:0/1046560281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a00c78c0 0x7f15a0148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.704+0000 7f15a533d700 1 --2- 172.21.15.177:0/1046560281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15a00c46c0 0x7f15a0153d20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.704+0000 7f15a533d700 1 --2- 172.21.15.177:0/1046560281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a00c74e0 0x7f15a00ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.704+0000 7f15a533d700 1 -- 172.21.15.177:0/1046560281 >> 172.21.15.177:0/1046560281 conn(0x7f15a00a9ea0 msgr2=0x7f15a0073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:05.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.704+0000 7f15a533d700 1 -- 172.21.15.177:0/1046560281 shutdown_connections 2024-05-08T19:22:05.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.704+0000 7f15a533d700 1 -- 172.21.15.177:0/1046560281 wait complete. 2024-05-08T19:22:05.708 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new c1307abe-84aa-4318-a7ac-ab160837cdc7 1 2024-05-08T19:22:05.715 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:05.723+0000 7f4db5ff9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T19:22:05.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.839+0000 7f122439d700 1 Processor -- start 2024-05-08T19:22:05.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.839+0000 7f122439d700 1 -- start start 2024-05-08T19:22:05.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.840+0000 7f122439d700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f121c071e00 0x7f121c151da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:05.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.840+0000 7f122439d700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121c072250 con 0x7f121c0c37f0 2024-05-08T19:22:05.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.840+0000 7f122439d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121c155830 con 0x7f121c14ebe0 2024-05-08T19:22:05.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.840+0000 7f122439d700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121c0c1c60 con 0x7f121c071e00 2024-05-08T19:22:05.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.840+0000 7f1222139700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f121c14ebe0 0x7f121c0716f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:43328/0 (socket says 172.21.15.177:43328) 2024-05-08T19:22:05.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.840+0000 7f1222139700 1 -- 172.21.15.177:0/3184760761 learned_addr learned my addr 172.21.15.177:0/3184760761 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-05-08T19:22:05.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.840+0000 7f122293a700 1 --2- 172.21.15.177:0/3184760761 >> v2:172.21.15.47:3300/0 conn(0x7f121c071e00 0x7f121c151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:05.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.841+0000 7f1221137700 1 -- 172.21.15.177:0/3184760761 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817847734 0 0) 0x7f121c155830 con 0x7f121c14ebe0 2024-05-08T19:22:05.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.841+0000 7f1221137700 1 -- 172.21.15.177:0/3184760761 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12080035b0 con 0x7f121c14ebe0 2024-05-08T19:22:05.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.841+0000 7f1221137700 1 -- 172.21.15.177:0/3184760761 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628101598 0 0) 0x7f121c072250 con 0x7f121c0c37f0 2024-05-08T19:22:05.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.841+0000 7f1221137700 1 -- 172.21.15.177:0/3184760761 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f121c155830 con 0x7f121c0c37f0 2024-05-08T19:22:05.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.841+0000 7f122293a700 1 -- 172.21.15.177:0/3184760761 >> v1:172.21.15.177:6789/0 conn(0x7f121c14ebe0 legacy=0x7f121c0716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:05.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.841+0000 7f122293a700 1 -- 172.21.15.177:0/3184760761 >> v1:172.21.15.47:6789/0 conn(0x7f121c0c37f0 legacy=0x7f121c151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:05.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.841+0000 7f122293a700 1 -- 172.21.15.177:0/3184760761 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c072bc0 con 0x7f121c071e00 2024-05-08T19:22:05.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.841+0000 7f122293a700 1 --2- 172.21.15.177:0/3184760761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f121c071e00 0x7f121c151da0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1214009d90 tx=0x7f121400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe45a3cd22f758dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:05.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.841+0000 7f1221137700 1 -- 172.21.15.177:0/3184760761 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121400e070 con 0x7f121c071e00 2024-05-08T19:22:05.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.841+0000 7f1221137700 1 -- 172.21.15.177:0/3184760761 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121400bb20 con 0x7f121c071e00 2024-05-08T19:22:05.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.841+0000 7f1221137700 1 -- 172.21.15.177:0/3184760761 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214012430 con 0x7f121c071e00 2024-05-08T19:22:05.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.842+0000 7f122439d700 1 -- 172.21.15.177:0/3184760761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f121c071e00 msgr2=0x7f121c151da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:05.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.842+0000 7f122439d700 1 --2- 172.21.15.177:0/3184760761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f121c071e00 0x7f121c151da0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1214009d90 tx=0x7f121400b330 comp rx=0 tx=0).stop 2024-05-08T19:22:05.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.842+0000 7f122439d700 1 -- 172.21.15.177:0/3184760761 shutdown_connections 2024-05-08T19:22:05.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.842+0000 7f122439d700 1 --2- 172.21.15.177:0/3184760761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f121c071e00 0x7f121c151da0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.842+0000 7f122439d700 1 -- 172.21.15.177:0/3184760761 >> 172.21.15.177:0/3184760761 conn(0x7f121c0c71c0 msgr2=0x7f121c0c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:05.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.842+0000 7f122439d700 1 -- 172.21.15.177:0/3184760761 shutdown_connections 2024-05-08T19:22:05.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.842+0000 7f122439d700 1 -- 172.21.15.177:0/3184760761 wait complete. 2024-05-08T19:22:05.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.843+0000 7f122439d700 1 Processor -- start 2024-05-08T19:22:05.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.843+0000 7f122439d700 1 -- start start 2024-05-08T19:22:05.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f122439d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f121c071e00 0x7f121c14ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:05.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f122439d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f121c0c37f0 0x7f121c0bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:05.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f122439d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f121c14ebe0 0x7f121c0c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:05.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f122439d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c0ac270 con 0x7f121c071e00 2024-05-08T19:22:05.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f122439d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c153a10 con 0x7f121c0c37f0 2024-05-08T19:22:05.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f122439d700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c0c0d60 con 0x7f121c14ebe0 2024-05-08T19:22:05.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f1221938700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f121c0c37f0 0x7f121c0bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:05.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f122293a700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f121c14ebe0 0x7f121c0c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:05.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f1221938700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f121c0c37f0 0x7f121c0bfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50446/0 (socket says 172.21.15.177:50446) 2024-05-08T19:22:05.844 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f1221938700 1 -- 172.21.15.177:0/3950981339 learned_addr learned my addr 172.21.15.177:0/3950981339 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-05-08T19:22:05.844 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f1222139700 1 --2- 172.21.15.177:0/3950981339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f121c071e00 0x7f121c14ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:05.844 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f1221938700 1 -- 172.21.15.177:0/3950981339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f121c14ebe0 msgr2=0x7f121c0c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:05.844 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f1221938700 1 --2- 172.21.15.177:0/3950981339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f121c14ebe0 0x7f121c0c03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.844 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f1221938700 1 -- 172.21.15.177:0/3950981339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f121c071e00 msgr2=0x7f121c14ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:05.844 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f1221938700 1 --2- 172.21.15.177:0/3950981339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f121c071e00 0x7f121c14ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.844 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f1221938700 1 -- 172.21.15.177:0/3950981339 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1214009a70 con 0x7f121c0c37f0 2024-05-08T19:22:05.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f122293a700 1 --2- 172.21.15.177:0/3950981339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f121c14ebe0 0x7f121c0c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:05.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f1221938700 1 --2- 172.21.15.177:0/3950981339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f121c0c37f0 0x7f121c0bfeb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f120c00c520 tx=0x7f120c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:05.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f1212ffd700 1 -- 172.21.15.177:0/3950981339 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c0052d0 con 0x7f121c0c37f0 2024-05-08T19:22:05.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f1212ffd700 1 -- 172.21.15.177:0/3950981339 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c005430 con 0x7f121c0c37f0 2024-05-08T19:22:05.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f122439d700 1 -- 172.21.15.177:0/3950981339 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f121c14f140 con 0x7f121c0c37f0 2024-05-08T19:22:05.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f1212ffd700 1 -- 172.21.15.177:0/3950981339 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c0038c0 con 0x7f121c0c37f0 2024-05-08T19:22:05.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.844+0000 7f122439d700 1 -- 172.21.15.177:0/3950981339 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121c14d200 con 0x7f121c0c37f0 2024-05-08T19:22:05.846 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.845+0000 7f1212ffd700 1 -- 172.21.15.177:0/3950981339 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f120c003d20 con 0x7f121c0c37f0 2024-05-08T19:22:05.846 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.845+0000 7f1212ffd700 1 -- 172.21.15.177:0/3950981339 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f120c01c440 con 0x7f121c0c37f0 2024-05-08T19:22:05.846 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.845+0000 7f122439d700 1 -- 172.21.15.177:0/3950981339 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121c0c1280 con 0x7f121c0c37f0 2024-05-08T19:22:05.846 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.847+0000 7f1212ffd700 1 -- 172.21.15.177:0/3950981339 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f121c0c1280 con 0x7f121c0c37f0 2024-05-08T19:22:05.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.933+0000 7f122439d700 1 -- 172.21.15.177:0/3950981339 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c1307abe-84aa-4318-a7ac-ab160837cdc7", "id": 1} v 0) v1 -- 0x7f121c04ec60 con 0x7f121c0c37f0 2024-05-08T19:22:05.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.936+0000 7f1212ffd700 1 -- 172.21.15.177:0/3950981339 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1307abe-84aa-4318-a7ac-ab160837cdc7", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f120c017070 con 0x7f121c0c37f0 2024-05-08T19:22:05.928 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-05-08T19:22:05.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.937+0000 7f122439d700 1 -- 172.21.15.177:0/3950981339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f121c0c37f0 msgr2=0x7f121c0bfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:05.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.937+0000 7f122439d700 1 --2- 172.21.15.177:0/3950981339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f121c0c37f0 0x7f121c0bfeb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f120c00c520 tx=0x7f120c00c830 comp rx=0 tx=0).stop 2024-05-08T19:22:05.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.937+0000 7f122439d700 1 -- 172.21.15.177:0/3950981339 shutdown_connections 2024-05-08T19:22:05.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.937+0000 7f122439d700 1 --2- 172.21.15.177:0/3950981339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f121c071e00 0x7f121c14ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.937+0000 7f122439d700 1 --2- 172.21.15.177:0/3950981339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f121c14ebe0 0x7f121c0c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.937+0000 7f122439d700 1 --2- 172.21.15.177:0/3950981339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f121c0c37f0 0x7f121c0bfeb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:05.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.937+0000 7f122439d700 1 -- 172.21.15.177:0/3950981339 >> 172.21.15.177:0/3950981339 conn(0x7f121c0c71c0 msgr2=0x7f121c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:05.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.937+0000 7f122439d700 1 -- 172.21.15.177:0/3950981339 shutdown_connections 2024-05-08T19:22:05.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:05.937+0000 7f122439d700 1 -- 172.21.15.177:0/3950981339 wait complete. 2024-05-08T19:22:05.941 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b 2 2024-05-08T19:22:06.050 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:06.058+0000 7fc1e8b05200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T19:22:06.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.071+0000 7f2ba45b3700 1 Processor -- start 2024-05-08T19:22:06.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.071+0000 7f2ba45b3700 1 -- start start 2024-05-08T19:22:06.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.072+0000 7f2ba45b3700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2b9c0c36b0 0x7f2b9c14b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.072+0000 7f2ba45b3700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2b9c14bb30 0x7f2b9c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.072+0000 7f2ba45b3700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9c0c2030 con 0x7f2b9c071910 2024-05-08T19:22:06.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.072+0000 7f2ba45b3700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b9c072400 con 0x7f2b9c14bb30 2024-05-08T19:22:06.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.072+0000 7f2ba45b3700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b9c152230 con 0x7f2b9c0c36b0 2024-05-08T19:22:06.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.072+0000 7f2ba1b4e700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2b9c0c36b0 0x7f2b9c14b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.072+0000 7f2ba234f700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f2b9c071910 0x7f2b9c071cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:43340/0 (socket says 172.21.15.177:43340) 2024-05-08T19:22:06.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.072+0000 7f2ba234f700 1 -- 172.21.15.177:0/662379517 learned_addr learned my addr 172.21.15.177:0/662379517 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-05-08T19:22:06.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.072+0000 7f2ba2b50700 1 --2- 172.21.15.177:0/662379517 >> v2:172.21.15.47:3300/0 conn(0x7f2b9c14bb30 0x7f2b9c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.073+0000 7f2ba1b4e700 1 -- 172.21.15.177:0/662379517 >> v2:172.21.15.47:3300/0 conn(0x7f2b9c14bb30 msgr2=0x7f2b9c06e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:06.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.073+0000 7f2ba1b4e700 1 --2- 172.21.15.177:0/662379517 >> v2:172.21.15.47:3300/0 conn(0x7f2b9c14bb30 0x7f2b9c06e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.073+0000 7f2ba1b4e700 1 -- 172.21.15.177:0/662379517 >> v1:172.21.15.177:6789/0 conn(0x7f2b9c071910 legacy=0x7f2b9c071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.073+0000 7f2ba1b4e700 1 -- 172.21.15.177:0/662379517 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c152510 con 0x7f2b9c0c36b0 2024-05-08T19:22:06.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.073+0000 7f2ba1b4e700 1 --2- 172.21.15.177:0/662379517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9c0c36b0 0x7f2b9c14b5f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0c4c30 tx=0x7f2b8c009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d3aa62f360020ee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:06.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.073+0000 7f2ba134d700 1 -- 172.21.15.177:0/662379517 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c011830 con 0x7f2b9c0c36b0 2024-05-08T19:22:06.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.073+0000 7f2ba134d700 1 -- 172.21.15.177:0/662379517 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c011990 con 0x7f2b9c0c36b0 2024-05-08T19:22:06.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.073+0000 7f2ba134d700 1 -- 172.21.15.177:0/662379517 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c011d20 con 0x7f2b9c0c36b0 2024-05-08T19:22:06.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.074+0000 7f2ba45b3700 1 -- 172.21.15.177:0/662379517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9c0c36b0 msgr2=0x7f2b9c14b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.074+0000 7f2ba45b3700 1 --2- 172.21.15.177:0/662379517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9c0c36b0 0x7f2b9c14b5f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0c4c30 tx=0x7f2b8c009b20 comp rx=0 tx=0).stop 2024-05-08T19:22:06.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.074+0000 7f2ba45b3700 1 -- 172.21.15.177:0/662379517 shutdown_connections 2024-05-08T19:22:06.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.074+0000 7f2ba45b3700 1 --2- 172.21.15.177:0/662379517 >> v2:172.21.15.47:3300/0 conn(0x7f2b9c14bb30 0x7f2b9c06e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.074+0000 7f2ba45b3700 1 --2- 172.21.15.177:0/662379517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9c0c36b0 0x7f2b9c14b5f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.074+0000 7f2ba45b3700 1 -- 172.21.15.177:0/662379517 >> 172.21.15.177:0/662379517 conn(0x7f2b9c0c7120 msgr2=0x7f2b9c0c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:06.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.074+0000 7f2ba45b3700 1 -- 172.21.15.177:0/662379517 shutdown_connections 2024-05-08T19:22:06.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.074+0000 7f2ba45b3700 1 -- 172.21.15.177:0/662379517 wait complete. 2024-05-08T19:22:06.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.075+0000 7f2ba45b3700 1 Processor -- start 2024-05-08T19:22:06.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.075+0000 7f2ba45b3700 1 -- start start 2024-05-08T19:22:06.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.075+0000 7f2ba45b3700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9c071910 0x7f2b9c148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.075+0000 7f2ba45b3700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b9c0c36b0 0x7f2b9c150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.075+0000 7f2ba45b3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b9c14bb30 0x7f2b9c1ed3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.075+0000 7f2ba45b3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c153a60 con 0x7f2b9c14bb30 2024-05-08T19:22:06.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba45b3700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c1ea830 con 0x7f2b9c071910 2024-05-08T19:22:06.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba45b3700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c14f130 con 0x7f2b9c0c36b0 2024-05-08T19:22:06.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba234f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9c071910 0x7f2b9c148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba1b4e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b9c0c36b0 0x7f2b9c150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba1b4e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b9c0c36b0 0x7f2b9c150db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:38182/0 (socket says 172.21.15.177:38182) 2024-05-08T19:22:06.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba1b4e700 1 -- 172.21.15.177:0/3821878759 learned_addr learned my addr 172.21.15.177:0/3821878759 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-05-08T19:22:06.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba234f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9c071910 0x7f2b9c148320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50464/0 (socket says 172.21.15.177:50464) 2024-05-08T19:22:06.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba2b50700 1 --2- 172.21.15.177:0/3821878759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b9c14bb30 0x7f2b9c1ed3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba234f700 1 -- 172.21.15.177:0/3821878759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b9c0c36b0 msgr2=0x7f2b9c150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba234f700 1 --2- 172.21.15.177:0/3821878759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b9c0c36b0 0x7f2b9c150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba234f700 1 -- 172.21.15.177:0/3821878759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b9c14bb30 msgr2=0x7f2b9c1ed3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba234f700 1 --2- 172.21.15.177:0/3821878759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b9c14bb30 0x7f2b9c1ed3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba234f700 1 -- 172.21.15.177:0/3821878759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c0094a0 con 0x7f2b9c071910 2024-05-08T19:22:06.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba1b4e700 1 --2- 172.21.15.177:0/3821878759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b9c0c36b0 0x7f2b9c150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:06.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba234f700 1 --2- 172.21.15.177:0/3821878759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9c071910 0x7f2b9c148320 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800c530 tx=0x7f2b9800c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:06.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2b92ffd700 1 -- 172.21.15.177:0/3821878759 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9800cea0 con 0x7f2b9c071910 2024-05-08T19:22:06.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2b92ffd700 1 -- 172.21.15.177:0/3821878759 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b98005d70 con 0x7f2b9c071910 2024-05-08T19:22:06.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba45b3700 1 -- 172.21.15.177:0/3821878759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9c151600 con 0x7f2b9c071910 2024-05-08T19:22:06.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2b92ffd700 1 -- 172.21.15.177:0/3821878759 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b980072d0 con 0x7f2b9c071910 2024-05-08T19:22:06.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2ba45b3700 1 -- 172.21.15.177:0/3821878759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9c1ea1e0 con 0x7f2b9c071910 2024-05-08T19:22:06.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2b92ffd700 1 -- 172.21.15.177:0/3821878759 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f2b9801c440 con 0x7f2b9c071910 2024-05-08T19:22:06.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.076+0000 7f2b92ffd700 1 -- 172.21.15.177:0/3821878759 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f2b98007730 con 0x7f2b9c071910 2024-05-08T19:22:06.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.077+0000 7f2ba45b3700 1 -- 172.21.15.177:0/3821878759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9c067190 con 0x7f2b9c071910 2024-05-08T19:22:06.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.079+0000 7f2b92ffd700 1 -- 172.21.15.177:0/3821878759 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f2b98021060 con 0x7f2b9c071910 2024-05-08T19:22:06.109 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:06.117+0000 7f4db5ff9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T19:22:06.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.165+0000 7f2ba45b3700 1 -- 172.21.15.177:0/3821878759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b", "id": 2} v 0) v1 -- 0x7f2b9c04ec60 con 0x7f2b9c071910 2024-05-08T19:22:06.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.168+0000 7f2b92ffd700 1 -- 172.21.15.177:0/3821878759 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2b98017070 con 0x7f2b9c071910 2024-05-08T19:22:06.160 INFO:teuthology.orchestra.run.smithi177.stdout:2 2024-05-08T19:22:06.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.169+0000 7f2ba45b3700 1 -- 172.21.15.177:0/3821878759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9c071910 msgr2=0x7f2b9c148320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.169+0000 7f2ba45b3700 1 --2- 172.21.15.177:0/3821878759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9c071910 0x7f2b9c148320 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800c530 tx=0x7f2b9800c840 comp rx=0 tx=0).stop 2024-05-08T19:22:06.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.169+0000 7f2ba45b3700 1 -- 172.21.15.177:0/3821878759 shutdown_connections 2024-05-08T19:22:06.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.169+0000 7f2ba45b3700 1 --2- 172.21.15.177:0/3821878759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b9c14bb30 0x7f2b9c1ed3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.169+0000 7f2ba45b3700 1 --2- 172.21.15.177:0/3821878759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9c071910 0x7f2b9c148320 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.169+0000 7f2ba45b3700 1 --2- 172.21.15.177:0/3821878759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b9c0c36b0 0x7f2b9c150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.169+0000 7f2ba45b3700 1 -- 172.21.15.177:0/3821878759 >> 172.21.15.177:0/3821878759 conn(0x7f2b9c0c7120 msgr2=0x7f2b9c06b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:06.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.169+0000 7f2ba45b3700 1 -- 172.21.15.177:0/3821878759 shutdown_connections 2024-05-08T19:22:06.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.169+0000 7f2ba45b3700 1 -- 172.21.15.177:0/3821878759 wait complete. 2024-05-08T19:22:06.174 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 1ce4b524-8dff-4475-a125-996e3ff9605c 3 2024-05-08T19:22:06.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.304+0000 7fc2f6eca700 1 Processor -- start 2024-05-08T19:22:06.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.304+0000 7fc2f6eca700 1 -- start start 2024-05-08T19:22:06.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.304+0000 7fc2f6eca700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc2f014ebe0 0x7fc2f00716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.304+0000 7fc2f6eca700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc2f00c37f0 0x7fc2f0071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.304+0000 7fc2f6eca700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f0151690 0x7fc2f0151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.304+0000 7fc2f6eca700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f0155830 con 0x7fc2f00c37f0 2024-05-08T19:22:06.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.304+0000 7fc2f6eca700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f00c1c60 con 0x7fc2f014ebe0 2024-05-08T19:22:06.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.304+0000 7fc2f6eca700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f0072bc0 con 0x7fc2f0151690 2024-05-08T19:22:06.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.304+0000 7fc2f4c66700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc2f014ebe0 0x7fc2f00716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.304+0000 7fc2f5467700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f0151690 0x7fc2f0151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.305+0000 7fc2f4c66700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc2f014ebe0 0x7fc2f00716f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50468/0 (socket says 172.21.15.177:50468) 2024-05-08T19:22:06.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.305+0000 7fc2f5467700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f0151690 0x7fc2f0151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:38198/0 (socket says 172.21.15.177:38198) 2024-05-08T19:22:06.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.305+0000 7fc2f4c66700 1 -- 172.21.15.177:0/1714257627 learned_addr learned my addr 172.21.15.177:0/1714257627 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-05-08T19:22:06.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.305+0000 7fc2effff700 1 --2- 172.21.15.177:0/1714257627 >> v2:172.21.15.47:3300/0 conn(0x7fc2f00c37f0 0x7fc2f0071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.305+0000 7fc2f5467700 1 -- 172.21.15.177:0/1714257627 >> v2:172.21.15.177:3300/0 conn(0x7fc2f014ebe0 msgr2=0x7fc2f00716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:06.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.305+0000 7fc2f5467700 1 --2- 172.21.15.177:0/1714257627 >> v2:172.21.15.177:3300/0 conn(0x7fc2f014ebe0 0x7fc2f00716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.305+0000 7fc2f5467700 1 -- 172.21.15.177:0/1714257627 >> v2:172.21.15.47:3300/0 conn(0x7fc2f00c37f0 msgr2=0x7fc2f0071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:06.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.305+0000 7fc2f5467700 1 --2- 172.21.15.177:0/1714257627 >> v2:172.21.15.47:3300/0 conn(0x7fc2f00c37f0 0x7fc2f0071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.305+0000 7fc2f5467700 1 -- 172.21.15.177:0/1714257627 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f0155b10 con 0x7fc2f0151690 2024-05-08T19:22:06.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.305+0000 7fc2f4c66700 1 --2- 172.21.15.177:0/1714257627 >> v2:172.21.15.177:3300/0 conn(0x7fc2f014ebe0 0x7fc2f00716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:06.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.305+0000 7fc2f5467700 1 --2- 172.21.15.177:0/1714257627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f0151690 0x7fc2f0151b20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00c4d10 tx=0x7fc2e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b51ab6bc853e0ef2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:06.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.305+0000 7fc2ef7fe700 1 -- 172.21.15.177:0/1714257627 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e800e070 con 0x7fc2f0151690 2024-05-08T19:22:06.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.305+0000 7fc2ef7fe700 1 -- 172.21.15.177:0/1714257627 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e800bb20 con 0x7fc2f0151690 2024-05-08T19:22:06.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.305+0000 7fc2ef7fe700 1 -- 172.21.15.177:0/1714257627 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8012430 con 0x7fc2f0151690 2024-05-08T19:22:06.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.306+0000 7fc2f6eca700 1 -- 172.21.15.177:0/1714257627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f0151690 msgr2=0x7fc2f0151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.306+0000 7fc2f6eca700 1 --2- 172.21.15.177:0/1714257627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f0151690 0x7fc2f0151b20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00c4d10 tx=0x7fc2e800b330 comp rx=0 tx=0).stop 2024-05-08T19:22:06.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.306+0000 7fc2f6eca700 1 -- 172.21.15.177:0/1714257627 shutdown_connections 2024-05-08T19:22:06.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.306+0000 7fc2f6eca700 1 --2- 172.21.15.177:0/1714257627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f0151690 0x7fc2f0151b20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.306+0000 7fc2f6eca700 1 --2- 172.21.15.177:0/1714257627 >> v2:172.21.15.177:3300/0 conn(0x7fc2f014ebe0 0x7fc2f00716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.306+0000 7fc2f6eca700 1 --2- 172.21.15.177:0/1714257627 >> v2:172.21.15.47:3300/0 conn(0x7fc2f00c37f0 0x7fc2f0071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.306+0000 7fc2f6eca700 1 -- 172.21.15.177:0/1714257627 >> 172.21.15.177:0/1714257627 conn(0x7fc2f00c71c0 msgr2=0x7fc2f00c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:06.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.306+0000 7fc2f6eca700 1 -- 172.21.15.177:0/1714257627 shutdown_connections 2024-05-08T19:22:06.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.306+0000 7fc2f6eca700 1 -- 172.21.15.177:0/1714257627 wait complete. 2024-05-08T19:22:06.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.307+0000 7fc2f6eca700 1 Processor -- start 2024-05-08T19:22:06.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.307+0000 7fc2f6eca700 1 -- start start 2024-05-08T19:22:06.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2f6eca700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f00c37f0 0x7fc2f014a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2f6eca700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f014ebe0 0x7fc2f014beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2f6eca700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2f0151690 0x7fc2f013e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2f6eca700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f01e6470 con 0x7fc2f0151690 2024-05-08T19:22:06.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2f6eca700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f01e6750 con 0x7fc2f014ebe0 2024-05-08T19:22:06.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2f6eca700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f01e6a30 con 0x7fc2f00c37f0 2024-05-08T19:22:06.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2effff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f014ebe0 0x7fc2f014beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2f4c66700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f00c37f0 0x7fc2f014a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2effff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f014ebe0 0x7fc2f014beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50472/0 (socket says 172.21.15.177:50472) 2024-05-08T19:22:06.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2effff700 1 -- 172.21.15.177:0/2283671584 learned_addr learned my addr 172.21.15.177:0/2283671584 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-05-08T19:22:06.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2f5467700 1 --2- 172.21.15.177:0/2283671584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2f0151690 0x7fc2f013e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2effff700 1 -- 172.21.15.177:0/2283671584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f00c37f0 msgr2=0x7fc2f014a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2effff700 1 --2- 172.21.15.177:0/2283671584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f00c37f0 0x7fc2f014a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2effff700 1 -- 172.21.15.177:0/2283671584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2f0151690 msgr2=0x7fc2f013e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2effff700 1 --2- 172.21.15.177:0/2283671584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2f0151690 0x7fc2f013e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2effff700 1 -- 172.21.15.177:0/2283671584 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e400b7f0 con 0x7fc2f014ebe0 2024-05-08T19:22:06.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2f4c66700 1 --2- 172.21.15.177:0/2283671584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f00c37f0 0x7fc2f014a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:06.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.308+0000 7fc2effff700 1 --2- 172.21.15.177:0/2283671584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f014ebe0 0x7fc2f014beb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e930 tx=0x7fc2dc00ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:06.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.309+0000 7fc2ed7fa700 1 -- 172.21.15.177:0/2283671584 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc013680 con 0x7fc2f014ebe0 2024-05-08T19:22:06.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.309+0000 7fc2ed7fa700 1 -- 172.21.15.177:0/2283671584 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc0137e0 con 0x7fc2f014ebe0 2024-05-08T19:22:06.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.309+0000 7fc2f6eca700 1 -- 172.21.15.177:0/2283671584 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e8009a70 con 0x7fc2f014ebe0 2024-05-08T19:22:06.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.309+0000 7fc2ed7fa700 1 -- 172.21.15.177:0/2283671584 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc013b70 con 0x7fc2f014ebe0 2024-05-08T19:22:06.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.309+0000 7fc2f6eca700 1 -- 172.21.15.177:0/2283671584 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f014f140 con 0x7fc2f014ebe0 2024-05-08T19:22:06.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.309+0000 7fc2ed7fa700 1 -- 172.21.15.177:0/2283671584 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc2dc005a20 con 0x7fc2f014ebe0 2024-05-08T19:22:06.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.309+0000 7fc2ed7fa700 1 -- 172.21.15.177:0/2283671584 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fc2dc0066b0 con 0x7fc2f014ebe0 2024-05-08T19:22:06.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.310+0000 7fc2f6eca700 1 -- 172.21.15.177:0/2283671584 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f014e720 con 0x7fc2f014ebe0 2024-05-08T19:22:06.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.313+0000 7fc2ed7fa700 1 -- 172.21.15.177:0/2283671584 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fc2dc021060 con 0x7fc2f014ebe0 2024-05-08T19:22:06.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.397+0000 7fc2f6eca700 1 -- 172.21.15.177:0/2283671584 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ce4b524-8dff-4475-a125-996e3ff9605c", "id": 3} v 0) v1 -- 0x7fc2f00c3360 con 0x7fc2f014ebe0 2024-05-08T19:22:06.394 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:06.402+0000 7fc1e8b05200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T19:22:06.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.405+0000 7fc2ed7fa700 1 -- 172.21.15.177:0/2283671584 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ce4b524-8dff-4475-a125-996e3ff9605c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc2dc017070 con 0x7fc2f014ebe0 2024-05-08T19:22:06.398 INFO:teuthology.orchestra.run.smithi177.stdout:3 2024-05-08T19:22:06.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.406+0000 7fc2f6eca700 1 -- 172.21.15.177:0/2283671584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f014ebe0 msgr2=0x7fc2f014beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.406+0000 7fc2f6eca700 1 --2- 172.21.15.177:0/2283671584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f014ebe0 0x7fc2f014beb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e930 tx=0x7fc2dc00ec40 comp rx=0 tx=0).stop 2024-05-08T19:22:06.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.406+0000 7fc2f6eca700 1 -- 172.21.15.177:0/2283671584 shutdown_connections 2024-05-08T19:22:06.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.406+0000 7fc2f6eca700 1 --2- 172.21.15.177:0/2283671584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2f0151690 0x7fc2f013e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.406+0000 7fc2f6eca700 1 --2- 172.21.15.177:0/2283671584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f00c37f0 0x7fc2f014a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.406+0000 7fc2f6eca700 1 --2- 172.21.15.177:0/2283671584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f014ebe0 0x7fc2f014beb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.406+0000 7fc2f6eca700 1 -- 172.21.15.177:0/2283671584 >> 172.21.15.177:0/2283671584 conn(0x7fc2f00c71c0 msgr2=0x7fc2f0154fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:06.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.406+0000 7fc2f6eca700 1 -- 172.21.15.177:0/2283671584 shutdown_connections 2024-05-08T19:22:06.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.406+0000 7fc2f6eca700 1 -- 172.21.15.177:0/2283671584 wait complete. 2024-05-08T19:22:06.411 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 07369d33-83c0-41d5-92f1-fabe56b1dcea 4 2024-05-08T19:22:06.451 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:06.459+0000 7f4db5ff9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T19:22:06.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.540+0000 7f928588f700 1 Processor -- start 2024-05-08T19:22:06.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.541+0000 7f928588f700 1 -- start start 2024-05-08T19:22:06.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.541+0000 7f928588f700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f92801554f0 0x7f928006edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.541+0000 7f928588f700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92800716a0 con 0x7f9280152130 2024-05-08T19:22:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.541+0000 7f928588f700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9280155980 con 0x7f92800c0770 2024-05-08T19:22:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.541+0000 7f928588f700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92800c3a40 con 0x7f92801554f0 2024-05-08T19:22:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.541+0000 7f927e7fc700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f92800c0770 0x7f928006e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:43348/0 (socket says 172.21.15.177:43348) 2024-05-08T19:22:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.541+0000 7f927e7fc700 1 -- 172.21.15.177:0/194760666 learned_addr learned my addr 172.21.15.177:0/194760666 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-05-08T19:22:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.541+0000 7f927f7fe700 1 --2- 172.21.15.177:0/194760666 >> v2:172.21.15.47:3300/0 conn(0x7f92801554f0 0x7f928006edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.542+0000 7f927dffb700 1 -- 172.21.15.177:0/194760666 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358239747 0 0) 0x7f9280155980 con 0x7f92800c0770 2024-05-08T19:22:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.542+0000 7f927dffb700 1 -- 172.21.15.177:0/194760666 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92680035b0 con 0x7f92800c0770 2024-05-08T19:22:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.542+0000 7f927dffb700 1 -- 172.21.15.177:0/194760666 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430859577 0 0) 0x7f92800716a0 con 0x7f9280152130 2024-05-08T19:22:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.542+0000 7f927dffb700 1 -- 172.21.15.177:0/194760666 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9280155980 con 0x7f9280152130 2024-05-08T19:22:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.542+0000 7f927dffb700 1 -- 172.21.15.177:0/194760666 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1688000878 0 0) 0x7f92680035b0 con 0x7f92800c0770 2024-05-08T19:22:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.542+0000 7f927f7fe700 1 -- 172.21.15.177:0/194760666 >> v1:172.21.15.177:6789/0 conn(0x7f92800c0770 legacy=0x7f928006e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.542+0000 7f927f7fe700 1 -- 172.21.15.177:0/194760666 >> v1:172.21.15.47:6789/0 conn(0x7f9280152130 legacy=0x7f9280154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.542+0000 7f927f7fe700 1 -- 172.21.15.177:0/194760666 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92800c11f0 con 0x7f92801554f0 2024-05-08T19:22:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.542+0000 7f927f7fe700 1 --2- 172.21.15.177:0/194760666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92801554f0 0x7f928006edf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9278009d90 tx=0x7f927800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42de7fa42fa31c98 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:06.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.542+0000 7f927dffb700 1 -- 172.21.15.177:0/194760666 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927800e070 con 0x7f92801554f0 2024-05-08T19:22:06.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.542+0000 7f927dffb700 1 -- 172.21.15.177:0/194760666 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9278003a20 con 0x7f92801554f0 2024-05-08T19:22:06.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.542+0000 7f927dffb700 1 -- 172.21.15.177:0/194760666 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9274001670 con 0x7f92801554f0 2024-05-08T19:22:06.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.543+0000 7f928588f700 1 -- 172.21.15.177:0/194760666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92801554f0 msgr2=0x7f928006edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.543+0000 7f928588f700 1 --2- 172.21.15.177:0/194760666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92801554f0 0x7f928006edf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9278009d90 tx=0x7f927800b330 comp rx=0 tx=0).stop 2024-05-08T19:22:06.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.543+0000 7f928588f700 1 -- 172.21.15.177:0/194760666 shutdown_connections 2024-05-08T19:22:06.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.543+0000 7f928588f700 1 --2- 172.21.15.177:0/194760666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92801554f0 0x7f928006edf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.543+0000 7f928588f700 1 -- 172.21.15.177:0/194760666 >> 172.21.15.177:0/194760666 conn(0x7f92800c7120 msgr2=0x7f92800c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:06.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.543+0000 7f928588f700 1 -- 172.21.15.177:0/194760666 shutdown_connections 2024-05-08T19:22:06.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.543+0000 7f928588f700 1 -- 172.21.15.177:0/194760666 wait complete. 2024-05-08T19:22:06.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.544+0000 7f928588f700 1 Processor -- start 2024-05-08T19:22:06.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.544+0000 7f928588f700 1 -- start start 2024-05-08T19:22:06.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f928588f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92800c0770 0x7f928014cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f928588f700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9280152130 0x7f92801e72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f928588f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92801554f0 0x7f92801e77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f928588f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92801e7d30 con 0x7f92801554f0 2024-05-08T19:22:06.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f928588f700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9280148ae0 con 0x7f92800c0770 2024-05-08T19:22:06.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f928588f700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9280152e00 con 0x7f9280152130 2024-05-08T19:22:06.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f927effd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92800c0770 0x7f928014cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f927e7fc700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9280152130 0x7f92801e72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f927e7fc700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9280152130 0x7f92801e72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:38218/0 (socket says 172.21.15.177:38218) 2024-05-08T19:22:06.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f927effd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92800c0770 0x7f928014cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50482/0 (socket says 172.21.15.177:50482) 2024-05-08T19:22:06.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f927e7fc700 1 -- 172.21.15.177:0/2159987682 learned_addr learned my addr 172.21.15.177:0/2159987682 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-05-08T19:22:06.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f927f7fe700 1 --2- 172.21.15.177:0/2159987682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92801554f0 0x7f92801e77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f927effd700 1 -- 172.21.15.177:0/2159987682 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9280152130 msgr2=0x7f92801e72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f927effd700 1 --2- 172.21.15.177:0/2159987682 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9280152130 0x7f92801e72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f927effd700 1 -- 172.21.15.177:0/2159987682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92801554f0 msgr2=0x7f92801e77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f927effd700 1 --2- 172.21.15.177:0/2159987682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92801554f0 0x7f92801e77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f927effd700 1 -- 172.21.15.177:0/2159987682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9278009a70 con 0x7f92800c0770 2024-05-08T19:22:06.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.545+0000 7f927e7fc700 1 --2- 172.21.15.177:0/2159987682 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9280152130 0x7f92801e72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:06.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.546+0000 7f927effd700 1 --2- 172.21.15.177:0/2159987682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92800c0770 0x7f928014cc60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f927000c480 tx=0x7f927000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:06.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.546+0000 7f9267fff700 1 -- 172.21.15.177:0/2159987682 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92700052d0 con 0x7f92800c0770 2024-05-08T19:22:06.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.546+0000 7f9267fff700 1 -- 172.21.15.177:0/2159987682 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9270005430 con 0x7f92800c0770 2024-05-08T19:22:06.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.546+0000 7f928588f700 1 -- 172.21.15.177:0/2159987682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92801ea560 con 0x7f92800c0770 2024-05-08T19:22:06.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.546+0000 7f9267fff700 1 -- 172.21.15.177:0/2159987682 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92700038c0 con 0x7f92800c0770 2024-05-08T19:22:06.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.546+0000 7f928588f700 1 -- 172.21.15.177:0/2159987682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92801eab20 con 0x7f92800c0770 2024-05-08T19:22:06.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.546+0000 7f9267fff700 1 -- 172.21.15.177:0/2159987682 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f9270003d20 con 0x7f92800c0770 2024-05-08T19:22:06.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.546+0000 7f9267fff700 1 -- 172.21.15.177:0/2159987682 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f9270011e00 con 0x7f92800c0770 2024-05-08T19:22:06.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.547+0000 7f928588f700 1 -- 172.21.15.177:0/2159987682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928004ec60 con 0x7f92800c0770 2024-05-08T19:22:06.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.550+0000 7f9267fff700 1 -- 172.21.15.177:0/2159987682 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f9270017070 con 0x7f92800c0770 2024-05-08T19:22:06.567 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:06.575+0000 7fc1e8b05200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T19:22:06.619 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:06.627+0000 7f4db5ff9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T19:22:06.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.636+0000 7f928588f700 1 -- 172.21.15.177:0/2159987682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "07369d33-83c0-41d5-92f1-fabe56b1dcea", "id": 4} v 0) v1 -- 0x7f928006b250 con 0x7f92800c0770 2024-05-08T19:22:06.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.647+0000 7f9267fff700 1 -- 172.21.15.177:0/2159987682 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "07369d33-83c0-41d5-92f1-fabe56b1dcea", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9270011590 con 0x7f92800c0770 2024-05-08T19:22:06.640 INFO:teuthology.orchestra.run.smithi177.stdout:4 2024-05-08T19:22:06.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.648+0000 7f928588f700 1 -- 172.21.15.177:0/2159987682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92800c0770 msgr2=0x7f928014cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.648+0000 7f928588f700 1 --2- 172.21.15.177:0/2159987682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92800c0770 0x7f928014cc60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f927000c480 tx=0x7f927000c790 comp rx=0 tx=0).stop 2024-05-08T19:22:06.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.648+0000 7f928588f700 1 -- 172.21.15.177:0/2159987682 shutdown_connections 2024-05-08T19:22:06.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.648+0000 7f928588f700 1 --2- 172.21.15.177:0/2159987682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92801554f0 0x7f92801e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.648+0000 7f928588f700 1 --2- 172.21.15.177:0/2159987682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92800c0770 0x7f928014cc60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.648+0000 7f928588f700 1 --2- 172.21.15.177:0/2159987682 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9280152130 0x7f92801e72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.648+0000 7f928588f700 1 -- 172.21.15.177:0/2159987682 >> 172.21.15.177:0/2159987682 conn(0x7f92800c7120 msgr2=0x7f92801513e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:06.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.648+0000 7f928588f700 1 -- 172.21.15.177:0/2159987682 shutdown_connections 2024-05-08T19:22:06.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.648+0000 7f928588f700 1 -- 172.21.15.177:0/2159987682 wait complete. 2024-05-08T19:22:06.650 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:06.658+0000 7fc1e8b05200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T19:22:06.653 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new d3891ee2-21e5-4f56-82a5-b08944cc3624 5 2024-05-08T19:22:06.702 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:06.709+0000 7f4db5ff9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T19:22:06.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.784+0000 7f7e06c9c700 1 Processor -- start 2024-05-08T19:22:06.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.784+0000 7f7e06c9c700 1 -- start start 2024-05-08T19:22:06.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.784+0000 7f7e06c9c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7e0006bc40 0x7f7e00151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.784+0000 7f7e06c9c700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e00066ba0 0x7f7e00152210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.784+0000 7f7e06c9c700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e00152750 con 0x7f7e000c5780 2024-05-08T19:22:06.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.784+0000 7f7e06c9c700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e000c17e0 con 0x7f7e0006bc40 2024-05-08T19:22:06.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.784+0000 7f7e06c9c700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000c60a0 con 0x7f7e00066ba0 2024-05-08T19:22:06.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.785+0000 7f7dfffff700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e00066ba0 0x7f7e00152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.785+0000 7f7e04a38700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7e0006bc40 0x7f7e00151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.785+0000 7f7dfffff700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e00066ba0 0x7f7e00152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:38232/0 (socket says 172.21.15.177:38232) 2024-05-08T19:22:06.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.785+0000 7f7dfffff700 1 -- 172.21.15.177:0/1731074633 learned_addr learned my addr 172.21.15.177:0/1731074633 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-05-08T19:22:06.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.785+0000 7f7dfffff700 1 -- 172.21.15.177:0/1731074633 >> v2:172.21.15.177:3300/0 conn(0x7f7e0006bc40 msgr2=0x7f7e00151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:06.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.785+0000 7f7dfffff700 1 --2- 172.21.15.177:0/1731074633 >> v2:172.21.15.177:3300/0 conn(0x7f7e0006bc40 0x7f7e00151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.785+0000 7f7dfffff700 1 -- 172.21.15.177:0/1731074633 >> v1:172.21.15.177:6789/0 conn(0x7f7e000c5780 legacy=0x7f7e00158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.785+0000 7f7dfffff700 1 -- 172.21.15.177:0/1731074633 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e000c6380 con 0x7f7e00066ba0 2024-05-08T19:22:06.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.785+0000 7f7dfffff700 1 --2- 172.21.15.177:0/1731074633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e00066ba0 0x7f7e00152210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0098f0 tx=0x7f7dec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41587b95aad28357 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:06.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.785+0000 7f7dff7fe700 1 -- 172.21.15.177:0/1731074633 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec011830 con 0x7f7e00066ba0 2024-05-08T19:22:06.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.785+0000 7f7dff7fe700 1 -- 172.21.15.177:0/1731074633 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec011990 con 0x7f7e00066ba0 2024-05-08T19:22:06.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.785+0000 7f7dff7fe700 1 -- 172.21.15.177:0/1731074633 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec011d20 con 0x7f7e00066ba0 2024-05-08T19:22:06.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.786+0000 7f7e06c9c700 1 -- 172.21.15.177:0/1731074633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e00066ba0 msgr2=0x7f7e00152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.786+0000 7f7e06c9c700 1 --2- 172.21.15.177:0/1731074633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e00066ba0 0x7f7e00152210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0098f0 tx=0x7f7dec009c00 comp rx=0 tx=0).stop 2024-05-08T19:22:06.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.786+0000 7f7e06c9c700 1 -- 172.21.15.177:0/1731074633 shutdown_connections 2024-05-08T19:22:06.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.786+0000 7f7e06c9c700 1 --2- 172.21.15.177:0/1731074633 >> v2:172.21.15.177:3300/0 conn(0x7f7e0006bc40 0x7f7e00151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.786+0000 7f7e06c9c700 1 --2- 172.21.15.177:0/1731074633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e00066ba0 0x7f7e00152210 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.786+0000 7f7e06c9c700 1 -- 172.21.15.177:0/1731074633 >> 172.21.15.177:0/1731074633 conn(0x7f7e000c3360 msgr2=0x7f7e000c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:06.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.786+0000 7f7e06c9c700 1 -- 172.21.15.177:0/1731074633 shutdown_connections 2024-05-08T19:22:06.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.786+0000 7f7e06c9c700 1 -- 172.21.15.177:0/1731074633 wait complete. 2024-05-08T19:22:06.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.787+0000 7f7e06c9c700 1 Processor -- start 2024-05-08T19:22:06.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.787+0000 7f7e06c9c700 1 -- start start 2024-05-08T19:22:06.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.788+0000 7f7e06c9c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e00066ba0 0x7f7e001ea9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.788+0000 7f7e06c9c700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e0006bc40 0x7f7e0006ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.788+0000 7f7e06c9c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e000c5780 0x7f7e001e7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:06.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.788+0000 7f7e06c9c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0006d660 con 0x7f7e000c5780 2024-05-08T19:22:06.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.788+0000 7f7e06c9c700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0006f150 con 0x7f7e00066ba0 2024-05-08T19:22:06.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.788+0000 7f7e06c9c700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e001e82c0 con 0x7f7e0006bc40 2024-05-08T19:22:06.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7dfffff700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e0006bc40 0x7f7e0006ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7e04a38700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e00066ba0 0x7f7e001ea9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7dfffff700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e0006bc40 0x7f7e0006ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:38248/0 (socket says 172.21.15.177:38248) 2024-05-08T19:22:06.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7dfffff700 1 -- 172.21.15.177:0/1025496605 learned_addr learned my addr 172.21.15.177:0/1025496605 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-05-08T19:22:06.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7e05239700 1 --2- 172.21.15.177:0/1025496605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e000c5780 0x7f7e001e7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:06.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7dfffff700 1 -- 172.21.15.177:0/1025496605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e00066ba0 msgr2=0x7f7e001ea9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7dfffff700 1 --2- 172.21.15.177:0/1025496605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e00066ba0 0x7f7e001ea9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7dfffff700 1 -- 172.21.15.177:0/1025496605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e000c5780 msgr2=0x7f7e001e7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7dfffff700 1 --2- 172.21.15.177:0/1025496605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e000c5780 0x7f7e001e7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7dfffff700 1 -- 172.21.15.177:0/1025496605 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec009550 con 0x7f7e0006bc40 2024-05-08T19:22:06.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7dfffff700 1 --2- 172.21.15.177:0/1025496605 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e0006bc40 0x7f7e0006ec10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7dec000c00 tx=0x7f7dec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:06.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7dfd7fa700 1 -- 172.21.15.177:0/1025496605 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec004480 con 0x7f7e0006bc40 2024-05-08T19:22:06.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7dfd7fa700 1 -- 172.21.15.177:0/1025496605 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec01f070 con 0x7f7e0006bc40 2024-05-08T19:22:06.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7dfd7fa700 1 -- 172.21.15.177:0/1025496605 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0038c0 con 0x7f7e0006bc40 2024-05-08T19:22:06.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7e06c9c700 1 -- 172.21.15.177:0/1025496605 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0006f690 con 0x7f7e0006bc40 2024-05-08T19:22:06.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7e06c9c700 1 -- 172.21.15.177:0/1025496605 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0006d010 con 0x7f7e0006bc40 2024-05-08T19:22:06.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7dfd7fa700 1 -- 172.21.15.177:0/1025496605 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7dec021030 con 0x7f7e0006bc40 2024-05-08T19:22:06.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.789+0000 7f7dfd7fa700 1 -- 172.21.15.177:0/1025496605 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f7dec024430 con 0x7f7e0006bc40 2024-05-08T19:22:06.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.790+0000 7f7e06c9c700 1 -- 172.21.15.177:0/1025496605 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0006d7d0 con 0x7f7e0006bc40 2024-05-08T19:22:06.789 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.794+0000 7f7dfd7fa700 1 -- 172.21.15.177:0/1025496605 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f7dec015020 con 0x7f7e0006bc40 2024-05-08T19:22:06.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.879+0000 7f7e06c9c700 1 -- 172.21.15.177:0/1025496605 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d3891ee2-21e5-4f56-82a5-b08944cc3624", "id": 5} v 0) v1 -- 0x7f7e0004ec60 con 0x7f7e0006bc40 2024-05-08T19:22:06.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.886+0000 7f7dfd7fa700 1 -- 172.21.15.177:0/1025496605 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d3891ee2-21e5-4f56-82a5-b08944cc3624", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7dec01a450 con 0x7f7e0006bc40 2024-05-08T19:22:06.879 INFO:teuthology.orchestra.run.smithi177.stdout:5 2024-05-08T19:22:06.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.887+0000 7f7e06c9c700 1 -- 172.21.15.177:0/1025496605 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e0006bc40 msgr2=0x7f7e0006ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:06.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.887+0000 7f7e06c9c700 1 --2- 172.21.15.177:0/1025496605 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e0006bc40 0x7f7e0006ec10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7dec000c00 tx=0x7f7dec004750 comp rx=0 tx=0).stop 2024-05-08T19:22:06.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.887+0000 7f7e06c9c700 1 -- 172.21.15.177:0/1025496605 shutdown_connections 2024-05-08T19:22:06.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.887+0000 7f7e06c9c700 1 --2- 172.21.15.177:0/1025496605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e000c5780 0x7f7e001e7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.887+0000 7f7e06c9c700 1 --2- 172.21.15.177:0/1025496605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e00066ba0 0x7f7e001ea9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.887+0000 7f7e06c9c700 1 --2- 172.21.15.177:0/1025496605 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e0006bc40 0x7f7e0006ec10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:06.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.887+0000 7f7e06c9c700 1 -- 172.21.15.177:0/1025496605 >> 172.21.15.177:0/1025496605 conn(0x7f7e000c3360 msgr2=0x7f7e00071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:06.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.888+0000 7f7e06c9c700 1 -- 172.21.15.177:0/1025496605 shutdown_connections 2024-05-08T19:22:06.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:06.888+0000 7f7e06c9c700 1 -- 172.21.15.177:0/1025496605 wait complete. 2024-05-08T19:22:06.892 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 82dbda35-f252-4da5-82fa-cd4bf03f8968 6 2024-05-08T19:22:07.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.035+0000 7f5fd9e24700 1 Processor -- start 2024-05-08T19:22:07.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.035+0000 7f5fd9e24700 1 -- start start 2024-05-08T19:22:07.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.036+0000 7f5fd9e24700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5fd40c7d60 0x7f5fd40716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:07.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.036+0000 7f5fd9e24700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd4150380 con 0x7f5fd414ffa0 2024-05-08T19:22:07.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.036+0000 7f5fd9e24700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd4152cf0 con 0x7f5fd40a9df0 2024-05-08T19:22:07.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.036+0000 7f5fd9e24700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd41567e0 con 0x7f5fd40c7d60 2024-05-08T19:22:07.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.036+0000 7f5fd2ffd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5fd40c7d60 0x7f5fd40716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:07.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.036+0000 7f5fd3fff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5fd40a9df0 0x7f5fd40ac4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:43362/0 (socket says 172.21.15.177:43362) 2024-05-08T19:22:07.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.036+0000 7f5fd3fff700 1 -- 172.21.15.177:0/2395291192 learned_addr learned my addr 172.21.15.177:0/2395291192 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-05-08T19:22:07.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.036+0000 7f5fd27fc700 1 -- 172.21.15.177:0/2395291192 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530916201 0 0) 0x7f5fd4152cf0 con 0x7f5fd40a9df0 2024-05-08T19:22:07.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.036+0000 7f5fd27fc700 1 -- 172.21.15.177:0/2395291192 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fbc0035b0 con 0x7f5fd40a9df0 2024-05-08T19:22:07.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.036+0000 7f5fd2ffd700 1 -- 172.21.15.177:0/2395291192 >> v1:172.21.15.177:6789/0 conn(0x7f5fd40a9df0 legacy=0x7f5fd40ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.036+0000 7f5fd2ffd700 1 -- 172.21.15.177:0/2395291192 >> v1:172.21.15.47:6789/0 conn(0x7f5fd414ffa0 legacy=0x7f5fd4153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.036+0000 7f5fd2ffd700 1 -- 172.21.15.177:0/2395291192 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd41529c0 con 0x7f5fd40c7d60 2024-05-08T19:22:07.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.037+0000 7f5fd2ffd700 1 --2- 172.21.15.177:0/2395291192 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5fd40c7d60 0x7f5fd40716a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009870 tx=0x7f5fc8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2b1f2d0b6b3e7e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:07.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.037+0000 7f5fd27fc700 1 -- 172.21.15.177:0/2395291192 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8011830 con 0x7f5fd40c7d60 2024-05-08T19:22:07.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.037+0000 7f5fd27fc700 1 -- 172.21.15.177:0/2395291192 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc8011990 con 0x7f5fd40c7d60 2024-05-08T19:22:07.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.037+0000 7f5fd27fc700 1 -- 172.21.15.177:0/2395291192 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8011d20 con 0x7f5fd40c7d60 2024-05-08T19:22:07.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.037+0000 7f5fd9e24700 1 -- 172.21.15.177:0/2395291192 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5fd40c7d60 msgr2=0x7f5fd40716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.037+0000 7f5fd9e24700 1 --2- 172.21.15.177:0/2395291192 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5fd40c7d60 0x7f5fd40716a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009870 tx=0x7f5fc8009b80 comp rx=0 tx=0).stop 2024-05-08T19:22:07.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.037+0000 7f5fd9e24700 1 -- 172.21.15.177:0/2395291192 shutdown_connections 2024-05-08T19:22:07.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.038+0000 7f5fd9e24700 1 --2- 172.21.15.177:0/2395291192 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5fd40c7d60 0x7f5fd40716a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.038+0000 7f5fd9e24700 1 -- 172.21.15.177:0/2395291192 >> 172.21.15.177:0/2395291192 conn(0x7f5fd40c7120 msgr2=0x7f5fd40c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:07.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.038+0000 7f5fd9e24700 1 -- 172.21.15.177:0/2395291192 shutdown_connections 2024-05-08T19:22:07.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.038+0000 7f5fd9e24700 1 -- 172.21.15.177:0/2395291192 wait complete. 2024-05-08T19:22:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.039+0000 7f5fd9e24700 1 Processor -- start 2024-05-08T19:22:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.039+0000 7f5fd9e24700 1 -- start start 2024-05-08T19:22:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd9e24700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5fd40a9df0 0x7f5fd41ea720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd9e24700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fd40c7d60 0x7f5fd40c07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd9e24700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd414ffa0 0x7f5fd4149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd9e24700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40c1e40 con 0x7f5fd414ffa0 2024-05-08T19:22:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd9e24700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40c3560 con 0x7f5fd40c7d60 2024-05-08T19:22:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd9e24700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd41eac60 con 0x7f5fd40a9df0 2024-05-08T19:22:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd37fe700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5fd40a9df0 0x7f5fd41ea720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd2ffd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fd40c7d60 0x7f5fd40c07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd2ffd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fd40c7d60 0x7f5fd40c07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50524/0 (socket says 172.21.15.177:50524) 2024-05-08T19:22:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd37fe700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5fd40a9df0 0x7f5fd41ea720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:38262/0 (socket says 172.21.15.177:38262) 2024-05-08T19:22:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd2ffd700 1 -- 172.21.15.177:0/796447047 learned_addr learned my addr 172.21.15.177:0/796447047 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-05-08T19:22:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd3fff700 1 --2- 172.21.15.177:0/796447047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd414ffa0 0x7f5fd4149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd37fe700 1 -- 172.21.15.177:0/796447047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fd40c7d60 msgr2=0x7f5fd40c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd37fe700 1 --2- 172.21.15.177:0/796447047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fd40c7d60 0x7f5fd40c07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd37fe700 1 -- 172.21.15.177:0/796447047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd414ffa0 msgr2=0x7f5fd4149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd37fe700 1 --2- 172.21.15.177:0/796447047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd414ffa0 0x7f5fd4149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd37fe700 1 -- 172.21.15.177:0/796447047 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc80094a0 con 0x7f5fd40a9df0 2024-05-08T19:22:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd3fff700 1 --2- 172.21.15.177:0/796447047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd414ffa0 0x7f5fd4149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd2ffd700 1 --2- 172.21.15.177:0/796447047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fd40c7d60 0x7f5fd40c07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:07.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fd37fe700 1 --2- 172.21.15.177:0/796447047 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5fd40a9df0 0x7f5fd41ea720 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400cb10 tx=0x7f5fc400ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:07.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fbbfff700 1 -- 172.21.15.177:0/796447047 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4003c00 con 0x7f5fd40a9df0 2024-05-08T19:22:07.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.040+0000 7f5fbbfff700 1 -- 172.21.15.177:0/796447047 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc4003d60 con 0x7f5fd40a9df0 2024-05-08T19:22:07.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.041+0000 7f5fd9e24700 1 -- 172.21.15.177:0/796447047 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd40c1b60 con 0x7f5fd40a9df0 2024-05-08T19:22:07.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.041+0000 7f5fbbfff700 1 -- 172.21.15.177:0/796447047 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc400aa20 con 0x7f5fd40a9df0 2024-05-08T19:22:07.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.041+0000 7f5fd9e24700 1 -- 172.21.15.177:0/796447047 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd40ac780 con 0x7f5fd40a9df0 2024-05-08T19:22:07.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.041+0000 7f5fbbfff700 1 -- 172.21.15.177:0/796447047 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5fc40050d0 con 0x7f5fd40a9df0 2024-05-08T19:22:07.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.041+0000 7f5fbbfff700 1 -- 172.21.15.177:0/796447047 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f5fc4012ab0 con 0x7f5fd40a9df0 2024-05-08T19:22:07.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.041+0000 7f5fd9e24700 1 -- 172.21.15.177:0/796447047 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd40ac300 con 0x7f5fd40a9df0 2024-05-08T19:22:07.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.044+0000 7f5fbbfff700 1 -- 172.21.15.177:0/796447047 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f5fd40ac300 con 0x7f5fd40a9df0 2024-05-08T19:22:07.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.131+0000 7f5fd9e24700 1 -- 172.21.15.177:0/796447047 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "82dbda35-f252-4da5-82fa-cd4bf03f8968", "id": 6} v 0) v1 -- 0x7f5fd404ec60 con 0x7f5fd40a9df0 2024-05-08T19:22:07.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.139+0000 7f5fbbfff700 1 -- 172.21.15.177:0/796447047 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "82dbda35-f252-4da5-82fa-cd4bf03f8968", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5fc4012d10 con 0x7f5fd40a9df0 2024-05-08T19:22:07.132 INFO:teuthology.orchestra.run.smithi177.stdout:6 2024-05-08T19:22:07.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.140+0000 7f5fd9e24700 1 -- 172.21.15.177:0/796447047 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5fd40a9df0 msgr2=0x7f5fd41ea720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.140+0000 7f5fd9e24700 1 --2- 172.21.15.177:0/796447047 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5fd40a9df0 0x7f5fd41ea720 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400cb10 tx=0x7f5fc400ce20 comp rx=0 tx=0).stop 2024-05-08T19:22:07.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.140+0000 7f5fd9e24700 1 -- 172.21.15.177:0/796447047 shutdown_connections 2024-05-08T19:22:07.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.140+0000 7f5fd9e24700 1 --2- 172.21.15.177:0/796447047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd414ffa0 0x7f5fd4149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.140+0000 7f5fd9e24700 1 --2- 172.21.15.177:0/796447047 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5fd40a9df0 0x7f5fd41ea720 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.140+0000 7f5fd9e24700 1 --2- 172.21.15.177:0/796447047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fd40c7d60 0x7f5fd40c07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.140+0000 7f5fd9e24700 1 -- 172.21.15.177:0/796447047 >> 172.21.15.177:0/796447047 conn(0x7f5fd40c7120 msgr2=0x7f5fd40c4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:07.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.140+0000 7f5fd9e24700 1 -- 172.21.15.177:0/796447047 shutdown_connections 2024-05-08T19:22:07.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.140+0000 7f5fd9e24700 1 -- 172.21.15.177:0/796447047 wait complete. 2024-05-08T19:22:07.144 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 8e14290d-32fd-4c1f-ad2a-fd6481f683cf 7 2024-05-08T19:22:07.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.276+0000 7f1c9093f700 1 Processor -- start 2024-05-08T19:22:07.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.276+0000 7f1c9093f700 1 -- start start 2024-05-08T19:22:07.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.277+0000 7f1c9093f700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c8c0aab40 0x7f1c8c0ac250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:07.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.277+0000 7f1c9093f700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1c8c0a84b0 0x7f1c8c0c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:07.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.277+0000 7f1c9093f700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8c0c2880 con 0x7f1c8c14eee0 2024-05-08T19:22:07.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.277+0000 7f1c9093f700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8c0ab450 con 0x7f1c8c0a84b0 2024-05-08T19:22:07.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.277+0000 7f1c9093f700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c0c2b60 con 0x7f1c8c0aab40 2024-05-08T19:22:07.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.277+0000 7f1c89d9b700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c8c0aab40 0x7f1c8c0ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:07.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.277+0000 7f1c8ad9d700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1c8c0a84b0 0x7f1c8c0c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:07.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.277+0000 7f1c89d9b700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c8c0aab40 0x7f1c8c0ac250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:38264/0 (socket says 172.21.15.177:38264) 2024-05-08T19:22:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.277+0000 7f1c8ad9d700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1c8c0a84b0 0x7f1c8c0c2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50536/0 (socket says 172.21.15.177:50536) 2024-05-08T19:22:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.277+0000 7f1c89d9b700 1 -- 172.21.15.177:0/974975242 learned_addr learned my addr 172.21.15.177:0/974975242 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-05-08T19:22:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.277+0000 7f1c8ad9d700 1 -- 172.21.15.177:0/974975242 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c8c0aab40 msgr2=0x7f1c8c0ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.277+0000 7f1c8ad9d700 1 --2- 172.21.15.177:0/974975242 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c8c0aab40 0x7f1c8c0ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.277+0000 7f1c8ad9d700 1 -- 172.21.15.177:0/974975242 >> v1:172.21.15.47:6789/0 conn(0x7f1c8c14eee0 legacy=0x7f1c8c0a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.277+0000 7f1c8ad9d700 1 -- 172.21.15.177:0/974975242 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c1526e0 con 0x7f1c8c0a84b0 2024-05-08T19:22:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.277+0000 7f1c89d9b700 1 --2- 172.21.15.177:0/974975242 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c8c0aab40 0x7f1c8c0ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.278+0000 7f1c8ad9d700 1 --2- 172.21.15.177:0/974975242 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c8c0a84b0 0x7f1c8c0c2ff0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009d90 tx=0x7f1c8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90fa3729f290d065 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.278+0000 7f1c8959a700 1 -- 172.21.15.177:0/974975242 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8400e070 con 0x7f1c8c0a84b0 2024-05-08T19:22:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.278+0000 7f1c8959a700 1 -- 172.21.15.177:0/974975242 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8400bb20 con 0x7f1c8c0a84b0 2024-05-08T19:22:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.278+0000 7f1c8959a700 1 -- 172.21.15.177:0/974975242 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84012430 con 0x7f1c8c0a84b0 2024-05-08T19:22:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.278+0000 7f1c9093f700 1 -- 172.21.15.177:0/974975242 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c8c0a84b0 msgr2=0x7f1c8c0c2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.278+0000 7f1c9093f700 1 --2- 172.21.15.177:0/974975242 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c8c0a84b0 0x7f1c8c0c2ff0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009d90 tx=0x7f1c8400b330 comp rx=0 tx=0).stop 2024-05-08T19:22:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.278+0000 7f1c9093f700 1 -- 172.21.15.177:0/974975242 shutdown_connections 2024-05-08T19:22:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.278+0000 7f1c9093f700 1 --2- 172.21.15.177:0/974975242 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c8c0a84b0 0x7f1c8c0c2ff0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.278+0000 7f1c9093f700 1 --2- 172.21.15.177:0/974975242 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c8c0aab40 0x7f1c8c0ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.278+0000 7f1c9093f700 1 -- 172.21.15.177:0/974975242 >> 172.21.15.177:0/974975242 conn(0x7f1c8c0c3c20 msgr2=0x7f1c8c0c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:07.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.278+0000 7f1c9093f700 1 -- 172.21.15.177:0/974975242 shutdown_connections 2024-05-08T19:22:07.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.278+0000 7f1c9093f700 1 -- 172.21.15.177:0/974975242 wait complete. 2024-05-08T19:22:07.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.280+0000 7f1c9093f700 1 Processor -- start 2024-05-08T19:22:07.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.280+0000 7f1c9093f700 1 -- start start 2024-05-08T19:22:07.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c9093f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c8c0a84b0 0x7f1c8c1e6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:07.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c9093f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c8c0aab40 0x7f1c8c149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:07.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c9093f700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c8c14eee0 0x7f1c8c153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:07.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c9093f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c1e66d0 con 0x7f1c8c0aab40 2024-05-08T19:22:07.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c9093f700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c1ea020 con 0x7f1c8c0a84b0 2024-05-08T19:22:07.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c9093f700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c1e6080 con 0x7f1c8c14eee0 2024-05-08T19:22:07.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c8a59c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c8c0a84b0 0x7f1c8c1e6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:07.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c8a59c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c8c0a84b0 0x7f1c8c1e6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50538/0 (socket says 172.21.15.177:50538) 2024-05-08T19:22:07.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c8ad9d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c8c14eee0 0x7f1c8c153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:07.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c8a59c700 1 -- 172.21.15.177:0/87448339 learned_addr learned my addr 172.21.15.177:0/87448339 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-05-08T19:22:07.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c89d9b700 1 --2- 172.21.15.177:0/87448339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c8c0aab40 0x7f1c8c149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:07.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c8ad9d700 1 -- 172.21.15.177:0/87448339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c8c0a84b0 msgr2=0x7f1c8c1e6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c8ad9d700 1 --2- 172.21.15.177:0/87448339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c8c0a84b0 0x7f1c8c1e6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c8ad9d700 1 -- 172.21.15.177:0/87448339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c8c0aab40 msgr2=0x7f1c8c149910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c8ad9d700 1 --2- 172.21.15.177:0/87448339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c8c0aab40 0x7f1c8c149910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c8ad9d700 1 -- 172.21.15.177:0/87448339 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c80009550 con 0x7f1c8c14eee0 2024-05-08T19:22:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.281+0000 7f1c8a59c700 1 --2- 172.21.15.177:0/87448339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c8c0a84b0 0x7f1c8c1e6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.282+0000 7f1c8ad9d700 1 --2- 172.21.15.177:0/87448339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c8c14eee0 0x7f1c8c153740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1c84016000 tx=0x7f1c84004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.282+0000 7f1c7affd700 1 -- 172.21.15.177:0/87448339 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84012430 con 0x7f1c8c14eee0 2024-05-08T19:22:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.282+0000 7f1c7affd700 1 -- 172.21.15.177:0/87448339 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c84020070 con 0x7f1c8c14eee0 2024-05-08T19:22:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.282+0000 7f1c9093f700 1 -- 172.21.15.177:0/87448339 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c84009a70 con 0x7f1c8c14eee0 2024-05-08T19:22:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.282+0000 7f1c7affd700 1 -- 172.21.15.177:0/87448339 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c840098f0 con 0x7f1c8c14eee0 2024-05-08T19:22:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.282+0000 7f1c9093f700 1 -- 172.21.15.177:0/87448339 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8c149e50 con 0x7f1c8c14eee0 2024-05-08T19:22:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.282+0000 7f1c7affd700 1 -- 172.21.15.177:0/87448339 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f1c84004340 con 0x7f1c8c14eee0 2024-05-08T19:22:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.282+0000 7f1c7affd700 1 -- 172.21.15.177:0/87448339 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f1c84022070 con 0x7f1c8c14eee0 2024-05-08T19:22:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.283+0000 7f1c9093f700 1 -- 172.21.15.177:0/87448339 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8c1e6840 con 0x7f1c8c14eee0 2024-05-08T19:22:07.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.287+0000 7f1c7affd700 1 -- 172.21.15.177:0/87448339 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f1c8402c060 con 0x7f1c8c14eee0 2024-05-08T19:22:07.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.371+0000 7f1c9093f700 1 -- 172.21.15.177:0/87448339 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8e14290d-32fd-4c1f-ad2a-fd6481f683cf", "id": 7} v 0) v1 -- 0x7f1c8c04ec60 con 0x7f1c8c14eee0 2024-05-08T19:22:07.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.377+0000 7f1c7affd700 1 -- 172.21.15.177:0/87448339 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e14290d-32fd-4c1f-ad2a-fd6481f683cf", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1c84004780 con 0x7f1c8c14eee0 2024-05-08T19:22:07.369 INFO:teuthology.orchestra.run.smithi177.stdout:7 2024-05-08T19:22:07.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.378+0000 7f1c9093f700 1 -- 172.21.15.177:0/87448339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c8c14eee0 msgr2=0x7f1c8c153740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.378+0000 7f1c9093f700 1 --2- 172.21.15.177:0/87448339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c8c14eee0 0x7f1c8c153740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1c84016000 tx=0x7f1c84004ad0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.378+0000 7f1c9093f700 1 -- 172.21.15.177:0/87448339 shutdown_connections 2024-05-08T19:22:07.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.378+0000 7f1c9093f700 1 --2- 172.21.15.177:0/87448339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c8c14eee0 0x7f1c8c153740 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.378+0000 7f1c9093f700 1 --2- 172.21.15.177:0/87448339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c8c0a84b0 0x7f1c8c1e6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.378+0000 7f1c9093f700 1 --2- 172.21.15.177:0/87448339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c8c0aab40 0x7f1c8c149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.378+0000 7f1c9093f700 1 -- 172.21.15.177:0/87448339 >> 172.21.15.177:0/87448339 conn(0x7f1c8c0c3c20 msgr2=0x7f1c8c14e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:07.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.378+0000 7f1c9093f700 1 -- 172.21.15.177:0/87448339 shutdown_connections 2024-05-08T19:22:07.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-05-08T19:22:07.378+0000 7f1c9093f700 1 -- 172.21.15.177:0/87448339 wait complete. 2024-05-08T19:22:07.382 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T19:22:07.382 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-08T19:22:07.384 INFO:tasks.ceph.osd.0:Started 2024-05-08T19:22:07.385 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T19:22:07.385 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-08T19:22:07.387 INFO:tasks.ceph.osd.1:Started 2024-05-08T19:22:07.387 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T19:22:07.387 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-08T19:22:07.390 INFO:tasks.ceph.osd.2:Started 2024-05-08T19:22:07.390 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T19:22:07.390 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-08T19:22:07.392 INFO:tasks.ceph.osd.3:Started 2024-05-08T19:22:07.392 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-08T19:22:07.392 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-08T19:22:07.394 INFO:tasks.ceph.osd.4:Started 2024-05-08T19:22:07.395 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-08T19:22:07.395 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-08T19:22:07.396 INFO:tasks.ceph.osd.5:Started 2024-05-08T19:22:07.396 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-08T19:22:07.397 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-08T19:22:07.398 INFO:tasks.ceph.osd.6:Started 2024-05-08T19:22:07.399 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-08T19:22:07.399 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-08T19:22:07.401 INFO:tasks.ceph.osd.7:Started 2024-05-08T19:22:07.401 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:07.406 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:07.414+0000 7fc1e8b05200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T19:22:07.479 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:07.482+0000 7f4db5ff9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T19:22:07.506 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:07.513+0000 7fc1e8b05200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T19:22:07.568 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:07.576+0000 7f4db5ff9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T19:22:07.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.579+0000 7f745850c700 1 Processor -- start 2024-05-08T19:22:07.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.579+0000 7f745850c700 1 -- start start 2024-05-08T19:22:07.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.580+0000 7f745850c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f745006e900 0x7f74500a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:07.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.580+0000 7f745850c700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f745006d450 0x7f74500c3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:07.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.580+0000 7f745850c700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745006dcd0 con 0x7f74500c2ea0 2024-05-08T19:22:07.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.580+0000 7f745850c700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74500c3940 con 0x7f745006e900 2024-05-08T19:22:07.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.580+0000 7f745850c700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7450155ae0 con 0x7f745006d450 2024-05-08T19:22:07.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.581+0000 7f7456aa9700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f745006d450 0x7f74500c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:07.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.581+0000 7f7455aa7700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f745006e900 0x7f74500a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:07.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.581+0000 7f7456aa9700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f745006d450 0x7f74500c3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:33186/0 (socket says 172.21.15.47:33186) 2024-05-08T19:22:07.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.581+0000 7f74562a8700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f74500c2ea0 0x7f74501553d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:50310/0 (socket says 172.21.15.47:50310) 2024-05-08T19:22:07.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.581+0000 7f7455aa7700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f745006e900 0x7f74500a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:42200/0 (socket says 172.21.15.47:42200) 2024-05-08T19:22:07.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.581+0000 7f7456aa9700 1 -- 172.21.15.47:0/3149710576 learned_addr learned my addr 172.21.15.47:0/3149710576 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:07.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.581+0000 7f7455aa7700 1 -- 172.21.15.47:0/3149710576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f745006d450 msgr2=0x7f74500c3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:07.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.581+0000 7f7455aa7700 1 --2- 172.21.15.47:0/3149710576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f745006d450 0x7f74500c3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.581+0000 7f7455aa7700 1 -- 172.21.15.47:0/3149710576 >> v1:172.21.15.177:6789/0 conn(0x7f74500c2ea0 legacy=0x7f74501553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.581+0000 7f7455aa7700 1 -- 172.21.15.47:0/3149710576 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74500c26a0 con 0x7f745006e900 2024-05-08T19:22:07.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.581+0000 7f7456aa9700 1 --2- 172.21.15.47:0/3149710576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f745006d450 0x7f74500c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:07.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.581+0000 7f7455aa7700 1 --2- 172.21.15.47:0/3149710576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f745006e900 0x7f74500a84b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7440009820 tx=0x7f7440009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=559ee55d0f4e424e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:07.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.581+0000 7f74552a6700 1 -- 172.21.15.47:0/3149710576 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440005e30 con 0x7f745006e900 2024-05-08T19:22:07.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.581+0000 7f74552a6700 1 -- 172.21.15.47:0/3149710576 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7440006030 con 0x7f745006e900 2024-05-08T19:22:07.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.581+0000 7f74552a6700 1 -- 172.21.15.47:0/3149710576 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400063c0 con 0x7f745006e900 2024-05-08T19:22:07.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.582+0000 7f745850c700 1 -- 172.21.15.47:0/3149710576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f745006e900 msgr2=0x7f74500a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.582+0000 7f745850c700 1 --2- 172.21.15.47:0/3149710576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f745006e900 0x7f74500a84b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7440009820 tx=0x7f7440009b30 comp rx=0 tx=0).stop 2024-05-08T19:22:07.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.582+0000 7f745850c700 1 -- 172.21.15.47:0/3149710576 shutdown_connections 2024-05-08T19:22:07.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.582+0000 7f745850c700 1 --2- 172.21.15.47:0/3149710576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f745006d450 0x7f74500c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.582+0000 7f745850c700 1 --2- 172.21.15.47:0/3149710576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f745006e900 0x7f74500a84b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.582+0000 7f745850c700 1 -- 172.21.15.47:0/3149710576 >> 172.21.15.47:0/3149710576 conn(0x7f74500c3c20 msgr2=0x7f74500c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:07.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.582+0000 7f745850c700 1 -- 172.21.15.47:0/3149710576 shutdown_connections 2024-05-08T19:22:07.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.582+0000 7f745850c700 1 -- 172.21.15.47:0/3149710576 wait complete. 2024-05-08T19:22:07.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.584+0000 7f745850c700 1 Processor -- start 2024-05-08T19:22:07.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.584+0000 7f745850c700 1 -- start start 2024-05-08T19:22:07.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f745850c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745006d450 0x7f7450151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:07.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f745850c700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f745006e900 0x7f74500aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:07.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f745850c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74500c2ea0 0x7f745014e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:07.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f745850c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745014ed70 con 0x7f745006d450 2024-05-08T19:22:07.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f745850c700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74501521b0 con 0x7f74500c2ea0 2024-05-08T19:22:07.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f745850c700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7450150ef0 con 0x7f745006e900 2024-05-08T19:22:07.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f74562a8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745006d450 0x7f7450151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:07.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f74562a8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745006d450 0x7f7450151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39182/0 (socket says 172.21.15.47:39182) 2024-05-08T19:22:07.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f74562a8700 1 -- 172.21.15.47:0/2240964626 learned_addr learned my addr 172.21.15.47:0/2240964626 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:07.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f7455aa7700 1 --2- 172.21.15.47:0/2240964626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f745006e900 0x7f74500aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:07.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f7456aa9700 1 --2- 172.21.15.47:0/2240964626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74500c2ea0 0x7f745014e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:07.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f74562a8700 1 -- 172.21.15.47:0/2240964626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f745006e900 msgr2=0x7f74500aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f74562a8700 1 --2- 172.21.15.47:0/2240964626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f745006e900 0x7f74500aae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f74562a8700 1 -- 172.21.15.47:0/2240964626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74500c2ea0 msgr2=0x7f745014e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f74562a8700 1 --2- 172.21.15.47:0/2240964626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74500c2ea0 0x7f745014e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f74562a8700 1 -- 172.21.15.47:0/2240964626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7448009b30 con 0x7f745006d450 2024-05-08T19:22:07.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f74562a8700 1 --2- 172.21.15.47:0/2240964626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745006d450 0x7f7450151c70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f744c00c500 tx=0x7f744c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:07.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f7446ffd700 1 -- 172.21.15.47:0/2240964626 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c005cb0 con 0x7f745006d450 2024-05-08T19:22:07.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f7446ffd700 1 -- 172.21.15.47:0/2240964626 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c005e10 con 0x7f745006d450 2024-05-08T19:22:07.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f7446ffd700 1 -- 172.21.15.47:0/2240964626 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0072d0 con 0x7f745006d450 2024-05-08T19:22:07.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f745850c700 1 -- 172.21.15.47:0/2240964626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7440009430 con 0x7f745006d450 2024-05-08T19:22:07.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.585+0000 7f745850c700 1 -- 172.21.15.47:0/2240964626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7450151190 con 0x7f745006d450 2024-05-08T19:22:07.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.586+0000 7f7446ffd700 1 -- 172.21.15.47:0/2240964626 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f744c01c440 con 0x7f745006d450 2024-05-08T19:22:07.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.586+0000 7f7446ffd700 1 -- 172.21.15.47:0/2240964626 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f744c012ad0 con 0x7f745006d450 2024-05-08T19:22:07.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.586+0000 7f745850c700 1 -- 172.21.15.47:0/2240964626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74500c1890 con 0x7f745006d450 2024-05-08T19:22:07.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.589+0000 7f7446ffd700 1 -- 172.21.15.47:0/2240964626 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f744c021060 con 0x7f745006d450 2024-05-08T19:22:07.640 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:07.647+0000 7fc1e8b05200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T19:22:07.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.661+0000 7f745850c700 1 -- 172.21.15.47:0/2240964626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7450154b60 con 0x7f745006d450 2024-05-08T19:22:07.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.661+0000 7f7446ffd700 1 -- 172.21.15.47:0/2240964626 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f744c017070 con 0x7f745006d450 2024-05-08T19:22:07.654 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:07.654 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":10,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:07.373402+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:07.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.662+0000 7f745850c700 1 -- 172.21.15.47:0/2240964626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745006d450 msgr2=0x7f7450151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:07.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.662+0000 7f745850c700 1 --2- 172.21.15.47:0/2240964626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745006d450 0x7f7450151c70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f744c00c500 tx=0x7f744c00c810 comp rx=0 tx=0).stop 2024-05-08T19:22:07.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.662+0000 7f745850c700 1 -- 172.21.15.47:0/2240964626 shutdown_connections 2024-05-08T19:22:07.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.662+0000 7f745850c700 1 --2- 172.21.15.47:0/2240964626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745006d450 0x7f7450151c70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.662+0000 7f745850c700 1 --2- 172.21.15.47:0/2240964626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74500c2ea0 0x7f745014e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.662+0000 7f745850c700 1 --2- 172.21.15.47:0/2240964626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f745006e900 0x7f74500aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:07.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.663+0000 7f745850c700 1 -- 172.21.15.47:0/2240964626 >> 172.21.15.47:0/2240964626 conn(0x7f74500c3c20 msgr2=0x7f7450148780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:07.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.663+0000 7f745850c700 1 -- 172.21.15.47:0/2240964626 shutdown_connections 2024-05-08T19:22:07.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:07.663+0000 7f745850c700 1 -- 172.21.15.47:0/2240964626 wait complete. 2024-05-08T19:22:07.667 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T19:22:07.667 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T19:22:07.710 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:07.718+0000 7f4db5ff9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T19:22:07.755 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-05-08T19:22:07.763+0000 7fefa209b7c0 -1 Falling back to public interface 2024-05-08T19:22:08.007 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-05-08T19:22:08.015+0000 7f5eabb807c0 -1 Falling back to public interface 2024-05-08T19:22:08.007 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-05-08T19:22:08.015+0000 7f43da9cf7c0 -1 Falling back to public interface 2024-05-08T19:22:08.008 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-05-08T19:22:08.015+0000 7f5ea2f3c700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-05-08T19:22:08.008 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-05-08T19:22:08.016+0000 7fbd4b66e7c0 -1 Falling back to public interface 2024-05-08T19:22:08.017 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-05-08T19:22:08.025+0000 7f97dc7697c0 -1 Falling back to public interface 2024-05-08T19:22:08.019 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-05-08T19:22:08.027+0000 7f5a48f9b7c0 -1 Falling back to public interface 2024-05-08T19:22:08.021 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-05-08T19:22:08.029+0000 7fa7f648c7c0 -1 Falling back to public interface 2024-05-08T19:22:08.037 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-05-08T19:22:08.045+0000 7f79c8fcf7c0 -1 Falling back to public interface 2024-05-08T19:22:08.195 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:08.203+0000 7fc1e8b05200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T19:22:08.292 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:08.300+0000 7f4db5ff9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T19:22:08.369 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:08.376+0000 7fc1e8b05200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T19:22:08.469 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:08.477+0000 7f4db5ff9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T19:22:08.473 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:08.532 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:08.540+0000 7fc1e8b05200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T19:22:08.589 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.597+0000 7f31a7afb700 1 Processor -- start 2024-05-08T19:22:08.589 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.597+0000 7f31a7afb700 1 -- start start 2024-05-08T19:22:08.593 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a7afb700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f31a00c33f0 0x7f31a0155700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:08.593 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a7afb700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31a006df60 0x7f31a00a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:08.593 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a7afb700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31a00c28e0 0x7f31a014e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:08.593 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a7afb700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a0155c40 con 0x7f31a00c28e0 2024-05-08T19:22:08.593 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a7afb700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a0155270 con 0x7f31a00c33f0 2024-05-08T19:22:08.594 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a7afb700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a0154c40 con 0x7f31a006df60 2024-05-08T19:22:08.594 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a6098700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31a00c28e0 0x7f31a014e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:08.594 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a6098700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31a00c28e0 0x7f31a014e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39196/0 (socket says 172.21.15.47:39196) 2024-05-08T19:22:08.594 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a6098700 1 -- 172.21.15.47:0/1978196815 learned_addr learned my addr 172.21.15.47:0/1978196815 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:08.594 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a5096700 1 --2- 172.21.15.47:0/1978196815 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31a006df60 0x7f31a00a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:08.594 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a5897700 1 --2- 172.21.15.47:0/1978196815 >> v2:172.21.15.177:3300/0 conn(0x7f31a00c33f0 0x7f31a0155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:08.594 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a6098700 1 -- 172.21.15.47:0/1978196815 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31a006df60 msgr2=0x7f31a00a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:08.594 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a6098700 1 --2- 172.21.15.47:0/1978196815 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31a006df60 0x7f31a00a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:08.594 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a6098700 1 -- 172.21.15.47:0/1978196815 >> v2:172.21.15.177:3300/0 conn(0x7f31a00c33f0 msgr2=0x7f31a0155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:08.595 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a6098700 1 --2- 172.21.15.47:0/1978196815 >> v2:172.21.15.177:3300/0 conn(0x7f31a00c33f0 0x7f31a0155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:08.595 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.598+0000 7f31a6098700 1 -- 172.21.15.47:0/1978196815 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a006d900 con 0x7f31a00c28e0 2024-05-08T19:22:08.595 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.599+0000 7f31a6098700 1 --2- 172.21.15.47:0/1978196815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31a00c28e0 0x7f31a014e930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f31a00c1ea0 tx=0x7f319800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433d68155c0420a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:08.595 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.599+0000 7f31a4895700 1 -- 172.21.15.47:0/1978196815 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198010070 con 0x7f31a00c28e0 2024-05-08T19:22:08.595 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.599+0000 7f31a4895700 1 -- 172.21.15.47:0/1978196815 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319800dce0 con 0x7f31a00c28e0 2024-05-08T19:22:08.595 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.599+0000 7f31a4895700 1 -- 172.21.15.47:0/1978196815 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319800b310 con 0x7f31a00c28e0 2024-05-08T19:22:08.595 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.599+0000 7f31a7afb700 1 -- 172.21.15.47:0/1978196815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31a00c28e0 msgr2=0x7f31a014e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:08.596 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.599+0000 7f31a7afb700 1 --2- 172.21.15.47:0/1978196815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31a00c28e0 0x7f31a014e930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f31a00c1ea0 tx=0x7f319800d430 comp rx=0 tx=0).stop 2024-05-08T19:22:08.596 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.599+0000 7f31a7afb700 1 -- 172.21.15.47:0/1978196815 shutdown_connections 2024-05-08T19:22:08.596 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.599+0000 7f31a7afb700 1 --2- 172.21.15.47:0/1978196815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31a00c28e0 0x7f31a014e930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:08.596 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.599+0000 7f31a7afb700 1 --2- 172.21.15.47:0/1978196815 >> v2:172.21.15.177:3300/0 conn(0x7f31a00c33f0 0x7f31a0155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:08.596 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.599+0000 7f31a7afb700 1 --2- 172.21.15.47:0/1978196815 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31a006df60 0x7f31a00a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:08.596 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.599+0000 7f31a7afb700 1 -- 172.21.15.47:0/1978196815 >> 172.21.15.47:0/1978196815 conn(0x7f31a00c3d30 msgr2=0x7f31a00c4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:08.596 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.599+0000 7f31a7afb700 1 -- 172.21.15.47:0/1978196815 shutdown_connections 2024-05-08T19:22:08.596 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.599+0000 7f31a7afb700 1 -- 172.21.15.47:0/1978196815 wait complete. 2024-05-08T19:22:08.596 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.601+0000 7f31a7afb700 1 Processor -- start 2024-05-08T19:22:08.596 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.601+0000 7f31a7afb700 1 -- start start 2024-05-08T19:22:08.599 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.601+0000 7f31a7afb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31a006df60 0x7f31a00c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:08.600 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.601+0000 7f31a7afb700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31a00c28e0 0x7f31a01e59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:08.600 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.601+0000 7f31a7afb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31a00c33f0 0x7f31a014a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:08.600 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.601+0000 7f31a7afb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a00c6fb0 con 0x7f31a00c33f0 2024-05-08T19:22:08.600 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.601+0000 7f31a7afb700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a01e9720 con 0x7f31a006df60 2024-05-08T19:22:08.600 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.601+0000 7f31a7afb700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a00c6d10 con 0x7f31a00c28e0 2024-05-08T19:22:08.600 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.601+0000 7f31a6098700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31a00c33f0 0x7f31a014a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:08.600 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31a6098700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31a00c33f0 0x7f31a014a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39208/0 (socket says 172.21.15.47:39208) 2024-05-08T19:22:08.600 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31a6098700 1 -- 172.21.15.47:0/444980781 learned_addr learned my addr 172.21.15.47:0/444980781 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:08.600 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31a5897700 1 --2- 172.21.15.47:0/444980781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31a006df60 0x7f31a00c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:08.600 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31a5096700 1 --2- 172.21.15.47:0/444980781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31a00c28e0 0x7f31a01e59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:08.600 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31a6098700 1 -- 172.21.15.47:0/444980781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31a00c28e0 msgr2=0x7f31a01e59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:08.601 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31a6098700 1 --2- 172.21.15.47:0/444980781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31a00c28e0 0x7f31a01e59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:08.601 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31a6098700 1 -- 172.21.15.47:0/444980781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31a006df60 msgr2=0x7f31a00c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:08.601 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31a6098700 1 --2- 172.21.15.47:0/444980781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31a006df60 0x7f31a00c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:08.601 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31a6098700 1 -- 172.21.15.47:0/444980781 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319800bd40 con 0x7f31a00c33f0 2024-05-08T19:22:08.601 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31a6098700 1 --2- 172.21.15.47:0/444980781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31a00c33f0 0x7f31a014a110 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f31a006c960 tx=0x7f3198004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:08.601 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31967fc700 1 -- 172.21.15.47:0/444980781 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198009a10 con 0x7f31a00c33f0 2024-05-08T19:22:08.601 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31967fc700 1 -- 172.21.15.47:0/444980781 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3198009b90 con 0x7f31a00c33f0 2024-05-08T19:22:08.601 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31a7afb700 1 -- 172.21.15.47:0/444980781 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a01e90d0 con 0x7f31a00c33f0 2024-05-08T19:22:08.602 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31967fc700 1 -- 172.21.15.47:0/444980781 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319800b4c0 con 0x7f31a00c33f0 2024-05-08T19:22:08.602 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31a7afb700 1 -- 172.21.15.47:0/444980781 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a00c55d0 con 0x7f31a00c33f0 2024-05-08T19:22:08.602 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31967fc700 1 -- 172.21.15.47:0/444980781 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3198004340 con 0x7f31a00c33f0 2024-05-08T19:22:08.602 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.602+0000 7f31967fc700 1 -- 172.21.15.47:0/444980781 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3198027450 con 0x7f31a00c33f0 2024-05-08T19:22:08.602 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.603+0000 7f31a7afb700 1 -- 172.21.15.47:0/444980781 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a004ecd0 con 0x7f31a00c33f0 2024-05-08T19:22:08.602 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.605+0000 7f31967fc700 1 -- 172.21.15.47:0/444980781 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f3198046dc0 con 0x7f31a00c33f0 2024-05-08T19:22:08.647 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:08.655+0000 7f4db5ff9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T19:22:08.669 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.677+0000 7f31a7afb700 1 -- 172.21.15.47:0/444980781 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31a01e9860 con 0x7f31a00c33f0 2024-05-08T19:22:08.670 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.678+0000 7f31967fc700 1 -- 172.21.15.47:0/444980781 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3198035070 con 0x7f31a00c33f0 2024-05-08T19:22:08.670 INFO:teuthology.misc.health.smithi047.stdout: 2024-05-08T19:22:08.670 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":10,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:07.373402+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:08.675 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.679+0000 7f31a7afb700 1 -- 172.21.15.47:0/444980781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31a00c33f0 msgr2=0x7f31a014a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:08.675 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.679+0000 7f31a7afb700 1 --2- 172.21.15.47:0/444980781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31a00c33f0 0x7f31a014a110 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f31a006c960 tx=0x7f3198004ad0 comp rx=0 tx=0).stop 2024-05-08T19:22:08.675 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.679+0000 7f31a7afb700 1 -- 172.21.15.47:0/444980781 shutdown_connections 2024-05-08T19:22:08.676 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.679+0000 7f31a7afb700 1 --2- 172.21.15.47:0/444980781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31a00c33f0 0x7f31a014a110 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:08.676 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.679+0000 7f31a7afb700 1 --2- 172.21.15.47:0/444980781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31a006df60 0x7f31a00c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:08.676 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.679+0000 7f31a7afb700 1 --2- 172.21.15.47:0/444980781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31a00c28e0 0x7f31a01e59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:08.676 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.679+0000 7f31a7afb700 1 -- 172.21.15.47:0/444980781 >> 172.21.15.47:0/444980781 conn(0x7f31a00c3d30 msgr2=0x7f31a00c1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:08.676 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.679+0000 7f31a7afb700 1 -- 172.21.15.47:0/444980781 shutdown_connections 2024-05-08T19:22:08.676 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:08.679+0000 7f31a7afb700 1 -- 172.21.15.47:0/444980781 wait complete. 2024-05-08T19:22:08.682 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T19:22:09.354 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:09.362+0000 7fc1e8b05200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T19:22:09.507 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:09.515+0000 7f4db5ff9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T19:22:09.596 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:09.604+0000 7fc1e8b05200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T19:22:09.670 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:09.678+0000 7fc1e8b05200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T19:22:09.756 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:09.764+0000 7f4db5ff9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T19:22:09.834 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:09.841+0000 7fc1e8b05200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T19:22:09.834 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:09.842+0000 7f4db5ff9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T19:22:10.008 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-08T19:22:10.016+0000 7f4db5ff9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T19:22:10.871 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:10.878+0000 7fc1a3da1700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-08T19:22:10.871 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-05-08T19:22:10.878+0000 7fc1a3da1700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-08T19:22:11.302 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-05-08T19:22:11.310+0000 7fefa209b7c0 -1 osd.0 0 log_to_monitors true 2024-05-08T19:22:11.481 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-05-08T19:22:11.488+0000 7fbd4b66e7c0 -1 osd.2 0 log_to_monitors true 2024-05-08T19:22:11.505 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-05-08T19:22:11.513+0000 7f43da9cf7c0 -1 osd.6 0 log_to_monitors true 2024-05-08T19:22:11.530 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-05-08T19:22:11.538+0000 7f97dc7697c0 -1 osd.1 0 log_to_monitors true 2024-05-08T19:22:11.551 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-05-08T19:22:11.558+0000 7f5eabb807c0 -1 osd.4 0 log_to_monitors true 2024-05-08T19:22:11.561 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-05-08T19:22:11.569+0000 7fa7f648c7c0 -1 osd.5 0 log_to_monitors true 2024-05-08T19:22:11.562 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-05-08T19:22:11.570+0000 7f5a48f9b7c0 -1 osd.7 0 log_to_monitors true 2024-05-08T19:22:11.597 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-05-08T19:22:11.605+0000 7f79c8fcf7c0 -1 osd.3 0 log_to_monitors true 2024-05-08T19:22:13.798 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-05-08T19:22:13.806+0000 7f43ced85700 -1 osd.6 0 waiting for initial osdmap 2024-05-08T19:22:13.822 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-05-08T19:22:13.830+0000 7f43c695f700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T19:22:13.832 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-05-08T19:22:13.840+0000 7fa7ea842700 -1 osd.5 0 waiting for initial osdmap 2024-05-08T19:22:13.843 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-05-08T19:22:13.850+0000 7f5a3d351700 -1 osd.7 0 waiting for initial osdmap 2024-05-08T19:22:13.845 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-05-08T19:22:13.853+0000 7fa7e241c700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T19:22:13.849 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-05-08T19:22:13.857+0000 7fef96451700 -1 osd.0 0 waiting for initial osdmap 2024-05-08T19:22:13.857 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-05-08T19:22:13.865+0000 7f5a34f2b700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T19:22:13.863 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-05-08T19:22:13.871+0000 7fbd3fa24700 -1 osd.2 0 waiting for initial osdmap 2024-05-08T19:22:13.865 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-05-08T19:22:13.873+0000 7fef8e02b700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T19:22:13.876 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-05-08T19:22:13.884+0000 7fbd375fe700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T19:22:13.892 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-05-08T19:22:13.900+0000 7f79bd385700 -1 osd.3 0 waiting for initial osdmap 2024-05-08T19:22:13.899 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-05-08T19:22:13.906+0000 7f97d0b1f700 -1 osd.1 0 waiting for initial osdmap 2024-05-08T19:22:13.901 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-05-08T19:22:13.909+0000 7f79b4f5f700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T19:22:13.908 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-05-08T19:22:13.916+0000 7f97c86f9700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T19:22:14.308 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-05-08T19:22:14.316+0000 7f5e9ff36700 -1 osd.4 0 waiting for initial osdmap 2024-05-08T19:22:14.326 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-05-08T19:22:14.334+0000 7f5e97b10700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T19:22:15.490 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:15.619 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.627+0000 7f8ae398e700 1 Processor -- start 2024-05-08T19:22:15.619 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.627+0000 7f8ae398e700 1 -- start start 2024-05-08T19:22:15.623 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.628+0000 7f8ae398e700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8adc0c0890 0x7f8adc158a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:15.623 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.628+0000 7f8ae398e700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8adc1585c0 con 0x7f8adc0c03d0 2024-05-08T19:22:15.623 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.628+0000 7f8ae398e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8adc072460 con 0x7f8adc06f690 2024-05-08T19:22:15.623 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.628+0000 7f8ae398e700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8adc1554f0 con 0x7f8adc0c0890 2024-05-08T19:22:15.623 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.628+0000 7f8ae0f29700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8adc0c03d0 0x7f8adc06b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59920/0 (socket says 172.21.15.47:59920) 2024-05-08T19:22:15.623 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.628+0000 7f8ae0f29700 1 -- 172.21.15.47:0/3253289436 learned_addr learned my addr 172.21.15.47:0/3253289436 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:15.623 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.628+0000 7f8ae1f2b700 1 --2- 172.21.15.47:0/3253289436 >> v2:172.21.15.177:3300/0 conn(0x7f8adc0c0890 0x7f8adc158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:15.623 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.628+0000 7f8acffff700 1 -- 172.21.15.47:0/3253289436 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020802113 0 0) 0x7f8adc1585c0 con 0x7f8adc0c03d0 2024-05-08T19:22:15.623 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.628+0000 7f8acffff700 1 -- 172.21.15.47:0/3253289436 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ac80035b0 con 0x7f8adc0c03d0 2024-05-08T19:22:15.624 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 -- 172.21.15.47:0/3253289436 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2663543809 0 0) 0x7f8ac80035b0 con 0x7f8adc0c03d0 2024-05-08T19:22:15.624 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 -- 172.21.15.47:0/3253289436 >> v2:172.21.15.177:3300/0 conn(0x7f8adc0c0890 msgr2=0x7f8adc158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:15.624 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 --2- 172.21.15.47:0/3253289436 >> v2:172.21.15.177:3300/0 conn(0x7f8adc0c0890 0x7f8adc158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:15.624 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 -- 172.21.15.47:0/3253289436 >> v1:172.21.15.177:6789/0 conn(0x7f8adc06f690 legacy=0x7f8adc071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:15.624 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 -- 172.21.15.47:0/3253289436 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc157f70 con 0x7f8adc0c03d0 2024-05-08T19:22:15.624 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 -- 172.21.15.47:0/3253289436 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f8ad8001670 con 0x7f8adc0c03d0 2024-05-08T19:22:15.624 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8ae1f2b700 1 --2- 172.21.15.47:0/3253289436 >> v2:172.21.15.177:3300/0 conn(0x7f8adc0c0890 0x7f8adc158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:15.624 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 -- 172.21.15.47:0/3253289436 >> v1:172.21.15.47:6789/0 conn(0x7f8adc0c03d0 legacy=0x7f8adc06b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:15.624 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 --2- 172.21.15.47:0/3253289436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac8003a00 0x7f8ac8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:15.624 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 --2- 172.21.15.47:0/3253289436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac8004850 0x7f8ac8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:15.624 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 --2- 172.21.15.47:0/3253289436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ac8005330 0x7f8ac800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:15.624 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 -- 172.21.15.47:0/3253289436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc1554f0 con 0x7f8ac8003a00 2024-05-08T19:22:15.624 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 -- 172.21.15.47:0/3253289436 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac800c200 con 0x7f8ac8004850 2024-05-08T19:22:15.625 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 -- 172.21.15.47:0/3253289436 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac800c3c0 con 0x7f8ac8005330 2024-05-08T19:22:15.625 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8ae172a700 1 --2- 172.21.15.47:0/3253289436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac8003a00 0x7f8ac8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:15.625 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8ae0f29700 1 --2- 172.21.15.47:0/3253289436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac8004850 0x7f8ac8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:15.625 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8ae1f2b700 1 --2- 172.21.15.47:0/3253289436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ac8005330 0x7f8ac800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:15.625 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8ae172a700 1 -- 172.21.15.47:0/3253289436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ac8005330 msgr2=0x7f8ac800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:15.626 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8ae172a700 1 --2- 172.21.15.47:0/3253289436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ac8005330 0x7f8ac800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:15.626 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8ae172a700 1 -- 172.21.15.47:0/3253289436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac8004850 msgr2=0x7f8ac8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:15.626 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8ae172a700 1 --2- 172.21.15.47:0/3253289436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac8004850 0x7f8ac8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:15.626 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8ae172a700 1 -- 172.21.15.47:0/3253289436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac80035b0 con 0x7f8ac8003a00 2024-05-08T19:22:15.626 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8ae1f2b700 1 --2- 172.21.15.47:0/3253289436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ac8005330 0x7f8ac800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:15.626 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8ae1f2b700 1 -- 172.21.15.47:0/3253289436 reap_dead start 2024-05-08T19:22:15.626 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8ae172a700 1 --2- 172.21.15.47:0/3253289436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac8003a00 0x7f8ac8003e20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0007fd0 tx=0x7f8ac8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7b1e0899f6b224 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:15.626 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 -- 172.21.15.47:0/3253289436 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00052d0 con 0x7f8ac8003a00 2024-05-08T19:22:15.626 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 -- 172.21.15.47:0/3253289436 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad0005430 con 0x7f8ac8003a00 2024-05-08T19:22:15.627 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.629+0000 7f8acffff700 1 -- 172.21.15.47:0/3253289436 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00038c0 con 0x7f8ac8003a00 2024-05-08T19:22:15.627 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.630+0000 7f8ae398e700 1 -- 172.21.15.47:0/3253289436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac8003a00 msgr2=0x7f8ac8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:15.627 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.630+0000 7f8ae398e700 1 --2- 172.21.15.47:0/3253289436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac8003a00 0x7f8ac8003e20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0007fd0 tx=0x7f8ac8005880 comp rx=0 tx=0).stop 2024-05-08T19:22:15.627 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.630+0000 7f8ae398e700 1 -- 172.21.15.47:0/3253289436 shutdown_connections 2024-05-08T19:22:15.627 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.630+0000 7f8ae398e700 1 --2- 172.21.15.47:0/3253289436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac8003a00 0x7f8ac8003e20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:15.627 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.630+0000 7f8ae398e700 1 -- 172.21.15.47:0/3253289436 >> 172.21.15.47:0/3253289436 conn(0x7f8adc06a9c0 msgr2=0x7f8adc06ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:15.627 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.630+0000 7f8ae398e700 1 -- 172.21.15.47:0/3253289436 shutdown_connections 2024-05-08T19:22:15.627 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.630+0000 7f8ae398e700 1 -- 172.21.15.47:0/3253289436 wait complete. 2024-05-08T19:22:15.630 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.631+0000 7f8ae398e700 1 Processor -- start 2024-05-08T19:22:15.630 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.631+0000 7f8ae398e700 1 -- start start 2024-05-08T19:22:15.630 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae398e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac8003a00 0x7f8adc1eda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:15.630 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae398e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8adc0a9690 0x7f8adc1edfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:15.630 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae398e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8adc153570 0x7f8adc153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:15.630 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae398e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc151920 con 0x7f8adc0a9690 2024-05-08T19:22:15.630 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae398e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc1ee640 con 0x7f8ac8003a00 2024-05-08T19:22:15.630 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae398e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc1ee8e0 con 0x7f8adc153570 2024-05-08T19:22:15.630 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae0f29700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8adc0a9690 0x7f8adc1edfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:15.630 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae0f29700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8adc0a9690 0x7f8adc1edfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39264/0 (socket says 172.21.15.47:39264) 2024-05-08T19:22:15.631 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae0f29700 1 -- 172.21.15.47:0/4233264267 learned_addr learned my addr 172.21.15.47:0/4233264267 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:15.631 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae1f2b700 1 --2- 172.21.15.47:0/4233264267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8adc153570 0x7f8adc153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:15.631 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae172a700 1 --2- 172.21.15.47:0/4233264267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac8003a00 0x7f8adc1eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:15.631 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae0f29700 1 -- 172.21.15.47:0/4233264267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8adc153570 msgr2=0x7f8adc153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:15.631 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae0f29700 1 --2- 172.21.15.47:0/4233264267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8adc153570 0x7f8adc153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:15.631 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae0f29700 1 -- 172.21.15.47:0/4233264267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac8003a00 msgr2=0x7f8adc1eda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:15.631 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae0f29700 1 --2- 172.21.15.47:0/4233264267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac8003a00 0x7f8adc1eda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:15.631 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.632+0000 7f8ae0f29700 1 -- 172.21.15.47:0/4233264267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc0bfef0 con 0x7f8adc0a9690 2024-05-08T19:22:15.631 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.633+0000 7f8ae0f29700 1 --2- 172.21.15.47:0/4233264267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8adc0a9690 0x7f8adc1edfd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80072c0 tx=0x7f8ad80075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:15.631 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.633+0000 7f8acdffb700 1 -- 172.21.15.47:0/4233264267 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8011580 con 0x7f8adc0a9690 2024-05-08T19:22:15.631 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.633+0000 7f8acdffb700 1 -- 172.21.15.47:0/4233264267 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad80116e0 con 0x7f8adc0a9690 2024-05-08T19:22:15.631 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.633+0000 7f8ae398e700 1 -- 172.21.15.47:0/4233264267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8adc14ed50 con 0x7f8adc0a9690 2024-05-08T19:22:15.631 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.633+0000 7f8acdffb700 1 -- 172.21.15.47:0/4233264267 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8011a90 con 0x7f8adc0a9690 2024-05-08T19:22:15.631 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.633+0000 7f8ae398e700 1 -- 172.21.15.47:0/4233264267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8adc14f310 con 0x7f8adc0a9690 2024-05-08T19:22:15.632 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.634+0000 7f8ae398e700 1 -- 172.21.15.47:0/4233264267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8adc0a6130 con 0x7f8adc0a9690 2024-05-08T19:22:15.632 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.634+0000 7f8acdffb700 1 -- 172.21.15.47:0/4233264267 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f8ad8011bf0 con 0x7f8adc0a9690 2024-05-08T19:22:15.632 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.635+0000 7f8acdffb700 1 --2- 172.21.15.47:0/4233264267 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f8ac006ac00 0x7f8ac006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:15.632 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.635+0000 7f8acdffb700 1 -- 172.21.15.47:0/4233264267 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f8ad8088bf0 con 0x7f8adc0a9690 2024-05-08T19:22:15.632 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.635+0000 7f8ae172a700 1 --2- 172.21.15.47:0/4233264267 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f8ac006ac00 0x7f8ac006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:15.632 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.636+0000 7f8ae172a700 1 --2- 172.21.15.47:0/4233264267 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f8ac006ac00 0x7f8ac006d0c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0015040 tx=0x7f8ad0009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:15.632 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.640+0000 7f8acdffb700 1 -- 172.21.15.47:0/4233264267 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8ad80544c0 con 0x7f8adc0a9690 2024-05-08T19:22:15.842 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.850+0000 7f8ae398e700 1 -- 172.21.15.47:0/4233264267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8adc153370 con 0x7f8adc0a9690 2024-05-08T19:22:15.843 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.851+0000 7f8acdffb700 1 -- 172.21.15.47:0/4233264267 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10440 (secure 0 0 0) 0x7f8ad8057ae0 con 0x7f8adc0a9690 2024-05-08T19:22:15.843 INFO:teuthology.misc.health.smithi047.stdout: 2024-05-08T19:22:15.843 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":13,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:14.845939+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:15.845 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.853+0000 7f8ae398e700 1 -- 172.21.15.47:0/4233264267 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f8ac006ac00 msgr2=0x7f8ac006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:15.846 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.853+0000 7f8ae398e700 1 --2- 172.21.15.47:0/4233264267 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f8ac006ac00 0x7f8ac006d0c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0015040 tx=0x7f8ad0009030 comp rx=0 tx=0).stop 2024-05-08T19:22:15.846 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.853+0000 7f8ae398e700 1 -- 172.21.15.47:0/4233264267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8adc0a9690 msgr2=0x7f8adc1edfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:15.846 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.853+0000 7f8ae398e700 1 --2- 172.21.15.47:0/4233264267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8adc0a9690 0x7f8adc1edfd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80072c0 tx=0x7f8ad80075d0 comp rx=0 tx=0).stop 2024-05-08T19:22:15.846 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.853+0000 7f8ae398e700 1 -- 172.21.15.47:0/4233264267 shutdown_connections 2024-05-08T19:22:15.846 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.853+0000 7f8ae398e700 1 --2- 172.21.15.47:0/4233264267 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f8ac006ac00 0x7f8ac006d0c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:15.846 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.853+0000 7f8ae398e700 1 --2- 172.21.15.47:0/4233264267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8adc153570 0x7f8adc153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:15.846 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.853+0000 7f8ae398e700 1 --2- 172.21.15.47:0/4233264267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac8003a00 0x7f8adc1eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:15.846 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.853+0000 7f8ae398e700 1 --2- 172.21.15.47:0/4233264267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8adc0a9690 0x7f8adc1edfd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:15.846 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.853+0000 7f8ae398e700 1 -- 172.21.15.47:0/4233264267 >> 172.21.15.47:0/4233264267 conn(0x7f8adc06a9c0 msgr2=0x7f8adc06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:15.846 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.853+0000 7f8ae398e700 1 -- 172.21.15.47:0/4233264267 shutdown_connections 2024-05-08T19:22:15.846 INFO:teuthology.misc.health.smithi047.stderr:2024-05-08T19:22:15.853+0000 7f8ae398e700 1 -- 172.21.15.47:0/4233264267 wait complete. 2024-05-08T19:22:15.857 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-08T19:22:15.857 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T19:22:15.858 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-08T19:22:15.858 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-08T19:22:15.861 INFO:tasks.ceph.mds.a:Started 2024-05-08T19:22:15.861 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-08T19:22:15.861 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-08T19:22:15.863 INFO:tasks.ceph.mds.c:Started 2024-05-08T19:22:15.864 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T19:22:15.864 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T19:22:15.867 INFO:tasks.ceph.mds.b:Started 2024-05-08T19:22:15.867 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T19:22:15.867 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T19:22:15.872 INFO:tasks.ceph.mds.d:Started 2024-05-08T19:22:15.872 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-08T19:22:15.872 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:15.952 INFO:tasks.ceph.mds.a.smithi047.stdout:starting mds.a at 2024-05-08T19:22:15.954 INFO:tasks.ceph.mds.c.smithi047.stdout:starting mds.c at 2024-05-08T19:22:15.959 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-05-08T19:22:15.960 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-05-08T19:22:16.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.027+0000 7f169359f700 1 Processor -- start 2024-05-08T19:22:16.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.027+0000 7f169359f700 1 -- start start 2024-05-08T19:22:16.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.028+0000 7f169359f700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f168c1522b0 0x7f168c155650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.028+0000 7f169359f700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f168c0c5480 0x7f168c0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.028+0000 7f169359f700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c0c4eb0 con 0x7f168c06bd40 2024-05-08T19:22:16.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.028+0000 7f169359f700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c06c870 con 0x7f168c0c5480 2024-05-08T19:22:16.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.028+0000 7f169359f700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0c8830 con 0x7f168c1522b0 2024-05-08T19:22:16.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.028+0000 7f169133b700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f168c1522b0 0x7f168c155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:16.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.028+0000 7f1691b3c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f168c0c5480 0x7f168c0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:16.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.028+0000 7f1690b3a700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f168c06bd40 0x7f168c0c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:50334/0 (socket says 172.21.15.47:50334) 2024-05-08T19:22:16.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.028+0000 7f1690b3a700 1 -- 172.21.15.47:0/2955364799 learned_addr learned my addr 172.21.15.47:0/2955364799 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:16.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.028+0000 7f169133b700 1 -- 172.21.15.47:0/2955364799 >> v2:172.21.15.177:3300/0 conn(0x7f168c0c5480 msgr2=0x7f168c0c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:16.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.028+0000 7f169133b700 1 --2- 172.21.15.47:0/2955364799 >> v2:172.21.15.177:3300/0 conn(0x7f168c0c5480 0x7f168c0c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.028+0000 7f169133b700 1 -- 172.21.15.47:0/2955364799 >> v1:172.21.15.177:6789/0 conn(0x7f168c06bd40 legacy=0x7f168c0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:16.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.028+0000 7f169133b700 1 -- 172.21.15.47:0/2955364799 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c154b90 con 0x7f168c1522b0 2024-05-08T19:22:16.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.028+0000 7f1691b3c700 1 --2- 172.21.15.47:0/2955364799 >> v2:172.21.15.177:3300/0 conn(0x7f168c0c5480 0x7f168c0c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:16.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.029+0000 7f169133b700 1 --2- 172.21.15.47:0/2955364799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f168c1522b0 0x7f168c155650 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1684009d90 tx=0x7f168400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb5a8aa85d2411c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:16.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.029+0000 7f168bfff700 1 -- 172.21.15.47:0/2955364799 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168400e070 con 0x7f168c1522b0 2024-05-08T19:22:16.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.029+0000 7f168bfff700 1 -- 172.21.15.47:0/2955364799 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168400bb20 con 0x7f168c1522b0 2024-05-08T19:22:16.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.029+0000 7f168bfff700 1 -- 172.21.15.47:0/2955364799 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684012430 con 0x7f168c1522b0 2024-05-08T19:22:16.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.029+0000 7f169359f700 1 -- 172.21.15.47:0/2955364799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f168c1522b0 msgr2=0x7f168c155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:16.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.029+0000 7f169359f700 1 --2- 172.21.15.47:0/2955364799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f168c1522b0 0x7f168c155650 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1684009d90 tx=0x7f168400b330 comp rx=0 tx=0).stop 2024-05-08T19:22:16.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.029+0000 7f169359f700 1 -- 172.21.15.47:0/2955364799 shutdown_connections 2024-05-08T19:22:16.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.029+0000 7f169359f700 1 --2- 172.21.15.47:0/2955364799 >> v2:172.21.15.177:3300/0 conn(0x7f168c0c5480 0x7f168c0c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.029+0000 7f169359f700 1 --2- 172.21.15.47:0/2955364799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f168c1522b0 0x7f168c155650 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.029+0000 7f169359f700 1 -- 172.21.15.47:0/2955364799 >> 172.21.15.47:0/2955364799 conn(0x7f168c0abd10 msgr2=0x7f168c0ac0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:16.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.029+0000 7f169359f700 1 -- 172.21.15.47:0/2955364799 shutdown_connections 2024-05-08T19:22:16.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.029+0000 7f169359f700 1 -- 172.21.15.47:0/2955364799 wait complete. 2024-05-08T19:22:16.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.031+0000 7f169359f700 1 Processor -- start 2024-05-08T19:22:16.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.031+0000 7f169359f700 1 -- start start 2024-05-08T19:22:16.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f169359f700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f168c06bd40 0x7f168c0afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f169359f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f168c0c5480 0x7f168c14d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f169359f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f168c1522b0 0x7f168c14a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f169359f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0c0d00 con 0x7f168c0c5480 2024-05-08T19:22:16.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f169359f700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0c06d0 con 0x7f168c1522b0 2024-05-08T19:22:16.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f169359f700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0ad950 con 0x7f168c06bd40 2024-05-08T19:22:16.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f1690b3a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f168c0c5480 0x7f168c14d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:16.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f169133b700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f168c06bd40 0x7f168c0afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:16.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f1690b3a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f168c0c5480 0x7f168c14d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39300/0 (socket says 172.21.15.47:39300) 2024-05-08T19:22:16.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f169133b700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f168c06bd40 0x7f168c0afdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:33308/0 (socket says 172.21.15.47:33308) 2024-05-08T19:22:16.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f1690b3a700 1 -- 172.21.15.47:0/2394860712 learned_addr learned my addr 172.21.15.47:0/2394860712 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:16.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f1691b3c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f168c1522b0 0x7f168c14a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:16.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f1690b3a700 1 -- 172.21.15.47:0/2394860712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f168c06bd40 msgr2=0x7f168c0afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:16.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f1690b3a700 1 --2- 172.21.15.47:0/2394860712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f168c06bd40 0x7f168c0afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f1690b3a700 1 -- 172.21.15.47:0/2394860712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f168c1522b0 msgr2=0x7f168c14a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:16.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f1690b3a700 1 --2- 172.21.15.47:0/2394860712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f168c1522b0 0x7f168c14a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f1690b3a700 1 -- 172.21.15.47:0/2394860712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c0094a0 con 0x7f168c0c5480 2024-05-08T19:22:16.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.032+0000 7f169133b700 1 --2- 172.21.15.47:0/2394860712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f168c06bd40 0x7f168c0afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:16.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.033+0000 7f1690b3a700 1 --2- 172.21.15.47:0/2394860712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f168c0c5480 0x7f168c14d910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f168000c480 tx=0x7f168000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:16.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.033+0000 7f1689ffb700 1 -- 172.21.15.47:0/2394860712 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1680005d70 con 0x7f168c0c5480 2024-05-08T19:22:16.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.033+0000 7f1689ffb700 1 -- 172.21.15.47:0/2394860712 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168000ce90 con 0x7f168c0c5480 2024-05-08T19:22:16.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.033+0000 7f169359f700 1 -- 172.21.15.47:0/2394860712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1684009a70 con 0x7f168c0c5480 2024-05-08T19:22:16.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.033+0000 7f1689ffb700 1 -- 172.21.15.47:0/2394860712 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16800072d0 con 0x7f168c0c5480 2024-05-08T19:22:16.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.033+0000 7f169359f700 1 -- 172.21.15.47:0/2394860712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c0c0920 con 0x7f168c0c5480 2024-05-08T19:22:16.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.034+0000 7f169359f700 1 -- 172.21.15.47:0/2394860712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c0ade70 con 0x7f168c0c5480 2024-05-08T19:22:16.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.034+0000 7f1689ffb700 1 -- 172.21.15.47:0/2394860712 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f1680007430 con 0x7f168c0c5480 2024-05-08T19:22:16.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.035+0000 7f1689ffb700 1 --2- 172.21.15.47:0/2394860712 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f167806ac00 0x7f167806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.035+0000 7f1689ffb700 1 -- 172.21.15.47:0/2394860712 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f1680088020 con 0x7f168c0c5480 2024-05-08T19:22:16.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.035+0000 7f169133b700 1 --2- 172.21.15.47:0/2394860712 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f167806ac00 0x7f167806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:16.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.036+0000 7f169133b700 1 --2- 172.21.15.47:0/2394860712 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f167806ac00 0x7f167806d0c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1684000f80 tx=0x7f1684011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:16.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.040+0000 7f1689ffb700 1 -- 172.21.15.47:0/2394860712 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1680053780 con 0x7f168c0c5480 2024-05-08T19:22:16.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.250+0000 7f169359f700 1 -- 172.21.15.47:0/2394860712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f168c04ec60 con 0x7f168c0c5480 2024-05-08T19:22:16.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.251+0000 7f1689ffb700 1 -- 172.21.15.47:0/2394860712 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+12386 (secure 0 0 0) 0x7f1680056da0 con 0x7f168c0c5480 2024-05-08T19:22:16.243 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:16.243 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":14,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:15.924359+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:16.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.253+0000 7f169359f700 1 -- 172.21.15.47:0/2394860712 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f167806ac00 msgr2=0x7f167806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:16.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.253+0000 7f169359f700 1 --2- 172.21.15.47:0/2394860712 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f167806ac00 0x7f167806d0c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1684000f80 tx=0x7f1684011000 comp rx=0 tx=0).stop 2024-05-08T19:22:16.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.253+0000 7f169359f700 1 -- 172.21.15.47:0/2394860712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f168c0c5480 msgr2=0x7f168c14d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:16.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.253+0000 7f169359f700 1 --2- 172.21.15.47:0/2394860712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f168c0c5480 0x7f168c14d910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f168000c480 tx=0x7f168000c790 comp rx=0 tx=0).stop 2024-05-08T19:22:16.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.253+0000 7f169359f700 1 -- 172.21.15.47:0/2394860712 shutdown_connections 2024-05-08T19:22:16.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.253+0000 7f169359f700 1 --2- 172.21.15.47:0/2394860712 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f167806ac00 0x7f167806d0c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.253+0000 7f169359f700 1 --2- 172.21.15.47:0/2394860712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f168c1522b0 0x7f168c14a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.253+0000 7f169359f700 1 --2- 172.21.15.47:0/2394860712 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f168c06bd40 0x7f168c0afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.253+0000 7f169359f700 1 --2- 172.21.15.47:0/2394860712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f168c0c5480 0x7f168c14d910 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.253+0000 7f169359f700 1 -- 172.21.15.47:0/2394860712 >> 172.21.15.47:0/2394860712 conn(0x7f168c0abd10 msgr2=0x7f168c14f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:16.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.253+0000 7f169359f700 1 -- 172.21.15.47:0/2394860712 shutdown_connections 2024-05-08T19:22:16.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.253+0000 7f169359f700 1 -- 172.21.15.47:0/2394860712 wait complete. 2024-05-08T19:22:16.257 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T19:22:15.923832+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T19:22:16.258 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T19:22:16.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.394+0000 7fe77c76c700 1 Processor -- start 2024-05-08T19:22:16.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.394+0000 7fe77c76c700 1 -- start start 2024-05-08T19:22:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.395+0000 7fe77c76c700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe7740c2be0 0x7fe7741526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.395+0000 7fe77c76c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe7740c4f60 0x7fe7740c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.395+0000 7fe77c76c700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7740ab720 con 0x7fe7740aae80 2024-05-08T19:22:16.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.395+0000 7fe77c76c700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7740aba00 con 0x7fe7740c2be0 2024-05-08T19:22:16.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.395+0000 7fe77c76c700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7740abce0 con 0x7fe7740c4f60 2024-05-08T19:22:16.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.395+0000 7fe77a508700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe7740c2be0 0x7fe7741526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:16.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.395+0000 7fe77a508700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe7740c2be0 0x7fe7741526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39302/0 (socket says 172.21.15.47:39302) 2024-05-08T19:22:16.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.395+0000 7fe77a508700 1 -- 172.21.15.47:0/4189260374 learned_addr learned my addr 172.21.15.47:0/4189260374 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:16.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.396+0000 7fe77ad09700 1 --2- 172.21.15.47:0/4189260374 >> v2:172.21.15.177:3300/0 conn(0x7fe7740c4f60 0x7fe7740c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:16.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.396+0000 7fe77a508700 1 -- 172.21.15.47:0/4189260374 >> v2:172.21.15.177:3300/0 conn(0x7fe7740c4f60 msgr2=0x7fe7740c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:16.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.396+0000 7fe77a508700 1 --2- 172.21.15.47:0/4189260374 >> v2:172.21.15.177:3300/0 conn(0x7fe7740c4f60 0x7fe7740c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.396+0000 7fe77a508700 1 -- 172.21.15.47:0/4189260374 >> v1:172.21.15.177:6789/0 conn(0x7fe7740aae80 legacy=0x7fe77406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:16.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.396+0000 7fe77a508700 1 -- 172.21.15.47:0/4189260374 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7740c4760 con 0x7fe7740c2be0 2024-05-08T19:22:16.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.396+0000 7fe77a508700 1 --2- 172.21.15.47:0/4189260374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7740c2be0 0x7fe7741526f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7740aa670 tx=0x7fe764009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f28172e65b11a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:16.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.396+0000 7fe779506700 1 -- 172.21.15.47:0/4189260374 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764004230 con 0x7fe7740c2be0 2024-05-08T19:22:16.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.396+0000 7fe779506700 1 -- 172.21.15.47:0/4189260374 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe764004390 con 0x7fe7740c2be0 2024-05-08T19:22:16.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.396+0000 7fe779506700 1 -- 172.21.15.47:0/4189260374 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7640036a0 con 0x7fe7740c2be0 2024-05-08T19:22:16.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.396+0000 7fe77c76c700 1 -- 172.21.15.47:0/4189260374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7740c2be0 msgr2=0x7fe7741526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:16.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.396+0000 7fe77c76c700 1 --2- 172.21.15.47:0/4189260374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7740c2be0 0x7fe7741526f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7740aa670 tx=0x7fe764009bd0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.397+0000 7fe77c76c700 1 -- 172.21.15.47:0/4189260374 shutdown_connections 2024-05-08T19:22:16.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.397+0000 7fe77c76c700 1 --2- 172.21.15.47:0/4189260374 >> v2:172.21.15.177:3300/0 conn(0x7fe7740c4f60 0x7fe7740c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.397+0000 7fe77c76c700 1 --2- 172.21.15.47:0/4189260374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7740c2be0 0x7fe7741526f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.397+0000 7fe77c76c700 1 -- 172.21.15.47:0/4189260374 >> 172.21.15.47:0/4189260374 conn(0x7fe7740c3360 msgr2=0x7fe7740c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:16.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.397+0000 7fe77c76c700 1 -- 172.21.15.47:0/4189260374 shutdown_connections 2024-05-08T19:22:16.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.397+0000 7fe77c76c700 1 -- 172.21.15.47:0/4189260374 wait complete. 2024-05-08T19:22:16.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.398+0000 7fe77c76c700 1 Processor -- start 2024-05-08T19:22:16.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.398+0000 7fe77c76c700 1 -- start start 2024-05-08T19:22:16.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.399+0000 7fe77c76c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7740aae80 0x7fe774151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.399+0000 7fe77c76c700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7740c2be0 0x7fe774149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.399+0000 7fe77c76c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7740c4f60 0x7fe7741499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.399+0000 7fe77c76c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7741545c0 con 0x7fe7740aae80 2024-05-08T19:22:16.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.399+0000 7fe77c76c700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7741548a0 con 0x7fe7740c4f60 2024-05-08T19:22:16.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.399+0000 7fe77c76c700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7741dcbb0 con 0x7fe7740c2be0 2024-05-08T19:22:16.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.399+0000 7fe77a508700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7740aae80 0x7fe774151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:16.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.399+0000 7fe77a508700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7740aae80 0x7fe774151c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39314/0 (socket says 172.21.15.47:39314) 2024-05-08T19:22:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.399+0000 7fe77a508700 1 -- 172.21.15.47:0/3409971110 learned_addr learned my addr 172.21.15.47:0/3409971110 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.399+0000 7fe77a508700 1 -- 172.21.15.47:0/3409971110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7740c2be0 msgr2=0x7fe774149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.399+0000 7fe77a508700 1 --2- 172.21.15.47:0/3409971110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7740c2be0 0x7fe774149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.399+0000 7fe77a508700 1 -- 172.21.15.47:0/3409971110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7740c4f60 msgr2=0x7fe7741499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.399+0000 7fe77a508700 1 --2- 172.21.15.47:0/3409971110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7740c4f60 0x7fe7741499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.399+0000 7fe77a508700 1 -- 172.21.15.47:0/3409971110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe764009550 con 0x7fe7740aae80 2024-05-08T19:22:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.400+0000 7fe77a508700 1 --2- 172.21.15.47:0/3409971110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7740aae80 0x7fe774151c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe764009130 tx=0x7fe764004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.400+0000 7fe76affd700 1 -- 172.21.15.47:0/3409971110 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764003d40 con 0x7fe7740aae80 2024-05-08T19:22:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.400+0000 7fe76affd700 1 -- 172.21.15.47:0/3409971110 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76401f070 con 0x7fe7740aae80 2024-05-08T19:22:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.400+0000 7fe77c76c700 1 -- 172.21.15.47:0/3409971110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7741dce90 con 0x7fe7740aae80 2024-05-08T19:22:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.400+0000 7fe76affd700 1 -- 172.21.15.47:0/3409971110 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764011870 con 0x7fe7740aae80 2024-05-08T19:22:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.400+0000 7fe77c76c700 1 -- 172.21.15.47:0/3409971110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7741521c0 con 0x7fe7740aae80 2024-05-08T19:22:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.401+0000 7fe77c76c700 1 -- 172.21.15.47:0/3409971110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7740ab2e0 con 0x7fe7740aae80 2024-05-08T19:22:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.401+0000 7fe76affd700 1 -- 172.21.15.47:0/3409971110 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7fe764021030 con 0x7fe7740aae80 2024-05-08T19:22:16.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.402+0000 7fe76affd700 1 --2- 172.21.15.47:0/3409971110 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe75806ac30 0x7fe75806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.402+0000 7fe76affd700 1 -- 172.21.15.47:0/3409971110 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4846+0+0 (secure 0 0 0) 0x7fe76408a400 con 0x7fe7740aae80 2024-05-08T19:22:16.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.402+0000 7fe779d07700 1 --2- 172.21.15.47:0/3409971110 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe75806ac30 0x7fe75806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:16.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.402+0000 7fe779d07700 1 --2- 172.21.15.47:0/3409971110 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe75806ac30 0x7fe75806d0f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe770003df0 tx=0x7fe770007a40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:16.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.407+0000 7fe76affd700 1 -- 172.21.15.47:0/3409971110 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe7740ab2e0 con 0x7fe7740aae80 2024-05-08T19:22:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.612+0000 7fe77c76c700 1 -- 172.21.15.47:0/3409971110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7741dd3b0 con 0x7fe7740aae80 2024-05-08T19:22:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.612+0000 7fe76affd700 1 -- 172.21.15.47:0/3409971110 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v14) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7741dd3b0 con 0x7fe7740aae80 2024-05-08T19:22:16.605 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-08T19:22:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.614+0000 7fe77c76c700 1 -- 172.21.15.47:0/3409971110 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe75806ac30 msgr2=0x7fe75806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.614+0000 7fe77c76c700 1 --2- 172.21.15.47:0/3409971110 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe75806ac30 0x7fe75806d0f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe770003df0 tx=0x7fe770007a40 comp rx=0 tx=0).stop 2024-05-08T19:22:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.614+0000 7fe77c76c700 1 -- 172.21.15.47:0/3409971110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7740aae80 msgr2=0x7fe774151c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.614+0000 7fe77c76c700 1 --2- 172.21.15.47:0/3409971110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7740aae80 0x7fe774151c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe764009130 tx=0x7fe764004750 comp rx=0 tx=0).stop 2024-05-08T19:22:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.614+0000 7fe77c76c700 1 -- 172.21.15.47:0/3409971110 shutdown_connections 2024-05-08T19:22:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.614+0000 7fe77c76c700 1 --2- 172.21.15.47:0/3409971110 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe75806ac30 0x7fe75806d0f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.614+0000 7fe77c76c700 1 --2- 172.21.15.47:0/3409971110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7740aae80 0x7fe774151c80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.614+0000 7fe77c76c700 1 --2- 172.21.15.47:0/3409971110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7740c4f60 0x7fe7741499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.614+0000 7fe77c76c700 1 --2- 172.21.15.47:0/3409971110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7740c2be0 0x7fe774149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.614+0000 7fe77c76c700 1 -- 172.21.15.47:0/3409971110 >> 172.21.15.47:0/3409971110 conn(0x7fe7740c3360 msgr2=0x7fe7740a7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:16.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.614+0000 7fe77c76c700 1 -- 172.21.15.47:0/3409971110 shutdown_connections 2024-05-08T19:22:16.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.615+0000 7fe77c76c700 1 -- 172.21.15.47:0/3409971110 wait complete. 2024-05-08T19:22:16.619 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T19:22:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.753+0000 7fe21d2c5700 1 Processor -- start 2024-05-08T19:22:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.753+0000 7fe21d2c5700 1 -- start start 2024-05-08T19:22:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe21d2c5700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe21806bd40 0x7fe218155650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe21d2c5700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2180c4eb0 con 0x7fe2181522b0 2024-05-08T19:22:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe21d2c5700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe218154b90 con 0x7fe2180c5480 2024-05-08T19:22:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe21d2c5700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21806c870 con 0x7fe21806bd40 2024-05-08T19:22:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe2167fc700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe21806bd40 0x7fe218155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe216ffd700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe2181522b0 0x7fe2180c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59944/0 (socket says 172.21.15.47:59944) 2024-05-08T19:22:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe2167fc700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe21806bd40 0x7fe218155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39318/0 (socket says 172.21.15.47:39318) 2024-05-08T19:22:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe216ffd700 1 -- 172.21.15.47:0/2287213130 learned_addr learned my addr 172.21.15.47:0/2287213130 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe215ffb700 1 -- 172.21.15.47:0/2287213130 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005366653 0 0) 0x7fe2180c4eb0 con 0x7fe2181522b0 2024-05-08T19:22:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe215ffb700 1 -- 172.21.15.47:0/2287213130 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2040035b0 con 0x7fe2181522b0 2024-05-08T19:22:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe2167fc700 1 -- 172.21.15.47:0/2287213130 >> v1:172.21.15.177:6789/0 conn(0x7fe2180c5480 legacy=0x7fe2180c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe2167fc700 1 -- 172.21.15.47:0/2287213130 >> v1:172.21.15.47:6789/0 conn(0x7fe2181522b0 legacy=0x7fe2180c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe2167fc700 1 -- 172.21.15.47:0/2287213130 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2180c5100 con 0x7fe21806bd40 2024-05-08T19:22:16.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe2167fc700 1 --2- 172.21.15.47:0/2287213130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe21806bd40 0x7fe218155650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe200009840 tx=0x7fe200009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7008df34eccaa13 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:16.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe215ffb700 1 -- 172.21.15.47:0/2287213130 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200004230 con 0x7fe21806bd40 2024-05-08T19:22:16.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe215ffb700 1 -- 172.21.15.47:0/2287213130 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe200004390 con 0x7fe21806bd40 2024-05-08T19:22:16.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.754+0000 7fe215ffb700 1 -- 172.21.15.47:0/2287213130 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2000036a0 con 0x7fe21806bd40 2024-05-08T19:22:16.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.755+0000 7fe21d2c5700 1 -- 172.21.15.47:0/2287213130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe21806bd40 msgr2=0x7fe218155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:16.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.755+0000 7fe21d2c5700 1 --2- 172.21.15.47:0/2287213130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe21806bd40 0x7fe218155650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe200009840 tx=0x7fe200009b50 comp rx=0 tx=0).stop 2024-05-08T19:22:16.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.755+0000 7fe21d2c5700 1 -- 172.21.15.47:0/2287213130 shutdown_connections 2024-05-08T19:22:16.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.755+0000 7fe21d2c5700 1 --2- 172.21.15.47:0/2287213130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe21806bd40 0x7fe218155650 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.755+0000 7fe21d2c5700 1 -- 172.21.15.47:0/2287213130 >> 172.21.15.47:0/2287213130 conn(0x7fe2180abd10 msgr2=0x7fe2180ac0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:16.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.755+0000 7fe21d2c5700 1 -- 172.21.15.47:0/2287213130 shutdown_connections 2024-05-08T19:22:16.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.755+0000 7fe21d2c5700 1 -- 172.21.15.47:0/2287213130 wait complete. 2024-05-08T19:22:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.756+0000 7fe21d2c5700 1 Processor -- start 2024-05-08T19:22:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.756+0000 7fe21d2c5700 1 -- start start 2024-05-08T19:22:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.757+0000 7fe21d2c5700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe21806bd40 0x7fe2180c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.757+0000 7fe21d2c5700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2180c5480 0x7fe2180c1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.757+0000 7fe21d2c5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2181522b0 0x7fe2180c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.757+0000 7fe21d2c5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2180bd710 con 0x7fe2181522b0 2024-05-08T19:22:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.757+0000 7fe21d2c5700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe218158c20 con 0x7fe2180c5480 2024-05-08T19:22:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.757+0000 7fe21d2c5700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2181ead10 con 0x7fe21806bd40 2024-05-08T19:22:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.757+0000 7fe2177fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2181522b0 0x7fe2180c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.757+0000 7fe2177fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2181522b0 0x7fe2180c1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39334/0 (socket says 172.21.15.47:39334) 2024-05-08T19:22:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.757+0000 7fe2177fe700 1 -- 172.21.15.47:0/3770003005 learned_addr learned my addr 172.21.15.47:0/3770003005 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.757+0000 7fe216ffd700 1 --2- 172.21.15.47:0/3770003005 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe21806bd40 0x7fe2180c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.757+0000 7fe2167fc700 1 --2- 172.21.15.47:0/3770003005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2180c5480 0x7fe2180c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.758+0000 7fe2177fe700 1 -- 172.21.15.47:0/3770003005 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe21806bd40 msgr2=0x7fe2180c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.758+0000 7fe2177fe700 1 --2- 172.21.15.47:0/3770003005 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe21806bd40 0x7fe2180c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.758+0000 7fe2177fe700 1 -- 172.21.15.47:0/3770003005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2180c5480 msgr2=0x7fe2180c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.758+0000 7fe2177fe700 1 --2- 172.21.15.47:0/3770003005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2180c5480 0x7fe2180c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.758+0000 7fe2177fe700 1 -- 172.21.15.47:0/3770003005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2000094a0 con 0x7fe2181522b0 2024-05-08T19:22:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.758+0000 7fe2177fe700 1 --2- 172.21.15.47:0/3770003005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2181522b0 0x7fe2180c1db0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe21000b970 tx=0x7fe21000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:16.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.758+0000 7fe20f7fe700 1 -- 172.21.15.47:0/3770003005 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21000d860 con 0x7fe2181522b0 2024-05-08T19:22:16.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.758+0000 7fe20f7fe700 1 -- 172.21.15.47:0/3770003005 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21000d9c0 con 0x7fe2181522b0 2024-05-08T19:22:16.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.758+0000 7fe21d2c5700 1 -- 172.21.15.47:0/3770003005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe218158980 con 0x7fe2181522b0 2024-05-08T19:22:16.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.758+0000 7fe20f7fe700 1 -- 172.21.15.47:0/3770003005 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21000dd70 con 0x7fe2181522b0 2024-05-08T19:22:16.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.758+0000 7fe21d2c5700 1 -- 172.21.15.47:0/3770003005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe218158e80 con 0x7fe2181522b0 2024-05-08T19:22:16.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.759+0000 7fe21d2c5700 1 -- 172.21.15.47:0/3770003005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe21804ec60 con 0x7fe2181522b0 2024-05-08T19:22:16.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.759+0000 7fe20f7fe700 1 -- 172.21.15.47:0/3770003005 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7fe21000e430 con 0x7fe2181522b0 2024-05-08T19:22:16.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.760+0000 7fe20f7fe700 1 --2- 172.21.15.47:0/3770003005 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe1f806ac00 0x7fe1f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:16.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.760+0000 7fe20f7fe700 1 -- 172.21.15.47:0/3770003005 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4846+0+0 (secure 0 0 0) 0x7fe210088f40 con 0x7fe2181522b0 2024-05-08T19:22:16.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.760+0000 7fe216ffd700 1 --2- 172.21.15.47:0/3770003005 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe1f806ac00 0x7fe1f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:16.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.761+0000 7fe216ffd700 1 --2- 172.21.15.47:0/3770003005 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe1f806ac00 0x7fe1f806d0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe208007fd0 tx=0x7fe208007dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:16.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:16.764+0000 7fe20f7fe700 1 -- 172.21.15.47:0/3770003005 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe2100546a0 con 0x7fe2181522b0 2024-05-08T19:22:17.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.023+0000 7fe21d2c5700 1 -- 172.21.15.47:0/3770003005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2180c6a80 con 0x7fe2181522b0 2024-05-08T19:22:17.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.023+0000 7fe20f7fe700 1 -- 172.21.15.47:0/3770003005 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7fe21001cde0 con 0x7fe2181522b0 2024-05-08T19:22:17.016 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:17.016 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3927983771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3927983771},{"type":"v1","addr":"172.21.15.47:6833","nonce":3927983771}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/201830514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":201830514},{"type":"v1","addr":"172.21.15.47:6835","nonce":201830514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1266001461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1266001461},{"type":"v1","addr":"172.21.15.177:6836","nonce":1266001461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/2990594738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2990594738},{"type":"v1","addr":"172.21.15.177:6837","nonce":2990594738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-08T19:22:17.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.025+0000 7fe21d2c5700 1 -- 172.21.15.47:0/3770003005 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe1f806ac00 msgr2=0x7fe1f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.025+0000 7fe21d2c5700 1 --2- 172.21.15.47:0/3770003005 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe1f806ac00 0x7fe1f806d0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe208007fd0 tx=0x7fe208007dc0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.025+0000 7fe21d2c5700 1 -- 172.21.15.47:0/3770003005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2181522b0 msgr2=0x7fe2180c1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.025+0000 7fe21d2c5700 1 --2- 172.21.15.47:0/3770003005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2181522b0 0x7fe2180c1db0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe21000b970 tx=0x7fe21000bc80 comp rx=0 tx=0).stop 2024-05-08T19:22:17.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.025+0000 7fe21d2c5700 1 -- 172.21.15.47:0/3770003005 shutdown_connections 2024-05-08T19:22:17.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.026+0000 7fe21d2c5700 1 --2- 172.21.15.47:0/3770003005 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe1f806ac00 0x7fe1f806d0c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.026+0000 7fe21d2c5700 1 --2- 172.21.15.47:0/3770003005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2181522b0 0x7fe2180c1db0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.026+0000 7fe21d2c5700 1 --2- 172.21.15.47:0/3770003005 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe21806bd40 0x7fe2180c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.026+0000 7fe21d2c5700 1 --2- 172.21.15.47:0/3770003005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2180c5480 0x7fe2180c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.026+0000 7fe21d2c5700 1 -- 172.21.15.47:0/3770003005 >> 172.21.15.47:0/3770003005 conn(0x7fe2180abd10 msgr2=0x7fe2181515d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:17.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.026+0000 7fe21d2c5700 1 -- 172.21.15.47:0/3770003005 shutdown_connections 2024-05-08T19:22:17.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.026+0000 7fe21d2c5700 1 -- 172.21.15.47:0/3770003005 wait complete. 2024-05-08T19:22:17.021 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 3 2024-05-08T19:22:17.030 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:17.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.172+0000 7fc602a40700 1 Processor -- start 2024-05-08T19:22:17.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.172+0000 7fc602a40700 1 -- start start 2024-05-08T19:22:17.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc602a40700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc5fc0c4220 0x7fc5fc153430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc602a40700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5fc06ff80 0x7fc5fc070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc602a40700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5fc156540 con 0x7fc5fc14fd80 2024-05-08T19:22:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc602a40700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5fc153010 con 0x7fc5fc0c4220 2024-05-08T19:22:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc602a40700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc0adf10 con 0x7fc5fc06ff80 2024-05-08T19:22:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc5fb7fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc5fc0c4220 0x7fc5fc153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc5fb7fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc5fc0c4220 0x7fc5fc153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39336/0 (socket says 172.21.15.47:39336) 2024-05-08T19:22:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc5fbfff700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc5fc14fd80 0x7fc5fc155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59946/0 (socket says 172.21.15.47:59946) 2024-05-08T19:22:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc5fb7fe700 1 -- 172.21.15.47:0/221288084 learned_addr learned my addr 172.21.15.47:0/221288084 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc600fdd700 1 --2- 172.21.15.47:0/221288084 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5fc06ff80 0x7fc5fc070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc5fb7fe700 1 -- 172.21.15.47:0/221288084 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5fc06ff80 msgr2=0x7fc5fc070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc5fb7fe700 1 --2- 172.21.15.47:0/221288084 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5fc06ff80 0x7fc5fc070390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc5fb7fe700 1 -- 172.21.15.47:0/221288084 >> v1:172.21.15.47:6789/0 conn(0x7fc5fc14fd80 legacy=0x7fc5fc155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc5fb7fe700 1 -- 172.21.15.47:0/221288084 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc152950 con 0x7fc5fc0c4220 2024-05-08T19:22:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc600fdd700 1 --2- 172.21.15.47:0/221288084 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5fc06ff80 0x7fc5fc070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc5fb7fe700 1 --2- 172.21.15.47:0/221288084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5fc0c4220 0x7fc5fc153430 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00098f0 tx=0x7fc5f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927adc78b65807c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:17.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc5faffd700 1 -- 172.21.15.47:0/221288084 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000b8a0 con 0x7fc5fc0c4220 2024-05-08T19:22:17.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc5faffd700 1 -- 172.21.15.47:0/221288084 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f000ba00 con 0x7fc5fc0c4220 2024-05-08T19:22:17.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.173+0000 7fc5faffd700 1 -- 172.21.15.47:0/221288084 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000bd90 con 0x7fc5fc0c4220 2024-05-08T19:22:17.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.174+0000 7fc602a40700 1 -- 172.21.15.47:0/221288084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5fc0c4220 msgr2=0x7fc5fc153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.174+0000 7fc602a40700 1 --2- 172.21.15.47:0/221288084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5fc0c4220 0x7fc5fc153430 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00098f0 tx=0x7fc5f0009c00 comp rx=0 tx=0).stop 2024-05-08T19:22:17.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.174+0000 7fc602a40700 1 -- 172.21.15.47:0/221288084 shutdown_connections 2024-05-08T19:22:17.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.174+0000 7fc602a40700 1 --2- 172.21.15.47:0/221288084 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5fc06ff80 0x7fc5fc070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.174+0000 7fc602a40700 1 --2- 172.21.15.47:0/221288084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5fc0c4220 0x7fc5fc153430 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.174+0000 7fc602a40700 1 -- 172.21.15.47:0/221288084 >> 172.21.15.47:0/221288084 conn(0x7fc5fc06e730 msgr2=0x7fc5fc06eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:17.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.174+0000 7fc602a40700 1 -- 172.21.15.47:0/221288084 shutdown_connections 2024-05-08T19:22:17.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.174+0000 7fc602a40700 1 -- 172.21.15.47:0/221288084 wait complete. 2024-05-08T19:22:17.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.176+0000 7fc602a40700 1 Processor -- start 2024-05-08T19:22:17.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.176+0000 7fc602a40700 1 -- start start 2024-05-08T19:22:17.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc602a40700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5fc06ff80 0x7fc5fc1e5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc602a40700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5fc0c4220 0x7fc5fc0c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc602a40700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5fc14fd80 0x7fc5fc1eb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc602a40700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc155780 con 0x7fc5fc06ff80 2024-05-08T19:22:17.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc602a40700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc0a96b0 con 0x7fc5fc14fd80 2024-05-08T19:22:17.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc602a40700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc0c7ae0 con 0x7fc5fc0c4220 2024-05-08T19:22:17.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc5fbfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5fc06ff80 0x7fc5fc1e5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc5fbfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5fc06ff80 0x7fc5fc1e5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39352/0 (socket says 172.21.15.47:39352) 2024-05-08T19:22:17.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc5fbfff700 1 -- 172.21.15.47:0/2985017116 learned_addr learned my addr 172.21.15.47:0/2985017116 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:17.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc5fb7fe700 1 --2- 172.21.15.47:0/2985017116 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5fc0c4220 0x7fc5fc0c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc600fdd700 1 --2- 172.21.15.47:0/2985017116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5fc14fd80 0x7fc5fc1eb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc5fbfff700 1 -- 172.21.15.47:0/2985017116 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5fc0c4220 msgr2=0x7fc5fc0c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc5fbfff700 1 --2- 172.21.15.47:0/2985017116 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5fc0c4220 0x7fc5fc0c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc5fbfff700 1 -- 172.21.15.47:0/2985017116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5fc14fd80 msgr2=0x7fc5fc1eb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc5fbfff700 1 --2- 172.21.15.47:0/2985017116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5fc14fd80 0x7fc5fc1eb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc5fbfff700 1 -- 172.21.15.47:0/2985017116 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f0009550 con 0x7fc5fc06ff80 2024-05-08T19:22:17.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc5fbfff700 1 --2- 172.21.15.47:0/2985017116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5fc06ff80 0x7fc5fc1e5460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00c500 tx=0x7fc5ec00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:17.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc5f8ff9700 1 -- 172.21.15.47:0/2985017116 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec005cb0 con 0x7fc5fc06ff80 2024-05-08T19:22:17.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc602a40700 1 -- 172.21.15.47:0/2985017116 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5fc0a8ef0 con 0x7fc5fc06ff80 2024-05-08T19:22:17.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc5f8ff9700 1 -- 172.21.15.47:0/2985017116 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec005e10 con 0x7fc5fc06ff80 2024-05-08T19:22:17.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc5f8ff9700 1 -- 172.21.15.47:0/2985017116 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec0072d0 con 0x7fc5fc06ff80 2024-05-08T19:22:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.177+0000 7fc602a40700 1 -- 172.21.15.47:0/2985017116 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5fc1e8970 con 0x7fc5fc06ff80 2024-05-08T19:22:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.178+0000 7fc602a40700 1 -- 172.21.15.47:0/2985017116 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5fc04ec60 con 0x7fc5fc06ff80 2024-05-08T19:22:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.179+0000 7fc5f8ff9700 1 -- 172.21.15.47:0/2985017116 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7fc5ec007430 con 0x7fc5fc06ff80 2024-05-08T19:22:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.179+0000 7fc5f8ff9700 1 --2- 172.21.15.47:0/2985017116 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc5e806ac00 0x7fc5e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.179+0000 7fc5f8ff9700 1 -- 172.21.15.47:0/2985017116 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc5ec088080 con 0x7fc5fc06ff80 2024-05-08T19:22:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.180+0000 7fc5fb7fe700 1 --2- 172.21.15.47:0/2985017116 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc5e806ac00 0x7fc5e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.180+0000 7fc5fb7fe700 1 --2- 172.21.15.47:0/2985017116 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc5e806ac00 0x7fc5e806d0c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009c40 tx=0x7fc5f0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:17.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.184+0000 7fc5f8ff9700 1 -- 172.21.15.47:0/2985017116 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc5ec053730 con 0x7fc5fc06ff80 2024-05-08T19:22:17.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.399+0000 7fc602a40700 1 -- 172.21.15.47:0/2985017116 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5fc06fd60 con 0x7fc5fc06ff80 2024-05-08T19:22:17.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.400+0000 7fc5f8ff9700 1 -- 172.21.15.47:0/2985017116 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12395 (secure 0 0 0) 0x7fc5ec056d50 con 0x7fc5fc06ff80 2024-05-08T19:22:17.393 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:17.393 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":15,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:16.931835+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:17.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.402+0000 7fc602a40700 1 -- 172.21.15.47:0/2985017116 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc5e806ac00 msgr2=0x7fc5e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.402+0000 7fc602a40700 1 --2- 172.21.15.47:0/2985017116 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc5e806ac00 0x7fc5e806d0c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009c40 tx=0x7fc5f0008030 comp rx=0 tx=0).stop 2024-05-08T19:22:17.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.402+0000 7fc602a40700 1 -- 172.21.15.47:0/2985017116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5fc06ff80 msgr2=0x7fc5fc1e5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.402+0000 7fc602a40700 1 --2- 172.21.15.47:0/2985017116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5fc06ff80 0x7fc5fc1e5460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00c500 tx=0x7fc5ec00c810 comp rx=0 tx=0).stop 2024-05-08T19:22:17.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.402+0000 7fc602a40700 1 -- 172.21.15.47:0/2985017116 shutdown_connections 2024-05-08T19:22:17.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.402+0000 7fc602a40700 1 --2- 172.21.15.47:0/2985017116 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc5e806ac00 0x7fc5e806d0c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.402+0000 7fc602a40700 1 --2- 172.21.15.47:0/2985017116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5fc06ff80 0x7fc5fc1e5460 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.402+0000 7fc602a40700 1 --2- 172.21.15.47:0/2985017116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5fc14fd80 0x7fc5fc1eb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.402+0000 7fc602a40700 1 --2- 172.21.15.47:0/2985017116 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5fc0c4220 0x7fc5fc0c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.402+0000 7fc602a40700 1 -- 172.21.15.47:0/2985017116 >> 172.21.15.47:0/2985017116 conn(0x7fc5fc06e730 msgr2=0x7fc5fc073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:17.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.402+0000 7fc602a40700 1 -- 172.21.15.47:0/2985017116 shutdown_connections 2024-05-08T19:22:17.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.402+0000 7fc602a40700 1 -- 172.21.15.47:0/2985017116 wait complete. 2024-05-08T19:22:17.408 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T19:22:15.923832+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T19:22:17.408 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T19:22:17.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.546+0000 7f26f69d1700 1 Processor -- start 2024-05-08T19:22:17.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.547+0000 7f26f69d1700 1 -- start start 2024-05-08T19:22:17.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.547+0000 7f26f69d1700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f26f0152160 0x7f26f006a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.547+0000 7f26f69d1700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26f006b5f0 0x7f26f006e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.547+0000 7f26f69d1700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f01554f0 con 0x7f26f006af00 2024-05-08T19:22:17.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.547+0000 7f26f69d1700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f00a8850 con 0x7f26f0152160 2024-05-08T19:22:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.547+0000 7f26f69d1700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f0152540 con 0x7f26f006b5f0 2024-05-08T19:22:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.548+0000 7f26effff700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f26f0152160 0x7f26f006a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.548+0000 7f26effff700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f26f0152160 0x7f26f006a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41860/0 (socket says 172.21.15.47:41860) 2024-05-08T19:22:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.548+0000 7f26effff700 1 -- 172.21.15.47:0/397663213 learned_addr learned my addr 172.21.15.47:0/397663213 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.548+0000 7f26ef7fe700 1 --2- 172.21.15.47:0/397663213 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26f006b5f0 0x7f26f006e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.548+0000 7f26effff700 1 -- 172.21.15.47:0/397663213 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26f006b5f0 msgr2=0x7f26f006e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.548+0000 7f26effff700 1 --2- 172.21.15.47:0/397663213 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26f006b5f0 0x7f26f006e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.548+0000 7f26effff700 1 -- 172.21.15.47:0/397663213 >> v1:172.21.15.177:6789/0 conn(0x7f26f006af00 legacy=0x7f26f0158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.548+0000 7f26effff700 1 -- 172.21.15.47:0/397663213 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f00a9940 con 0x7f26f0152160 2024-05-08T19:22:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.548+0000 7f26effff700 1 --2- 172.21.15.47:0/397663213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26f0152160 0x7f26f006a9c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009920 tx=0x7f26e0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66893d6bde5900a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:17.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.548+0000 7f26eeffd700 1 -- 172.21.15.47:0/397663213 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e0004230 con 0x7f26f0152160 2024-05-08T19:22:17.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.548+0000 7f26eeffd700 1 -- 172.21.15.47:0/397663213 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e0004390 con 0x7f26f0152160 2024-05-08T19:22:17.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.548+0000 7f26eeffd700 1 -- 172.21.15.47:0/397663213 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e0009e70 con 0x7f26f0152160 2024-05-08T19:22:17.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.549+0000 7f26f69d1700 1 -- 172.21.15.47:0/397663213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26f0152160 msgr2=0x7f26f006a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.549+0000 7f26f69d1700 1 --2- 172.21.15.47:0/397663213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26f0152160 0x7f26f006a9c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009920 tx=0x7f26e0009c30 comp rx=0 tx=0).stop 2024-05-08T19:22:17.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.549+0000 7f26f69d1700 1 -- 172.21.15.47:0/397663213 shutdown_connections 2024-05-08T19:22:17.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.549+0000 7f26f69d1700 1 --2- 172.21.15.47:0/397663213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26f0152160 0x7f26f006a9c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.549+0000 7f26f69d1700 1 --2- 172.21.15.47:0/397663213 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26f006b5f0 0x7f26f006e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.549+0000 7f26f69d1700 1 -- 172.21.15.47:0/397663213 >> 172.21.15.47:0/397663213 conn(0x7f26f00c71c0 msgr2=0x7f26f00c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:17.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.549+0000 7f26f69d1700 1 -- 172.21.15.47:0/397663213 shutdown_connections 2024-05-08T19:22:17.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.549+0000 7f26f69d1700 1 -- 172.21.15.47:0/397663213 wait complete. 2024-05-08T19:22:17.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.551+0000 7f26f69d1700 1 Processor -- start 2024-05-08T19:22:17.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.551+0000 7f26f69d1700 1 -- start start 2024-05-08T19:22:17.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26f69d1700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26f006af00 0x7f26f00c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26f69d1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26f006b5f0 0x7f26f0148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26f69d1700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26f0152160 0x7f26f01ea7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26f69d1700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f0145b10 con 0x7f26f006b5f0 2024-05-08T19:22:17.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26f69d1700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f0145770 con 0x7f26f006af00 2024-05-08T19:22:17.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26f69d1700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f0147ac0 con 0x7f26f0152160 2024-05-08T19:22:17.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26ef7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26f006b5f0 0x7f26f0148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26ef7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26f006b5f0 0x7f26f0148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41876/0 (socket says 172.21.15.47:41876) 2024-05-08T19:22:17.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26ef7fe700 1 -- 172.21.15.47:0/1873289898 learned_addr learned my addr 172.21.15.47:0/1873289898 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:17.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26effff700 1 --2- 172.21.15.47:0/1873289898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26f006af00 0x7f26f00c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26f4f6e700 1 --2- 172.21.15.47:0/1873289898 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26f0152160 0x7f26f01ea7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26ef7fe700 1 -- 172.21.15.47:0/1873289898 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26f0152160 msgr2=0x7f26f01ea7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26ef7fe700 1 --2- 172.21.15.47:0/1873289898 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26f0152160 0x7f26f01ea7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26ef7fe700 1 -- 172.21.15.47:0/1873289898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26f006af00 msgr2=0x7f26f00c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26ef7fe700 1 --2- 172.21.15.47:0/1873289898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26f006af00 0x7f26f00c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26ef7fe700 1 -- 172.21.15.47:0/1873289898 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e0009550 con 0x7f26f006b5f0 2024-05-08T19:22:17.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26effff700 1 --2- 172.21.15.47:0/1873289898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26f006af00 0x7f26f00c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:17.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.552+0000 7f26ef7fe700 1 --2- 172.21.15.47:0/1873289898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26f006b5f0 0x7f26f0148870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f26e400c7f0 tx=0x7f26e400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:17.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.553+0000 7f26ecff9700 1 -- 172.21.15.47:0/1873289898 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4004220 con 0x7f26f006b5f0 2024-05-08T19:22:17.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.553+0000 7f26ecff9700 1 -- 172.21.15.47:0/1873289898 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e4004380 con 0x7f26f006b5f0 2024-05-08T19:22:17.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.553+0000 7f26f69d1700 1 -- 172.21.15.47:0/1873289898 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f01ee7f0 con 0x7f26f006b5f0 2024-05-08T19:22:17.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.553+0000 7f26ecff9700 1 -- 172.21.15.47:0/1873289898 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e40036a0 con 0x7f26f006b5f0 2024-05-08T19:22:17.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.553+0000 7f26f69d1700 1 -- 172.21.15.47:0/1873289898 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f0147da0 con 0x7f26f006b5f0 2024-05-08T19:22:17.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.554+0000 7f26f69d1700 1 -- 172.21.15.47:0/1873289898 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f0067320 con 0x7f26f006b5f0 2024-05-08T19:22:17.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.554+0000 7f26ecff9700 1 -- 172.21.15.47:0/1873289898 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f26e4003800 con 0x7f26f006b5f0 2024-05-08T19:22:17.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.554+0000 7f26ecff9700 1 --2- 172.21.15.47:0/1873289898 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f26dc06ac00 0x7f26dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.555+0000 7f26ecff9700 1 -- 172.21.15.47:0/1873289898 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f26e4088be0 con 0x7f26f006b5f0 2024-05-08T19:22:17.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.559+0000 7f26ecff9700 1 -- 172.21.15.47:0/1873289898 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f26e4054160 con 0x7f26f006b5f0 2024-05-08T19:22:17.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.563+0000 7f26effff700 1 --2- 172.21.15.47:0/1873289898 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f26dc06ac00 0x7f26dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.564+0000 7f26effff700 1 --2- 172.21.15.47:0/1873289898 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f26dc06ac00 0x7f26dc06d0c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009840 tx=0x7f26e0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:17.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.769+0000 7f26f69d1700 1 -- 172.21.15.47:0/1873289898 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26f01486c0 con 0x7f26f006b5f0 2024-05-08T19:22:17.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.769+0000 7f26ecff9700 1 -- 172.21.15.47:0/1873289898 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26e4057780 con 0x7f26f006b5f0 2024-05-08T19:22:17.762 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-08T19:22:17.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.772+0000 7f26f69d1700 1 -- 172.21.15.47:0/1873289898 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f26dc06ac00 msgr2=0x7f26dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.772+0000 7f26f69d1700 1 --2- 172.21.15.47:0/1873289898 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f26dc06ac00 0x7f26dc06d0c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009840 tx=0x7f26e0008030 comp rx=0 tx=0).stop 2024-05-08T19:22:17.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.772+0000 7f26f69d1700 1 -- 172.21.15.47:0/1873289898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26f006b5f0 msgr2=0x7f26f0148870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.772+0000 7f26f69d1700 1 --2- 172.21.15.47:0/1873289898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26f006b5f0 0x7f26f0148870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f26e400c7f0 tx=0x7f26e400cbb0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.772+0000 7f26f69d1700 1 -- 172.21.15.47:0/1873289898 shutdown_connections 2024-05-08T19:22:17.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.772+0000 7f26f69d1700 1 --2- 172.21.15.47:0/1873289898 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f26dc06ac00 0x7f26dc06d0c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.772+0000 7f26f69d1700 1 --2- 172.21.15.47:0/1873289898 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26f0152160 0x7f26f01ea7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.772+0000 7f26f69d1700 1 --2- 172.21.15.47:0/1873289898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26f006af00 0x7f26f00c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.772+0000 7f26f69d1700 1 --2- 172.21.15.47:0/1873289898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26f006b5f0 0x7f26f0148870 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.772+0000 7f26f69d1700 1 -- 172.21.15.47:0/1873289898 >> 172.21.15.47:0/1873289898 conn(0x7f26f00c71c0 msgr2=0x7f26f00c1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:17.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.772+0000 7f26f69d1700 1 -- 172.21.15.47:0/1873289898 shutdown_connections 2024-05-08T19:22:17.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.772+0000 7f26f69d1700 1 -- 172.21.15.47:0/1873289898 wait complete. 2024-05-08T19:22:17.777 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T19:22:17.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.911+0000 7f767c50d700 1 Processor -- start 2024-05-08T19:22:17.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.911+0000 7f767c50d700 1 -- start start 2024-05-08T19:22:17.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.912+0000 7f767c50d700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7674150040 0x7f76740c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.912+0000 7f767c50d700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7674155e00 con 0x7f76740c2a80 2024-05-08T19:22:17.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.912+0000 7f767c50d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76741560e0 con 0x7f767414fc60 2024-05-08T19:22:17.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.912+0000 7f767c50d700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76741563c0 con 0x7f7674150040 2024-05-08T19:22:17.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.912+0000 7f7679aa8700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7674150040 0x7f76740c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.912+0000 7f7679aa8700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7674150040 0x7f76740c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41892/0 (socket says 172.21.15.47:41892) 2024-05-08T19:22:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.912+0000 7f7679aa8700 1 -- 172.21.15.47:0/4204583378 learned_addr learned my addr 172.21.15.47:0/4204583378 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.912+0000 7f7679aa8700 1 -- 172.21.15.47:0/4204583378 >> v1:172.21.15.177:6789/0 conn(0x7f767414fc60 legacy=0x7f76740c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.912+0000 7f7679aa8700 1 -- 172.21.15.47:0/4204583378 >> v1:172.21.15.47:6789/0 conn(0x7f76740c2a80 legacy=0x7f76741528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.912+0000 7f7679aa8700 1 -- 172.21.15.47:0/4204583378 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76741566a0 con 0x7f7674150040 2024-05-08T19:22:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.912+0000 7f76792a7700 1 -- 172.21.15.47:0/4204583378 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664113892 0 0) 0x7f7674155e00 con 0x7f76740c2a80 2024-05-08T19:22:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.912+0000 7f7679aa8700 1 --2- 172.21.15.47:0/4204583378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674150040 0x7f76740c89f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f76640098f0 tx=0x7f7664009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf75ab9baed792bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.912+0000 7f76792a7700 1 -- 172.21.15.47:0/4204583378 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766400b8a0 con 0x7f7674150040 2024-05-08T19:22:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.912+0000 7f76792a7700 1 -- 172.21.15.47:0/4204583378 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766400ba00 con 0x7f7674150040 2024-05-08T19:22:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.912+0000 7f76792a7700 1 -- 172.21.15.47:0/4204583378 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766400bd90 con 0x7f7674150040 2024-05-08T19:22:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.913+0000 7f767c50d700 1 -- 172.21.15.47:0/4204583378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674150040 msgr2=0x7f76740c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.913+0000 7f767c50d700 1 --2- 172.21.15.47:0/4204583378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674150040 0x7f76740c89f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f76640098f0 tx=0x7f7664009c00 comp rx=0 tx=0).stop 2024-05-08T19:22:17.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.913+0000 7f767c50d700 1 -- 172.21.15.47:0/4204583378 shutdown_connections 2024-05-08T19:22:17.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.913+0000 7f767c50d700 1 --2- 172.21.15.47:0/4204583378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674150040 0x7f76740c89f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.913+0000 7f767c50d700 1 -- 172.21.15.47:0/4204583378 >> 172.21.15.47:0/4204583378 conn(0x7f7674072dd0 msgr2=0x7f767406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:17.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.913+0000 7f767c50d700 1 -- 172.21.15.47:0/4204583378 shutdown_connections 2024-05-08T19:22:17.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.913+0000 7f767c50d700 1 -- 172.21.15.47:0/4204583378 wait complete. 2024-05-08T19:22:17.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.914+0000 7f767c50d700 1 Processor -- start 2024-05-08T19:22:17.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.914+0000 7f767c50d700 1 -- start start 2024-05-08T19:22:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f767c50d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76740c2a80 0x7f76741ec420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f767c50d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f767414fc60 0x7f7674151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f767c50d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674150040 0x7f76741e8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f767c50d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76741ec960 con 0x7f7674150040 2024-05-08T19:22:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f767c50d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76741546d0 con 0x7f76740c2a80 2024-05-08T19:22:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f767c50d700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76741e84a0 con 0x7f767414fc60 2024-05-08T19:22:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f767aaaa700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674150040 0x7f76741e8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f767aaaa700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674150040 0x7f76741e8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41898/0 (socket says 172.21.15.47:41898) 2024-05-08T19:22:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f767a2a9700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76740c2a80 0x7f76741ec420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f767aaaa700 1 -- 172.21.15.47:0/2114688587 learned_addr learned my addr 172.21.15.47:0/2114688587 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f7679aa8700 1 --2- 172.21.15.47:0/2114688587 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f767414fc60 0x7f7674151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f767aaaa700 1 -- 172.21.15.47:0/2114688587 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f767414fc60 msgr2=0x7f7674151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f767aaaa700 1 --2- 172.21.15.47:0/2114688587 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f767414fc60 0x7f7674151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f767aaaa700 1 -- 172.21.15.47:0/2114688587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76740c2a80 msgr2=0x7f76741ec420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:17.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f767aaaa700 1 --2- 172.21.15.47:0/2114688587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76740c2a80 0x7f76741ec420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:17.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.915+0000 7f767aaaa700 1 -- 172.21.15.47:0/2114688587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7664009550 con 0x7f7674150040 2024-05-08T19:22:17.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.916+0000 7f767aaaa700 1 --2- 172.21.15.47:0/2114688587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674150040 0x7f76741e8960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f766c00c810 tx=0x7f766c00cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:17.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.916+0000 7f766affd700 1 -- 172.21.15.47:0/2114688587 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c003e30 con 0x7f7674150040 2024-05-08T19:22:17.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.916+0000 7f766affd700 1 -- 172.21.15.47:0/2114688587 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c005070 con 0x7f7674150040 2024-05-08T19:22:17.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.916+0000 7f767c50d700 1 -- 172.21.15.47:0/2114688587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7674154940 con 0x7f7674150040 2024-05-08T19:22:17.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.916+0000 7f766affd700 1 -- 172.21.15.47:0/2114688587 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c005420 con 0x7f7674150040 2024-05-08T19:22:17.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.916+0000 7f767c50d700 1 -- 172.21.15.47:0/2114688587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76740ab490 con 0x7f7674150040 2024-05-08T19:22:17.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.917+0000 7f767c50d700 1 -- 172.21.15.47:0/2114688587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76741e8660 con 0x7f7674150040 2024-05-08T19:22:17.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.917+0000 7f766affd700 1 -- 172.21.15.47:0/2114688587 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f766c005580 con 0x7f7674150040 2024-05-08T19:22:17.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.918+0000 7f766affd700 1 --2- 172.21.15.47:0/2114688587 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f765806ac00 0x7f765806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:17.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.918+0000 7f766affd700 1 -- 172.21.15.47:0/2114688587 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f766c088c30 con 0x7f7674150040 2024-05-08T19:22:17.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.918+0000 7f767a2a9700 1 --2- 172.21.15.47:0/2114688587 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f765806ac00 0x7f765806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:17.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.918+0000 7f767a2a9700 1 --2- 172.21.15.47:0/2114688587 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f765806ac00 0x7f765806d0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7670000f60 tx=0x7f7670009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:17.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:17.922+0000 7f766affd700 1 -- 172.21.15.47:0/2114688587 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f766c054130 con 0x7f7674150040 2024-05-08T19:22:18.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.137+0000 7f767c50d700 1 -- 172.21.15.47:0/2114688587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f76740c2510 con 0x7f7674150040 2024-05-08T19:22:18.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.137+0000 7f766affd700 1 -- 172.21.15.47:0/2114688587 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f766c057750 con 0x7f7674150040 2024-05-08T19:22:18.129 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:18.129 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-05-08T19:22:18.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-08T19:22:18.129 INFO:teuthology.orchestra.run.smithi047.stdout: "poolnum": 1, 2024-05-08T19:22:18.129 INFO:teuthology.orchestra.run.smithi047.stdout: "poolname": ".mgr" 2024-05-08T19:22:18.130 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-08T19:22:18.130 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-05-08T19:22:18.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.139+0000 7f767c50d700 1 -- 172.21.15.47:0/2114688587 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f765806ac00 msgr2=0x7f765806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:18.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.139+0000 7f767c50d700 1 --2- 172.21.15.47:0/2114688587 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f765806ac00 0x7f765806d0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7670000f60 tx=0x7f7670009040 comp rx=0 tx=0).stop 2024-05-08T19:22:18.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.139+0000 7f767c50d700 1 -- 172.21.15.47:0/2114688587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674150040 msgr2=0x7f76741e8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:18.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.139+0000 7f767c50d700 1 --2- 172.21.15.47:0/2114688587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674150040 0x7f76741e8960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f766c00c810 tx=0x7f766c00cb20 comp rx=0 tx=0).stop 2024-05-08T19:22:18.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.139+0000 7f767c50d700 1 -- 172.21.15.47:0/2114688587 shutdown_connections 2024-05-08T19:22:18.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.139+0000 7f767c50d700 1 --2- 172.21.15.47:0/2114688587 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f765806ac00 0x7f765806d0c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:18.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.139+0000 7f767c50d700 1 --2- 172.21.15.47:0/2114688587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674150040 0x7f76741e8960 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:18.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.139+0000 7f767c50d700 1 --2- 172.21.15.47:0/2114688587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76740c2a80 0x7f76741ec420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:18.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.139+0000 7f767c50d700 1 --2- 172.21.15.47:0/2114688587 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f767414fc60 0x7f7674151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:18.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.139+0000 7f767c50d700 1 -- 172.21.15.47:0/2114688587 >> 172.21.15.47:0/2114688587 conn(0x7f7674072dd0 msgr2=0x7f76740c2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:18.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.139+0000 7f767c50d700 1 -- 172.21.15.47:0/2114688587 shutdown_connections 2024-05-08T19:22:18.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.139+0000 7f767c50d700 1 -- 172.21.15.47:0/2114688587 wait complete. 2024-05-08T19:22:18.143 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T19:22:18.144 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T19:22:18.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.282+0000 7f3991a94700 1 Processor -- start 2024-05-08T19:22:18.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.282+0000 7f3991a94700 1 -- start start 2024-05-08T19:22:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f3991a94700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f398c14fd80 0x7f398c0c4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f3991a94700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f398c153430 0x7f398c155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f3991a94700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c0adf10 con 0x7f398c06ff80 2024-05-08T19:22:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f3991a94700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c153010 con 0x7f398c14fd80 2024-05-08T19:22:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f3991a94700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c152950 con 0x7f398c153430 2024-05-08T19:22:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398bfff700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f398c06ff80 0x7f398c0c80a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60394/0 (socket says 172.21.15.47:60394) 2024-05-08T19:22:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398bfff700 1 -- 172.21.15.47:0/715832989 learned_addr learned my addr 172.21.15.47:0/715832989 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 -- 172.21.15.47:0/715832989 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944962748 0 0) 0x7f398c0adf10 con 0x7f398c06ff80 2024-05-08T19:22:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398affd700 1 --2- 172.21.15.47:0/715832989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f398c153430 0x7f398c155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398b7fe700 1 --2- 172.21.15.47:0/715832989 >> v2:172.21.15.177:3300/0 conn(0x7f398c14fd80 0x7f398c0c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 -- 172.21.15.47:0/715832989 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39740035b0 con 0x7f398c06ff80 2024-05-08T19:22:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 -- 172.21.15.47:0/715832989 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4210521471 0 0) 0x7f39740035b0 con 0x7f398c06ff80 2024-05-08T19:22:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 -- 172.21.15.47:0/715832989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f398c153430 msgr2=0x7f398c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 --2- 172.21.15.47:0/715832989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f398c153430 0x7f398c155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 -- 172.21.15.47:0/715832989 >> v2:172.21.15.177:3300/0 conn(0x7f398c14fd80 msgr2=0x7f398c0c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 --2- 172.21.15.47:0/715832989 >> v2:172.21.15.177:3300/0 conn(0x7f398c14fd80 0x7f398c0c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 -- 172.21.15.47:0/715832989 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c152c30 con 0x7f398c06ff80 2024-05-08T19:22:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 -- 172.21.15.47:0/715832989 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f39840019f0 con 0x7f398c06ff80 2024-05-08T19:22:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 -- 172.21.15.47:0/715832989 >> v1:172.21.15.47:6789/0 conn(0x7f398c06ff80 legacy=0x7f398c0c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 --2- 172.21.15.47:0/715832989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3974003a00 0x7f3974003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:18.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 --2- 172.21.15.47:0/715832989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f398c153430 0x7f3974004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:18.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 --2- 172.21.15.47:0/715832989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3974004d90 0x7f3974005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:18.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 -- 172.21.15.47:0/715832989 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c153010 con 0x7f3974003a00 2024-05-08T19:22:18.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 -- 172.21.15.47:0/715832989 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c152950 con 0x7f3974004d90 2024-05-08T19:22:18.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398a7fc700 1 -- 172.21.15.47:0/715832989 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397400ba40 con 0x7f398c153430 2024-05-08T19:22:18.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398b7fe700 1 --2- 172.21.15.47:0/715832989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3974003a00 0x7f3974003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:18.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398affd700 1 --2- 172.21.15.47:0/715832989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f398c153430 0x7f3974004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:18.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.283+0000 7f398bfff700 1 --2- 172.21.15.47:0/715832989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3974004d90 0x7f3974005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:18.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.284+0000 7f398b7fe700 1 -- 172.21.15.47:0/715832989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f398c153430 msgr2=0x7f3974004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:18.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.284+0000 7f398b7fe700 1 --2- 172.21.15.47:0/715832989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f398c153430 0x7f3974004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:18.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.284+0000 7f398b7fe700 1 -- 172.21.15.47:0/715832989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3974004d90 msgr2=0x7f3974005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:18.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.284+0000 7f398b7fe700 1 --2- 172.21.15.47:0/715832989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3974004d90 0x7f3974005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:18.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.284+0000 7f398b7fe700 1 -- 172.21.15.47:0/715832989 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39740035b0 con 0x7f3974003a00 2024-05-08T19:22:18.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.284+0000 7f398b7fe700 1 --2- 172.21.15.47:0/715832989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3974003a00 0x7f3974003e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f397c009b60 tx=0x7f3974005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96975fda7dd0eaac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:18.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.284+0000 7f398a7fc700 1 -- 172.21.15.47:0/715832989 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00e6c0 con 0x7f3974003a00 2024-05-08T19:22:18.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.284+0000 7f398a7fc700 1 -- 172.21.15.47:0/715832989 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c00e820 con 0x7f3974003a00 2024-05-08T19:22:18.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.284+0000 7f398a7fc700 1 -- 172.21.15.47:0/715832989 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00eb90 con 0x7f3974003a00 2024-05-08T19:22:18.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.284+0000 7f3991a94700 1 -- 172.21.15.47:0/715832989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3974003a00 msgr2=0x7f3974003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:18.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.284+0000 7f3991a94700 1 --2- 172.21.15.47:0/715832989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3974003a00 0x7f3974003e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f397c009b60 tx=0x7f3974005880 comp rx=0 tx=0).stop 2024-05-08T19:22:18.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.284+0000 7f398bfff700 1 -- 172.21.15.47:0/715832989 reap_dead start 2024-05-08T19:22:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.285+0000 7f3991a94700 1 -- 172.21.15.47:0/715832989 shutdown_connections 2024-05-08T19:22:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.285+0000 7f3991a94700 1 -- 172.21.15.47:0/715832989 >> 172.21.15.47:0/715832989 conn(0x7f398c06e730 msgr2=0x7f398c06eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.285+0000 7f3991a94700 1 -- 172.21.15.47:0/715832989 shutdown_connections 2024-05-08T19:22:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.285+0000 7f3991a94700 1 -- 172.21.15.47:0/715832989 wait complete. 2024-05-08T19:22:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.286+0000 7f3991a94700 1 Processor -- start 2024-05-08T19:22:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.286+0000 7f3991a94700 1 -- start start 2024-05-08T19:22:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f3991a94700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3974003a00 0x7f398c14b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f3991a94700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f398c0c5f10 0x7f398c1e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f3991a94700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f398c1ebed0 0x7f398c1e8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f3991a94700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0c7410 con 0x7f398c1ebed0 2024-05-08T19:22:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f3991a94700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c143240 con 0x7f3974003a00 2024-05-08T19:22:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f3991a94700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0c6cd0 con 0x7f398c0c5f10 2024-05-08T19:22:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f398bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f398c1ebed0 0x7f398c1e8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:18.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f398bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f398c1ebed0 0x7f398c1e8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41908/0 (socket says 172.21.15.47:41908) 2024-05-08T19:22:18.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f398bfff700 1 -- 172.21.15.47:0/3726153550 learned_addr learned my addr 172.21.15.47:0/3726153550 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:18.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f398b7fe700 1 --2- 172.21.15.47:0/3726153550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3974003a00 0x7f398c14b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:18.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f398affd700 1 --2- 172.21.15.47:0/3726153550 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f398c0c5f10 0x7f398c1e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:18.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f398bfff700 1 -- 172.21.15.47:0/3726153550 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f398c0c5f10 msgr2=0x7f398c1e7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:18.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f398bfff700 1 --2- 172.21.15.47:0/3726153550 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f398c0c5f10 0x7f398c1e7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:18.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f398bfff700 1 -- 172.21.15.47:0/3726153550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3974003a00 msgr2=0x7f398c14b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f398bfff700 1 --2- 172.21.15.47:0/3726153550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3974003a00 0x7f398c14b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f398bfff700 1 -- 172.21.15.47:0/3726153550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c1eb3f0 con 0x7f398c1ebed0 2024-05-08T19:22:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f398bfff700 1 --2- 172.21.15.47:0/3726153550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f398c1ebed0 0x7f398c1e8290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3984001330 tx=0x7f398400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f3973fff700 1 -- 172.21.15.47:0/3726153550 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398400adb0 con 0x7f398c1ebed0 2024-05-08T19:22:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f3973fff700 1 -- 172.21.15.47:0/3726153550 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39840133f0 con 0x7f398c1ebed0 2024-05-08T19:22:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f3991a94700 1 -- 172.21.15.47:0/3726153550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c1eb6d0 con 0x7f398c1ebed0 2024-05-08T19:22:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f3973fff700 1 -- 172.21.15.47:0/3726153550 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39840137a0 con 0x7f398c1ebed0 2024-05-08T19:22:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.287+0000 7f3991a94700 1 -- 172.21.15.47:0/3726153550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c0c6fb0 con 0x7f398c1ebed0 2024-05-08T19:22:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.288+0000 7f3991a94700 1 -- 172.21.15.47:0/3726153550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c1ebbf0 con 0x7f398c1ebed0 2024-05-08T19:22:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.289+0000 7f3973fff700 1 -- 172.21.15.47:0/3726153550 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f3984013900 con 0x7f398c1ebed0 2024-05-08T19:22:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.289+0000 7f3973fff700 1 --2- 172.21.15.47:0/3726153550 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f397806ac00 0x7f397806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.289+0000 7f3973fff700 1 -- 172.21.15.47:0/3726153550 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f39840898c0 con 0x7f398c1ebed0 2024-05-08T19:22:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.289+0000 7f398b7fe700 1 --2- 172.21.15.47:0/3726153550 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f397806ac00 0x7f397806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.290+0000 7f398b7fe700 1 --2- 172.21.15.47:0/3726153550 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f397806ac00 0x7f397806d0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f397c0090b0 tx=0x7f397c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.294+0000 7f3973fff700 1 -- 172.21.15.47:0/3726153550 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f398c1ebbf0 con 0x7f398c1ebed0 2024-05-08T19:22:18.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.499+0000 7f3991a94700 1 -- 172.21.15.47:0/3726153550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f398c1ebbf0 con 0x7f398c1ebed0 2024-05-08T19:22:18.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.788+0000 7f3973fff700 1 -- 172.21.15.47:0/3726153550 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3984055330 con 0x7f398c1ebed0 2024-05-08T19:22:18.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.982+0000 7f3973fff700 1 -- 172.21.15.47:0/3726153550 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3984087ba0 con 0x7f398c1ebed0 2024-05-08T19:22:18.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.985+0000 7f3991a94700 1 -- 172.21.15.47:0/3726153550 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f397806ac00 msgr2=0x7f397806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:18.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.985+0000 7f3991a94700 1 --2- 172.21.15.47:0/3726153550 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f397806ac00 0x7f397806d0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f397c0090b0 tx=0x7f397c008030 comp rx=0 tx=0).stop 2024-05-08T19:22:18.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.985+0000 7f3991a94700 1 -- 172.21.15.47:0/3726153550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f398c1ebed0 msgr2=0x7f398c1e8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:18.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.985+0000 7f3991a94700 1 --2- 172.21.15.47:0/3726153550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f398c1ebed0 0x7f398c1e8290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3984001330 tx=0x7f398400a640 comp rx=0 tx=0).stop 2024-05-08T19:22:18.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.985+0000 7f3991a94700 1 -- 172.21.15.47:0/3726153550 shutdown_connections 2024-05-08T19:22:18.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.985+0000 7f3991a94700 1 --2- 172.21.15.47:0/3726153550 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f397806ac00 0x7f397806d0c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:18.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.985+0000 7f3991a94700 1 --2- 172.21.15.47:0/3726153550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f398c1ebed0 0x7f398c1e8290 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:18.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.985+0000 7f3991a94700 1 --2- 172.21.15.47:0/3726153550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3974003a00 0x7f398c14b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:18.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.985+0000 7f3991a94700 1 --2- 172.21.15.47:0/3726153550 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f398c0c5f10 0x7f398c1e7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:18.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.985+0000 7f3991a94700 1 -- 172.21.15.47:0/3726153550 >> 172.21.15.47:0/3726153550 conn(0x7f398c06e730 msgr2=0x7f398c14cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:18.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.985+0000 7f3991a94700 1 -- 172.21.15.47:0/3726153550 shutdown_connections 2024-05-08T19:22:18.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:18.985+0000 7f3991a94700 1 -- 172.21.15.47:0/3726153550 wait complete. 2024-05-08T19:22:18.979 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' created 2024-05-08T19:22:18.994 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-08T19:22:19.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.137+0000 7f38433c6700 1 Processor -- start 2024-05-08T19:22:19.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.138+0000 7f38433c6700 1 -- start start 2024-05-08T19:22:19.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.138+0000 7f38433c6700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f383c152230 0x7f383c0c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:19.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.138+0000 7f38433c6700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f383c0c62b0 0x7f383c0c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.138+0000 7f38433c6700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383c0c2fc0 con 0x7f383c070470 2024-05-08T19:22:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.138+0000 7f38433c6700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383c0c3e20 con 0x7f383c0c62b0 2024-05-08T19:22:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.138+0000 7f38433c6700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383c152610 con 0x7f383c152230 2024-05-08T19:22:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.138+0000 7f3840961700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f383c070470 0x7f383c0c3440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60406/0 (socket says 172.21.15.47:60406) 2024-05-08T19:22:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.138+0000 7f3840961700 1 -- 172.21.15.47:0/4177520380 learned_addr learned my addr 172.21.15.47:0/4177520380 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.139+0000 7f3841963700 1 --2- 172.21.15.47:0/4177520380 >> v2:172.21.15.177:3300/0 conn(0x7f383c0c62b0 0x7f383c0c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.139+0000 7f3841162700 1 --2- 172.21.15.47:0/4177520380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f383c152230 0x7f383c0c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.139+0000 7f382ffff700 1 -- 172.21.15.47:0/4177520380 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949884615 0 0) 0x7f383c0c2fc0 con 0x7f383c070470 2024-05-08T19:22:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.139+0000 7f382ffff700 1 -- 172.21.15.47:0/4177520380 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38280035b0 con 0x7f383c070470 2024-05-08T19:22:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.139+0000 7f3841963700 1 -- 172.21.15.47:0/4177520380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f383c152230 msgr2=0x7f383c0c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.139+0000 7f3841963700 1 --2- 172.21.15.47:0/4177520380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f383c152230 0x7f383c0c2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.139+0000 7f3841963700 1 -- 172.21.15.47:0/4177520380 >> v1:172.21.15.47:6789/0 conn(0x7f383c070470 legacy=0x7f383c0c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.139+0000 7f3841963700 1 -- 172.21.15.47:0/4177520380 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c0702a0 con 0x7f383c0c62b0 2024-05-08T19:22:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.139+0000 7f3841162700 1 --2- 172.21.15.47:0/4177520380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f383c152230 0x7f383c0c2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:19.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.139+0000 7f3841963700 1 --2- 172.21.15.47:0/4177520380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f383c0c62b0 0x7f383c0c14b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3834009dc0 tx=0x7f383400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0f684f78d507ce0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:19.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.139+0000 7f382ffff700 1 -- 172.21.15.47:0/4177520380 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383400e070 con 0x7f383c0c62b0 2024-05-08T19:22:19.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.139+0000 7f382ffff700 1 -- 172.21.15.47:0/4177520380 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383400bae0 con 0x7f383c0c62b0 2024-05-08T19:22:19.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.139+0000 7f382ffff700 1 -- 172.21.15.47:0/4177520380 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383400be90 con 0x7f383c0c62b0 2024-05-08T19:22:19.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.140+0000 7f38433c6700 1 -- 172.21.15.47:0/4177520380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f383c0c62b0 msgr2=0x7f383c0c14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:19.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.140+0000 7f38433c6700 1 --2- 172.21.15.47:0/4177520380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f383c0c62b0 0x7f383c0c14b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3834009dc0 tx=0x7f383400b330 comp rx=0 tx=0).stop 2024-05-08T19:22:19.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.140+0000 7f38433c6700 1 -- 172.21.15.47:0/4177520380 shutdown_connections 2024-05-08T19:22:19.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.140+0000 7f38433c6700 1 --2- 172.21.15.47:0/4177520380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f383c0c62b0 0x7f383c0c14b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:19.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.140+0000 7f38433c6700 1 --2- 172.21.15.47:0/4177520380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f383c152230 0x7f383c0c2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:19.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.140+0000 7f38433c6700 1 -- 172.21.15.47:0/4177520380 >> 172.21.15.47:0/4177520380 conn(0x7f383c06b1b0 msgr2=0x7f383c0a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:19.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.140+0000 7f38433c6700 1 -- 172.21.15.47:0/4177520380 shutdown_connections 2024-05-08T19:22:19.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.140+0000 7f38433c6700 1 -- 172.21.15.47:0/4177520380 wait complete. 2024-05-08T19:22:19.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.141+0000 7f38433c6700 1 Processor -- start 2024-05-08T19:22:19.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.141+0000 7f38433c6700 1 -- start start 2024-05-08T19:22:19.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f38433c6700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f383c070470 0x7f383c14a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:19.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f38433c6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f383c0c62b0 0x7f383c14c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:19.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f38433c6700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f383c152230 0x7f383c1ed780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:19.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f38433c6700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c14e220 con 0x7f383c0c62b0 2024-05-08T19:22:19.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f38433c6700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c158910 con 0x7f383c152230 2024-05-08T19:22:19.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f38433c6700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383c14f430 con 0x7f383c070470 2024-05-08T19:22:19.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f3840961700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f383c0c62b0 0x7f383c14c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:19.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f3840961700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f383c0c62b0 0x7f383c14c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41916/0 (socket says 172.21.15.47:41916) 2024-05-08T19:22:19.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f3840961700 1 -- 172.21.15.47:0/3567775797 learned_addr learned my addr 172.21.15.47:0/3567775797 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:19.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f3841162700 1 --2- 172.21.15.47:0/3567775797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f383c070470 0x7f383c14a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:19.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f3841963700 1 --2- 172.21.15.47:0/3567775797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f383c152230 0x7f383c1ed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:19.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f3840961700 1 -- 172.21.15.47:0/3567775797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f383c070470 msgr2=0x7f383c14a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:19.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f3840961700 1 --2- 172.21.15.47:0/3567775797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f383c070470 0x7f383c14a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:19.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f3840961700 1 -- 172.21.15.47:0/3567775797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f383c152230 msgr2=0x7f383c1ed780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:19.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f3840961700 1 --2- 172.21.15.47:0/3567775797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f383c152230 0x7f383c1ed780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:19.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f3840961700 1 -- 172.21.15.47:0/3567775797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38300094a0 con 0x7f383c0c62b0 2024-05-08T19:22:19.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.142+0000 7f3840961700 1 --2- 172.21.15.47:0/3567775797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f383c0c62b0 0x7f383c14c4d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3838005910 tx=0x7f383800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:19.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.143+0000 7f382dffb700 1 -- 172.21.15.47:0/3567775797 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838005d70 con 0x7f383c0c62b0 2024-05-08T19:22:19.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.143+0000 7f382dffb700 1 -- 172.21.15.47:0/3567775797 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38380070d0 con 0x7f383c0c62b0 2024-05-08T19:22:19.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.143+0000 7f38433c6700 1 -- 172.21.15.47:0/3567775797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3834009a70 con 0x7f383c0c62b0 2024-05-08T19:22:19.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.143+0000 7f382dffb700 1 -- 172.21.15.47:0/3567775797 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838007460 con 0x7f383c0c62b0 2024-05-08T19:22:19.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.143+0000 7f38433c6700 1 -- 172.21.15.47:0/3567775797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383c0ada70 con 0x7f383c0c62b0 2024-05-08T19:22:19.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.144+0000 7f38433c6700 1 -- 172.21.15.47:0/3567775797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383c0adc60 con 0x7f383c0c62b0 2024-05-08T19:22:19.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.144+0000 7f382dffb700 1 -- 172.21.15.47:0/3567775797 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f38380075c0 con 0x7f383c0c62b0 2024-05-08T19:22:19.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.144+0000 7f382dffb700 1 --2- 172.21.15.47:0/3567775797 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f382006ac90 0x7f382006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:19.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.145+0000 7f382dffb700 1 -- 172.21.15.47:0/3567775797 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f38380885f0 con 0x7f383c0c62b0 2024-05-08T19:22:19.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.145+0000 7f3841162700 1 --2- 172.21.15.47:0/3567775797 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f382006ac90 0x7f382006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:19.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.145+0000 7f3841162700 1 --2- 172.21.15.47:0/3567775797 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f382006ac90 0x7f382006d150 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f383c158810 tx=0x7f3830009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:19.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.149+0000 7f382dffb700 1 -- 172.21.15.47:0/3567775797 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f38380539b0 con 0x7f383c0c62b0 2024-05-08T19:22:19.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.359+0000 7f38433c6700 1 -- 172.21.15.47:0/3567775797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f383c04ec60 con 0x7f383c0c62b0 2024-05-08T19:22:19.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:19.989+0000 7f382dffb700 1 -- 172.21.15.47:0/3567775797 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f3838056fd0 con 0x7f383c0c62b0 2024-05-08T19:22:19.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.002+0000 7f38433c6700 1 -- 172.21.15.47:0/3567775797 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f382006ac90 msgr2=0x7f382006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:19.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.002+0000 7f38433c6700 1 --2- 172.21.15.47:0/3567775797 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f382006ac90 0x7f382006d150 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f383c158810 tx=0x7f3830009210 comp rx=0 tx=0).stop 2024-05-08T19:22:19.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.002+0000 7f38433c6700 1 -- 172.21.15.47:0/3567775797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f383c0c62b0 msgr2=0x7f383c14c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:19.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.002+0000 7f38433c6700 1 --2- 172.21.15.47:0/3567775797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f383c0c62b0 0x7f383c14c4d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3838005910 tx=0x7f383800c9e0 comp rx=0 tx=0).stop 2024-05-08T19:22:19.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.002+0000 7f38433c6700 1 -- 172.21.15.47:0/3567775797 shutdown_connections 2024-05-08T19:22:19.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.003+0000 7f38433c6700 1 --2- 172.21.15.47:0/3567775797 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f382006ac90 0x7f382006d150 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:19.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.003+0000 7f38433c6700 1 --2- 172.21.15.47:0/3567775797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f383c152230 0x7f383c1ed780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:19.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.003+0000 7f38433c6700 1 --2- 172.21.15.47:0/3567775797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f383c070470 0x7f383c14a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:19.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.003+0000 7f38433c6700 1 --2- 172.21.15.47:0/3567775797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f383c0c62b0 0x7f383c14c4d0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3838005910 tx=0x7f383800c9e0 comp rx=0 tx=0).stop 2024-05-08T19:22:19.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.003+0000 7f38433c6700 1 -- 172.21.15.47:0/3567775797 >> 172.21.15.47:0/3567775797 conn(0x7f383c06b1b0 msgr2=0x7f383c06ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:19.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.003+0000 7f38433c6700 1 -- 172.21.15.47:0/3567775797 shutdown_connections 2024-05-08T19:22:19.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.004+0000 7f38433c6700 1 -- 172.21.15.47:0/3567775797 wait complete. 2024-05-08T19:22:19.998 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' created 2024-05-08T19:22:20.015 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T19:22:20.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.157+0000 7fc3ac7d4700 1 Processor -- start 2024-05-08T19:22:20.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.157+0000 7fc3ac7d4700 1 -- start start 2024-05-08T19:22:20.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.158+0000 7fc3ac7d4700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3a40c6d70 0x7fc3a406e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:20.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.158+0000 7fc3ac7d4700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc3a40c8050 0x7fc3a40c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:20.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.158+0000 7fc3ac7d4700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a41536f0 con 0x7fc3a40ada50 2024-05-08T19:22:20.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.158+0000 7fc3ac7d4700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a4153190 con 0x7fc3a40c8050 2024-05-08T19:22:20.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.158+0000 7fc3ac7d4700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40c7da0 con 0x7fc3a40c6d70 2024-05-08T19:22:20.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.158+0000 7fc3aad71700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc3a40c8050 0x7fc3a40c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:20.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.158+0000 7fc3aad71700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc3a40c8050 0x7fc3a40c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41920/0 (socket says 172.21.15.47:41920) 2024-05-08T19:22:20.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.158+0000 7fc3aad71700 1 -- 172.21.15.47:0/4110701112 learned_addr learned my addr 172.21.15.47:0/4110701112 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:20.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.159+0000 7fc3aa570700 1 --2- 172.21.15.47:0/4110701112 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3a40c6d70 0x7fc3a406e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:20.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.159+0000 7fc3aad71700 1 -- 172.21.15.47:0/4110701112 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3a40c6d70 msgr2=0x7fc3a406e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:20.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.159+0000 7fc3aad71700 1 --2- 172.21.15.47:0/4110701112 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3a40c6d70 0x7fc3a406e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:20.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.159+0000 7fc3aad71700 1 -- 172.21.15.47:0/4110701112 >> v1:172.21.15.177:6789/0 conn(0x7fc3a40ada50 legacy=0x7fc3a40c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:20.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.159+0000 7fc3aad71700 1 -- 172.21.15.47:0/4110701112 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a4070860 con 0x7fc3a40c8050 2024-05-08T19:22:20.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.159+0000 7fc3aa570700 1 --2- 172.21.15.47:0/4110701112 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3a40c6d70 0x7fc3a406e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:20.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.159+0000 7fc3aad71700 1 --2- 172.21.15.47:0/4110701112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3a40c8050 0x7fc3a40c84e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009e50 tx=0x7fc39c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d24a8bf8ef5222d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:20.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.159+0000 7fc3a956e700 1 -- 172.21.15.47:0/4110701112 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c00e070 con 0x7fc3a40c8050 2024-05-08T19:22:20.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.159+0000 7fc3a956e700 1 -- 172.21.15.47:0/4110701112 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c00b9c0 con 0x7fc3a40c8050 2024-05-08T19:22:20.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.159+0000 7fc3a956e700 1 -- 172.21.15.47:0/4110701112 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c00bd70 con 0x7fc3a40c8050 2024-05-08T19:22:20.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.159+0000 7fc3ac7d4700 1 -- 172.21.15.47:0/4110701112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3a40c8050 msgr2=0x7fc3a40c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:20.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.160+0000 7fc3ac7d4700 1 --2- 172.21.15.47:0/4110701112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3a40c8050 0x7fc3a40c84e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009e50 tx=0x7fc39c00b330 comp rx=0 tx=0).stop 2024-05-08T19:22:20.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.160+0000 7fc3ac7d4700 1 -- 172.21.15.47:0/4110701112 shutdown_connections 2024-05-08T19:22:20.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.160+0000 7fc3ac7d4700 1 --2- 172.21.15.47:0/4110701112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3a40c8050 0x7fc3a40c84e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:20.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.160+0000 7fc3ac7d4700 1 --2- 172.21.15.47:0/4110701112 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3a40c6d70 0x7fc3a406e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:20.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.160+0000 7fc3ac7d4700 1 -- 172.21.15.47:0/4110701112 >> 172.21.15.47:0/4110701112 conn(0x7fc3a406b1b0 msgr2=0x7fc3a40a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:20.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.160+0000 7fc3ac7d4700 1 -- 172.21.15.47:0/4110701112 shutdown_connections 2024-05-08T19:22:20.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.160+0000 7fc3ac7d4700 1 -- 172.21.15.47:0/4110701112 wait complete. 2024-05-08T19:22:20.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.161+0000 7fc3ac7d4700 1 Processor -- start 2024-05-08T19:22:20.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.161+0000 7fc3ac7d4700 1 -- start start 2024-05-08T19:22:20.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.161+0000 7fc3ac7d4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3a40ada50 0x7fc3a40c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:20.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.161+0000 7fc3ac7d4700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3a40c6d70 0x7fc3a4144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:20.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.161+0000 7fc3ac7d4700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3a40c8050 0x7fc3a41446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:20.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.161+0000 7fc3ac7d4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a414ece0 con 0x7fc3a40ada50 2024-05-08T19:22:20.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.161+0000 7fc3ac7d4700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4153b30 con 0x7fc3a40c6d70 2024-05-08T19:22:20.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.161+0000 7fc3ac7d4700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4153e10 con 0x7fc3a40c8050 2024-05-08T19:22:20.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc3aa570700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3a40ada50 0x7fc3a40c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:20.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc3aa570700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3a40ada50 0x7fc3a40c1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41934/0 (socket says 172.21.15.47:41934) 2024-05-08T19:22:20.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc3aa570700 1 -- 172.21.15.47:0/873880689 learned_addr learned my addr 172.21.15.47:0/873880689 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:20.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc3a9d6f700 1 --2- 172.21.15.47:0/873880689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3a40c6d70 0x7fc3a4144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:20.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc3aad71700 1 --2- 172.21.15.47:0/873880689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3a40c8050 0x7fc3a41446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:20.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc3aa570700 1 -- 172.21.15.47:0/873880689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3a40c8050 msgr2=0x7fc3a41446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:20.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc3aa570700 1 --2- 172.21.15.47:0/873880689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3a40c8050 0x7fc3a41446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:20.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc3aa570700 1 -- 172.21.15.47:0/873880689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3a40c6d70 msgr2=0x7fc3a4144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:20.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc3aa570700 1 --2- 172.21.15.47:0/873880689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3a40c6d70 0x7fc3a4144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:20.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc3aa570700 1 -- 172.21.15.47:0/873880689 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c009b30 con 0x7fc3a40ada50 2024-05-08T19:22:20.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc3aa570700 1 --2- 172.21.15.47:0/873880689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3a40ada50 0x7fc3a40c1720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc39400e810 tx=0x7fc39400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:20.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc39affd700 1 -- 172.21.15.47:0/873880689 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394013610 con 0x7fc3a40ada50 2024-05-08T19:22:20.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc39affd700 1 -- 172.21.15.47:0/873880689 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc394013770 con 0x7fc3a40ada50 2024-05-08T19:22:20.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc3ac7d4700 1 -- 172.21.15.47:0/873880689 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a41540f0 con 0x7fc3a40ada50 2024-05-08T19:22:20.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc39affd700 1 -- 172.21.15.47:0/873880689 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394013ae0 con 0x7fc3a40ada50 2024-05-08T19:22:20.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.162+0000 7fc3ac7d4700 1 -- 172.21.15.47:0/873880689 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a40c1c60 con 0x7fc3a40ada50 2024-05-08T19:22:20.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.163+0000 7fc3ac7d4700 1 -- 172.21.15.47:0/873880689 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a414efc0 con 0x7fc3a40ada50 2024-05-08T19:22:20.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.164+0000 7fc39affd700 1 -- 172.21.15.47:0/873880689 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc394013c40 con 0x7fc3a40ada50 2024-05-08T19:22:20.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.164+0000 7fc39affd700 1 --2- 172.21.15.47:0/873880689 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc38806ac90 0x7fc38806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:20.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.164+0000 7fc39affd700 1 -- 172.21.15.47:0/873880689 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fc394088e40 con 0x7fc3a40ada50 2024-05-08T19:22:20.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.164+0000 7fc3a9d6f700 1 --2- 172.21.15.47:0/873880689 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc38806ac90 0x7fc38806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:20.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.165+0000 7fc3a9d6f700 1 --2- 172.21.15.47:0/873880689 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc38806ac90 0x7fc38806d150 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4155490 tx=0x7fc3a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:20.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.169+0000 7fc39affd700 1 -- 172.21.15.47:0/873880689 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc394054070 con 0x7fc3a40ada50 2024-05-08T19:22:20.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.422+0000 7fc3ac7d4700 1 -- 172.21.15.47:0/873880689 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc3a41533f0 con 0x7fc3a40ada50 2024-05-08T19:22:20.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.427+0000 7fc39affd700 1 -- 172.21.15.47:0/873880689 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc3a41533f0 con 0x7fc3a40ada50 2024-05-08T19:22:20.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.432+0000 7fc3ac7d4700 1 -- 172.21.15.47:0/873880689 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc38806ac90 msgr2=0x7fc38806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:20.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.432+0000 7fc3ac7d4700 1 --2- 172.21.15.47:0/873880689 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc38806ac90 0x7fc38806d150 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4155490 tx=0x7fc3a0009040 comp rx=0 tx=0).stop 2024-05-08T19:22:20.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.432+0000 7fc3ac7d4700 1 -- 172.21.15.47:0/873880689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3a40ada50 msgr2=0x7fc3a40c1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:20.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.432+0000 7fc3ac7d4700 1 --2- 172.21.15.47:0/873880689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3a40ada50 0x7fc3a40c1720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc39400e810 tx=0x7fc39400eb20 comp rx=0 tx=0).stop 2024-05-08T19:22:20.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.432+0000 7fc3ac7d4700 1 -- 172.21.15.47:0/873880689 shutdown_connections 2024-05-08T19:22:20.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.432+0000 7fc3ac7d4700 1 --2- 172.21.15.47:0/873880689 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc38806ac90 0x7fc38806d150 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:20.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.432+0000 7fc3ac7d4700 1 --2- 172.21.15.47:0/873880689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3a40ada50 0x7fc3a40c1720 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:20.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.432+0000 7fc3ac7d4700 1 --2- 172.21.15.47:0/873880689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3a40c8050 0x7fc3a41446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:20.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.432+0000 7fc3ac7d4700 1 --2- 172.21.15.47:0/873880689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3a40c6d70 0x7fc3a4144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:20.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.432+0000 7fc3ac7d4700 1 -- 172.21.15.47:0/873880689 >> 172.21.15.47:0/873880689 conn(0x7fc3a406b1b0 msgr2=0x7fc3a40a7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:20.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.432+0000 7fc3ac7d4700 1 -- 172.21.15.47:0/873880689 shutdown_connections 2024-05-08T19:22:20.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.432+0000 7fc3ac7d4700 1 -- 172.21.15.47:0/873880689 wait complete. 2024-05-08T19:22:20.428 INFO:teuthology.orchestra.run.smithi047.stderr:new fs with metadata pool 2 and data pool 3 2024-05-08T19:22:20.448 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-08T19:22:20.448 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-08T19:22:20.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.587+0000 7f0eb9ebb700 1 Processor -- start 2024-05-08T19:22:20.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.587+0000 7f0eb9ebb700 1 -- start start 2024-05-08T19:22:20.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.588+0000 7f0eb9ebb700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0eb40c3840 0x7f0eb40c1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:20.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.588+0000 7f0eb9ebb700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0eb40a9e00 0x7f0eb406a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:20.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.588+0000 7f0eb9ebb700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb41561d0 con 0x7f0eb41500f0 2024-05-08T19:22:20.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.588+0000 7f0eb9ebb700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb40c3520 con 0x7f0eb40c3840 2024-05-08T19:22:20.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.588+0000 7f0eb9ebb700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb4155f60 con 0x7f0eb40a9e00 2024-05-08T19:22:20.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.588+0000 7f0eb37fe700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0eb41500f0 0x7f0eb40a90c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60422/0 (socket says 172.21.15.47:60422) 2024-05-08T19:22:20.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.588+0000 7f0eb37fe700 1 -- 172.21.15.47:0/3568208623 learned_addr learned my addr 172.21.15.47:0/3568208623 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:20.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.588+0000 7f0eb3fff700 1 --2- 172.21.15.47:0/3568208623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0eb40a9e00 0x7f0eb406a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:20.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.588+0000 7f0eb27fc700 1 -- 172.21.15.47:0/3568208623 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788324824 0 0) 0x7f0eb41561d0 con 0x7f0eb41500f0 2024-05-08T19:22:20.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.588+0000 7f0eb2ffd700 1 --2- 172.21.15.47:0/3568208623 >> v2:172.21.15.177:3300/0 conn(0x7f0eb40c3840 0x7f0eb40c1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:20.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb27fc700 1 -- 172.21.15.47:0/3568208623 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e9c0035b0 con 0x7f0eb41500f0 2024-05-08T19:22:20.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb27fc700 1 -- 172.21.15.47:0/3568208623 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4245701659 0 0) 0x7f0e9c0035b0 con 0x7f0eb41500f0 2024-05-08T19:22:20.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb27fc700 1 -- 172.21.15.47:0/3568208623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0eb40a9e00 msgr2=0x7f0eb406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:20.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb27fc700 1 --2- 172.21.15.47:0/3568208623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0eb40a9e00 0x7f0eb406a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:20.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb27fc700 1 -- 172.21.15.47:0/3568208623 >> v2:172.21.15.177:3300/0 conn(0x7f0eb40c3840 msgr2=0x7f0eb40c1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:20.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb27fc700 1 --2- 172.21.15.47:0/3568208623 >> v2:172.21.15.177:3300/0 conn(0x7f0eb40c3840 0x7f0eb40c1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:20.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb27fc700 1 -- 172.21.15.47:0/3568208623 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb40a97d0 con 0x7f0eb41500f0 2024-05-08T19:22:20.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb27fc700 1 -- 172.21.15.47:0/3568208623 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f0ea8001670 con 0x7f0eb41500f0 2024-05-08T19:22:20.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb27fc700 1 -- 172.21.15.47:0/3568208623 >> v1:172.21.15.47:6789/0 conn(0x7f0eb41500f0 legacy=0x7f0eb40a90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:20.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb27fc700 1 --2- 172.21.15.47:0/3568208623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c003a00 0x7f0e9c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:20.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb27fc700 1 --2- 172.21.15.47:0/3568208623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0eb40a9e00 0x7f0e9c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:20.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb27fc700 1 --2- 172.21.15.47:0/3568208623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e9c004d90 0x7f0e9c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:20.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb27fc700 1 -- 172.21.15.47:0/3568208623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb4155f60 con 0x7f0e9c003a00 2024-05-08T19:22:20.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb27fc700 1 -- 172.21.15.47:0/3568208623 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c00ba10 con 0x7f0e9c004d90 2024-05-08T19:22:20.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb27fc700 1 -- 172.21.15.47:0/3568208623 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c00bbd0 con 0x7f0eb40a9e00 2024-05-08T19:22:20.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb37fe700 1 --2- 172.21.15.47:0/3568208623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c003a00 0x7f0e9c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:20.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb2ffd700 1 --2- 172.21.15.47:0/3568208623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0eb40a9e00 0x7f0e9c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:20.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb3fff700 1 --2- 172.21.15.47:0/3568208623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e9c004d90 0x7f0e9c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:20.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb37fe700 1 -- 172.21.15.47:0/3568208623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0eb40a9e00 msgr2=0x7f0e9c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:20.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb37fe700 1 --2- 172.21.15.47:0/3568208623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0eb40a9e00 0x7f0e9c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:20.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb37fe700 1 -- 172.21.15.47:0/3568208623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e9c004d90 msgr2=0x7f0e9c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb37fe700 1 --2- 172.21.15.47:0/3568208623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e9c004d90 0x7f0e9c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb37fe700 1 -- 172.21.15.47:0/3568208623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c0035b0 con 0x7f0e9c003a00 2024-05-08T19:22:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.589+0000 7f0eb37fe700 1 --2- 172.21.15.47:0/3568208623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c003a00 0x7f0e9c003e20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800c370 tx=0x7f0e9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2789a6b95e1b8854 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.590+0000 7f0eb27fc700 1 -- 172.21.15.47:0/3568208623 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8007c60 con 0x7f0e9c003a00 2024-05-08T19:22:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.590+0000 7f0eb27fc700 1 -- 172.21.15.47:0/3568208623 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea8005960 con 0x7f0e9c003a00 2024-05-08T19:22:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.590+0000 7f0eb27fc700 1 -- 172.21.15.47:0/3568208623 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8005d10 con 0x7f0e9c003a00 2024-05-08T19:22:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.590+0000 7f0eb9ebb700 1 -- 172.21.15.47:0/3568208623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c003a00 msgr2=0x7f0e9c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.590+0000 7f0eb9ebb700 1 --2- 172.21.15.47:0/3568208623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c003a00 0x7f0e9c003e20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800c370 tx=0x7f0e9c005880 comp rx=0 tx=0).stop 2024-05-08T19:22:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.590+0000 7f0eb3fff700 1 -- 172.21.15.47:0/3568208623 reap_dead start 2024-05-08T19:22:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.590+0000 7f0eb9ebb700 1 -- 172.21.15.47:0/3568208623 shutdown_connections 2024-05-08T19:22:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.590+0000 7f0eb9ebb700 1 -- 172.21.15.47:0/3568208623 >> 172.21.15.47:0/3568208623 conn(0x7f0eb40c3c20 msgr2=0x7f0eb40c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.590+0000 7f0eb9ebb700 1 -- 172.21.15.47:0/3568208623 shutdown_connections 2024-05-08T19:22:20.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.590+0000 7f0eb9ebb700 1 -- 172.21.15.47:0/3568208623 wait complete. 2024-05-08T19:22:20.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.591+0000 7f0eb9ebb700 1 Processor -- start 2024-05-08T19:22:20.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.592+0000 7f0eb9ebb700 1 -- start start 2024-05-08T19:22:20.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.592+0000 7f0eb9ebb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c003a00 0x7f0eb40aa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:20.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.592+0000 7f0eb9ebb700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0eb41e7540 0x7f0eb40c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:20.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.592+0000 7f0eb9ebb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0eb40c68e0 0x7f0eb41e9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:20.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.592+0000 7f0eb9ebb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40c0550 con 0x7f0e9c003a00 2024-05-08T19:22:20.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.592+0000 7f0eb9ebb700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40c0b10 con 0x7f0eb40c68e0 2024-05-08T19:22:20.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.592+0000 7f0eb9ebb700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40c14e0 con 0x7f0eb41e7540 2024-05-08T19:22:20.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.592+0000 7f0eb37fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c003a00 0x7f0eb40aa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:20.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.592+0000 7f0eb37fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c003a00 0x7f0eb40aa810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41946/0 (socket says 172.21.15.47:41946) 2024-05-08T19:22:20.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.592+0000 7f0eb37fe700 1 -- 172.21.15.47:0/1995768892 learned_addr learned my addr 172.21.15.47:0/1995768892 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:20.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.592+0000 7f0eb2ffd700 1 --2- 172.21.15.47:0/1995768892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0eb41e7540 0x7f0eb40c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:20.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.592+0000 7f0eb3fff700 1 --2- 172.21.15.47:0/1995768892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0eb40c68e0 0x7f0eb41e9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:20.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.593+0000 7f0eb37fe700 1 -- 172.21.15.47:0/1995768892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0eb41e7540 msgr2=0x7f0eb40c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:20.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.593+0000 7f0eb37fe700 1 --2- 172.21.15.47:0/1995768892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0eb41e7540 0x7f0eb40c63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:20.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.593+0000 7f0eb37fe700 1 -- 172.21.15.47:0/1995768892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0eb40c68e0 msgr2=0x7f0eb41e9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:20.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.593+0000 7f0eb37fe700 1 --2- 172.21.15.47:0/1995768892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0eb40c68e0 0x7f0eb41e9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:20.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.593+0000 7f0eb37fe700 1 -- 172.21.15.47:0/1995768892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb41edf00 con 0x7f0e9c003a00 2024-05-08T19:22:20.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.593+0000 7f0eb3fff700 1 --2- 172.21.15.47:0/1995768892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0eb40c68e0 0x7f0eb41e9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:20.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.593+0000 7f0eb37fe700 1 --2- 172.21.15.47:0/1995768892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c003a00 0x7f0eb40aa810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800c960 tx=0x7f0ea8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:20.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.593+0000 7f0e9bfff700 1 -- 172.21.15.47:0/1995768892 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8004870 con 0x7f0e9c003a00 2024-05-08T19:22:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.593+0000 7f0e9bfff700 1 -- 172.21.15.47:0/1995768892 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea80049d0 con 0x7f0e9c003a00 2024-05-08T19:22:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.593+0000 7f0eb9ebb700 1 -- 172.21.15.47:0/1995768892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb41ee1e0 con 0x7f0e9c003a00 2024-05-08T19:22:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.593+0000 7f0e9bfff700 1 -- 172.21.15.47:0/1995768892 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8004d80 con 0x7f0e9c003a00 2024-05-08T19:22:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.593+0000 7f0eb9ebb700 1 -- 172.21.15.47:0/1995768892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb4143dd0 con 0x7f0e9c003a00 2024-05-08T19:22:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.594+0000 7f0eb9ebb700 1 -- 172.21.15.47:0/1995768892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb40c0df0 con 0x7f0e9c003a00 2024-05-08T19:22:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.595+0000 7f0e9bfff700 1 -- 172.21.15.47:0/1995768892 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0ea80070d0 con 0x7f0e9c003a00 2024-05-08T19:22:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.595+0000 7f0e9bfff700 1 --2- 172.21.15.47:0/1995768892 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0ea006ac90 0x7f0ea006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.595+0000 7f0e9bfff700 1 -- 172.21.15.47:0/1995768892 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ea808a910 con 0x7f0e9c003a00 2024-05-08T19:22:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.595+0000 7f0eb2ffd700 1 --2- 172.21.15.47:0/1995768892 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0ea006ac90 0x7f0ea006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.596+0000 7f0eb2ffd700 1 --2- 172.21.15.47:0/1995768892 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0ea006ac90 0x7f0ea006d150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0eb414a2a0 tx=0x7f0ea4009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.599+0000 7f0e9bfff700 1 -- 172.21.15.47:0/1995768892 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0ea8055b80 con 0x7f0e9c003a00 2024-05-08T19:22:20.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:20.817+0000 7f0eb9ebb700 1 -- 172.21.15.47:0/1995768892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f0eb41ee3a0 con 0x7f0e9c003a00 2024-05-08T19:22:21.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.436+0000 7f0e9bfff700 1 -- 172.21.15.47:0/1995768892 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f0eb41ee3a0 con 0x7f0e9c003a00 2024-05-08T19:22:21.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.440+0000 7f0eb9ebb700 1 -- 172.21.15.47:0/1995768892 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0ea006ac90 msgr2=0x7f0ea006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:21.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.440+0000 7f0eb9ebb700 1 --2- 172.21.15.47:0/1995768892 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0ea006ac90 0x7f0ea006d150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0eb414a2a0 tx=0x7f0ea4009210 comp rx=0 tx=0).stop 2024-05-08T19:22:21.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.440+0000 7f0eb9ebb700 1 -- 172.21.15.47:0/1995768892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c003a00 msgr2=0x7f0eb40aa810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:21.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.440+0000 7f0eb9ebb700 1 --2- 172.21.15.47:0/1995768892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c003a00 0x7f0eb40aa810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800c960 tx=0x7f0ea8000fe0 comp rx=0 tx=0).stop 2024-05-08T19:22:21.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.440+0000 7f0eb9ebb700 1 -- 172.21.15.47:0/1995768892 shutdown_connections 2024-05-08T19:22:21.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.440+0000 7f0eb9ebb700 1 --2- 172.21.15.47:0/1995768892 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0ea006ac90 0x7f0ea006d150 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:21.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.440+0000 7f0eb9ebb700 1 --2- 172.21.15.47:0/1995768892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c003a00 0x7f0eb40aa810 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:21.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.440+0000 7f0eb9ebb700 1 --2- 172.21.15.47:0/1995768892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0eb40c68e0 0x7f0eb41e9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:21.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.440+0000 7f0eb9ebb700 1 --2- 172.21.15.47:0/1995768892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0eb41e7540 0x7f0eb40c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:21.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.440+0000 7f0eb9ebb700 1 -- 172.21.15.47:0/1995768892 >> 172.21.15.47:0/1995768892 conn(0x7f0eb40c3c20 msgr2=0x7f0eb414f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:21.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.440+0000 7f0eb9ebb700 1 -- 172.21.15.47:0/1995768892 shutdown_connections 2024-05-08T19:22:21.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.440+0000 7f0eb9ebb700 1 -- 172.21.15.47:0/1995768892 wait complete. 2024-05-08T19:22:21.454 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T19:22:21.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.603+0000 7fb0b3ffb700 1 Processor -- start 2024-05-08T19:22:21.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.603+0000 7fb0b3ffb700 1 -- start start 2024-05-08T19:22:21.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.604+0000 7fb0b3ffb700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb0ac070470 0x7fb0ac0c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:21.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.604+0000 7fb0b3ffb700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb0ac0c62b0 0x7fb0ac0c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:21.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.604+0000 7fb0b3ffb700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ac0c2fc0 con 0x7fb0ac152230 2024-05-08T19:22:21.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.604+0000 7fb0b3ffb700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ac0c3e20 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.604+0000 7fb0b3ffb700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ac152610 con 0x7fb0ac070470 2024-05-08T19:22:21.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.604+0000 7fb0b2598700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb0ac0c62b0 0x7fb0ac0c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:21.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.604+0000 7fb0b2598700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb0ac0c62b0 0x7fb0ac0c14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41958/0 (socket says 172.21.15.47:41958) 2024-05-08T19:22:21.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.604+0000 7fb0b2598700 1 -- 172.21.15.47:0/975598683 learned_addr learned my addr 172.21.15.47:0/975598683 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:21.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.605+0000 7fb0b1596700 1 --2- 172.21.15.47:0/975598683 >> v2:172.21.15.177:3300/0 conn(0x7fb0ac070470 0x7fb0ac0c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:21.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.605+0000 7fb0b2598700 1 -- 172.21.15.47:0/975598683 >> v2:172.21.15.177:3300/0 conn(0x7fb0ac070470 msgr2=0x7fb0ac0c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:21.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.605+0000 7fb0b2598700 1 --2- 172.21.15.47:0/975598683 >> v2:172.21.15.177:3300/0 conn(0x7fb0ac070470 0x7fb0ac0c2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:21.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.605+0000 7fb0b2598700 1 -- 172.21.15.47:0/975598683 >> v1:172.21.15.177:6789/0 conn(0x7fb0ac152230 legacy=0x7fb0ac0c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:21.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.605+0000 7fb0b2598700 1 -- 172.21.15.47:0/975598683 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac0702a0 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.605+0000 7fb0b1596700 1 --2- 172.21.15.47:0/975598683 >> v2:172.21.15.177:3300/0 conn(0x7fb0ac070470 0x7fb0ac0c2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:21.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.605+0000 7fb0b2598700 1 --2- 172.21.15.47:0/975598683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac0c62b0 0x7fb0ac0c14b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac06e4a0 tx=0x7fb0a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474fdbe97a9f5dbe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:21.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.605+0000 7fb0b0d95700 1 -- 172.21.15.47:0/975598683 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a400e070 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.605+0000 7fb0b0d95700 1 -- 172.21.15.47:0/975598683 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a4003a20 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.605+0000 7fb0b0d95700 1 -- 172.21.15.47:0/975598683 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4003dd0 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.606+0000 7fb0b3ffb700 1 -- 172.21.15.47:0/975598683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac0c62b0 msgr2=0x7fb0ac0c14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:21.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.606+0000 7fb0b3ffb700 1 --2- 172.21.15.47:0/975598683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac0c62b0 0x7fb0ac0c14b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac06e4a0 tx=0x7fb0a400b330 comp rx=0 tx=0).stop 2024-05-08T19:22:21.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.606+0000 7fb0b3ffb700 1 -- 172.21.15.47:0/975598683 shutdown_connections 2024-05-08T19:22:21.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.606+0000 7fb0b3ffb700 1 --2- 172.21.15.47:0/975598683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac0c62b0 0x7fb0ac0c14b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:21.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.606+0000 7fb0b3ffb700 1 --2- 172.21.15.47:0/975598683 >> v2:172.21.15.177:3300/0 conn(0x7fb0ac070470 0x7fb0ac0c2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:21.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.606+0000 7fb0b3ffb700 1 -- 172.21.15.47:0/975598683 >> 172.21.15.47:0/975598683 conn(0x7fb0ac06b1b0 msgr2=0x7fb0ac0a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:21.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.606+0000 7fb0b3ffb700 1 -- 172.21.15.47:0/975598683 shutdown_connections 2024-05-08T19:22:21.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.606+0000 7fb0b3ffb700 1 -- 172.21.15.47:0/975598683 wait complete. 2024-05-08T19:22:21.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.607+0000 7fb0b3ffb700 1 Processor -- start 2024-05-08T19:22:21.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.607+0000 7fb0b3ffb700 1 -- start start 2024-05-08T19:22:21.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b3ffb700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0ac070470 0x7fb0ac153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:21.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b3ffb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac0c62b0 0x7fb0ac1edba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:21.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b3ffb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0ac152230 0x7fb0ac1ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:21.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b3ffb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac1ed670 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b3ffb700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac1ee620 con 0x7fb0ac152230 2024-05-08T19:22:21.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b3ffb700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac1587d0 con 0x7fb0ac070470 2024-05-08T19:22:21.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b1596700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac0c62b0 0x7fb0ac1edba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:21.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b1596700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac0c62b0 0x7fb0ac1edba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41970/0 (socket says 172.21.15.47:41970) 2024-05-08T19:22:21.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b1596700 1 -- 172.21.15.47:0/2660488582 learned_addr learned my addr 172.21.15.47:0/2660488582 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:21.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b2598700 1 --2- 172.21.15.47:0/2660488582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0ac152230 0x7fb0ac1ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:21.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b1d97700 1 --2- 172.21.15.47:0/2660488582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0ac070470 0x7fb0ac153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:21.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b1596700 1 -- 172.21.15.47:0/2660488582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0ac070470 msgr2=0x7fb0ac153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:21.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b1596700 1 --2- 172.21.15.47:0/2660488582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0ac070470 0x7fb0ac153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:21.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b1596700 1 -- 172.21.15.47:0/2660488582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0ac152230 msgr2=0x7fb0ac1ee0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:21.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b1596700 1 --2- 172.21.15.47:0/2660488582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0ac152230 0x7fb0ac1ee0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:21.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b1596700 1 -- 172.21.15.47:0/2660488582 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a4009b30 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b1596700 1 --2- 172.21.15.47:0/2660488582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac0c62b0 0x7fb0ac1edba0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800c740 tx=0x7fb0a800ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:21.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0a27fc700 1 -- 172.21.15.47:0/2660488582 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8004220 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0a27fc700 1 -- 172.21.15.47:0/2660488582 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a8004380 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b3ffb700 1 -- 172.21.15.47:0/2660488582 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ac0c8840 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0a27fc700 1 -- 172.21.15.47:0/2660488582 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80036c0 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.608+0000 7fb0b3ffb700 1 -- 172.21.15.47:0/2660488582 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ac1584f0 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.609+0000 7fb0b3ffb700 1 -- 172.21.15.47:0/2660488582 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ac04ec60 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.610+0000 7fb0a27fc700 1 -- 172.21.15.47:0/2660488582 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb0a8003820 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.610+0000 7fb0a27fc700 1 --2- 172.21.15.47:0/2660488582 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb09006ac90 0x7fb09006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:21.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.611+0000 7fb0a27fc700 1 -- 172.21.15.47:0/2660488582 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fb0a8089580 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.611+0000 7fb0b1d97700 1 --2- 172.21.15.47:0/2660488582 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb09006ac90 0x7fb09006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:21.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.611+0000 7fb0b1d97700 1 --2- 172.21.15.47:0/2660488582 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb09006ac90 0x7fb09006d150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009960 tx=0x7fb09c0090e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:21.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.615+0000 7fb0a27fc700 1 -- 172.21.15.47:0/2660488582 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb0a8054710 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:21.822+0000 7fb0b3ffb700 1 -- 172.21.15.47:0/2660488582 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb0ac0c6090 con 0x7fb0ac0c62b0 2024-05-08T19:22:21.973 INFO:tasks.ceph.mds.d.smithi177.stderr:2024-05-08T19:22:21.982+0000 7fb1ff3a2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T19:22:23.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.443+0000 7fb0a27fc700 1 -- 172.21.15.47:0/2660488582 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7fb0a8057d30 con 0x7fb0ac0c62b0 2024-05-08T19:22:23.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.448+0000 7fb0b3ffb700 1 -- 172.21.15.47:0/2660488582 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb09006ac90 msgr2=0x7fb09006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:23.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.448+0000 7fb0b3ffb700 1 --2- 172.21.15.47:0/2660488582 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb09006ac90 0x7fb09006d150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009960 tx=0x7fb09c0090e0 comp rx=0 tx=0).stop 2024-05-08T19:22:23.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.448+0000 7fb0b3ffb700 1 -- 172.21.15.47:0/2660488582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac0c62b0 msgr2=0x7fb0ac1edba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:23.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.448+0000 7fb0b3ffb700 1 --2- 172.21.15.47:0/2660488582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac0c62b0 0x7fb0ac1edba0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800c740 tx=0x7fb0a800ca50 comp rx=0 tx=0).stop 2024-05-08T19:22:23.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.449+0000 7fb0b3ffb700 1 -- 172.21.15.47:0/2660488582 shutdown_connections 2024-05-08T19:22:23.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.449+0000 7fb0b3ffb700 1 --2- 172.21.15.47:0/2660488582 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb09006ac90 0x7fb09006d150 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:23.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.449+0000 7fb0b3ffb700 1 --2- 172.21.15.47:0/2660488582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0ac152230 0x7fb0ac1ee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:23.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.449+0000 7fb0b3ffb700 1 --2- 172.21.15.47:0/2660488582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0ac070470 0x7fb0ac153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:23.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.449+0000 7fb0b3ffb700 1 --2- 172.21.15.47:0/2660488582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac0c62b0 0x7fb0ac1edba0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:23.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.449+0000 7fb0b3ffb700 1 -- 172.21.15.47:0/2660488582 >> 172.21.15.47:0/2660488582 conn(0x7fb0ac06b1b0 msgr2=0x7fb0ac0c7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:23.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.449+0000 7fb0b3ffb700 1 -- 172.21.15.47:0/2660488582 shutdown_connections 2024-05-08T19:22:23.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.449+0000 7fb0b3ffb700 1 -- 172.21.15.47:0/2660488582 wait complete. 2024-05-08T19:22:23.445 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data_ec' created 2024-05-08T19:22:23.460 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-08T19:22:23.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.603+0000 7f260a34b700 1 Processor -- start 2024-05-08T19:22:23.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.604+0000 7f260a34b700 1 -- start start 2024-05-08T19:22:23.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.604+0000 7f260a34b700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2604152100 0x7f260406f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:23.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.604+0000 7f260a34b700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f26040c3450 0x7f260406fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:23.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.604+0000 7f260a34b700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260406f1d0 con 0x7f26040700e0 2024-05-08T19:22:23.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.604+0000 7f260a34b700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26041554d0 con 0x7f26040c3450 2024-05-08T19:22:23.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.604+0000 7f260a34b700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26040c3a10 con 0x7f2604152100 2024-05-08T19:22:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.604+0000 7f26037fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f26040c3450 0x7f260406fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.604+0000 7f26037fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f26040c3450 0x7f260406fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41976/0 (socket says 172.21.15.47:41976) 2024-05-08T19:22:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.604+0000 7f26037fe700 1 -- 172.21.15.47:0/36051950 learned_addr learned my addr 172.21.15.47:0/36051950 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.605+0000 7f2603fff700 1 --2- 172.21.15.47:0/36051950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2604152100 0x7f260406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.605+0000 7f26037fe700 1 -- 172.21.15.47:0/36051950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2604152100 msgr2=0x7f260406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.605+0000 7f26037fe700 1 --2- 172.21.15.47:0/36051950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2604152100 0x7f260406f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.605+0000 7f26037fe700 1 -- 172.21.15.47:0/36051950 >> v1:172.21.15.177:6789/0 conn(0x7f26040700e0 legacy=0x7f26040c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.605+0000 7f26037fe700 1 -- 172.21.15.47:0/36051950 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26041524e0 con 0x7f26040c3450 2024-05-08T19:22:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.605+0000 7f2603fff700 1 --2- 172.21.15.47:0/36051950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2604152100 0x7f260406f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.605+0000 7f26037fe700 1 --2- 172.21.15.47:0/36051950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26040c3450 0x7f260406fba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f25f80098f0 tx=0x7f25f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8f1b8286738442 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.605+0000 7f2602ffd700 1 -- 172.21.15.47:0/36051950 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8004230 con 0x7f26040c3450 2024-05-08T19:22:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.605+0000 7f2602ffd700 1 -- 172.21.15.47:0/36051950 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f8004390 con 0x7f26040c3450 2024-05-08T19:22:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.605+0000 7f2602ffd700 1 -- 172.21.15.47:0/36051950 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f80036a0 con 0x7f26040c3450 2024-05-08T19:22:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.606+0000 7f260a34b700 1 -- 172.21.15.47:0/36051950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26040c3450 msgr2=0x7f260406fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.606+0000 7f260a34b700 1 --2- 172.21.15.47:0/36051950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26040c3450 0x7f260406fba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f25f80098f0 tx=0x7f25f8009c00 comp rx=0 tx=0).stop 2024-05-08T19:22:23.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.606+0000 7f260a34b700 1 -- 172.21.15.47:0/36051950 shutdown_connections 2024-05-08T19:22:23.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.606+0000 7f260a34b700 1 --2- 172.21.15.47:0/36051950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2604152100 0x7f260406f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:23.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.606+0000 7f260a34b700 1 --2- 172.21.15.47:0/36051950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26040c3450 0x7f260406fba0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:23.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.606+0000 7f260a34b700 1 -- 172.21.15.47:0/36051950 >> 172.21.15.47:0/36051950 conn(0x7f260406b1b0 msgr2=0x7f26040a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:23.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.606+0000 7f260a34b700 1 -- 172.21.15.47:0/36051950 shutdown_connections 2024-05-08T19:22:23.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.606+0000 7f260a34b700 1 -- 172.21.15.47:0/36051950 wait complete. 2024-05-08T19:22:23.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.607+0000 7f260a34b700 1 Processor -- start 2024-05-08T19:22:23.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.607+0000 7f260a34b700 1 -- start start 2024-05-08T19:22:23.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f260a34b700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26040700e0 0x7f26040a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:23.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f260a34b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26040c3450 0x7f2604156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:23.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f260a34b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2604152100 0x7f26041568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:23.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f260a34b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260414e980 con 0x7f26040c3450 2024-05-08T19:22:23.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f260a34b700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26040ad9a0 con 0x7f2604152100 2024-05-08T19:22:23.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f260a34b700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260414e3c0 con 0x7f26040700e0 2024-05-08T19:22:23.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f26037fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26040c3450 0x7f2604156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:23.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f26037fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26040c3450 0x7f2604156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41986/0 (socket says 172.21.15.47:41986) 2024-05-08T19:22:23.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f26037fe700 1 -- 172.21.15.47:0/1587607129 learned_addr learned my addr 172.21.15.47:0/1587607129 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:23.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f2603fff700 1 --2- 172.21.15.47:0/1587607129 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26040700e0 0x7f26040a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:23.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f26088e8700 1 --2- 172.21.15.47:0/1587607129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2604152100 0x7f26041568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:23.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f26037fe700 1 -- 172.21.15.47:0/1587607129 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26040700e0 msgr2=0x7f26040a9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:23.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f26037fe700 1 --2- 172.21.15.47:0/1587607129 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26040700e0 0x7f26040a9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:23.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f26037fe700 1 -- 172.21.15.47:0/1587607129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2604152100 msgr2=0x7f26041568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:23.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f26037fe700 1 --2- 172.21.15.47:0/1587607129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2604152100 0x7f26041568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:23.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f26037fe700 1 -- 172.21.15.47:0/1587607129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f8009550 con 0x7f26040c3450 2024-05-08T19:22:23.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f26037fe700 1 --2- 172.21.15.47:0/1587607129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26040c3450 0x7f2604156380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26040c2890 tx=0x7f25f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:23.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f2600ff9700 1 -- 172.21.15.47:0/1587607129 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8003d10 con 0x7f26040c3450 2024-05-08T19:22:23.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f2600ff9700 1 -- 172.21.15.47:0/1587607129 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f801f070 con 0x7f26040c3450 2024-05-08T19:22:23.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f260a34b700 1 -- 172.21.15.47:0/1587607129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260414e6a0 con 0x7f26040c3450 2024-05-08T19:22:23.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.608+0000 7f2600ff9700 1 -- 172.21.15.47:0/1587607129 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f800b8a0 con 0x7f26040c3450 2024-05-08T19:22:23.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.609+0000 7f260a34b700 1 -- 172.21.15.47:0/1587607129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26040c89d0 con 0x7f26040c3450 2024-05-08T19:22:23.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.610+0000 7f260a34b700 1 -- 172.21.15.47:0/1587607129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26040ad490 con 0x7f26040c3450 2024-05-08T19:22:23.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.610+0000 7f2600ff9700 1 -- 172.21.15.47:0/1587607129 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f25f8021030 con 0x7f26040c3450 2024-05-08T19:22:23.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.611+0000 7f2600ff9700 1 --2- 172.21.15.47:0/1587607129 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f25f006ac90 0x7f25f006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:23.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.611+0000 7f2600ff9700 1 -- 172.21.15.47:0/1587607129 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f25f808aa90 con 0x7f26040c3450 2024-05-08T19:22:23.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.611+0000 7f2603fff700 1 --2- 172.21.15.47:0/1587607129 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f25f006ac90 0x7f25f006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:23.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.611+0000 7f2603fff700 1 --2- 172.21.15.47:0/1587607129 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f25f006ac90 0x7f25f006d150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f25f4006fd0 tx=0x7f25f4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:23.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.616+0000 7f2600ff9700 1 -- 172.21.15.47:0/1587607129 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f26040ad490 con 0x7f26040c3450 2024-05-08T19:22:23.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:23.821+0000 7f260a34b700 1 -- 172.21.15.47:0/1587607129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f26040ad490 con 0x7f26040c3450 2024-05-08T19:22:24.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.450+0000 7f2600ff9700 1 -- 172.21.15.47:0/1587607129 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f26040ad490 con 0x7f26040c3450 2024-05-08T19:22:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.461+0000 7f260a34b700 1 -- 172.21.15.47:0/1587607129 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f25f006ac90 msgr2=0x7f25f006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.461+0000 7f260a34b700 1 --2- 172.21.15.47:0/1587607129 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f25f006ac90 0x7f25f006d150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f25f4006fd0 tx=0x7f25f4008040 comp rx=0 tx=0).stop 2024-05-08T19:22:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.461+0000 7f260a34b700 1 -- 172.21.15.47:0/1587607129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26040c3450 msgr2=0x7f2604156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.461+0000 7f260a34b700 1 --2- 172.21.15.47:0/1587607129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26040c3450 0x7f2604156380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26040c2890 tx=0x7f25f8004750 comp rx=0 tx=0).stop 2024-05-08T19:22:24.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.462+0000 7f260a34b700 1 -- 172.21.15.47:0/1587607129 shutdown_connections 2024-05-08T19:22:24.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.462+0000 7f260a34b700 1 --2- 172.21.15.47:0/1587607129 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f25f006ac90 0x7f25f006d150 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:24.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.462+0000 7f260a34b700 1 --2- 172.21.15.47:0/1587607129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2604152100 0x7f26041568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:24.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.462+0000 7f260a34b700 1 --2- 172.21.15.47:0/1587607129 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f26040700e0 0x7f26040a9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:24.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.462+0000 7f260a34b700 1 --2- 172.21.15.47:0/1587607129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26040c3450 0x7f2604156380 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:24.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.462+0000 7f260a34b700 1 -- 172.21.15.47:0/1587607129 >> 172.21.15.47:0/1587607129 conn(0x7f260406b1b0 msgr2=0x7f26041533b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:24.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.462+0000 7f260a34b700 1 -- 172.21.15.47:0/1587607129 shutdown_connections 2024-05-08T19:22:24.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.463+0000 7f260a34b700 1 -- 172.21.15.47:0/1587607129 wait complete. 2024-05-08T19:22:24.457 INFO:teuthology.orchestra.run.smithi047.stderr:set pool 4 allow_ec_overwrites to true 2024-05-08T19:22:24.476 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-08T19:22:24.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.620+0000 7f04dd79a700 1 Processor -- start 2024-05-08T19:22:24.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.620+0000 7f04dd79a700 1 -- start start 2024-05-08T19:22:24.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.620+0000 7f04dd79a700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f04d814ff90 0x7f04d80ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:24.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04dd79a700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04d80a9d70 0x7f04d8152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:24.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04dd79a700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d8153420 con 0x7f04d806e730 2024-05-08T19:22:24.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04dd79a700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d80a8830 con 0x7f04d814ff90 2024-05-08T19:22:24.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04dd79a700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d806f820 con 0x7f04d80a9d70 2024-05-08T19:22:24.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04d6ffd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f04d814ff90 0x7f04d80ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:24.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04d77fe700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04d80a9d70 0x7f04d8152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:24.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04d77fe700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04d80a9d70 0x7f04d8152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:51356/0 (socket says 172.21.15.47:51356) 2024-05-08T19:22:24.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04d6ffd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f04d814ff90 0x7f04d80ac5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:56034/0 (socket says 172.21.15.47:56034) 2024-05-08T19:22:24.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04d77fe700 1 -- 172.21.15.47:0/2805440583 learned_addr learned my addr 172.21.15.47:0/2805440583 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:24.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04d67fc700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f04d806e730 0x7f04d81527d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:60484/0 (socket says 172.21.15.47:60484) 2024-05-08T19:22:24.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04d5ffb700 1 -- 172.21.15.47:0/2805440583 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699481566 0 0) 0x7f04d8153420 con 0x7f04d806e730 2024-05-08T19:22:24.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04d77fe700 1 -- 172.21.15.47:0/2805440583 >> v2:172.21.15.177:3300/0 conn(0x7f04d814ff90 msgr2=0x7f04d80ac5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:24.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04d77fe700 1 --2- 172.21.15.47:0/2805440583 >> v2:172.21.15.177:3300/0 conn(0x7f04d814ff90 0x7f04d80ac5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:24.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04d77fe700 1 -- 172.21.15.47:0/2805440583 >> v1:172.21.15.177:6789/0 conn(0x7f04d806e730 legacy=0x7f04d81527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:24.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04d77fe700 1 -- 172.21.15.47:0/2805440583 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d80a8550 con 0x7f04d80a9d70 2024-05-08T19:22:24.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04d77fe700 1 --2- 172.21.15.47:0/2805440583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04d80a9d70 0x7f04d8152ee0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009e50 tx=0x7f04d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e995f5874200cfc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:24.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.621+0000 7f04d5ffb700 1 -- 172.21.15.47:0/2805440583 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d000e070 con 0x7f04d80a9d70 2024-05-08T19:22:24.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.622+0000 7f04d5ffb700 1 -- 172.21.15.47:0/2805440583 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d000b910 con 0x7f04d80a9d70 2024-05-08T19:22:24.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.622+0000 7f04d5ffb700 1 -- 172.21.15.47:0/2805440583 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d000bcc0 con 0x7f04d80a9d70 2024-05-08T19:22:24.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.622+0000 7f04dd79a700 1 -- 172.21.15.47:0/2805440583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04d80a9d70 msgr2=0x7f04d8152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:24.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.622+0000 7f04dd79a700 1 --2- 172.21.15.47:0/2805440583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04d80a9d70 0x7f04d8152ee0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009e50 tx=0x7f04d000b330 comp rx=0 tx=0).stop 2024-05-08T19:22:24.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.622+0000 7f04dd79a700 1 -- 172.21.15.47:0/2805440583 shutdown_connections 2024-05-08T19:22:24.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.622+0000 7f04dd79a700 1 --2- 172.21.15.47:0/2805440583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04d80a9d70 0x7f04d8152ee0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:24.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.622+0000 7f04dd79a700 1 --2- 172.21.15.47:0/2805440583 >> v2:172.21.15.177:3300/0 conn(0x7f04d814ff90 0x7f04d80ac5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:24.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.622+0000 7f04dd79a700 1 -- 172.21.15.47:0/2805440583 >> 172.21.15.47:0/2805440583 conn(0x7f04d80c71c0 msgr2=0x7f04d80c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:24.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.622+0000 7f04dd79a700 1 -- 172.21.15.47:0/2805440583 shutdown_connections 2024-05-08T19:22:24.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.622+0000 7f04dd79a700 1 -- 172.21.15.47:0/2805440583 wait complete. 2024-05-08T19:22:24.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.623+0000 7f04dd79a700 1 Processor -- start 2024-05-08T19:22:24.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.623+0000 7f04dd79a700 1 -- start start 2024-05-08T19:22:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.624+0000 7f04dd79a700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04d806e730 0x7f04d814cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.624+0000 7f04dd79a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04d80a9d70 0x7f04d80abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.624+0000 7f04dd79a700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04d814ff90 0x7f04d80c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.624+0000 7f04dd79a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d80c1220 con 0x7f04d80a9d70 2024-05-08T19:22:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.624+0000 7f04dd79a700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d81eaec0 con 0x7f04d814ff90 2024-05-08T19:22:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.624+0000 7f04dd79a700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d81ea2b0 con 0x7f04d806e730 2024-05-08T19:22:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.624+0000 7f04d67fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04d80a9d70 0x7f04d80abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.624+0000 7f04d67fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04d80a9d70 0x7f04d80abd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42000/0 (socket says 172.21.15.47:42000) 2024-05-08T19:22:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.624+0000 7f04d67fc700 1 -- 172.21.15.47:0/2442519714 learned_addr learned my addr 172.21.15.47:0/2442519714 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.624+0000 7f04d77fe700 1 --2- 172.21.15.47:0/2442519714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04d814ff90 0x7f04d80c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.624+0000 7f04d6ffd700 1 --2- 172.21.15.47:0/2442519714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04d806e730 0x7f04d814cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.625+0000 7f04d67fc700 1 -- 172.21.15.47:0/2442519714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04d806e730 msgr2=0x7f04d814cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.625+0000 7f04d67fc700 1 --2- 172.21.15.47:0/2442519714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04d806e730 0x7f04d814cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.625+0000 7f04d67fc700 1 -- 172.21.15.47:0/2442519714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04d814ff90 msgr2=0x7f04d80c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.625+0000 7f04d67fc700 1 --2- 172.21.15.47:0/2442519714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04d814ff90 0x7f04d80c20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.625+0000 7f04d67fc700 1 -- 172.21.15.47:0/2442519714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d0009b30 con 0x7f04d80a9d70 2024-05-08T19:22:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.625+0000 7f04d6ffd700 1 --2- 172.21.15.47:0/2442519714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04d806e730 0x7f04d814cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.625+0000 7f04d67fc700 1 --2- 172.21.15.47:0/2442519714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04d80a9d70 0x7f04d80abd90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0011e0 tx=0x7f04cc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.625+0000 7f04bf7fe700 1 -- 172.21.15.47:0/2442519714 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc004c80 con 0x7f04d80a9d70 2024-05-08T19:22:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.625+0000 7f04bf7fe700 1 -- 172.21.15.47:0/2442519714 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc004de0 con 0x7f04d80a9d70 2024-05-08T19:22:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.625+0000 7f04dd79a700 1 -- 172.21.15.47:0/2442519714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d81ea590 con 0x7f04d80a9d70 2024-05-08T19:22:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.625+0000 7f04bf7fe700 1 -- 172.21.15.47:0/2442519714 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc007310 con 0x7f04d80a9d70 2024-05-08T19:22:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.625+0000 7f04dd79a700 1 -- 172.21.15.47:0/2442519714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d81eab50 con 0x7f04d80a9d70 2024-05-08T19:22:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.626+0000 7f04dd79a700 1 -- 172.21.15.47:0/2442519714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d81ed4c0 con 0x7f04d80a9d70 2024-05-08T19:22:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.627+0000 7f04bf7fe700 1 -- 172.21.15.47:0/2442519714 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f04cc007470 con 0x7f04d80a9d70 2024-05-08T19:22:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.627+0000 7f04bf7fe700 1 --2- 172.21.15.47:0/2442519714 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f04c406ac90 0x7f04c406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:24.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.627+0000 7f04bf7fe700 1 -- 172.21.15.47:0/2442519714 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f04cc089880 con 0x7f04d80a9d70 2024-05-08T19:22:24.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.627+0000 7f04d6ffd700 1 --2- 172.21.15.47:0/2442519714 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f04c406ac90 0x7f04c406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:24.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.628+0000 7f04d6ffd700 1 --2- 172.21.15.47:0/2442519714 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f04c406ac90 0x7f04c406d150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009b90 tx=0x7f04c8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:24.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.631+0000 7f04bf7fe700 1 -- 172.21.15.47:0/2442519714 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f04cc054900 con 0x7f04d80a9d70 2024-05-08T19:22:24.867 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:22:24.870 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:22:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.890+0000 7f04dd79a700 1 -- 172.21.15.47:0/2442519714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f04d80c15f0 con 0x7f04d80a9d70 2024-05-08T19:22:24.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.895+0000 7f04bf7fe700 1 -- 172.21.15.47:0/2442519714 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f04cc057f20 con 0x7f04d80a9d70 2024-05-08T19:22:24.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.898+0000 7f04dd79a700 1 -- 172.21.15.47:0/2442519714 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f04c406ac90 msgr2=0x7f04c406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:24.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.898+0000 7f04dd79a700 1 --2- 172.21.15.47:0/2442519714 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f04c406ac90 0x7f04c406d150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009b90 tx=0x7f04c8008040 comp rx=0 tx=0).stop 2024-05-08T19:22:24.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.898+0000 7f04dd79a700 1 -- 172.21.15.47:0/2442519714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04d80a9d70 msgr2=0x7f04d80abd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:24.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.898+0000 7f04dd79a700 1 --2- 172.21.15.47:0/2442519714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04d80a9d70 0x7f04d80abd90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0011e0 tx=0x7f04cc00ca30 comp rx=0 tx=0).stop 2024-05-08T19:22:24.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.898+0000 7f04dd79a700 1 -- 172.21.15.47:0/2442519714 shutdown_connections 2024-05-08T19:22:24.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.898+0000 7f04dd79a700 1 --2- 172.21.15.47:0/2442519714 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f04c406ac90 0x7f04c406d150 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:24.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.898+0000 7f04dd79a700 1 --2- 172.21.15.47:0/2442519714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04d814ff90 0x7f04d80c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:24.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.898+0000 7f04dd79a700 1 --2- 172.21.15.47:0/2442519714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04d806e730 0x7f04d814cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:24.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.898+0000 7f04dd79a700 1 --2- 172.21.15.47:0/2442519714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04d80a9d70 0x7f04d80abd90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:24.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.898+0000 7f04dd79a700 1 -- 172.21.15.47:0/2442519714 >> 172.21.15.47:0/2442519714 conn(0x7f04d80c71c0 msgr2=0x7f04d80715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:24.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.898+0000 7f04dd79a700 1 -- 172.21.15.47:0/2442519714 shutdown_connections 2024-05-08T19:22:24.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:24.898+0000 7f04dd79a700 1 -- 172.21.15.47:0/2442519714 wait complete. 2024-05-08T19:22:24.892 INFO:teuthology.orchestra.run.smithi047.stderr:added data pool 4 to fsmap 2024-05-08T19:22:24.904 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T19:22:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.078+0000 7f59c9661700 1 Processor -- start 2024-05-08T19:22:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.078+0000 7f59c9661700 1 -- start start 2024-05-08T19:22:25.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.079+0000 7f59c9661700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c406e900 0x7f59c40a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.079+0000 7f59c9661700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c406dcd0 con 0x7f59c40c2ea0 2024-05-08T19:22:25.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.079+0000 7f59c9661700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c4155ae0 con 0x7f59c406d450 2024-05-08T19:22:25.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.079+0000 7f59c9661700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40c3940 con 0x7f59c406e900 2024-05-08T19:22:25.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.079+0000 7f59c2ffd700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f59c40c2ea0 0x7f59c41553d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60436/0 (socket says 172.21.15.47:60436) 2024-05-08T19:22:25.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.079+0000 7f59c2ffd700 1 -- 172.21.15.47:0/3737071701 learned_addr learned my addr 172.21.15.47:0/3737071701 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:25.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c27fc700 1 --2- 172.21.15.47:0/3737071701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c406e900 0x7f59c40a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c1ffb700 1 -- 172.21.15.47:0/3737071701 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925479119 0 0) 0x7f59c406dcd0 con 0x7f59c40c2ea0 2024-05-08T19:22:25.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c1ffb700 1 -- 172.21.15.47:0/3737071701 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59ac0035b0 con 0x7f59c40c2ea0 2024-05-08T19:22:25.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c1ffb700 1 -- 172.21.15.47:0/3737071701 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3796427751 0 0) 0x7f59ac0035b0 con 0x7f59c40c2ea0 2024-05-08T19:22:25.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c1ffb700 1 -- 172.21.15.47:0/3737071701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c406e900 msgr2=0x7f59c40a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:25.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c1ffb700 1 --2- 172.21.15.47:0/3737071701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c406e900 0x7f59c40a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c1ffb700 1 -- 172.21.15.47:0/3737071701 >> v1:172.21.15.177:6789/0 conn(0x7f59c406d450 legacy=0x7f59c415bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c1ffb700 1 -- 172.21.15.47:0/3737071701 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c40c26a0 con 0x7f59c40c2ea0 2024-05-08T19:22:25.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c1ffb700 1 -- 172.21.15.47:0/3737071701 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f59b4001670 con 0x7f59c40c2ea0 2024-05-08T19:22:25.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c1ffb700 1 -- 172.21.15.47:0/3737071701 >> v1:172.21.15.47:6789/0 conn(0x7f59c40c2ea0 legacy=0x7f59c41553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c1ffb700 1 --2- 172.21.15.47:0/3737071701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c406e900 0x7f59ac003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c1ffb700 1 --2- 172.21.15.47:0/3737071701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59ac003fb0 0x7f59ac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c1ffb700 1 --2- 172.21.15.47:0/3737071701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac004d90 0x7f59ac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c1ffb700 1 -- 172.21.15.47:0/3737071701 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40c3940 con 0x7f59ac004d90 2024-05-08T19:22:25.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c1ffb700 1 -- 172.21.15.47:0/3737071701 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac00de60 con 0x7f59ac003fb0 2024-05-08T19:22:25.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c1ffb700 1 -- 172.21.15.47:0/3737071701 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac00e020 con 0x7f59c406e900 2024-05-08T19:22:25.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c27fc700 1 --2- 172.21.15.47:0/3737071701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59ac003fb0 0x7f59ac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c2ffd700 1 --2- 172.21.15.47:0/3737071701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c406e900 0x7f59ac003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c37fe700 1 --2- 172.21.15.47:0/3737071701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac004d90 0x7f59ac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c27fc700 1 -- 172.21.15.47:0/3737071701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c406e900 msgr2=0x7f59ac003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:25.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.080+0000 7f59c27fc700 1 --2- 172.21.15.47:0/3737071701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c406e900 0x7f59ac003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.081+0000 7f59c27fc700 1 -- 172.21.15.47:0/3737071701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac004d90 msgr2=0x7f59ac005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.081+0000 7f59c27fc700 1 --2- 172.21.15.47:0/3737071701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac004d90 0x7f59ac005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.081+0000 7f59c27fc700 1 -- 172.21.15.47:0/3737071701 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac0035b0 con 0x7f59ac003fb0 2024-05-08T19:22:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.081+0000 7f59c37fe700 1 --2- 172.21.15.47:0/3737071701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac004d90 0x7f59ac005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.081+0000 7f59c27fc700 1 --2- 172.21.15.47:0/3737071701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59ac003fb0 0x7f59ac004850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009b40 tx=0x7f59ac005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=807f5dbc51ca9bb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.081+0000 7f59c1ffb700 1 -- 172.21.15.47:0/3737071701 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8005a20 con 0x7f59ac003fb0 2024-05-08T19:22:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.081+0000 7f59c1ffb700 1 -- 172.21.15.47:0/3737071701 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b8005b80 con 0x7f59ac003fb0 2024-05-08T19:22:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.081+0000 7f59c1ffb700 1 -- 172.21.15.47:0/3737071701 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b800e6c0 con 0x7f59ac003fb0 2024-05-08T19:22:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.081+0000 7f59c9661700 1 -- 172.21.15.47:0/3737071701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59ac003fb0 msgr2=0x7f59ac004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.081+0000 7f59c9661700 1 --2- 172.21.15.47:0/3737071701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59ac003fb0 0x7f59ac004850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009b40 tx=0x7f59ac005880 comp rx=0 tx=0).stop 2024-05-08T19:22:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.081+0000 7f59c37fe700 1 -- 172.21.15.47:0/3737071701 reap_dead start 2024-05-08T19:22:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.081+0000 7f59c9661700 1 -- 172.21.15.47:0/3737071701 shutdown_connections 2024-05-08T19:22:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.081+0000 7f59c9661700 1 -- 172.21.15.47:0/3737071701 >> 172.21.15.47:0/3737071701 conn(0x7f59c40c3c20 msgr2=0x7f59c40c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.081+0000 7f59c9661700 1 -- 172.21.15.47:0/3737071701 shutdown_connections 2024-05-08T19:22:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.082+0000 7f59c9661700 1 -- 172.21.15.47:0/3737071701 wait complete. 2024-05-08T19:22:25.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.083+0000 7f59c9661700 1 Processor -- start 2024-05-08T19:22:25.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.083+0000 7f59c9661700 1 -- start start 2024-05-08T19:22:25.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.083+0000 7f59c9661700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59ac003fb0 0x7f59c4149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.083+0000 7f59c9661700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c40acf20 0x7f59c41e93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.083+0000 7f59c9661700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59c41e98f0 0x7f59c40c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.083+0000 7f59c9661700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40aaee0 con 0x7f59c41e98f0 2024-05-08T19:22:25.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.083+0000 7f59c9661700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c41dda80 con 0x7f59c40acf20 2024-05-08T19:22:25.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.083+0000 7f59c9661700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40aa2b0 con 0x7f59ac003fb0 2024-05-08T19:22:25.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59c37fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59c41e98f0 0x7f59c40c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59c37fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59c41e98f0 0x7f59c40c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42012/0 (socket says 172.21.15.47:42012) 2024-05-08T19:22:25.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59c37fe700 1 -- 172.21.15.47:0/2553004234 learned_addr learned my addr 172.21.15.47:0/2553004234 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:25.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59c27fc700 1 --2- 172.21.15.47:0/2553004234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c40acf20 0x7f59c41e93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59c2ffd700 1 --2- 172.21.15.47:0/2553004234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59ac003fb0 0x7f59c4149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59c37fe700 1 -- 172.21.15.47:0/2553004234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59ac003fb0 msgr2=0x7f59c4149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59c37fe700 1 --2- 172.21.15.47:0/2553004234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59ac003fb0 0x7f59c4149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59c37fe700 1 -- 172.21.15.47:0/2553004234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c40acf20 msgr2=0x7f59c41e93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59c37fe700 1 --2- 172.21.15.47:0/2553004234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c40acf20 0x7f59c41e93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59c37fe700 1 -- 172.21.15.47:0/2553004234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c41dd7a0 con 0x7f59c41e98f0 2024-05-08T19:22:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59c27fc700 1 --2- 172.21.15.47:0/2553004234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c40acf20 0x7f59c41e93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59c37fe700 1 --2- 172.21.15.47:0/2553004234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59c41e98f0 0x7f59c40c5e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f59c40c1bb0 tx=0x7f59bc00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59ab7fe700 1 -- 172.21.15.47:0/2553004234 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00dc60 con 0x7f59c41e98f0 2024-05-08T19:22:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59ab7fe700 1 -- 172.21.15.47:0/2553004234 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc00dde0 con 0x7f59c41e98f0 2024-05-08T19:22:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59c9661700 1 -- 172.21.15.47:0/2553004234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c40aa550 con 0x7f59c41e98f0 2024-05-08T19:22:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59ab7fe700 1 -- 172.21.15.47:0/2553004234 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc003c40 con 0x7f59c41e98f0 2024-05-08T19:22:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.084+0000 7f59c9661700 1 -- 172.21.15.47:0/2553004234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c40aab70 con 0x7f59c41e98f0 2024-05-08T19:22:25.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.085+0000 7f59c9661700 1 -- 172.21.15.47:0/2553004234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c404ec60 con 0x7f59c41e98f0 2024-05-08T19:22:25.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.086+0000 7f59ab7fe700 1 -- 172.21.15.47:0/2553004234 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f59bc0050d0 con 0x7f59c41e98f0 2024-05-08T19:22:25.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.086+0000 7f59ab7fe700 1 --2- 172.21.15.47:0/2553004234 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f59b006ac90 0x7f59b006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.086+0000 7f59ab7fe700 1 -- 172.21.15.47:0/2553004234 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f59bc089850 con 0x7f59c41e98f0 2024-05-08T19:22:25.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.086+0000 7f59c2ffd700 1 --2- 172.21.15.47:0/2553004234 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f59b006ac90 0x7f59b006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.087+0000 7f59c2ffd700 1 --2- 172.21.15.47:0/2553004234 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f59b006ac90 0x7f59b006d150 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f59c41db210 tx=0x7f59b4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:25.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.090+0000 7f59ab7fe700 1 -- 172.21.15.47:0/2553004234 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f59bc0547d0 con 0x7f59c41e98f0 2024-05-08T19:22:25.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.349+0000 7f59c9661700 1 -- 172.21.15.47:0/2553004234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59c40c2350 con 0x7f59c41e98f0 2024-05-08T19:22:25.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.349+0000 7f59ab7fe700 1 -- 172.21.15.47:0/2553004234 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f59bc057df0 con 0x7f59c41e98f0 2024-05-08T19:22:25.341 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:25.342 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3927983771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3927983771},{"type":"v1","addr":"172.21.15.47:6833","nonce":3927983771}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/201830514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":201830514},{"type":"v1","addr":"172.21.15.47:6835","nonce":201830514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1266001461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1266001461},{"type":"v1","addr":"172.21.15.177:6836","nonce":1266001461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T19:22:20.424727+0000","modified":"2024-05-08T19:22:24.892072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/2990594738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2990594738},{"type":"v1","addr":"172.21.15.177:6837","nonce":2990594738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-08T19:22:25.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.352+0000 7f59c9661700 1 -- 172.21.15.47:0/2553004234 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f59b006ac90 msgr2=0x7f59b006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.352+0000 7f59c9661700 1 --2- 172.21.15.47:0/2553004234 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f59b006ac90 0x7f59b006d150 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f59c41db210 tx=0x7f59b4009040 comp rx=0 tx=0).stop 2024-05-08T19:22:25.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.352+0000 7f59c9661700 1 -- 172.21.15.47:0/2553004234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59c41e98f0 msgr2=0x7f59c40c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.352+0000 7f59c9661700 1 --2- 172.21.15.47:0/2553004234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59c41e98f0 0x7f59c40c5e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f59c40c1bb0 tx=0x7f59bc00d430 comp rx=0 tx=0).stop 2024-05-08T19:22:25.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.352+0000 7f59c9661700 1 -- 172.21.15.47:0/2553004234 shutdown_connections 2024-05-08T19:22:25.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.352+0000 7f59c9661700 1 --2- 172.21.15.47:0/2553004234 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f59b006ac90 0x7f59b006d150 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.352+0000 7f59c9661700 1 --2- 172.21.15.47:0/2553004234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59c41e98f0 0x7f59c40c5e90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.352+0000 7f59c9661700 1 --2- 172.21.15.47:0/2553004234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59ac003fb0 0x7f59c4149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.352+0000 7f59c9661700 1 --2- 172.21.15.47:0/2553004234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c40acf20 0x7f59c41e93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.352+0000 7f59c9661700 1 -- 172.21.15.47:0/2553004234 >> 172.21.15.47:0/2553004234 conn(0x7f59c40c3c20 msgr2=0x7f59c40c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:25.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.352+0000 7f59c9661700 1 -- 172.21.15.47:0/2553004234 shutdown_connections 2024-05-08T19:22:25.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.352+0000 7f59c9661700 1 -- 172.21.15.47:0/2553004234 wait complete. 2024-05-08T19:22:25.345 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 7 2024-05-08T19:22:25.356 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:25.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.489+0000 7f07e70ab700 1 Processor -- start 2024-05-08T19:22:25.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.489+0000 7f07e70ab700 1 -- start start 2024-05-08T19:22:25.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.490+0000 7f07e70ab700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f07e01521c0 0x7f07e00720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.490+0000 7f07e70ab700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f07e0071710 0x7f07e0154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.490+0000 7f07e70ab700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e00c0be0 con 0x7f07e00725e0 2024-05-08T19:22:25.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.490+0000 7f07e70ab700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e006b470 con 0x7f07e0071710 2024-05-08T19:22:25.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.490+0000 7f07e70ab700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e00c1250 con 0x7f07e01521c0 2024-05-08T19:22:25.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.490+0000 7f07dffff700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f07e0071710 0x7f07e0154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.490+0000 7f07dffff700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f07e0071710 0x7f07e0154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42016/0 (socket says 172.21.15.47:42016) 2024-05-08T19:22:25.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.490+0000 7f07dffff700 1 -- 172.21.15.47:0/2405605962 learned_addr learned my addr 172.21.15.47:0/2405605962 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:25.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.490+0000 7f07e5648700 1 --1- 172.21.15.47:0/2405605962 >> v1:172.21.15.47:6789/0 conn(0x7f07e00725e0 0x7f07e01551f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60438/0 (socket says 172.21.15.47:60438) 2024-05-08T19:22:25.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.490+0000 7f07e4e47700 1 --2- 172.21.15.47:0/2405605962 >> v2:172.21.15.177:3300/0 conn(0x7f07e01521c0 0x7f07e00720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.491+0000 7f07dffff700 1 -- 172.21.15.47:0/2405605962 >> v2:172.21.15.177:3300/0 conn(0x7f07e01521c0 msgr2=0x7f07e00720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:25.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.491+0000 7f07dffff700 1 --2- 172.21.15.47:0/2405605962 >> v2:172.21.15.177:3300/0 conn(0x7f07e01521c0 0x7f07e00720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.491+0000 7f07dffff700 1 -- 172.21.15.47:0/2405605962 >> v1:172.21.15.47:6789/0 conn(0x7f07e00725e0 legacy=0x7f07e01551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.491+0000 7f07df7fe700 1 -- 172.21.15.47:0/2405605962 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946306823 0 0) 0x7f07e00c0be0 con 0x7f07e00725e0 2024-05-08T19:22:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.491+0000 7f07dffff700 1 -- 172.21.15.47:0/2405605962 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e006b710 con 0x7f07e0071710 2024-05-08T19:22:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.491+0000 7f07dffff700 1 --2- 172.21.15.47:0/2405605962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e0071710 0x7f07e0154cb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f07e006cf90 tx=0x7f07cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82f0417ccb347a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.491+0000 7f07df7fe700 1 -- 172.21.15.47:0/2405605962 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc011830 con 0x7f07e0071710 2024-05-08T19:22:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.491+0000 7f07df7fe700 1 -- 172.21.15.47:0/2405605962 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc011990 con 0x7f07e0071710 2024-05-08T19:22:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.491+0000 7f07df7fe700 1 -- 172.21.15.47:0/2405605962 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc011d20 con 0x7f07e0071710 2024-05-08T19:22:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.491+0000 7f07e70ab700 1 -- 172.21.15.47:0/2405605962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e0071710 msgr2=0x7f07e0154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.491+0000 7f07e70ab700 1 --2- 172.21.15.47:0/2405605962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e0071710 0x7f07e0154cb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f07e006cf90 tx=0x7f07cc009bd0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.491+0000 7f07e70ab700 1 -- 172.21.15.47:0/2405605962 shutdown_connections 2024-05-08T19:22:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.491+0000 7f07e70ab700 1 --2- 172.21.15.47:0/2405605962 >> v2:172.21.15.177:3300/0 conn(0x7f07e01521c0 0x7f07e00720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.491+0000 7f07e70ab700 1 --2- 172.21.15.47:0/2405605962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e0071710 0x7f07e0154cb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.492+0000 7f07e70ab700 1 -- 172.21.15.47:0/2405605962 >> 172.21.15.47:0/2405605962 conn(0x7f07e00c7120 msgr2=0x7f07e00c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.492+0000 7f07e70ab700 1 -- 172.21.15.47:0/2405605962 shutdown_connections 2024-05-08T19:22:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.492+0000 7f07e70ab700 1 -- 172.21.15.47:0/2405605962 wait complete. 2024-05-08T19:22:25.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.493+0000 7f07e70ab700 1 Processor -- start 2024-05-08T19:22:25.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.493+0000 7f07e70ab700 1 -- start start 2024-05-08T19:22:25.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e70ab700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07e0071710 0x7f07e01434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e70ab700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07e00725e0 0x7f07e014bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e70ab700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e01521c0 0x7f07e0156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e70ab700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01e7f30 con 0x7f07e01521c0 2024-05-08T19:22:25.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e70ab700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01583f0 con 0x7f07e0071710 2024-05-08T19:22:25.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e70ab700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01ee520 con 0x7f07e00725e0 2024-05-08T19:22:25.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e5648700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e01521c0 0x7f07e0156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e5648700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e01521c0 0x7f07e0156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42022/0 (socket says 172.21.15.47:42022) 2024-05-08T19:22:25.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e5648700 1 -- 172.21.15.47:0/1411375714 learned_addr learned my addr 172.21.15.47:0/1411375714 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:25.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e4e47700 1 --2- 172.21.15.47:0/1411375714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07e0071710 0x7f07e01434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07dffff700 1 --2- 172.21.15.47:0/1411375714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07e00725e0 0x7f07e014bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e5648700 1 -- 172.21.15.47:0/1411375714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07e00725e0 msgr2=0x7f07e014bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e5648700 1 --2- 172.21.15.47:0/1411375714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07e00725e0 0x7f07e014bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e5648700 1 -- 172.21.15.47:0/1411375714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07e0071710 msgr2=0x7f07e01434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e5648700 1 --2- 172.21.15.47:0/1411375714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07e0071710 0x7f07e01434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e5648700 1 -- 172.21.15.47:0/1411375714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc009550 con 0x7f07e01521c0 2024-05-08T19:22:25.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e5648700 1 --2- 172.21.15.47:0/1411375714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e01521c0 0x7f07e0156010 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f07d800cc70 tx=0x7f07d800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:25.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07dd7fa700 1 -- 172.21.15.47:0/1411375714 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d800aac0 con 0x7f07e01521c0 2024-05-08T19:22:25.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07dd7fa700 1 -- 172.21.15.47:0/1411375714 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d800ac40 con 0x7f07e01521c0 2024-05-08T19:22:25.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e70ab700 1 -- 172.21.15.47:0/1411375714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e01ed910 con 0x7f07e01521c0 2024-05-08T19:22:25.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07dd7fa700 1 -- 172.21.15.47:0/1411375714 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d80070d0 con 0x7f07e01521c0 2024-05-08T19:22:25.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.494+0000 7f07e70ab700 1 -- 172.21.15.47:0/1411375714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e01eded0 con 0x7f07e01521c0 2024-05-08T19:22:25.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.495+0000 7f07e70ab700 1 -- 172.21.15.47:0/1411375714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e01ee660 con 0x7f07e01521c0 2024-05-08T19:22:25.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.496+0000 7f07dd7fa700 1 -- 172.21.15.47:0/1411375714 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f07d8007250 con 0x7f07e01521c0 2024-05-08T19:22:25.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.496+0000 7f07dd7fa700 1 --2- 172.21.15.47:0/1411375714 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f07c406ac90 0x7f07c406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.496+0000 7f07dd7fa700 1 -- 172.21.15.47:0/1411375714 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f07d8089480 con 0x7f07e01521c0 2024-05-08T19:22:25.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.496+0000 7f07e4e47700 1 --2- 172.21.15.47:0/1411375714 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f07c406ac90 0x7f07c406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.497+0000 7f07e4e47700 1 --2- 172.21.15.47:0/1411375714 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f07c406ac90 0x7f07c406d150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009be0 tx=0x7f07d4009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:25.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.501+0000 7f07dd7fa700 1 -- 172.21.15.47:0/1411375714 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f07e01ee660 con 0x7f07e01521c0 2024-05-08T19:22:25.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.710+0000 7f07e70ab700 1 -- 172.21.15.47:0/1411375714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07e01ee660 con 0x7f07e01521c0 2024-05-08T19:22:25.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.712+0000 7f07dd7fa700 1 -- 172.21.15.47:0/1411375714 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f07e01ee660 con 0x7f07e01521c0 2024-05-08T19:22:25.704 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:25.704 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:24.891864+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:25.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.714+0000 7f07e70ab700 1 -- 172.21.15.47:0/1411375714 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f07c406ac90 msgr2=0x7f07c406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.714+0000 7f07e70ab700 1 --2- 172.21.15.47:0/1411375714 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f07c406ac90 0x7f07c406d150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009be0 tx=0x7f07d4009210 comp rx=0 tx=0).stop 2024-05-08T19:22:25.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.714+0000 7f07e70ab700 1 -- 172.21.15.47:0/1411375714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e01521c0 msgr2=0x7f07e0156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.714+0000 7f07e70ab700 1 --2- 172.21.15.47:0/1411375714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e01521c0 0x7f07e0156010 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f07d800cc70 tx=0x7f07d800cf80 comp rx=0 tx=0).stop 2024-05-08T19:22:25.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.714+0000 7f07e70ab700 1 -- 172.21.15.47:0/1411375714 shutdown_connections 2024-05-08T19:22:25.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.714+0000 7f07e70ab700 1 --2- 172.21.15.47:0/1411375714 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f07c406ac90 0x7f07c406d150 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.714+0000 7f07e70ab700 1 --2- 172.21.15.47:0/1411375714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e01521c0 0x7f07e0156010 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.714+0000 7f07e70ab700 1 --2- 172.21.15.47:0/1411375714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07e0071710 0x7f07e01434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.714+0000 7f07e70ab700 1 --2- 172.21.15.47:0/1411375714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07e00725e0 0x7f07e014bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.714+0000 7f07e70ab700 1 -- 172.21.15.47:0/1411375714 >> 172.21.15.47:0/1411375714 conn(0x7f07e00c7120 msgr2=0x7f07e00c3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:25.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.714+0000 7f07e70ab700 1 -- 172.21.15.47:0/1411375714 shutdown_connections 2024-05-08T19:22:25.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.714+0000 7f07e70ab700 1 -- 172.21.15.47:0/1411375714 wait complete. 2024-05-08T19:22:25.719 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:25.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.852+0000 7f90db6b4700 1 Processor -- start 2024-05-08T19:22:25.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.853+0000 7f90db6b4700 1 -- start start 2024-05-08T19:22:25.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.853+0000 7f90db6b4700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90d414fd80 0x7f90d40c4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.853+0000 7f90db6b4700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f90d4153430 0x7f90d4155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.853+0000 7f90db6b4700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d40adf10 con 0x7f90d406ff80 2024-05-08T19:22:25.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.853+0000 7f90db6b4700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d4153010 con 0x7f90d4153430 2024-05-08T19:22:25.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.853+0000 7f90db6b4700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d4152950 con 0x7f90d414fd80 2024-05-08T19:22:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.854+0000 7f90d8c4f700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f90d4153430 0x7f90d4155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.854+0000 7f90d9c51700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f90d406ff80 0x7f90d40c80a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60448/0 (socket says 172.21.15.47:60448) 2024-05-08T19:22:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.854+0000 7f90d8c4f700 1 --2- 172.21.15.47:0/3777050448 >> v2:172.21.15.47:3300/0 conn(0x7f90d4153430 0x7f90d4155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42036/0 (socket says 172.21.15.47:42036) 2024-05-08T19:22:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.854+0000 7f90d9c51700 1 -- 172.21.15.47:0/3777050448 learned_addr learned my addr 172.21.15.47:0/3777050448 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.854+0000 7f90d9450700 1 --2- 172.21.15.47:0/3777050448 >> v2:172.21.15.177:3300/0 conn(0x7f90d414fd80 0x7f90d40c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.854+0000 7f90d8c4f700 1 -- 172.21.15.47:0/3777050448 >> v2:172.21.15.177:3300/0 conn(0x7f90d414fd80 msgr2=0x7f90d40c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.854+0000 7f90d8c4f700 1 --2- 172.21.15.47:0/3777050448 >> v2:172.21.15.177:3300/0 conn(0x7f90d414fd80 0x7f90d40c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.854+0000 7f90d8c4f700 1 -- 172.21.15.47:0/3777050448 >> v1:172.21.15.47:6789/0 conn(0x7f90d406ff80 legacy=0x7f90d40c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.854+0000 7f90d8c4f700 1 -- 172.21.15.47:0/3777050448 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d4152c30 con 0x7f90d4153430 2024-05-08T19:22:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.854+0000 7f90c7fff700 1 -- 172.21.15.47:0/3777050448 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829458454 0 0) 0x7f90d40adf10 con 0x7f90d406ff80 2024-05-08T19:22:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.854+0000 7f90d9450700 1 --2- 172.21.15.47:0/3777050448 >> v2:172.21.15.177:3300/0 conn(0x7f90d414fd80 0x7f90d40c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.854+0000 7f90d8c4f700 1 --2- 172.21.15.47:0/3777050448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90d4153430 0x7f90d4155e30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90d40c8070 tx=0x7f90c8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc510f566a6e67b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.854+0000 7f90c7fff700 1 -- 172.21.15.47:0/3777050448 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8011830 con 0x7f90d4153430 2024-05-08T19:22:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.854+0000 7f90c7fff700 1 -- 172.21.15.47:0/3777050448 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c8011990 con 0x7f90d4153430 2024-05-08T19:22:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.854+0000 7f90c7fff700 1 -- 172.21.15.47:0/3777050448 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8011d20 con 0x7f90d4153430 2024-05-08T19:22:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.855+0000 7f90db6b4700 1 -- 172.21.15.47:0/3777050448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90d4153430 msgr2=0x7f90d4155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.855+0000 7f90db6b4700 1 --2- 172.21.15.47:0/3777050448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90d4153430 0x7f90d4155e30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90d40c8070 tx=0x7f90c8009b20 comp rx=0 tx=0).stop 2024-05-08T19:22:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.855+0000 7f90db6b4700 1 -- 172.21.15.47:0/3777050448 shutdown_connections 2024-05-08T19:22:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.855+0000 7f90db6b4700 1 --2- 172.21.15.47:0/3777050448 >> v2:172.21.15.177:3300/0 conn(0x7f90d414fd80 0x7f90d40c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.855+0000 7f90db6b4700 1 --2- 172.21.15.47:0/3777050448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90d4153430 0x7f90d4155e30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.855+0000 7f90db6b4700 1 -- 172.21.15.47:0/3777050448 >> 172.21.15.47:0/3777050448 conn(0x7f90d406e730 msgr2=0x7f90d406eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.855+0000 7f90db6b4700 1 -- 172.21.15.47:0/3777050448 shutdown_connections 2024-05-08T19:22:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.855+0000 7f90db6b4700 1 -- 172.21.15.47:0/3777050448 wait complete. 2024-05-08T19:22:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.856+0000 7f90db6b4700 1 Processor -- start 2024-05-08T19:22:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.856+0000 7f90db6b4700 1 -- start start 2024-05-08T19:22:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90db6b4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90d406ff80 0x7f90d40c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90db6b4700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d414fd80 0x7f90d4155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90db6b4700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d4153430 0x7f90d40a97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90db6b4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40bdb00 con 0x7f90d406ff80 2024-05-08T19:22:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90db6b4700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d414c0a0 con 0x7f90d414fd80 2024-05-08T19:22:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90db6b4700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40bd440 con 0x7f90d4153430 2024-05-08T19:22:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90d9450700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90d406ff80 0x7f90d40c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90d9450700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90d406ff80 0x7f90d40c13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42038/0 (socket says 172.21.15.47:42038) 2024-05-08T19:22:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90d9450700 1 -- 172.21.15.47:0/3619612267 learned_addr learned my addr 172.21.15.47:0/3619612267 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90d8c4f700 1 --2- 172.21.15.47:0/3619612267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d414fd80 0x7f90d4155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90d9c51700 1 --2- 172.21.15.47:0/3619612267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d4153430 0x7f90d40a97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90d9450700 1 -- 172.21.15.47:0/3619612267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d4153430 msgr2=0x7f90d40a97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90d9450700 1 --2- 172.21.15.47:0/3619612267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d4153430 0x7f90d40a97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90d9450700 1 -- 172.21.15.47:0/3619612267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d414fd80 msgr2=0x7f90d4155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90d9450700 1 --2- 172.21.15.47:0/3619612267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d414fd80 0x7f90d4155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90d9450700 1 -- 172.21.15.47:0/3619612267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c80094a0 con 0x7f90d406ff80 2024-05-08T19:22:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90d9450700 1 --2- 172.21.15.47:0/3619612267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90d406ff80 0x7f90d40c13f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90d000c780 tx=0x7f90d000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.857+0000 7f90c5ffb700 1 -- 172.21.15.47:0/3619612267 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d0011800 con 0x7f90d406ff80 2024-05-08T19:22:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.858+0000 7f90c5ffb700 1 -- 172.21.15.47:0/3619612267 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d0011960 con 0x7f90d406ff80 2024-05-08T19:22:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.858+0000 7f90db6b4700 1 -- 172.21.15.47:0/3619612267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d40a9130 con 0x7f90d406ff80 2024-05-08T19:22:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.858+0000 7f90c5ffb700 1 -- 172.21.15.47:0/3619612267 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d0011cd0 con 0x7f90d406ff80 2024-05-08T19:22:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.858+0000 7f90db6b4700 1 -- 172.21.15.47:0/3619612267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d40a8800 con 0x7f90d406ff80 2024-05-08T19:22:25.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.859+0000 7f90db6b4700 1 -- 172.21.15.47:0/3619612267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d404ec60 con 0x7f90d406ff80 2024-05-08T19:22:25.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.859+0000 7f90c5ffb700 1 -- 172.21.15.47:0/3619612267 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f90d0021350 con 0x7f90d406ff80 2024-05-08T19:22:25.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.860+0000 7f90c5ffb700 1 --2- 172.21.15.47:0/3619612267 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f90b806ac90 0x7f90b806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:25.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.860+0000 7f90c5ffb700 1 -- 172.21.15.47:0/3619612267 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f90d0089330 con 0x7f90d406ff80 2024-05-08T19:22:25.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.860+0000 7f90d8c4f700 1 --2- 172.21.15.47:0/3619612267 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f90b806ac90 0x7f90b806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:25.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.860+0000 7f90d8c4f700 1 --2- 172.21.15.47:0/3619612267 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f90b806ac90 0x7f90b806d150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f90c80090b0 tx=0x7f90c801c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:25.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:25.864+0000 7f90c5ffb700 1 -- 172.21.15.47:0/3619612267 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f90d00542b0 con 0x7f90d406ff80 2024-05-08T19:22:26.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.075+0000 7f90db6b4700 1 -- 172.21.15.47:0/3619612267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90d414ecb0 con 0x7f90d406ff80 2024-05-08T19:22:26.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.076+0000 7f90c5ffb700 1 -- 172.21.15.47:0/3619612267 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f90d00578d0 con 0x7f90d406ff80 2024-05-08T19:22:26.069 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:26.069 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:24.891864+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:26.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.078+0000 7f90db6b4700 1 -- 172.21.15.47:0/3619612267 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f90b806ac90 msgr2=0x7f90b806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:26.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.078+0000 7f90db6b4700 1 --2- 172.21.15.47:0/3619612267 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f90b806ac90 0x7f90b806d150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f90c80090b0 tx=0x7f90c801c040 comp rx=0 tx=0).stop 2024-05-08T19:22:26.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.079+0000 7f90db6b4700 1 -- 172.21.15.47:0/3619612267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90d406ff80 msgr2=0x7f90d40c13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:26.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.079+0000 7f90db6b4700 1 --2- 172.21.15.47:0/3619612267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90d406ff80 0x7f90d40c13f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90d000c780 tx=0x7f90d000ca90 comp rx=0 tx=0).stop 2024-05-08T19:22:26.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.079+0000 7f90db6b4700 1 -- 172.21.15.47:0/3619612267 shutdown_connections 2024-05-08T19:22:26.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.079+0000 7f90db6b4700 1 --2- 172.21.15.47:0/3619612267 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f90b806ac90 0x7f90b806d150 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.079+0000 7f90db6b4700 1 --2- 172.21.15.47:0/3619612267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90d406ff80 0x7f90d40c13f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.079+0000 7f90db6b4700 1 --2- 172.21.15.47:0/3619612267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d4153430 0x7f90d40a97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.079+0000 7f90db6b4700 1 --2- 172.21.15.47:0/3619612267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d414fd80 0x7f90d4155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.079+0000 7f90db6b4700 1 -- 172.21.15.47:0/3619612267 >> 172.21.15.47:0/3619612267 conn(0x7f90d406e730 msgr2=0x7f90d414d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:26.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.079+0000 7f90db6b4700 1 -- 172.21.15.47:0/3619612267 shutdown_connections 2024-05-08T19:22:26.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.079+0000 7f90db6b4700 1 -- 172.21.15.47:0/3619612267 wait complete. 2024-05-08T19:22:26.180 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T19:22:26.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.313+0000 7fc05a18d700 1 Processor -- start 2024-05-08T19:22:26.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.313+0000 7fc05a18d700 1 -- start start 2024-05-08T19:22:26.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.314+0000 7fc05a18d700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc05414fc60 0x7fc0540c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:26.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.314+0000 7fc05a18d700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc054150040 0x7fc0540c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:26.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.314+0000 7fc05a18d700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc054155e00 con 0x7fc0540c2a80 2024-05-08T19:22:26.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.314+0000 7fc05a18d700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0541560e0 con 0x7fc054150040 2024-05-08T19:22:26.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.314+0000 7fc05a18d700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0541563c0 con 0x7fc05414fc60 2024-05-08T19:22:26.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.314+0000 7fc052ffd700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc054150040 0x7fc0540c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:26.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.314+0000 7fc052ffd700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc054150040 0x7fc0540c4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42046/0 (socket says 172.21.15.47:42046) 2024-05-08T19:22:26.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.314+0000 7fc053fff700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc0540c2a80 0x7fc0541528f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60452/0 (socket says 172.21.15.47:60452) 2024-05-08T19:22:26.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.314+0000 7fc052ffd700 1 -- 172.21.15.47:0/2592750071 learned_addr learned my addr 172.21.15.47:0/2592750071 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:26.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.315+0000 7fc0537fe700 1 --2- 172.21.15.47:0/2592750071 >> v2:172.21.15.177:3300/0 conn(0x7fc05414fc60 0x7fc0540c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:26.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.315+0000 7fc052ffd700 1 -- 172.21.15.47:0/2592750071 >> v2:172.21.15.177:3300/0 conn(0x7fc05414fc60 msgr2=0x7fc0540c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:26.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.315+0000 7fc052ffd700 1 --2- 172.21.15.47:0/2592750071 >> v2:172.21.15.177:3300/0 conn(0x7fc05414fc60 0x7fc0540c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.315+0000 7fc052ffd700 1 -- 172.21.15.47:0/2592750071 >> v1:172.21.15.47:6789/0 conn(0x7fc0540c2a80 legacy=0x7fc0541528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:26.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.315+0000 7fc052ffd700 1 -- 172.21.15.47:0/2592750071 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0541566a0 con 0x7fc054150040 2024-05-08T19:22:26.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.315+0000 7fc0527fc700 1 -- 172.21.15.47:0/2592750071 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730598434 0 0) 0x7fc054155e00 con 0x7fc0540c2a80 2024-05-08T19:22:26.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.315+0000 7fc0537fe700 1 --2- 172.21.15.47:0/2592750071 >> v2:172.21.15.177:3300/0 conn(0x7fc05414fc60 0x7fc0540c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:26.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.315+0000 7fc052ffd700 1 --2- 172.21.15.47:0/2592750071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc054150040 0x7fc0540c4a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc05406b630 tx=0x7fc048009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c3b84c5fe5802f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:26.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.315+0000 7fc0527fc700 1 -- 172.21.15.47:0/2592750071 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04800b870 con 0x7fc054150040 2024-05-08T19:22:26.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.315+0000 7fc0527fc700 1 -- 172.21.15.47:0/2592750071 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04800b9d0 con 0x7fc054150040 2024-05-08T19:22:26.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.315+0000 7fc0527fc700 1 -- 172.21.15.47:0/2592750071 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04800bd60 con 0x7fc054150040 2024-05-08T19:22:26.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.316+0000 7fc05a18d700 1 -- 172.21.15.47:0/2592750071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc054150040 msgr2=0x7fc0540c4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:26.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.316+0000 7fc05a18d700 1 --2- 172.21.15.47:0/2592750071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc054150040 0x7fc0540c4a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc05406b630 tx=0x7fc048009bd0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.316+0000 7fc05a18d700 1 -- 172.21.15.47:0/2592750071 shutdown_connections 2024-05-08T19:22:26.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.316+0000 7fc05a18d700 1 --2- 172.21.15.47:0/2592750071 >> v2:172.21.15.177:3300/0 conn(0x7fc05414fc60 0x7fc0540c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.316+0000 7fc05a18d700 1 --2- 172.21.15.47:0/2592750071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc054150040 0x7fc0540c4a00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.316+0000 7fc05a18d700 1 -- 172.21.15.47:0/2592750071 >> 172.21.15.47:0/2592750071 conn(0x7fc054072dd0 msgr2=0x7fc05406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:26.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.316+0000 7fc05a18d700 1 -- 172.21.15.47:0/2592750071 shutdown_connections 2024-05-08T19:22:26.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.316+0000 7fc05a18d700 1 -- 172.21.15.47:0/2592750071 wait complete. 2024-05-08T19:22:26.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.317+0000 7fc05a18d700 1 Processor -- start 2024-05-08T19:22:26.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.317+0000 7fc05a18d700 1 -- start start 2024-05-08T19:22:26.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc05a18d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0540c2a80 0x7fc0541eb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:26.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc05a18d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc05414fc60 0x7fc0541444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:26.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc05a18d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc054150040 0x7fc054144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:26.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc05a18d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0541544f0 con 0x7fc054150040 2024-05-08T19:22:26.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc05a18d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc054155600 con 0x7fc0540c2a80 2024-05-08T19:22:26.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc05a18d700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0541558e0 con 0x7fc05414fc60 2024-05-08T19:22:26.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc053fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc054150040 0x7fc054144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:26.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc053fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc054150040 0x7fc054144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42060/0 (socket says 172.21.15.47:42060) 2024-05-08T19:22:26.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc053fff700 1 -- 172.21.15.47:0/457622452 learned_addr learned my addr 172.21.15.47:0/457622452 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:26.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc0537fe700 1 --2- 172.21.15.47:0/457622452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0540c2a80 0x7fc0541eb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:26.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc052ffd700 1 --2- 172.21.15.47:0/457622452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc05414fc60 0x7fc0541444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:26.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc053fff700 1 -- 172.21.15.47:0/457622452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc05414fc60 msgr2=0x7fc0541444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:26.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc053fff700 1 --2- 172.21.15.47:0/457622452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc05414fc60 0x7fc0541444d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc053fff700 1 -- 172.21.15.47:0/457622452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0540c2a80 msgr2=0x7fc0541eb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:26.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc053fff700 1 --2- 172.21.15.47:0/457622452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0540c2a80 0x7fc0541eb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc053fff700 1 -- 172.21.15.47:0/457622452 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc048009550 con 0x7fc054150040 2024-05-08T19:22:26.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc053fff700 1 --2- 172.21.15.47:0/457622452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc054150040 0x7fc054144a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00cca0 tx=0x7fc04c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:26.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc03bfff700 1 -- 172.21.15.47:0/457622452 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00ab70 con 0x7fc054150040 2024-05-08T19:22:26.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc03bfff700 1 -- 172.21.15.47:0/457622452 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c00acd0 con 0x7fc054150040 2024-05-08T19:22:26.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc05a18d700 1 -- 172.21.15.47:0/457622452 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0541ebeb0 con 0x7fc054150040 2024-05-08T19:22:26.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc03bfff700 1 -- 172.21.15.47:0/457622452 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c007310 con 0x7fc054150040 2024-05-08T19:22:26.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.318+0000 7fc05a18d700 1 -- 172.21.15.47:0/457622452 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0541522c0 con 0x7fc054150040 2024-05-08T19:22:26.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.319+0000 7fc05a18d700 1 -- 172.21.15.47:0/457622452 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0541542c0 con 0x7fc054150040 2024-05-08T19:22:26.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.320+0000 7fc03bfff700 1 -- 172.21.15.47:0/457622452 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc04c007470 con 0x7fc054150040 2024-05-08T19:22:26.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.320+0000 7fc03bfff700 1 --2- 172.21.15.47:0/457622452 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc04006ac90 0x7fc04006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:26.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.320+0000 7fc03bfff700 1 -- 172.21.15.47:0/457622452 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc04c0893e0 con 0x7fc054150040 2024-05-08T19:22:26.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.321+0000 7fc0537fe700 1 --2- 172.21.15.47:0/457622452 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc04006ac90 0x7fc04006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:26.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.321+0000 7fc0537fe700 1 --2- 172.21.15.47:0/457622452 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc04006ac90 0x7fc04006d150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc05414f870 tx=0x7fc044008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:26.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.325+0000 7fc03bfff700 1 -- 172.21.15.47:0/457622452 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc0541542c0 con 0x7fc054150040 2024-05-08T19:22:26.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.580+0000 7fc05a18d700 1 -- 172.21.15.47:0/457622452 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0541542c0 con 0x7fc054150040 2024-05-08T19:22:26.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.580+0000 7fc03bfff700 1 -- 172.21.15.47:0/457622452 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4733 (secure 0 0 0) 0x7fc0541542c0 con 0x7fc054150040 2024-05-08T19:22:26.572 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:26.572 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3927983771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3927983771},{"type":"v1","addr":"172.21.15.47:6833","nonce":3927983771}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/201830514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":201830514},{"type":"v1","addr":"172.21.15.47:6835","nonce":201830514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1266001461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1266001461},{"type":"v1","addr":"172.21.15.177:6836","nonce":1266001461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T19:22:20.424727+0000","modified":"2024-05-08T19:22:24.892072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/2990594738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2990594738},{"type":"v1","addr":"172.21.15.177:6837","nonce":2990594738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-08T19:22:26.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.582+0000 7fc05a18d700 1 -- 172.21.15.47:0/457622452 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc04006ac90 msgr2=0x7fc04006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:26.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.582+0000 7fc05a18d700 1 --2- 172.21.15.47:0/457622452 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc04006ac90 0x7fc04006d150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc05414f870 tx=0x7fc044008040 comp rx=0 tx=0).stop 2024-05-08T19:22:26.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.582+0000 7fc05a18d700 1 -- 172.21.15.47:0/457622452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc054150040 msgr2=0x7fc054144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:26.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.582+0000 7fc05a18d700 1 --2- 172.21.15.47:0/457622452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc054150040 0x7fc054144a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00cca0 tx=0x7fc04c00a060 comp rx=0 tx=0).stop 2024-05-08T19:22:26.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.582+0000 7fc05a18d700 1 -- 172.21.15.47:0/457622452 shutdown_connections 2024-05-08T19:22:26.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.582+0000 7fc05a18d700 1 --2- 172.21.15.47:0/457622452 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc04006ac90 0x7fc04006d150 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.582+0000 7fc05a18d700 1 --2- 172.21.15.47:0/457622452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc054150040 0x7fc054144a10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.582+0000 7fc05a18d700 1 --2- 172.21.15.47:0/457622452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0540c2a80 0x7fc0541eb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.582+0000 7fc05a18d700 1 --2- 172.21.15.47:0/457622452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc05414fc60 0x7fc0541444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.582+0000 7fc05a18d700 1 -- 172.21.15.47:0/457622452 >> 172.21.15.47:0/457622452 conn(0x7fc054072dd0 msgr2=0x7fc05406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:26.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.582+0000 7fc05a18d700 1 -- 172.21.15.47:0/457622452 shutdown_connections 2024-05-08T19:22:26.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.582+0000 7fc05a18d700 1 -- 172.21.15.47:0/457622452 wait complete. 2024-05-08T19:22:26.576 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 7 2024-05-08T19:22:26.587 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:26.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.721+0000 7fb67cbd8700 1 Processor -- start 2024-05-08T19:22:26.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.721+0000 7fb67cbd8700 1 -- start start 2024-05-08T19:22:26.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.722+0000 7fb67cbd8700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb6780bfbb0 0x7fb6780c05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:26.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.722+0000 7fb67cbd8700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6780c1950 con 0x7fb67806bc40 2024-05-08T19:22:26.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.722+0000 7fb67cbd8700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb678154970 con 0x7fb67806f490 2024-05-08T19:22:26.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.722+0000 7fb67cbd8700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6780c1180 con 0x7fb6780bfbb0 2024-05-08T19:22:26.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.722+0000 7fb676d9d700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb6780bfbb0 0x7fb6780c05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:26.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.722+0000 7fb676d9d700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb6780bfbb0 0x7fb6780c05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42074/0 (socket says 172.21.15.47:42074) 2024-05-08T19:22:26.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.722+0000 7fb67659c700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb67806bc40 0x7fb678066780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60460/0 (socket says 172.21.15.47:60460) 2024-05-08T19:22:26.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.722+0000 7fb676d9d700 1 -- 172.21.15.47:0/4293979148 learned_addr learned my addr 172.21.15.47:0/4293979148 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:26.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.722+0000 7fb676d9d700 1 -- 172.21.15.47:0/4293979148 >> v1:172.21.15.177:6789/0 conn(0x7fb67806f490 legacy=0x7fb678155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:26.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.722+0000 7fb676d9d700 1 -- 172.21.15.47:0/4293979148 >> v1:172.21.15.47:6789/0 conn(0x7fb67806bc40 legacy=0x7fb678066780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:26.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.722+0000 7fb676d9d700 1 -- 172.21.15.47:0/4293979148 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb678155860 con 0x7fb6780bfbb0 2024-05-08T19:22:26.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.722+0000 7fb67559a700 1 -- 172.21.15.47:0/4293979148 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217716173 0 0) 0x7fb6780c1950 con 0x7fb67806bc40 2024-05-08T19:22:26.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.723+0000 7fb676d9d700 1 --2- 172.21.15.47:0/4293979148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6780bfbb0 0x7fb6780c05f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb670009e50 tx=0x7fb67000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc8a89caa4b2fb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:26.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.723+0000 7fb67559a700 1 -- 172.21.15.47:0/4293979148 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67000e070 con 0x7fb6780bfbb0 2024-05-08T19:22:26.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.723+0000 7fb67559a700 1 -- 172.21.15.47:0/4293979148 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67000b9c0 con 0x7fb6780bfbb0 2024-05-08T19:22:26.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.723+0000 7fb67559a700 1 -- 172.21.15.47:0/4293979148 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67000bd70 con 0x7fb6780bfbb0 2024-05-08T19:22:26.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.723+0000 7fb67cbd8700 1 -- 172.21.15.47:0/4293979148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6780bfbb0 msgr2=0x7fb6780c05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:26.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.723+0000 7fb67cbd8700 1 --2- 172.21.15.47:0/4293979148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6780bfbb0 0x7fb6780c05f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb670009e50 tx=0x7fb67000b330 comp rx=0 tx=0).stop 2024-05-08T19:22:26.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.723+0000 7fb67cbd8700 1 -- 172.21.15.47:0/4293979148 shutdown_connections 2024-05-08T19:22:26.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.723+0000 7fb67cbd8700 1 --2- 172.21.15.47:0/4293979148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6780bfbb0 0x7fb6780c05f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.723+0000 7fb67cbd8700 1 -- 172.21.15.47:0/4293979148 >> 172.21.15.47:0/4293979148 conn(0x7fb6780c3280 msgr2=0x7fb6780c3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:26.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.723+0000 7fb67cbd8700 1 -- 172.21.15.47:0/4293979148 shutdown_connections 2024-05-08T19:22:26.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.724+0000 7fb67cbd8700 1 -- 172.21.15.47:0/4293979148 wait complete. 2024-05-08T19:22:26.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.725+0000 7fb67cbd8700 1 Processor -- start 2024-05-08T19:22:26.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.725+0000 7fb67cbd8700 1 -- start start 2024-05-08T19:22:26.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.725+0000 7fb67cbd8700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67806bc40 0x7fb67814cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:26.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.725+0000 7fb67cbd8700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67806f490 0x7fb6781409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:26.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.725+0000 7fb67cbd8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6780bfbb0 0x7fb678140f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:26.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.725+0000 7fb67cbd8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780a6b70 con 0x7fb6780bfbb0 2024-05-08T19:22:26.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.725+0000 7fb67cbd8700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780720b0 con 0x7fb67806bc40 2024-05-08T19:22:26.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.725+0000 7fb67cbd8700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780a61c0 con 0x7fb67806f490 2024-05-08T19:22:26.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb676d9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6780bfbb0 0x7fb678140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:26.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb676d9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6780bfbb0 0x7fb678140f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42080/0 (socket says 172.21.15.47:42080) 2024-05-08T19:22:26.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb676d9d700 1 -- 172.21.15.47:0/2816716272 learned_addr learned my addr 172.21.15.47:0/2816716272 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:26.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb67659c700 1 --2- 172.21.15.47:0/2816716272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67806bc40 0x7fb67814cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:26.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb675d9b700 1 --2- 172.21.15.47:0/2816716272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67806f490 0x7fb6781409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:26.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb676d9d700 1 -- 172.21.15.47:0/2816716272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67806f490 msgr2=0x7fb6781409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:26.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb676d9d700 1 --2- 172.21.15.47:0/2816716272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67806f490 0x7fb6781409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb676d9d700 1 -- 172.21.15.47:0/2816716272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67806bc40 msgr2=0x7fb67814cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:26.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb676d9d700 1 --2- 172.21.15.47:0/2816716272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67806bc40 0x7fb67814cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb676d9d700 1 -- 172.21.15.47:0/2816716272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb670009b30 con 0x7fb6780bfbb0 2024-05-08T19:22:26.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb676d9d700 1 --2- 172.21.15.47:0/2816716272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6780bfbb0 0x7fb678140f10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb678074750 tx=0x7fb670004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:26.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb666ffd700 1 -- 172.21.15.47:0/2816716272 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6700092e0 con 0x7fb6780bfbb0 2024-05-08T19:22:26.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb666ffd700 1 -- 172.21.15.47:0/2816716272 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6700099b0 con 0x7fb6780bfbb0 2024-05-08T19:22:26.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb67cbd8700 1 -- 172.21.15.47:0/2816716272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6780a9d40 con 0x7fb6780bfbb0 2024-05-08T19:22:26.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb666ffd700 1 -- 172.21.15.47:0/2816716272 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67001b670 con 0x7fb6780bfbb0 2024-05-08T19:22:26.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.726+0000 7fb67cbd8700 1 -- 172.21.15.47:0/2816716272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6780a99d0 con 0x7fb6780bfbb0 2024-05-08T19:22:26.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.727+0000 7fb67cbd8700 1 -- 172.21.15.47:0/2816716272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6780a9830 con 0x7fb6780bfbb0 2024-05-08T19:22:26.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.728+0000 7fb666ffd700 1 -- 172.21.15.47:0/2816716272 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb67001b7d0 con 0x7fb6780bfbb0 2024-05-08T19:22:26.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.728+0000 7fb666ffd700 1 --2- 172.21.15.47:0/2816716272 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb65806ac90 0x7fb65806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:26.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.728+0000 7fb666ffd700 1 -- 172.21.15.47:0/2816716272 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb67008afb0 con 0x7fb6780bfbb0 2024-05-08T19:22:26.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.728+0000 7fb67659c700 1 --2- 172.21.15.47:0/2816716272 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb65806ac90 0x7fb65806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:26.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.729+0000 7fb67659c700 1 --2- 172.21.15.47:0/2816716272 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb65806ac90 0x7fb65806d150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000f60 tx=0x7fb66c007c40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:26.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.733+0000 7fb666ffd700 1 -- 172.21.15.47:0/2816716272 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb6700be900 con 0x7fb6780bfbb0 2024-05-08T19:22:26.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.941+0000 7fb67cbd8700 1 -- 172.21.15.47:0/2816716272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb67804ec60 con 0x7fb6780bfbb0 2024-05-08T19:22:26.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.942+0000 7fb666ffd700 1 -- 172.21.15.47:0/2816716272 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17878 (secure 0 0 0) 0x7fb6780a9830 con 0x7fb6780bfbb0 2024-05-08T19:22:26.935 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:26.935 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:24.891864+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:26.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.945+0000 7fb67cbd8700 1 -- 172.21.15.47:0/2816716272 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb65806ac90 msgr2=0x7fb65806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:26.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.945+0000 7fb67cbd8700 1 --2- 172.21.15.47:0/2816716272 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb65806ac90 0x7fb65806d150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000f60 tx=0x7fb66c007c40 comp rx=0 tx=0).stop 2024-05-08T19:22:26.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.945+0000 7fb67cbd8700 1 -- 172.21.15.47:0/2816716272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6780bfbb0 msgr2=0x7fb678140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:26.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.945+0000 7fb67cbd8700 1 --2- 172.21.15.47:0/2816716272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6780bfbb0 0x7fb678140f10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb678074750 tx=0x7fb670004ad0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.945+0000 7fb67cbd8700 1 -- 172.21.15.47:0/2816716272 shutdown_connections 2024-05-08T19:22:26.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.945+0000 7fb67cbd8700 1 --2- 172.21.15.47:0/2816716272 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb65806ac90 0x7fb65806d150 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.945+0000 7fb67cbd8700 1 --2- 172.21.15.47:0/2816716272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6780bfbb0 0x7fb678140f10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.945+0000 7fb67cbd8700 1 --2- 172.21.15.47:0/2816716272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67806bc40 0x7fb67814cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.945+0000 7fb67cbd8700 1 --2- 172.21.15.47:0/2816716272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67806f490 0x7fb6781409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:26.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.945+0000 7fb67cbd8700 1 -- 172.21.15.47:0/2816716272 >> 172.21.15.47:0/2816716272 conn(0x7fb6780c3280 msgr2=0x7fb678066780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:26.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.945+0000 7fb67cbd8700 1 -- 172.21.15.47:0/2816716272 shutdown_connections 2024-05-08T19:22:26.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:26.945+0000 7fb67cbd8700 1 -- 172.21.15.47:0/2816716272 wait complete. 2024-05-08T19:22:27.353 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T19:22:20.424727+0000', 'modified': '2024-05-08T19:22:24.892072+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.177:6837/2990594738', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6835', 'nonce': 2990594738}, {'type': 'v1', 'addr': '172.21.15.177:6837', 'nonce': 2990594738}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-05-08T19:22:27.353 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T19:22:27.353 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-08T19:22:27.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.495+0000 7f3e2a56a700 1 Processor -- start 2024-05-08T19:22:27.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.495+0000 7f3e2a56a700 1 -- start start 2024-05-08T19:22:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.496+0000 7f3e2a56a700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e240ada50 0x7f3e2406e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.496+0000 7f3e2a56a700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3e240c8050 0x7f3e240c8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.496+0000 7f3e2a56a700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e241536f0 con 0x7f3e240c6d70 2024-05-08T19:22:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.496+0000 7f3e2a56a700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e24153190 con 0x7f3e240c8050 2024-05-08T19:22:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.496+0000 7f3e2a56a700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240c7da0 con 0x7f3e240ada50 2024-05-08T19:22:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.496+0000 7f3e23fff700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f3e240c6d70 0x7f3e240c7690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34068/0 (socket says 172.21.15.47:34068) 2024-05-08T19:22:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.496+0000 7f3e23fff700 1 -- 172.21.15.47:0/1812954464 learned_addr learned my addr 172.21.15.47:0/1812954464 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.496+0000 7f3e237fe700 1 --2- 172.21.15.47:0/1812954464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e240ada50 0x7f3e2406e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.496+0000 7f3e28b07700 1 --2- 172.21.15.47:0/1812954464 >> v2:172.21.15.177:3300/0 conn(0x7f3e240c8050 0x7f3e240c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.496+0000 7f3e22ffd700 1 -- 172.21.15.47:0/1812954464 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814534386 0 0) 0x7f3e241536f0 con 0x7f3e240c6d70 2024-05-08T19:22:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.496+0000 7f3e22ffd700 1 -- 172.21.15.47:0/1812954464 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e0c0035b0 con 0x7f3e240c6d70 2024-05-08T19:22:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.496+0000 7f3e237fe700 1 -- 172.21.15.47:0/1812954464 >> v2:172.21.15.177:3300/0 conn(0x7f3e240c8050 msgr2=0x7f3e240c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.496+0000 7f3e237fe700 1 --2- 172.21.15.47:0/1812954464 >> v2:172.21.15.177:3300/0 conn(0x7f3e240c8050 0x7f3e240c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.496+0000 7f3e237fe700 1 -- 172.21.15.47:0/1812954464 >> v1:172.21.15.47:6789/0 conn(0x7f3e240c6d70 legacy=0x7f3e240c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.496+0000 7f3e237fe700 1 -- 172.21.15.47:0/1812954464 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e24070860 con 0x7f3e240ada50 2024-05-08T19:22:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.497+0000 7f3e237fe700 1 --2- 172.21.15.47:0/1812954464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e240ada50 0x7f3e2406e850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009840 tx=0x7f3e18009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b6f2a6fd0dbff5b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.497+0000 7f3e22ffd700 1 -- 172.21.15.47:0/1812954464 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18011830 con 0x7f3e240ada50 2024-05-08T19:22:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.497+0000 7f3e22ffd700 1 -- 172.21.15.47:0/1812954464 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e18011990 con 0x7f3e240ada50 2024-05-08T19:22:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.497+0000 7f3e22ffd700 1 -- 172.21.15.47:0/1812954464 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18011d00 con 0x7f3e240ada50 2024-05-08T19:22:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.497+0000 7f3e2a56a700 1 -- 172.21.15.47:0/1812954464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e240ada50 msgr2=0x7f3e2406e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.497+0000 7f3e2a56a700 1 --2- 172.21.15.47:0/1812954464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e240ada50 0x7f3e2406e850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009840 tx=0x7f3e18009b50 comp rx=0 tx=0).stop 2024-05-08T19:22:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.497+0000 7f3e2a56a700 1 -- 172.21.15.47:0/1812954464 shutdown_connections 2024-05-08T19:22:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.497+0000 7f3e2a56a700 1 --2- 172.21.15.47:0/1812954464 >> v2:172.21.15.177:3300/0 conn(0x7f3e240c8050 0x7f3e240c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.497+0000 7f3e2a56a700 1 --2- 172.21.15.47:0/1812954464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e240ada50 0x7f3e2406e850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.497+0000 7f3e2a56a700 1 -- 172.21.15.47:0/1812954464 >> 172.21.15.47:0/1812954464 conn(0x7f3e2406b1b0 msgr2=0x7f3e240a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.497+0000 7f3e2a56a700 1 -- 172.21.15.47:0/1812954464 shutdown_connections 2024-05-08T19:22:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.497+0000 7f3e2a56a700 1 -- 172.21.15.47:0/1812954464 wait complete. 2024-05-08T19:22:27.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.499+0000 7f3e2a56a700 1 Processor -- start 2024-05-08T19:22:27.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.499+0000 7f3e2a56a700 1 -- start start 2024-05-08T19:22:27.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.499+0000 7f3e2a56a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e240ada50 0x7f3e240c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.499+0000 7f3e2a56a700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e240c6d70 0x7f3e2414b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e2a56a700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e240c8050 0x7f3e2414b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e2a56a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24155c30 con 0x7f3e240ada50 2024-05-08T19:22:27.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e2a56a700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e241ea660 con 0x7f3e240c6d70 2024-05-08T19:22:27.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e2a56a700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24153c10 con 0x7f3e240c8050 2024-05-08T19:22:27.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e23fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e240ada50 0x7f3e240c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e23fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e240ada50 0x7f3e240c1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56976/0 (socket says 172.21.15.47:56976) 2024-05-08T19:22:27.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e23fff700 1 -- 172.21.15.47:0/1028430746 learned_addr learned my addr 172.21.15.47:0/1028430746 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:27.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e237fe700 1 --2- 172.21.15.47:0/1028430746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e240c6d70 0x7f3e2414b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e28b07700 1 --2- 172.21.15.47:0/1028430746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e240c8050 0x7f3e2414b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e23fff700 1 -- 172.21.15.47:0/1028430746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e240c8050 msgr2=0x7f3e2414b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e23fff700 1 --2- 172.21.15.47:0/1028430746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e240c8050 0x7f3e2414b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e23fff700 1 -- 172.21.15.47:0/1028430746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e240c6d70 msgr2=0x7f3e2414b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e23fff700 1 --2- 172.21.15.47:0/1028430746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e240c6d70 0x7f3e2414b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e23fff700 1 -- 172.21.15.47:0/1028430746 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e180094a0 con 0x7f3e240ada50 2024-05-08T19:22:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e23fff700 1 --2- 172.21.15.47:0/1028430746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e240ada50 0x7f3e240c1720 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400c420 tx=0x7f3e1400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e20ff9700 1 -- 172.21.15.47:0/1028430746 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14005d70 con 0x7f3e240ada50 2024-05-08T19:22:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e20ff9700 1 -- 172.21.15.47:0/1028430746 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1400ce30 con 0x7f3e240ada50 2024-05-08T19:22:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e20ff9700 1 -- 172.21.15.47:0/1028430746 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e140072d0 con 0x7f3e240ada50 2024-05-08T19:22:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e2a56a700 1 -- 172.21.15.47:0/1028430746 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2406da20 con 0x7f3e240ada50 2024-05-08T19:22:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.500+0000 7f3e2a56a700 1 -- 172.21.15.47:0/1028430746 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e24154780 con 0x7f3e240ada50 2024-05-08T19:22:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.502+0000 7f3e20ff9700 1 -- 172.21.15.47:0/1028430746 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3e14007430 con 0x7f3e240ada50 2024-05-08T19:22:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.502+0000 7f3e20ff9700 1 --2- 172.21.15.47:0/1028430746 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3e1006ac90 0x7f3e1006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.502+0000 7f3e20ff9700 1 -- 172.21.15.47:0/1028430746 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e14088790 con 0x7f3e240ada50 2024-05-08T19:22:27.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.502+0000 7f3e237fe700 1 --2- 172.21.15.47:0/1028430746 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3e1006ac90 0x7f3e1006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.503+0000 7f3e237fe700 1 --2- 172.21.15.47:0/1028430746 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3e1006ac90 0x7f3e1006d150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009840 tx=0x7f3e1801c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:27.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.504+0000 7f3e36724b80 1 Processor -- start 2024-05-08T19:22:27.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.504+0000 7f3e36724b80 1 -- start start 2024-05-08T19:22:27.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e36724b80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad34980 0x55bb5ad72930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e36724b80 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad36010 0x55bb5ad2fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e36724b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34d60 0x55bb5ad52c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e36724b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb5ac8b100 con 0x55bb5ad34d60 2024-05-08T19:22:27.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e36724b80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb5ac88ac0 con 0x55bb5ad34980 2024-05-08T19:22:27.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e36724b80 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb5ac843b0 con 0x55bb5ad36010 2024-05-08T19:22:27.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e28b07700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34d60 0x55bb5ad52c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e28b07700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34d60 0x55bb5ad52c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56978/0 (socket says 172.21.15.47:56978) 2024-05-08T19:22:27.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e28b07700 1 -- 172.21.15.47:0/2633562270 learned_addr learned my addr 172.21.15.47:0/2633562270 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:27.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e23fff700 1 --2- 172.21.15.47:0/2633562270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad34980 0x55bb5ad72930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e237fe700 1 --2- 172.21.15.47:0/2633562270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad36010 0x55bb5ad2fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e28b07700 1 -- 172.21.15.47:0/2633562270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad36010 msgr2=0x55bb5ad2fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:27.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e28b07700 1 --2- 172.21.15.47:0/2633562270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad36010 0x55bb5ad2fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e28b07700 1 -- 172.21.15.47:0/2633562270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad34980 msgr2=0x55bb5ad72930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:27.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e28b07700 1 --2- 172.21.15.47:0/2633562270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad34980 0x55bb5ad72930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e28b07700 1 -- 172.21.15.47:0/2633562270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb5ab05360 con 0x55bb5ad34d60 2024-05-08T19:22:27.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e28b07700 1 --2- 172.21.15.47:0/2633562270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34d60 0x55bb5ad52c20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c011580 tx=0x7f3e1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ffd19f623a018f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:27.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e09ffb700 1 -- 172.21.15.47:0/2633562270 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00e040 con 0x55bb5ad34d60 2024-05-08T19:22:27.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.505+0000 7f3e09ffb700 1 -- 172.21.15.47:0/2633562270 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c00f040 con 0x55bb5ad34d60 2024-05-08T19:22:27.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.506+0000 7f3e09ffb700 1 -- 172.21.15.47:0/2633562270 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c015830 con 0x55bb5ad34d60 2024-05-08T19:22:27.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.506+0000 7f3e36724b80 1 -- 172.21.15.47:0/2633562270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34d60 msgr2=0x55bb5ad52c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.506+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2633562270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34d60 0x55bb5ad52c20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c011580 tx=0x7f3e1c009750 comp rx=0 tx=0).stop 2024-05-08T19:22:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.506+0000 7f3e36724b80 1 -- 172.21.15.47:0/2633562270 shutdown_connections 2024-05-08T19:22:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.506+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2633562270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34d60 0x55bb5ad52c20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.506+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2633562270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad34980 0x55bb5ad72930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.506+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2633562270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad36010 0x55bb5ad2fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.506+0000 7f3e36724b80 1 -- 172.21.15.47:0/2633562270 >> 172.21.15.47:0/2633562270 conn(0x55bb5ac921c0 msgr2=0x55bb5ad326b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.506+0000 7f3e36724b80 1 -- 172.21.15.47:0/2633562270 shutdown_connections 2024-05-08T19:22:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.506+0000 7f3e36724b80 1 -- 172.21.15.47:0/2633562270 wait complete. 2024-05-08T19:22:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.507+0000 7f3e36724b80 1 -- start start 2024-05-08T19:22:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.507+0000 7f3e36724b80 1 Processor -- start 2024-05-08T19:22:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e36724b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad84020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e36724b80 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad34d60 0x55bb5ad704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e36724b80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 0x55bb5ad50d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e36724b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb5ac20510 con 0x55bb5ad34980 2024-05-08T19:22:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e36724b80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb5ac201b0 con 0x55bb5ad36010 2024-05-08T19:22:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e36724b80 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb5ab07650 con 0x55bb5ad34d60 2024-05-08T19:22:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e36724b80 10 client.0 _ll_register_callbacks cb 0x55bb5ac29ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T19:22:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e23fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad84020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e23fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad84020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56980/0 (socket says 172.21.15.47:56980) 2024-05-08T19:22:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e23fff700 1 -- 172.21.15.47:0/2598354841 learned_addr learned my addr 172.21.15.47:0/2598354841 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e237fe700 1 --2- 172.21.15.47:0/2598354841 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad34d60 0x55bb5ad704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e28b07700 1 --2- 172.21.15.47:0/2598354841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 0x55bb5ad50d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e23fff700 1 -- 172.21.15.47:0/2598354841 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad34d60 msgr2=0x55bb5ad704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e23fff700 1 --2- 172.21.15.47:0/2598354841 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad34d60 0x55bb5ad704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e23fff700 1 -- 172.21.15.47:0/2598354841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 msgr2=0x55bb5ad50d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e23fff700 1 --2- 172.21.15.47:0/2598354841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 0x55bb5ad50d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e23fff700 1 -- 172.21.15.47:0/2598354841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1c011230 con 0x55bb5ad34980 2024-05-08T19:22:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e23fff700 1 --2- 172.21.15.47:0/2598354841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad84020 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e14053980 tx=0x7f3e140579c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ccadb98213dddf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e02ffd700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-08T19:22:27.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e02ffd700 1 -- 172.21.15.47:0/2598354841 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1405b260 con 0x55bb5ad34980 2024-05-08T19:22:27.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e02ffd700 1 -- 172.21.15.47:0/2598354841 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e1405f7c0 con 0x55bb5ad34980 2024-05-08T19:22:27.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e36724b80 1 -- 172.21.15.47:0/2598354841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb5abdd220 con 0x55bb5ad34980 2024-05-08T19:22:27.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e02ffd700 1 -- 172.21.15.47:0/2598354841 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e14057250 con 0x55bb5ad34980 2024-05-08T19:22:27.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.508+0000 7f3e36724b80 10 client.4410 fetch_fsmap learned FSMap version 7 2024-05-08T19:22:27.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.509+0000 7f3e36724b80 1 -- 172.21.15.47:0/2598354841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55bb5aab1b10 con 0x55bb5ad34980 2024-05-08T19:22:27.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.509+0000 7f3e02ffd700 1 -- 172.21.15.47:0/2598354841 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb5abdd220 con 0x55bb5ad34980 2024-05-08T19:22:27.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.509+0000 7f3e02ffd700 1 -- 172.21.15.47:0/2598354841 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f3e1406d030 con 0x55bb5ad34980 2024-05-08T19:22:27.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.509+0000 7f3e36724b80 10 client.4410 fetch_fsmap finished waiting for FSMap version 7 2024-05-08T19:22:27.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.509+0000 7f3e36724b80 10 client.4410 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-08T19:22:27.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.509+0000 7f3e36724b80 20 client.4410 populate_metadata read hostname 'smithi047' 2024-05-08T19:22:27.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.509+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2598354841 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x55bb5ad51500 0x55bb5ad806b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.509+0000 7f3e36724b80 4 client.4410 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T19:22:27.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.509+0000 7f3e36724b80 1 -- 172.21.15.47:0/2598354841 --> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb5ad03790 con 0x55bb5ad51500 2024-05-08T19:22:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.509+0000 7f3e237fe700 1 --2- 172.21.15.47:0/2598354841 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x55bb5ad51500 0x55bb5ad806b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.509+0000 7f3e02ffd700 10 client.4410 ms_handle_connect on v2:172.21.15.177:6835/2990594738 2024-05-08T19:22:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.509+0000 7f3e237fe700 1 --2- 172.21.15.47:0/2598354841 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x55bb5ad51500 0x55bb5ad806b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=118a59315da27074 server_cookie=edbca18f3f36a654 in_seq=0 out_seq=0 2024-05-08T19:22:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.510+0000 7f3e02ffd700 1 -- 172.21.15.47:0/2598354841 <== mds.0 v2:172.21.15.177:6835/2990594738 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bb5ad03790 con 0x55bb5ad51500 2024-05-08T19:22:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.510+0000 7f3e02ffd700 10 client.4410 handle_command_reply: tid=0 2024-05-08T19:22:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.510+0000 7f3e36724b80 1 client.4410 shutdown 2024-05-08T19:22:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.510+0000 7f3e36724b80 1 -- 172.21.15.47:0/2598354841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 msgr2=0x55bb5ad84020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.510+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2598354841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad84020 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e14053980 tx=0x7f3e140579c0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.510+0000 7f3e36724b80 1 -- 172.21.15.47:0/2598354841 shutdown_connections 2024-05-08T19:22:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.510+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2598354841 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x55bb5ad51500 0x55bb5ad806b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.510+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2598354841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad84020 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.510+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2598354841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 0x55bb5ad50d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.510+0000 7f3e02ffd700 0 client.4410 ms_handle_reset on v2:172.21.15.177:6835/2990594738 2024-05-08T19:22:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.510+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2598354841 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad34d60 0x55bb5ad704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.510+0000 7f3e36724b80 1 -- 172.21.15.47:0/2598354841 >> 172.21.15.47:0/2598354841 conn(0x55bb5ac921c0 msgr2=0x55bb5ad529f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:27.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.510+0000 7f3e36724b80 1 -- 172.21.15.47:0/2598354841 shutdown_connections 2024-05-08T19:22:27.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.510+0000 7f3e36724b80 1 -- 172.21.15.47:0/2598354841 wait complete. 2024-05-08T19:22:27.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.511+0000 7f3e36724b80 20 client.4410 trim_cache size 0 max 16384 2024-05-08T19:22:27.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.529+0000 7f3e36724b80 1 Processor -- start 2024-05-08T19:22:27.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.529+0000 7f3e36724b80 1 -- start start 2024-05-08T19:22:27.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.529+0000 7f3e36724b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad93470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.529+0000 7f3e36724b80 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad34d60 0x55bb5ad806b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.529+0000 7f3e36724b80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 0x55bb5ad80bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.529+0000 7f3e36724b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb5ad844b0 con 0x55bb5ad34980 2024-05-08T19:22:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.529+0000 7f3e36724b80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb5ad35e30 con 0x55bb5ad36010 2024-05-08T19:22:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.529+0000 7f3e36724b80 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb5ad2e4a0 con 0x55bb5ad34d60 2024-05-08T19:22:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.529+0000 7f3e23fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad93470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.529+0000 7f3e23fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad93470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56996/0 (socket says 172.21.15.47:56996) 2024-05-08T19:22:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.529+0000 7f3e23fff700 1 -- 172.21.15.47:0/3219444754 learned_addr learned my addr 172.21.15.47:0/3219444754 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.530+0000 7f3e28b07700 1 --2- 172.21.15.47:0/3219444754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 0x55bb5ad80bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.530+0000 7f3e237fe700 1 --2- 172.21.15.47:0/3219444754 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad34d60 0x55bb5ad806b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.530+0000 7f3e23fff700 1 -- 172.21.15.47:0/3219444754 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad34d60 msgr2=0x55bb5ad806b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.530+0000 7f3e23fff700 1 --2- 172.21.15.47:0/3219444754 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad34d60 0x55bb5ad806b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.530+0000 7f3e23fff700 1 -- 172.21.15.47:0/3219444754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 msgr2=0x55bb5ad80bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.530+0000 7f3e23fff700 1 --2- 172.21.15.47:0/3219444754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 0x55bb5ad80bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.530+0000 7f3e23fff700 1 -- 172.21.15.47:0/3219444754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb5ac4a510 con 0x55bb5ad34980 2024-05-08T19:22:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.530+0000 7f3e28b07700 1 --2- 172.21.15.47:0/3219444754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 0x55bb5ad80bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.530+0000 7f3e23fff700 1 --2- 172.21.15.47:0/3219444754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad93470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3e140070a0 tx=0x7f3e14088050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b0ddccbaa21957 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.530+0000 7f3e0a7fc700 1 -- 172.21.15.47:0/3219444754 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1405b260 con 0x55bb5ad34980 2024-05-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.530+0000 7f3e0a7fc700 1 -- 172.21.15.47:0/3219444754 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e14057250 con 0x55bb5ad34980 2024-05-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.530+0000 7f3e0a7fc700 1 -- 172.21.15.47:0/3219444754 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1405d4f0 con 0x55bb5ad34980 2024-05-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.530+0000 7f3e36724b80 1 -- 172.21.15.47:0/3219444754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 msgr2=0x55bb5ad93470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.530+0000 7f3e36724b80 1 --2- 172.21.15.47:0/3219444754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad93470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3e140070a0 tx=0x7f3e14088050 comp rx=0 tx=0).stop 2024-05-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.531+0000 7f3e36724b80 1 -- 172.21.15.47:0/3219444754 shutdown_connections 2024-05-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.531+0000 7f3e36724b80 1 --2- 172.21.15.47:0/3219444754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad93470 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.531+0000 7f3e36724b80 1 --2- 172.21.15.47:0/3219444754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 0x55bb5ad80bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.531+0000 7f3e36724b80 1 --2- 172.21.15.47:0/3219444754 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad34d60 0x55bb5ad806b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.531+0000 7f3e36724b80 1 -- 172.21.15.47:0/3219444754 >> 172.21.15.47:0/3219444754 conn(0x55bb5ac921c0 msgr2=0x55bb5ad2b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.531+0000 7f3e36724b80 1 -- 172.21.15.47:0/3219444754 shutdown_connections 2024-05-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.531+0000 7f3e36724b80 1 -- 172.21.15.47:0/3219444754 wait complete. 2024-05-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.531+0000 7f3e36724b80 1 -- start start 2024-05-08T19:22:27.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.531+0000 7f3e36724b80 1 Processor -- start 2024-05-08T19:22:27.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e36724b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad8a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e36724b80 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad34d60 0x55bb5addd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e36724b80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 0x55bb5ad88180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e36724b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb5ad886c0 con 0x55bb5ad34980 2024-05-08T19:22:27.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e36724b80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb5addd800 con 0x55bb5ad36010 2024-05-08T19:22:27.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e36724b80 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb5add40d0 con 0x55bb5ad34d60 2024-05-08T19:22:27.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e36724b80 10 client.0 _ll_register_callbacks cb 0x55bb5ac29ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T19:22:27.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e23fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad8a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e23fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad8a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57010/0 (socket says 172.21.15.47:57010) 2024-05-08T19:22:27.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e23fff700 1 -- 172.21.15.47:0/2938753045 learned_addr learned my addr 172.21.15.47:0/2938753045 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:27.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e237fe700 1 --2- 172.21.15.47:0/2938753045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad34d60 0x55bb5addd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e28b07700 1 --2- 172.21.15.47:0/2938753045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 0x55bb5ad88180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e23fff700 1 -- 172.21.15.47:0/2938753045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad34d60 msgr2=0x55bb5addd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:27.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e23fff700 1 --2- 172.21.15.47:0/2938753045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad34d60 0x55bb5addd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e23fff700 1 -- 172.21.15.47:0/2938753045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 msgr2=0x55bb5ad88180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:27.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e23fff700 1 --2- 172.21.15.47:0/2938753045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 0x55bb5ad88180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.532+0000 7f3e23fff700 1 -- 172.21.15.47:0/2938753045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb5aab1b10 con 0x55bb5ad34980 2024-05-08T19:22:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e23fff700 1 --2- 172.21.15.47:0/2938753045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad8a3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e140573c0 tx=0x7f3e14000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa65f39e8d3ef89 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e02ffd700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-08T19:22:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e02ffd700 1 -- 172.21.15.47:0/2938753045 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1405b260 con 0x55bb5ad34980 2024-05-08T19:22:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e02ffd700 1 -- 172.21.15.47:0/2938753045 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e1405f7c0 con 0x55bb5ad34980 2024-05-08T19:22:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e36724b80 1 -- 172.21.15.47:0/2938753045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e1c00f040 con 0x55bb5ad34980 2024-05-08T19:22:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e02ffd700 1 -- 172.21.15.47:0/2938753045 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e140077d0 con 0x55bb5ad34980 2024-05-08T19:22:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e36724b80 10 client.4416 fetch_fsmap learned FSMap version 7 2024-05-08T19:22:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e36724b80 1 -- 172.21.15.47:0/2938753045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55bb5ab09c80 con 0x55bb5ad34980 2024-05-08T19:22:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e02ffd700 1 -- 172.21.15.47:0/2938753045 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e14063070 con 0x55bb5ad34980 2024-05-08T19:22:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e02ffd700 1 -- 172.21.15.47:0/2938753045 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f3e1407a070 con 0x55bb5ad34980 2024-05-08T19:22:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e36724b80 10 client.4416 fetch_fsmap finished waiting for FSMap version 7 2024-05-08T19:22:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e36724b80 10 client.4416 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-08T19:22:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e36724b80 20 client.4416 populate_metadata read hostname 'smithi047' 2024-05-08T19:22:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2938753045 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x55bb5adda830 0x55bb5ad7f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e36724b80 4 client.4416 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T19:22:27.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e36724b80 1 -- 172.21.15.47:0/2938753045 --> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bb5ac7ce70 con 0x55bb5adda830 2024-05-08T19:22:27.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.533+0000 7f3e237fe700 1 --2- 172.21.15.47:0/2938753045 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x55bb5adda830 0x55bb5ad7f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e237fe700 1 --2- 172.21.15.47:0/2938753045 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x55bb5adda830 0x55bb5ad7f3d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d70d77038dce9e97 server_cookie=263edac7b81ffeb2 in_seq=0 out_seq=0 2024-05-08T19:22:27.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e02ffd700 10 client.4416 ms_handle_connect on v2:172.21.15.177:6835/2990594738 2024-05-08T19:22:27.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e02ffd700 1 -- 172.21.15.47:0/2938753045 <== mds.0 v2:172.21.15.177:6835/2990594738 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55bb5ac7ce70 con 0x55bb5adda830 2024-05-08T19:22:27.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e02ffd700 10 client.4416 handle_command_reply: tid=0 2024-05-08T19:22:27.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e36724b80 1 client.4416 shutdown 2024-05-08T19:22:27.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e36724b80 1 -- 172.21.15.47:0/2938753045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 msgr2=0x55bb5ad8a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2938753045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad8a3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e140573c0 tx=0x7f3e14000bc0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e36724b80 1 -- 172.21.15.47:0/2938753045 shutdown_connections 2024-05-08T19:22:27.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2938753045 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x55bb5adda830 0x55bb5ad7f3d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2938753045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb5ad34980 0x55bb5ad8a3f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2938753045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bb5ad36010 0x55bb5ad88180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e02ffd700 0 client.4416 ms_handle_reset on v2:172.21.15.177:6835/2990594738 2024-05-08T19:22:27.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e36724b80 1 --2- 172.21.15.47:0/2938753045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bb5ad34d60 0x55bb5addd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e36724b80 1 -- 172.21.15.47:0/2938753045 >> 172.21.15.47:0/2938753045 conn(0x55bb5ac921c0 msgr2=0x55bb5ad73c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:27.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e36724b80 1 -- 172.21.15.47:0/2938753045 shutdown_connections 2024-05-08T19:22:27.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e36724b80 1 -- 172.21.15.47:0/2938753045 wait complete. 2024-05-08T19:22:27.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.534+0000 7f3e36724b80 20 client.4416 trim_cache size 0 max 16384 2024-05-08T19:22:27.533 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-08T19:22:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e1596084-137b-43d3-b844-c72a72dda1f6", 2024-05-08T19:22:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-05-08T19:22:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4282, 2024-05-08T19:22:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-08T19:22:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-08T19:22:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-08T19:22:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 7.1082640530000001, 2024-05-08T19:22:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 7, 2024-05-08T19:22:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 24, 2024-05-08T19:22:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 23, 2024-05-08T19:22:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 11.564610352000001 2024-05-08T19:22:27.534 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-08T19:22:27.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.535+0000 7f3e2a56a700 1 -- 172.21.15.47:0/1028430746 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3e1006ac90 msgr2=0x7f3e1006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.535+0000 7f3e2a56a700 1 --2- 172.21.15.47:0/1028430746 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3e1006ac90 0x7f3e1006d150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009840 tx=0x7f3e1801c040 comp rx=0 tx=0).stop 2024-05-08T19:22:27.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.535+0000 7f3e2a56a700 1 -- 172.21.15.47:0/1028430746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e240ada50 msgr2=0x7f3e240c1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.535+0000 7f3e2a56a700 1 --2- 172.21.15.47:0/1028430746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e240ada50 0x7f3e240c1720 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400c420 tx=0x7f3e1400c730 comp rx=0 tx=0).stop 2024-05-08T19:22:27.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.535+0000 7f3e2a56a700 1 -- 172.21.15.47:0/1028430746 shutdown_connections 2024-05-08T19:22:27.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.535+0000 7f3e2a56a700 1 --2- 172.21.15.47:0/1028430746 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3e1006ac90 0x7f3e1006d150 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.535+0000 7f3e2a56a700 1 --2- 172.21.15.47:0/1028430746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e240ada50 0x7f3e240c1720 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.535+0000 7f3e2a56a700 1 --2- 172.21.15.47:0/1028430746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e240c8050 0x7f3e2414b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.535+0000 7f3e2a56a700 1 --2- 172.21.15.47:0/1028430746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e240c6d70 0x7f3e2414b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.535+0000 7f3e2a56a700 1 -- 172.21.15.47:0/1028430746 >> 172.21.15.47:0/1028430746 conn(0x7f3e2406b1b0 msgr2=0x7f3e2414e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:27.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.535+0000 7f3e2a56a700 1 -- 172.21.15.47:0/1028430746 shutdown_connections 2024-05-08T19:22:27.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.535+0000 7f3e2a56a700 1 -- 172.21.15.47:0/1028430746 wait complete. 2024-05-08T19:22:27.539 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T19:22:27.539 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-08T19:22:27.539 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T19:22:27.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.673+0000 7f0f90c4d700 1 Processor -- start 2024-05-08T19:22:27.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.674+0000 7f0f90c4d700 1 -- start start 2024-05-08T19:22:27.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.674+0000 7f0f90c4d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f8c0c2ea0 0x7f0f8c0a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.674+0000 7f0f90c4d700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f8c06dcd0 con 0x7f0f8c06d450 2024-05-08T19:22:27.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.674+0000 7f0f90c4d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f8c155ae0 con 0x7f0f8c06e900 2024-05-08T19:22:27.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.674+0000 7f0f90c4d700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c0c3940 con 0x7f0f8c0c2ea0 2024-05-08T19:22:27.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8ad9d700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0f8c06d450 0x7f0f8c15bf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34072/0 (socket says 172.21.15.47:34072) 2024-05-08T19:22:27.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8ad9d700 1 -- 172.21.15.47:0/2991296877 learned_addr learned my addr 172.21.15.47:0/2991296877 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:27.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8a59c700 1 --2- 172.21.15.47:0/2991296877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f8c0c2ea0 0x7f0f8c0a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8959a700 1 -- 172.21.15.47:0/2991296877 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882443374 0 0) 0x7f0f8c06dcd0 con 0x7f0f8c06d450 2024-05-08T19:22:27.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8959a700 1 -- 172.21.15.47:0/2991296877 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f740035b0 con 0x7f0f8c06d450 2024-05-08T19:22:27.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8959a700 1 -- 172.21.15.47:0/2991296877 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1238604592 0 0) 0x7f0f740035b0 con 0x7f0f8c06d450 2024-05-08T19:22:27.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8959a700 1 -- 172.21.15.47:0/2991296877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f8c0c2ea0 msgr2=0x7f0f8c0a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:27.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8959a700 1 --2- 172.21.15.47:0/2991296877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f8c0c2ea0 0x7f0f8c0a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8959a700 1 -- 172.21.15.47:0/2991296877 >> v1:172.21.15.177:6789/0 conn(0x7f0f8c06e900 legacy=0x7f0f8c1553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8959a700 1 -- 172.21.15.47:0/2991296877 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c0c26a0 con 0x7f0f8c06d450 2024-05-08T19:22:27.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8959a700 1 -- 172.21.15.47:0/2991296877 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f0f840019f0 con 0x7f0f8c06d450 2024-05-08T19:22:27.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8959a700 1 -- 172.21.15.47:0/2991296877 >> v1:172.21.15.47:6789/0 conn(0x7f0f8c06d450 legacy=0x7f0f8c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8959a700 1 --2- 172.21.15.47:0/2991296877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f8c0c2ea0 0x7f0f74003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8959a700 1 --2- 172.21.15.47:0/2991296877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f74003f70 0x7f0f74004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8959a700 1 --2- 172.21.15.47:0/2991296877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f74004d90 0x7f0f74005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8959a700 1 -- 172.21.15.47:0/2991296877 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c0c3940 con 0x7f0f74003f70 2024-05-08T19:22:27.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8959a700 1 -- 172.21.15.47:0/2991296877 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7400bbd0 con 0x7f0f74004d90 2024-05-08T19:22:27.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8959a700 1 -- 172.21.15.47:0/2991296877 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7400bd90 con 0x7f0f8c0c2ea0 2024-05-08T19:22:27.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f89d9b700 1 --2- 172.21.15.47:0/2991296877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f74003f70 0x7f0f74004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.675+0000 7f0f8a59c700 1 --2- 172.21.15.47:0/2991296877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f8c0c2ea0 0x7f0f74003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.676+0000 7f0f8ad9d700 1 --2- 172.21.15.47:0/2991296877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f74004d90 0x7f0f74005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.676+0000 7f0f89d9b700 1 -- 172.21.15.47:0/2991296877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f8c0c2ea0 msgr2=0x7f0f74003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:27.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.676+0000 7f0f89d9b700 1 --2- 172.21.15.47:0/2991296877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f8c0c2ea0 0x7f0f74003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.676+0000 7f0f89d9b700 1 -- 172.21.15.47:0/2991296877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f74004d90 msgr2=0x7f0f74005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.676+0000 7f0f89d9b700 1 --2- 172.21.15.47:0/2991296877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f74004d90 0x7f0f74005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.676+0000 7f0f89d9b700 1 -- 172.21.15.47:0/2991296877 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f740035b0 con 0x7f0f74003f70 2024-05-08T19:22:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.676+0000 7f0f89d9b700 1 --2- 172.21.15.47:0/2991296877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f74003f70 0x7f0f74004850 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0f80001930 tx=0x7f0f74005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777302e061b9792a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.676+0000 7f0f8959a700 1 -- 172.21.15.47:0/2991296877 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f800013a0 con 0x7f0f74003f70 2024-05-08T19:22:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.676+0000 7f0f8959a700 1 -- 172.21.15.47:0/2991296877 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8000c6b0 con 0x7f0f74003f70 2024-05-08T19:22:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.676+0000 7f0f8959a700 1 -- 172.21.15.47:0/2991296877 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8000ca60 con 0x7f0f74003f70 2024-05-08T19:22:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.676+0000 7f0f90c4d700 1 -- 172.21.15.47:0/2991296877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f74003f70 msgr2=0x7f0f74004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.676+0000 7f0f90c4d700 1 --2- 172.21.15.47:0/2991296877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f74003f70 0x7f0f74004850 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0f80001930 tx=0x7f0f74005880 comp rx=0 tx=0).stop 2024-05-08T19:22:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.676+0000 7f0f8ad9d700 1 -- 172.21.15.47:0/2991296877 reap_dead start 2024-05-08T19:22:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.677+0000 7f0f90c4d700 1 -- 172.21.15.47:0/2991296877 shutdown_connections 2024-05-08T19:22:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.677+0000 7f0f90c4d700 1 -- 172.21.15.47:0/2991296877 >> 172.21.15.47:0/2991296877 conn(0x7f0f8c0c3c20 msgr2=0x7f0f8c0c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.677+0000 7f0f90c4d700 1 -- 172.21.15.47:0/2991296877 shutdown_connections 2024-05-08T19:22:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.677+0000 7f0f90c4d700 1 -- 172.21.15.47:0/2991296877 wait complete. 2024-05-08T19:22:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.678+0000 7f0f90c4d700 1 Processor -- start 2024-05-08T19:22:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.678+0000 7f0f90c4d700 1 -- start start 2024-05-08T19:22:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.679+0000 7f0f90c4d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74003f70 0x7f0f8c0ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.679+0000 7f0f90c4d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f8c06b420 0x7f0f8c13ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.679+0000 7f0f90c4d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f8c153f20 0x7f0f8c1543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.679+0000 7f0f90c4d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c06b900 con 0x7f0f8c153f20 2024-05-08T19:22:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.679+0000 7f0f90c4d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c1548f0 con 0x7f0f8c06b420 2024-05-08T19:22:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.679+0000 7f0f90c4d700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c0c5450 con 0x7f0f74003f70 2024-05-08T19:22:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.679+0000 7f0f8ad9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f8c153f20 0x7f0f8c1543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.679+0000 7f0f8ad9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f8c153f20 0x7f0f8c1543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57036/0 (socket says 172.21.15.47:57036) 2024-05-08T19:22:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.679+0000 7f0f8ad9d700 1 -- 172.21.15.47:0/413394564 learned_addr learned my addr 172.21.15.47:0/413394564 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.679+0000 7f0f8a59c700 1 --2- 172.21.15.47:0/413394564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74003f70 0x7f0f8c0ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.679+0000 7f0f89d9b700 1 --2- 172.21.15.47:0/413394564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f8c06b420 0x7f0f8c13ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.680+0000 7f0f8ad9d700 1 -- 172.21.15.47:0/413394564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74003f70 msgr2=0x7f0f8c0ace50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.680+0000 7f0f8ad9d700 1 --2- 172.21.15.47:0/413394564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74003f70 0x7f0f8c0ace50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.680+0000 7f0f8ad9d700 1 -- 172.21.15.47:0/413394564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f8c06b420 msgr2=0x7f0f8c13ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.680+0000 7f0f8ad9d700 1 --2- 172.21.15.47:0/413394564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f8c06b420 0x7f0f8c13ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.680+0000 7f0f8ad9d700 1 -- 172.21.15.47:0/413394564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c0c4e90 con 0x7f0f8c153f20 2024-05-08T19:22:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.680+0000 7f0f8ad9d700 1 --2- 172.21.15.47:0/413394564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f8c153f20 0x7f0f8c1543b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0c1bb0 tx=0x7f0f8400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.680+0000 7f0f7affd700 1 -- 172.21.15.47:0/413394564 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f840019e0 con 0x7f0f8c153f20 2024-05-08T19:22:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.680+0000 7f0f7affd700 1 -- 172.21.15.47:0/413394564 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8400adb0 con 0x7f0f8c153f20 2024-05-08T19:22:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.680+0000 7f0f90c4d700 1 -- 172.21.15.47:0/413394564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8c0c5170 con 0x7f0f8c153f20 2024-05-08T19:22:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.680+0000 7f0f7affd700 1 -- 172.21.15.47:0/413394564 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84013630 con 0x7f0f8c153f20 2024-05-08T19:22:27.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.680+0000 7f0f90c4d700 1 -- 172.21.15.47:0/413394564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8c140510 con 0x7f0f8c153f20 2024-05-08T19:22:27.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.681+0000 7f0f90c4d700 1 -- 172.21.15.47:0/413394564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8c153c40 con 0x7f0f8c153f20 2024-05-08T19:22:27.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.681+0000 7f0f7affd700 1 -- 172.21.15.47:0/413394564 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0f84013790 con 0x7f0f8c153f20 2024-05-08T19:22:27.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.682+0000 7f0f7affd700 1 --2- 172.21.15.47:0/413394564 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0f6c06ac90 0x7f0f6c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:27.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.682+0000 7f0f7affd700 1 -- 172.21.15.47:0/413394564 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f8408a000 con 0x7f0f8c153f20 2024-05-08T19:22:27.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.682+0000 7f0f8a59c700 1 --2- 172.21.15.47:0/413394564 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0f6c06ac90 0x7f0f6c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:27.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.682+0000 7f0f8a59c700 1 --2- 172.21.15.47:0/413394564 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0f6c06ac90 0x7f0f6c06d150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009c60 tx=0x7f0f7c009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:27.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.686+0000 7f0f7affd700 1 -- 172.21.15.47:0/413394564 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0f8c153c40 con 0x7f0f8c153f20 2024-05-08T19:22:27.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.943+0000 7f0f90c4d700 1 -- 172.21.15.47:0/413394564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0f8c153c40 con 0x7f0f8c153f20 2024-05-08T19:22:27.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.943+0000 7f0f7affd700 1 -- 172.21.15.47:0/413394564 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0f8c153c40 con 0x7f0f8c153f20 2024-05-08T19:22:27.935 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-08T19:22:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.945+0000 7f0f90c4d700 1 -- 172.21.15.47:0/413394564 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0f6c06ac90 msgr2=0x7f0f6c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.945+0000 7f0f90c4d700 1 --2- 172.21.15.47:0/413394564 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0f6c06ac90 0x7f0f6c06d150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009c60 tx=0x7f0f7c009210 comp rx=0 tx=0).stop 2024-05-08T19:22:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.945+0000 7f0f90c4d700 1 -- 172.21.15.47:0/413394564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f8c153f20 msgr2=0x7f0f8c1543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.945+0000 7f0f90c4d700 1 --2- 172.21.15.47:0/413394564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f8c153f20 0x7f0f8c1543b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0c1bb0 tx=0x7f0f8400a640 comp rx=0 tx=0).stop 2024-05-08T19:22:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.945+0000 7f0f90c4d700 1 -- 172.21.15.47:0/413394564 shutdown_connections 2024-05-08T19:22:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.945+0000 7f0f90c4d700 1 --2- 172.21.15.47:0/413394564 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0f6c06ac90 0x7f0f6c06d150 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.945+0000 7f0f90c4d700 1 --2- 172.21.15.47:0/413394564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f8c153f20 0x7f0f8c1543b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.945+0000 7f0f90c4d700 1 --2- 172.21.15.47:0/413394564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74003f70 0x7f0f8c0ace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.945+0000 7f0f90c4d700 1 --2- 172.21.15.47:0/413394564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f8c06b420 0x7f0f8c13ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:27.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.945+0000 7f0f90c4d700 1 -- 172.21.15.47:0/413394564 >> 172.21.15.47:0/413394564 conn(0x7f0f8c0c3c20 msgr2=0x7f0f8c1456e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:27.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.945+0000 7f0f90c4d700 1 -- 172.21.15.47:0/413394564 shutdown_connections 2024-05-08T19:22:27.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:27.945+0000 7f0f90c4d700 1 -- 172.21.15.47:0/413394564 wait complete. 2024-05-08T19:22:27.950 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-08T19:22:27.950 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T19:22:27.950 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-05-08T19:22:27.950 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-08T19:22:27.950 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-08T19:22:27.950 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-08T19:22:27.950 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T19:22:27.950 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T19:22:27.950 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-08T19:22:27.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:27.951 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-05-08T19:22:27.969 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T19:22:27.969 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T19:22:27.969 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T19:22:27.969 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-08T19:22:27.969 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-05-08T19:22:27.969 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-08T19:22:27.969 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T19:22:27.969 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-05-08T19:22:27.969 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-05-08T19:22:27.969 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T19:22:27.970 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-05-08T19:22:27.970 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-05-08T19:22:27.970 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T19:22:27.970 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-05-08T19:22:27.970 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-05-08T19:22:27.970 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-08T19:22:27.970 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42309sec preferred_lft 42309sec 2024-05-08T19:22:27.970 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link 2024-05-08T19:22:27.970 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-08T19:22:27.970 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T19:22:27.970 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-05-08T19:22:27.970 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-05-08T19:22:27.971 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T19:22:27.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:27.971 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-08T19:22:27.971 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-08T19:22:27.971 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-05-08T19:22:27.971 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-05-08T19:22:27.971 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-05-08T19:22:27.972 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T19:22:27.972 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-08T19:22:28.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:28.134 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T19:22:28.163 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-05-08T19:22:28.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:28.165 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-05-08T19:22:28.235 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-05-08T19:22:28.235 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T19:22:28.235 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-08T19:22:28.235 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-08T19:22:28.235 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T19:22:28.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:28.236 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-08T19:22:28.237 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-08T19:22:28.237 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-08T19:22:28.237 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-08T19:22:28.237 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-08T19:22:28.237 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-08T19:22:28.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:28.481 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-08T19:22:28.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:28.499 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-05-08T19:22:28.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:28.557 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-08T19:22:28.557 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-08T19:22:28.557 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-08T19:22:28.557 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-08T19:22:28.557 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-08T19:22:28.654 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-08T19:22:28.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:28.655 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-08T19:22:28.655 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-08T19:22:28.655 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-08T19:22:28.655 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T19:22:28.655 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-08T19:22:28.655 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-08T19:22:28.655 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-08T19:22:28.655 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-08T19:22:28.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:28.867 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-08T19:22:28.867 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-08T19:22:28.867 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-05-08T19:22:28.867 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T19:22:28.867 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-08T19:22:28.967 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-08T19:22:28.967 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T19:22:28.967 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-08T19:22:28.984 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-08T19:22:28.984 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T19:22:28.985 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-08T19:22:29.042 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-08T19:22:29.113 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T19:22:29.114 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T19:22:29.181 INFO:teuthology.orchestra.run.smithi047.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T19:22:29.182 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T19:22:29.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:29.182 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-08T19:22:29.240 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T19:22:29.240 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-08T19:22:29.282 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-08T19:22:29.311 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T19:22:29.311 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T19:22:29.375 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:2024-05-08T19:22:29.383+0000 7f306c85c5c0 -1 init, newargv = 0x5578595fec90 newargc=15 2024-05-08T19:22:29.375 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:ceph-fuse[52977]: starting ceph client 2024-05-08T19:22:29.379 INFO:teuthology.orchestra.run.smithi047.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T19:22:29.380 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T19:22:29.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:29.381 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-08T19:22:29.382 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:ceph-fuse[52977]: starting fuse 2024-05-08T19:22:29.399 INFO:teuthology.orchestra.run.smithi047.stdout:47 2024-05-08T19:22:29.399 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2024-05-08T19:22:29.399 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-08T19:22:29.399 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-05-08T19:22:29.399 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-05-08T19:22:29.399 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T19:22:29.400 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T19:22:29.401 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-05-08T19:22:29.401 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-05-08T19:22:29.401 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-05-08T19:22:29.401 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T19:22:29.401 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-08T19:22:29.401 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.admin")) 2024-05-08T19:22:29.402 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-05-08T19:22:29.524 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.admin.52977.asok 2024-05-08T19:22:29.706 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.52977.asok 2024-05-08T19:22:29.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:29.707 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.52977.asok status 2024-05-08T19:22:29.869 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-08T19:22:29.870 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-05-08T19:22:29.870 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "d21e4f961318b56f0d915caa2490c3711bf13c34", 2024-05-08T19:22:29.870 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T19:22:29.870 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "admin", 2024-05-08T19:22:29.870 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-05-08T19:22:29.871 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-08T19:22:29.871 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "52977", 2024-05-08T19:22:29.871 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/" 2024-05-08T19:22:29.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-08T19:22:29.871 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-05-08T19:22:29.871 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-05-08T19:22:29.871 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4428, 2024-05-08T19:22:29.872 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-05-08T19:22:29.872 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-05-08T19:22:29.872 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-05-08T19:22:29.872 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 4428 2024-05-08T19:22:29.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-08T19:22:29.873 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-05-08T19:22:29.873 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-05-08T19:22:29.873 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-05-08T19:22:29.873 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 761606222 2024-05-08T19:22:29.873 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-08T19:22:29.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-08T19:22:29.874 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-05-08T19:22:29.874 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-05-08T19:22:29.874 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-05-08T19:22:29.874 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 761606222 2024-05-08T19:22:29.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-08T19:22:29.874 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.4428 192.168.0.1:0/761606222", 2024-05-08T19:22:29.874 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "192.168.0.1:0/761606222", 2024-05-08T19:22:29.874 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 1, 2024-05-08T19:22:29.874 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 7, 2024-05-08T19:22:29.874 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 24, 2024-05-08T19:22:29.874 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 0, 2024-05-08T19:22:29.875 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-05-08T19:22:29.875 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-05-08T19:22:29.875 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-08T19:22:29.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:29.881 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-05-08T19:22:29.881 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-08T19:22:29.899 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-05-08T19:22:29.900 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-08T19:22:29.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:29.900 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-08T19:22:29.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:29.969 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-08T19:22:30.067 INFO:teuthology.orchestra.run.smithi047.stdout:# file: . 2024-05-08T19:22:30.067 INFO:teuthology.orchestra.run.smithi047.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-08T19:22:30.067 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:30.067 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:22:30.067 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T19:22:30.086 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:30.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.259+0000 7f282ec60700 1 Processor -- start 2024-05-08T19:22:30.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.259+0000 7f282ec60700 1 -- start start 2024-05-08T19:22:30.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.260+0000 7f282ec60700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2828152160 0x7f28280c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.260+0000 7f282ec60700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2828154900 0x7f282806d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.260+0000 7f282ec60700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28280c8d60 con 0x7f28280c5110 2024-05-08T19:22:30.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.260+0000 7f282ec60700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282806c530 con 0x7f2828154900 2024-05-08T19:22:30.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.260+0000 7f282ec60700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2828154e70 con 0x7f2828152160 2024-05-08T19:22:30.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.260+0000 7f282d1fd700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2828154900 0x7f282806d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.260+0000 7f2827fff700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f28280c5110 0x7f282806c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34080/0 (socket says 172.21.15.47:34080) 2024-05-08T19:22:30.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.260+0000 7f2827fff700 1 -- 172.21.15.47:0/2110980081 learned_addr learned my addr 172.21.15.47:0/2110980081 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:30.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.261+0000 7f282c9fc700 1 --2- 172.21.15.47:0/2110980081 >> v2:172.21.15.177:3300/0 conn(0x7f2828152160 0x7f28280c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.261+0000 7f282d1fd700 1 -- 172.21.15.47:0/2110980081 >> v2:172.21.15.177:3300/0 conn(0x7f2828152160 msgr2=0x7f28280c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.261+0000 7f282d1fd700 1 --2- 172.21.15.47:0/2110980081 >> v2:172.21.15.177:3300/0 conn(0x7f2828152160 0x7f28280c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.261+0000 7f282d1fd700 1 -- 172.21.15.47:0/2110980081 >> v1:172.21.15.47:6789/0 conn(0x7f28280c5110 legacy=0x7f282806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.261+0000 7f282d1fd700 1 -- 172.21.15.47:0/2110980081 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2828155150 con 0x7f2828154900 2024-05-08T19:22:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.261+0000 7f28277fe700 1 -- 172.21.15.47:0/2110980081 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962588369 0 0) 0x7f28280c8d60 con 0x7f28280c5110 2024-05-08T19:22:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.261+0000 7f282c9fc700 1 --2- 172.21.15.47:0/2110980081 >> v2:172.21.15.177:3300/0 conn(0x7f2828152160 0x7f28280c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.261+0000 7f282d1fd700 1 --2- 172.21.15.47:0/2110980081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2828154900 0x7f282806d090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f28280acce0 tx=0x7f282000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca857842d75ef1a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.261+0000 7f28277fe700 1 -- 172.21.15.47:0/2110980081 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282000e070 con 0x7f2828154900 2024-05-08T19:22:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.261+0000 7f28277fe700 1 -- 172.21.15.47:0/2110980081 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282000bbd0 con 0x7f2828154900 2024-05-08T19:22:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.261+0000 7f28277fe700 1 -- 172.21.15.47:0/2110980081 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2820012430 con 0x7f2828154900 2024-05-08T19:22:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.261+0000 7f282ec60700 1 -- 172.21.15.47:0/2110980081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2828154900 msgr2=0x7f282806d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.261+0000 7f282ec60700 1 --2- 172.21.15.47:0/2110980081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2828154900 0x7f282806d090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f28280acce0 tx=0x7f282000b330 comp rx=0 tx=0).stop 2024-05-08T19:22:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.262+0000 7f282ec60700 1 -- 172.21.15.47:0/2110980081 shutdown_connections 2024-05-08T19:22:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.262+0000 7f282ec60700 1 --2- 172.21.15.47:0/2110980081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2828154900 0x7f282806d090 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.262+0000 7f282ec60700 1 --2- 172.21.15.47:0/2110980081 >> v2:172.21.15.177:3300/0 conn(0x7f2828152160 0x7f28280c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.262+0000 7f282ec60700 1 -- 172.21.15.47:0/2110980081 >> 172.21.15.47:0/2110980081 conn(0x7f28280abea0 msgr2=0x7f28280ac2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:30.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.262+0000 7f282ec60700 1 -- 172.21.15.47:0/2110980081 shutdown_connections 2024-05-08T19:22:30.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.262+0000 7f282ec60700 1 -- 172.21.15.47:0/2110980081 wait complete. 2024-05-08T19:22:30.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.263+0000 7f282ec60700 1 Processor -- start 2024-05-08T19:22:30.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.263+0000 7f282ec60700 1 -- start start 2024-05-08T19:22:30.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.263+0000 7f282ec60700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28280c5110 0x7f28280ab090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.263+0000 7f282ec60700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2828152160 0x7f2828144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f282ec60700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2828154900 0x7f2828145170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f282ec60700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28280aef10 con 0x7f2828152160 2024-05-08T19:22:30.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f282ec60700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28281ee2e0 con 0x7f28280c5110 2024-05-08T19:22:30.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f282ec60700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28280ae8c0 con 0x7f2828154900 2024-05-08T19:22:30.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f2827fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2828152160 0x7f2828144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f2827fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2828152160 0x7f2828144c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57054/0 (socket says 172.21.15.47:57054) 2024-05-08T19:22:30.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f2827fff700 1 -- 172.21.15.47:0/3640519769 learned_addr learned my addr 172.21.15.47:0/3640519769 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:30.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f282c9fc700 1 --2- 172.21.15.47:0/3640519769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28280c5110 0x7f28280ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f282d1fd700 1 --2- 172.21.15.47:0/3640519769 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2828154900 0x7f2828145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f2827fff700 1 -- 172.21.15.47:0/3640519769 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2828154900 msgr2=0x7f2828145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f2827fff700 1 --2- 172.21.15.47:0/3640519769 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2828154900 0x7f2828145170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f2827fff700 1 -- 172.21.15.47:0/3640519769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28280c5110 msgr2=0x7f28280ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f2827fff700 1 --2- 172.21.15.47:0/3640519769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28280c5110 0x7f28280ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f2827fff700 1 -- 172.21.15.47:0/3640519769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2820009a70 con 0x7f2828152160 2024-05-08T19:22:30.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f282c9fc700 1 --2- 172.21.15.47:0/3640519769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28280c5110 0x7f28280ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:30.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f2827fff700 1 --2- 172.21.15.47:0/3640519769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2828152160 0x7f2828144c30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f28140011e0 tx=0x7f281400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:30.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f28257fa700 1 -- 172.21.15.47:0/3640519769 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814004c80 con 0x7f2828152160 2024-05-08T19:22:30.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f28257fa700 1 -- 172.21.15.47:0/3640519769 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2814004e00 con 0x7f2828152160 2024-05-08T19:22:30.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f282ec60700 1 -- 172.21.15.47:0/3640519769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28280aeba0 con 0x7f2828152160 2024-05-08T19:22:30.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f28257fa700 1 -- 172.21.15.47:0/3640519769 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814007310 con 0x7f2828152160 2024-05-08T19:22:30.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.264+0000 7f282ec60700 1 -- 172.21.15.47:0/3640519769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28281ee5c0 con 0x7f2828152160 2024-05-08T19:22:30.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.265+0000 7f282ec60700 1 -- 172.21.15.47:0/3640519769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282804ec60 con 0x7f2828152160 2024-05-08T19:22:30.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.266+0000 7f28257fa700 1 -- 172.21.15.47:0/3640519769 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2814007470 con 0x7f2828152160 2024-05-08T19:22:30.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.266+0000 7f28257fa700 1 --2- 172.21.15.47:0/3640519769 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f280c06ac90 0x7f280c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.266+0000 7f28257fa700 1 -- 172.21.15.47:0/3640519769 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2814089380 con 0x7f2828152160 2024-05-08T19:22:30.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.266+0000 7f282c9fc700 1 --2- 172.21.15.47:0/3640519769 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f280c06ac90 0x7f280c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.267+0000 7f282c9fc700 1 --2- 172.21.15.47:0/3640519769 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f280c06ac90 0x7f280c06d150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f281c0089b0 tx=0x7f281c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:30.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.271+0000 7f28257fa700 1 -- 172.21.15.47:0/3640519769 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2814054300 con 0x7f2828152160 2024-05-08T19:22:30.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.480+0000 7f282ec60700 1 -- 172.21.15.47:0/3640519769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28280c8b40 con 0x7f2828152160 2024-05-08T19:22:30.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.481+0000 7f28257fa700 1 -- 172.21.15.47:0/3640519769 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f2814057920 con 0x7f2828152160 2024-05-08T19:22:30.474 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:30.474 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:24.891864+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:30.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.484+0000 7f282ec60700 1 -- 172.21.15.47:0/3640519769 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f280c06ac90 msgr2=0x7f280c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.484+0000 7f282ec60700 1 --2- 172.21.15.47:0/3640519769 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f280c06ac90 0x7f280c06d150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f281c0089b0 tx=0x7f281c008040 comp rx=0 tx=0).stop 2024-05-08T19:22:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.484+0000 7f282ec60700 1 -- 172.21.15.47:0/3640519769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2828152160 msgr2=0x7f2828144c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.484+0000 7f282ec60700 1 --2- 172.21.15.47:0/3640519769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2828152160 0x7f2828144c30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f28140011e0 tx=0x7f281400cae0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.484+0000 7f282ec60700 1 -- 172.21.15.47:0/3640519769 shutdown_connections 2024-05-08T19:22:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.484+0000 7f282ec60700 1 --2- 172.21.15.47:0/3640519769 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f280c06ac90 0x7f280c06d150 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.484+0000 7f282ec60700 1 --2- 172.21.15.47:0/3640519769 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2828154900 0x7f2828145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.484+0000 7f282ec60700 1 --2- 172.21.15.47:0/3640519769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28280c5110 0x7f28280ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.484+0000 7f282ec60700 1 --2- 172.21.15.47:0/3640519769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2828152160 0x7f2828144c30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.484+0000 7f282ec60700 1 -- 172.21.15.47:0/3640519769 >> 172.21.15.47:0/3640519769 conn(0x7f28280abea0 msgr2=0x7f28280c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.484+0000 7f282ec60700 1 -- 172.21.15.47:0/3640519769 shutdown_connections 2024-05-08T19:22:30.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.484+0000 7f282ec60700 1 -- 172.21.15.47:0/3640519769 wait complete. 2024-05-08T19:22:30.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T19:22:15.923832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T19:22:18.529792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T19:22:19.389797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T19:22:22.474001+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T19:22:30.489 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T19:22:30.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.625+0000 7f351e17e700 1 Processor -- start 2024-05-08T19:22:30.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.625+0000 7f351e17e700 1 -- start start 2024-05-08T19:22:30.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.626+0000 7f351e17e700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f351814eee0 0x7f35180ac250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.626+0000 7f351e17e700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35180c2880 con 0x7f35180a84b0 2024-05-08T19:22:30.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.626+0000 7f351e17e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35180c2b60 con 0x7f35180aab40 2024-05-08T19:22:30.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.626+0000 7f351e17e700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35180ab450 con 0x7f351814eee0 2024-05-08T19:22:30.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.626+0000 7f3517fff700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f35180a84b0 0x7f35180c2ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34090/0 (socket says 172.21.15.47:34090) 2024-05-08T19:22:30.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.626+0000 7f3517fff700 1 -- 172.21.15.47:0/590872228 learned_addr learned my addr 172.21.15.47:0/590872228 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:30.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.626+0000 7f35177fe700 1 --2- 172.21.15.47:0/590872228 >> v2:172.21.15.177:3300/0 conn(0x7f351814eee0 0x7f35180ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.626+0000 7f35167fc700 1 -- 172.21.15.47:0/590872228 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902070775 0 0) 0x7f35180c2880 con 0x7f35180a84b0 2024-05-08T19:22:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.626+0000 7f35167fc700 1 -- 172.21.15.47:0/590872228 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35000035b0 con 0x7f35180a84b0 2024-05-08T19:22:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 -- 172.21.15.47:0/590872228 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1002630494 0 0) 0x7f35000035b0 con 0x7f35180a84b0 2024-05-08T19:22:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 -- 172.21.15.47:0/590872228 >> v2:172.21.15.177:3300/0 conn(0x7f351814eee0 msgr2=0x7f35180ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 --2- 172.21.15.47:0/590872228 >> v2:172.21.15.177:3300/0 conn(0x7f351814eee0 0x7f35180ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 -- 172.21.15.47:0/590872228 >> v1:172.21.15.177:6789/0 conn(0x7f35180aab40 legacy=0x7f35180a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 -- 172.21.15.47:0/590872228 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35181526e0 con 0x7f35180a84b0 2024-05-08T19:22:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 -- 172.21.15.47:0/590872228 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f35100019f0 con 0x7f35180a84b0 2024-05-08T19:22:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35177fe700 1 --2- 172.21.15.47:0/590872228 >> v2:172.21.15.177:3300/0 conn(0x7f351814eee0 0x7f35180ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 -- 172.21.15.47:0/590872228 >> v1:172.21.15.47:6789/0 conn(0x7f35180a84b0 legacy=0x7f35180c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 --2- 172.21.15.47:0/590872228 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3500003a00 0x7f3500003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 --2- 172.21.15.47:0/590872228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3500004850 0x7f3500004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 --2- 172.21.15.47:0/590872228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3500005210 0x7f350000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 -- 172.21.15.47:0/590872228 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35180ab450 con 0x7f3500004850 2024-05-08T19:22:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 -- 172.21.15.47:0/590872228 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350000c0b0 con 0x7f3500005210 2024-05-08T19:22:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 -- 172.21.15.47:0/590872228 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350000c270 con 0x7f3500003a00 2024-05-08T19:22:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f3516ffd700 1 --2- 172.21.15.47:0/590872228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3500004850 0x7f3500004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35177fe700 1 --2- 172.21.15.47:0/590872228 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3500003a00 0x7f3500003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f3517fff700 1 --2- 172.21.15.47:0/590872228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3500005210 0x7f350000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f3516ffd700 1 -- 172.21.15.47:0/590872228 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3500003a00 msgr2=0x7f3500003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f3516ffd700 1 --2- 172.21.15.47:0/590872228 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3500003a00 0x7f3500003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f3516ffd700 1 -- 172.21.15.47:0/590872228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3500005210 msgr2=0x7f350000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f3516ffd700 1 --2- 172.21.15.47:0/590872228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3500005210 0x7f350000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f3516ffd700 1 -- 172.21.15.47:0/590872228 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35000035b0 con 0x7f3500004850 2024-05-08T19:22:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f3517fff700 1 -- 172.21.15.47:0/590872228 reap_dead start 2024-05-08T19:22:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f3516ffd700 1 --2- 172.21.15.47:0/590872228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3500004850 0x7f3500004cd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f35180ac790 tx=0x7f3500005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d05ecdbcc1941b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 -- 172.21.15.47:0/590872228 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0052d0 con 0x7f3500004850 2024-05-08T19:22:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 -- 172.21.15.47:0/590872228 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c005450 con 0x7f3500004850 2024-05-08T19:22:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.627+0000 7f35167fc700 1 -- 172.21.15.47:0/590872228 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0038c0 con 0x7f3500004850 2024-05-08T19:22:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.628+0000 7f351e17e700 1 -- 172.21.15.47:0/590872228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3500004850 msgr2=0x7f3500004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.628+0000 7f351e17e700 1 --2- 172.21.15.47:0/590872228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3500004850 0x7f3500004cd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f35180ac790 tx=0x7f3500005880 comp rx=0 tx=0).stop 2024-05-08T19:22:30.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.628+0000 7f351e17e700 1 -- 172.21.15.47:0/590872228 shutdown_connections 2024-05-08T19:22:30.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.628+0000 7f351e17e700 1 --2- 172.21.15.47:0/590872228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3500004850 0x7f3500004cd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.628+0000 7f351e17e700 1 -- 172.21.15.47:0/590872228 >> 172.21.15.47:0/590872228 conn(0x7f35180c3c20 msgr2=0x7f35180c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:30.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.628+0000 7f351e17e700 1 -- 172.21.15.47:0/590872228 shutdown_connections 2024-05-08T19:22:30.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.628+0000 7f351e17e700 1 -- 172.21.15.47:0/590872228 wait complete. 2024-05-08T19:22:30.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.629+0000 7f351e17e700 1 Processor -- start 2024-05-08T19:22:30.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.629+0000 7f351e17e700 1 -- start start 2024-05-08T19:22:30.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.630+0000 7f351e17e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3500004850 0x7f35181dad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.630+0000 7f351e17e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f351806f740 0x7f351806ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.630+0000 7f351e17e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f351806dbb0 0x7f3518148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.630+0000 7f351e17e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351806ea60 con 0x7f351806f740 2024-05-08T19:22:30.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.630+0000 7f351e17e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35181dda90 con 0x7f351806dbb0 2024-05-08T19:22:30.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.630+0000 7f351e17e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35181dca50 con 0x7f3500004850 2024-05-08T19:22:30.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.630+0000 7f3516ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f351806f740 0x7f351806ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.630+0000 7f3516ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f351806f740 0x7f351806ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57074/0 (socket says 172.21.15.47:57074) 2024-05-08T19:22:30.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.630+0000 7f3516ffd700 1 -- 172.21.15.47:0/2238464263 learned_addr learned my addr 172.21.15.47:0/2238464263 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:30.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.630+0000 7f3517fff700 1 --2- 172.21.15.47:0/2238464263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f351806dbb0 0x7f3518148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.630+0000 7f35177fe700 1 --2- 172.21.15.47:0/2238464263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3500004850 0x7f35181dad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.631+0000 7f3516ffd700 1 -- 172.21.15.47:0/2238464263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3500004850 msgr2=0x7f35181dad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.631+0000 7f3516ffd700 1 --2- 172.21.15.47:0/2238464263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3500004850 0x7f35181dad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.631+0000 7f3516ffd700 1 -- 172.21.15.47:0/2238464263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f351806dbb0 msgr2=0x7f3518148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.631+0000 7f3516ffd700 1 --2- 172.21.15.47:0/2238464263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f351806dbb0 0x7f3518148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.631+0000 7f3516ffd700 1 -- 172.21.15.47:0/2238464263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35181f2830 con 0x7f351806f740 2024-05-08T19:22:30.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.631+0000 7f3517fff700 1 --2- 172.21.15.47:0/2238464263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f351806dbb0 0x7f3518148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:30.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.631+0000 7f3516ffd700 1 --2- 172.21.15.47:0/2238464263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f351806f740 0x7f351806ac30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f350000c080 tx=0x7f350c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:30.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.631+0000 7f34fffff700 1 -- 172.21.15.47:0/2238464263 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c001290 con 0x7f351806f740 2024-05-08T19:22:30.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.631+0000 7f34fffff700 1 -- 172.21.15.47:0/2238464263 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c000ed0 con 0x7f351806f740 2024-05-08T19:22:30.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.631+0000 7f351e17e700 1 -- 172.21.15.47:0/2238464263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351806d3b0 con 0x7f351806f740 2024-05-08T19:22:30.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.631+0000 7f34fffff700 1 -- 172.21.15.47:0/2238464263 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c007240 con 0x7f351806f740 2024-05-08T19:22:30.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.631+0000 7f351e17e700 1 -- 172.21.15.47:0/2238464263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351806b170 con 0x7f351806f740 2024-05-08T19:22:30.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.632+0000 7f351e17e700 1 -- 172.21.15.47:0/2238464263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351804ec60 con 0x7f351806f740 2024-05-08T19:22:30.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.632+0000 7f34fffff700 1 -- 172.21.15.47:0/2238464263 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f350c0073a0 con 0x7f351806f740 2024-05-08T19:22:30.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.633+0000 7f34fffff700 1 --2- 172.21.15.47:0/2238464263 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f350406ac90 0x7f350406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.633+0000 7f34fffff700 1 -- 172.21.15.47:0/2238464263 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f350c089f70 con 0x7f351806f740 2024-05-08T19:22:30.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.633+0000 7f35177fe700 1 --2- 172.21.15.47:0/2238464263 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f350406ac90 0x7f350406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.634+0000 7f35177fe700 1 --2- 172.21.15.47:0/2238464263 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f350406ac90 0x7f350406d150 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3508009e60 tx=0x7f3508009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:30.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.638+0000 7f34fffff700 1 -- 172.21.15.47:0/2238464263 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f350c0bd900 con 0x7f351806f740 2024-05-08T19:22:30.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.842+0000 7f351e17e700 1 -- 172.21.15.47:0/2238464263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35180c1b20 con 0x7f351806f740 2024-05-08T19:22:30.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.842+0000 7f34fffff700 1 -- 172.21.15.47:0/2238464263 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f350c02b020 con 0x7f351806f740 2024-05-08T19:22:30.835 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-08T19:22:30.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.844+0000 7f351e17e700 1 -- 172.21.15.47:0/2238464263 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f350406ac90 msgr2=0x7f350406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.844+0000 7f351e17e700 1 --2- 172.21.15.47:0/2238464263 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f350406ac90 0x7f350406d150 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3508009e60 tx=0x7f3508009210 comp rx=0 tx=0).stop 2024-05-08T19:22:30.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.844+0000 7f351e17e700 1 -- 172.21.15.47:0/2238464263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f351806f740 msgr2=0x7f351806ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.844+0000 7f351e17e700 1 --2- 172.21.15.47:0/2238464263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f351806f740 0x7f351806ac30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f350000c080 tx=0x7f350c001120 comp rx=0 tx=0).stop 2024-05-08T19:22:30.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.844+0000 7f351e17e700 1 -- 172.21.15.47:0/2238464263 shutdown_connections 2024-05-08T19:22:30.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.844+0000 7f351e17e700 1 --2- 172.21.15.47:0/2238464263 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f350406ac90 0x7f350406d150 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.844+0000 7f351e17e700 1 --2- 172.21.15.47:0/2238464263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f351806dbb0 0x7f3518148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.844+0000 7f351e17e700 1 --2- 172.21.15.47:0/2238464263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3500004850 0x7f35181dad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.844+0000 7f351e17e700 1 --2- 172.21.15.47:0/2238464263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f351806f740 0x7f351806ac30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.844+0000 7f351e17e700 1 -- 172.21.15.47:0/2238464263 >> 172.21.15.47:0/2238464263 conn(0x7f35180c3c20 msgr2=0x7f3518149860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:30.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.845+0000 7f351e17e700 1 -- 172.21.15.47:0/2238464263 shutdown_connections 2024-05-08T19:22:30.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.845+0000 7f351e17e700 1 -- 172.21.15.47:0/2238464263 wait complete. 2024-05-08T19:22:30.850 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T19:22:30.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.986+0000 7f1084dce700 1 Processor -- start 2024-05-08T19:22:30.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.986+0000 7f1084dce700 1 -- start start 2024-05-08T19:22:30.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.987+0000 7f1084dce700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f108014f0c0 0x7f10800a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.987+0000 7f1084dce700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1080070f80 0x7f10800713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.987+0000 7f1084dce700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10800c29c0 con 0x7f10800c2b80 2024-05-08T19:22:30.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.987+0000 7f1084dce700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1080072aa0 con 0x7f108014f0c0 2024-05-08T19:22:30.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.987+0000 7f1084dce700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108014f4a0 con 0x7f1080070f80 2024-05-08T19:22:30.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.987+0000 7f107e59c700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f108014f0c0 0x7f10800a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.987+0000 7f107e59c700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f108014f0c0 0x7f10800a5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57082/0 (socket says 172.21.15.47:57082) 2024-05-08T19:22:30.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.987+0000 7f107e59c700 1 -- 172.21.15.47:0/4081129671 learned_addr learned my addr 172.21.15.47:0/4081129671 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:30.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.987+0000 7f107ed9d700 1 --2- 172.21.15.47:0/4081129671 >> v2:172.21.15.177:3300/0 conn(0x7f1080070f80 0x7f10800713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.988+0000 7f107e59c700 1 -- 172.21.15.47:0/4081129671 >> v2:172.21.15.177:3300/0 conn(0x7f1080070f80 msgr2=0x7f10800713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:30.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.988+0000 7f107e59c700 1 --2- 172.21.15.47:0/4081129671 >> v2:172.21.15.177:3300/0 conn(0x7f1080070f80 0x7f10800713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.988+0000 7f107e59c700 1 -- 172.21.15.47:0/4081129671 >> v1:172.21.15.177:6789/0 conn(0x7f10800c2b80 legacy=0x7f108006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.988+0000 7f107e59c700 1 -- 172.21.15.47:0/4081129671 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1080152630 con 0x7f108014f0c0 2024-05-08T19:22:30.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.988+0000 7f107e59c700 1 --2- 172.21.15.47:0/4081129671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f108014f0c0 0x7f10800a5e40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1080070e10 tx=0x7f106800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea32a3139c4a99c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:30.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.988+0000 7f107d59a700 1 -- 172.21.15.47:0/4081129671 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106800dc70 con 0x7f108014f0c0 2024-05-08T19:22:30.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.988+0000 7f107d59a700 1 -- 172.21.15.47:0/4081129671 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106800ddd0 con 0x7f108014f0c0 2024-05-08T19:22:30.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.989+0000 7f107d59a700 1 -- 172.21.15.47:0/4081129671 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068010690 con 0x7f108014f0c0 2024-05-08T19:22:30.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.989+0000 7f1084dce700 1 -- 172.21.15.47:0/4081129671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f108014f0c0 msgr2=0x7f10800a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.989+0000 7f1084dce700 1 --2- 172.21.15.47:0/4081129671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f108014f0c0 0x7f10800a5e40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1080070e10 tx=0x7f106800be70 comp rx=0 tx=0).stop 2024-05-08T19:22:30.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.989+0000 7f1084dce700 1 -- 172.21.15.47:0/4081129671 shutdown_connections 2024-05-08T19:22:30.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.989+0000 7f1084dce700 1 --2- 172.21.15.47:0/4081129671 >> v2:172.21.15.177:3300/0 conn(0x7f1080070f80 0x7f10800713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.989+0000 7f1084dce700 1 --2- 172.21.15.47:0/4081129671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f108014f0c0 0x7f10800a5e40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.989+0000 7f1084dce700 1 -- 172.21.15.47:0/4081129671 >> 172.21.15.47:0/4081129671 conn(0x7f10800c3360 msgr2=0x7f10800c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:30.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.989+0000 7f1084dce700 1 -- 172.21.15.47:0/4081129671 shutdown_connections 2024-05-08T19:22:30.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.989+0000 7f1084dce700 1 -- 172.21.15.47:0/4081129671 wait complete. 2024-05-08T19:22:30.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.990+0000 7f1084dce700 1 Processor -- start 2024-05-08T19:22:30.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.990+0000 7f1084dce700 1 -- start start 2024-05-08T19:22:30.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f1084dce700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1080070f80 0x7f108014a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f1084dce700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10800c2b80 0x7f1080150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f1084dce700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f108014f0c0 0x7f1080142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f1084dce700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10801e61c0 con 0x7f10800c2b80 2024-05-08T19:22:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f1084dce700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10801e63d0 con 0x7f1080070f80 2024-05-08T19:22:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f1084dce700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10801e6670 con 0x7f108014f0c0 2024-05-08T19:22:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f107dd9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10800c2b80 0x7f1080150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f107dd9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10800c2b80 0x7f1080150bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57096/0 (socket says 172.21.15.47:57096) 2024-05-08T19:22:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f107dd9b700 1 -- 172.21.15.47:0/1377793554 learned_addr learned my addr 172.21.15.47:0/1377793554 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f107e59c700 1 --2- 172.21.15.47:0/1377793554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1080070f80 0x7f108014a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f107ed9d700 1 --2- 172.21.15.47:0/1377793554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f108014f0c0 0x7f1080142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f107dd9b700 1 -- 172.21.15.47:0/1377793554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f108014f0c0 msgr2=0x7f1080142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f107dd9b700 1 --2- 172.21.15.47:0/1377793554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f108014f0c0 0x7f1080142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f107dd9b700 1 -- 172.21.15.47:0/1377793554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1080070f80 msgr2=0x7f108014a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f107dd9b700 1 --2- 172.21.15.47:0/1377793554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1080070f80 0x7f108014a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f107dd9b700 1 -- 172.21.15.47:0/1377793554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106800b7f0 con 0x7f10800c2b80 2024-05-08T19:22:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f107dd9b700 1 --2- 172.21.15.47:0/1377793554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10800c2b80 0x7f1080150bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f107000c490 tx=0x7f107000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f1076ffd700 1 -- 172.21.15.47:0/1377793554 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107000cea0 con 0x7f10800c2b80 2024-05-08T19:22:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.991+0000 7f1076ffd700 1 -- 172.21.15.47:0/1377793554 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10700052f0 con 0x7f10800c2b80 2024-05-08T19:22:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.992+0000 7f1084dce700 1 -- 172.21.15.47:0/1377793554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10801e6950 con 0x7f10800c2b80 2024-05-08T19:22:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.992+0000 7f1076ffd700 1 -- 172.21.15.47:0/1377793554 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1070006860 con 0x7f10800c2b80 2024-05-08T19:22:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.992+0000 7f1084dce700 1 -- 172.21.15.47:0/1377793554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10801e6f10 con 0x7f10800c2b80 2024-05-08T19:22:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.993+0000 7f1084dce700 1 -- 172.21.15.47:0/1377793554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108004ec60 con 0x7f10800c2b80 2024-05-08T19:22:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.993+0000 7f1076ffd700 1 -- 172.21.15.47:0/1377793554 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1070003680 con 0x7f10800c2b80 2024-05-08T19:22:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.993+0000 7f1076ffd700 1 --2- 172.21.15.47:0/1377793554 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f106006ac90 0x7f106006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.993+0000 7f1076ffd700 1 -- 172.21.15.47:0/1377793554 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1070088730 con 0x7f10800c2b80 2024-05-08T19:22:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.994+0000 7f107e59c700 1 --2- 172.21.15.47:0/1377793554 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f106006ac90 0x7f106006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.994+0000 7f107e59c700 1 --2- 172.21.15.47:0/1377793554 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f106006ac90 0x7f106006d150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f106800beb0 tx=0x7f1068013000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:30.998+0000 7f1076ffd700 1 -- 172.21.15.47:0/1377793554 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f10700536b0 con 0x7f10800c2b80 2024-05-08T19:22:31.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.202+0000 7f1084dce700 1 -- 172.21.15.47:0/1377793554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f108006bff0 con 0x7f10800c2b80 2024-05-08T19:22:31.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.203+0000 7f1076ffd700 1 -- 172.21.15.47:0/1377793554 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1070056cd0 con 0x7f10800c2b80 2024-05-08T19:22:31.195 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-08T19:22:31.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.205+0000 7f1084dce700 1 -- 172.21.15.47:0/1377793554 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f106006ac90 msgr2=0x7f106006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:31.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.205+0000 7f1084dce700 1 --2- 172.21.15.47:0/1377793554 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f106006ac90 0x7f106006d150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f106800beb0 tx=0x7f1068013000 comp rx=0 tx=0).stop 2024-05-08T19:22:31.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.205+0000 7f1084dce700 1 -- 172.21.15.47:0/1377793554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10800c2b80 msgr2=0x7f1080150bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:31.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.205+0000 7f1084dce700 1 --2- 172.21.15.47:0/1377793554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10800c2b80 0x7f1080150bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f107000c490 tx=0x7f107000c7a0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.205+0000 7f1084dce700 1 -- 172.21.15.47:0/1377793554 shutdown_connections 2024-05-08T19:22:31.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.205+0000 7f1084dce700 1 --2- 172.21.15.47:0/1377793554 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f106006ac90 0x7f106006d150 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.205+0000 7f1084dce700 1 --2- 172.21.15.47:0/1377793554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f108014f0c0 0x7f1080142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.205+0000 7f1084dce700 1 --2- 172.21.15.47:0/1377793554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1080070f80 0x7f108014a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.205+0000 7f1084dce700 1 --2- 172.21.15.47:0/1377793554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10800c2b80 0x7f1080150bf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.205+0000 7f1084dce700 1 -- 172.21.15.47:0/1377793554 >> 172.21.15.47:0/1377793554 conn(0x7f10800c3360 msgr2=0x7f108014dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:31.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.205+0000 7f1084dce700 1 -- 172.21.15.47:0/1377793554 shutdown_connections 2024-05-08T19:22:31.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.205+0000 7f1084dce700 1 -- 172.21.15.47:0/1377793554 wait complete. 2024-05-08T19:22:31.209 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T19:22:31.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.346+0000 7fd803cf8700 1 Processor -- start 2024-05-08T19:22:31.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.346+0000 7fd803cf8700 1 -- start start 2024-05-08T19:22:31.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.347+0000 7fd803cf8700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd7fc0c62b0 0x7fd7fc0c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:31.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.347+0000 7fd803cf8700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7fc0c2fc0 con 0x7fd7fc152230 2024-05-08T19:22:31.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.347+0000 7fd803cf8700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7fc152610 con 0x7fd7fc070470 2024-05-08T19:22:31.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.347+0000 7fd803cf8700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7fc0c3e20 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.347+0000 7fd802295700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd7fc0c62b0 0x7fd7fc0c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:31.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.347+0000 7fd802295700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd7fc0c62b0 0x7fd7fc0c2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57098/0 (socket says 172.21.15.47:57098) 2024-05-08T19:22:31.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.347+0000 7fd802295700 1 -- 172.21.15.47:0/3022728741 learned_addr learned my addr 172.21.15.47:0/3022728741 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:31.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.347+0000 7fd801a94700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd7fc152230 0x7fd7fc0c3440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34096/0 (socket says 172.21.15.47:34096) 2024-05-08T19:22:31.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.347+0000 7fd802295700 1 -- 172.21.15.47:0/3022728741 >> v1:172.21.15.177:6789/0 conn(0x7fd7fc070470 legacy=0x7fd7fc0c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:31.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.347+0000 7fd802295700 1 -- 172.21.15.47:0/3022728741 >> v1:172.21.15.47:6789/0 conn(0x7fd7fc152230 legacy=0x7fd7fc0c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:31.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.347+0000 7fd800a92700 1 -- 172.21.15.47:0/3022728741 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183720139 0 0) 0x7fd7fc0c2fc0 con 0x7fd7fc152230 2024-05-08T19:22:31.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.347+0000 7fd802295700 1 -- 172.21.15.47:0/3022728741 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc0702a0 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.347+0000 7fd802295700 1 --2- 172.21.15.47:0/3022728741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7fc0c62b0 0x7fd7fc0c2a80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4009e50 tx=0x7fd7f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9e53b4169ba7c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:31.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.348+0000 7fd800a92700 1 -- 172.21.15.47:0/3022728741 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400e070 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.348+0000 7fd800a92700 1 -- 172.21.15.47:0/3022728741 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f4003a20 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.348+0000 7fd800a92700 1 -- 172.21.15.47:0/3022728741 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4003dd0 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.348+0000 7fd803cf8700 1 -- 172.21.15.47:0/3022728741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7fc0c62b0 msgr2=0x7fd7fc0c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:31.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.348+0000 7fd803cf8700 1 --2- 172.21.15.47:0/3022728741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7fc0c62b0 0x7fd7fc0c2a80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4009e50 tx=0x7fd7f400b330 comp rx=0 tx=0).stop 2024-05-08T19:22:31.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.348+0000 7fd803cf8700 1 -- 172.21.15.47:0/3022728741 shutdown_connections 2024-05-08T19:22:31.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.348+0000 7fd803cf8700 1 --2- 172.21.15.47:0/3022728741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7fc0c62b0 0x7fd7fc0c2a80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.348+0000 7fd803cf8700 1 -- 172.21.15.47:0/3022728741 >> 172.21.15.47:0/3022728741 conn(0x7fd7fc06b1b0 msgr2=0x7fd7fc0a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:31.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.348+0000 7fd803cf8700 1 -- 172.21.15.47:0/3022728741 shutdown_connections 2024-05-08T19:22:31.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.348+0000 7fd803cf8700 1 -- 172.21.15.47:0/3022728741 wait complete. 2024-05-08T19:22:31.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.349+0000 7fd803cf8700 1 Processor -- start 2024-05-08T19:22:31.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.349+0000 7fd803cf8700 1 -- start start 2024-05-08T19:22:31.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.350+0000 7fd803cf8700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7fc070470 0x7fd7fc06f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:31.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.350+0000 7fd803cf8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7fc0c62b0 0x7fd7fc1586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:31.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.350+0000 7fd803cf8700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7fc152230 0x7fd7fc1483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:31.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.350+0000 7fd803cf8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0addc0 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.350+0000 7fd803cf8700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0ad1b0 con 0x7fd7fc152230 2024-05-08T19:22:31.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.350+0000 7fd803cf8700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0ad490 con 0x7fd7fc070470 2024-05-08T19:22:31.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.350+0000 7fd801293700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7fc0c62b0 0x7fd7fc1586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:31.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.350+0000 7fd801293700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7fc0c62b0 0x7fd7fc1586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57104/0 (socket says 172.21.15.47:57104) 2024-05-08T19:22:31.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.350+0000 7fd801293700 1 -- 172.21.15.47:0/4117611595 learned_addr learned my addr 172.21.15.47:0/4117611595 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:31.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.350+0000 7fd802295700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7fc152230 0x7fd7fc1483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:31.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.350+0000 7fd801a94700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7fc070470 0x7fd7fc06f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:31.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.350+0000 7fd801293700 1 -- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7fc070470 msgr2=0x7fd7fc06f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:31.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.351+0000 7fd801293700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7fc070470 0x7fd7fc06f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.351+0000 7fd801293700 1 -- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7fc152230 msgr2=0x7fd7fc1483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:31.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.351+0000 7fd801293700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7fc152230 0x7fd7fc1483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.351+0000 7fd801293700 1 -- 172.21.15.47:0/4117611595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f4009b30 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.351+0000 7fd801a94700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7fc070470 0x7fd7fc06f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:31.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.351+0000 7fd802295700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7fc152230 0x7fd7fc1483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:31.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.351+0000 7fd801293700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7fc0c62b0 0x7fd7fc1586b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00c4a0 tx=0x7fd7ec00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:31.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.351+0000 7fd7f27fc700 1 -- 172.21.15.47:0/4117611595 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec011790 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.351+0000 7fd7f27fc700 1 -- 172.21.15.47:0/4117611595 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec0118f0 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.351+0000 7fd7f27fc700 1 -- 172.21.15.47:0/4117611595 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec011ca0 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.351+0000 7fd803cf8700 1 -- 172.21.15.47:0/4117611595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7fc0ad770 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.351+0000 7fd803cf8700 1 -- 172.21.15.47:0/4117611595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7fc06f590 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.352+0000 7fd803cf8700 1 -- 172.21.15.47:0/4117611595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7fc0adf30 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.352+0000 7fd7f27fc700 1 -- 172.21.15.47:0/4117611595 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd7ec01c460 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.353+0000 7fd7f27fc700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd7e006ac90 0x7fd7e006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:31.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.353+0000 7fd7f27fc700 1 -- 172.21.15.47:0/4117611595 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7ec0894b0 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.353+0000 7fd801a94700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd7e006ac90 0x7fd7e006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:31.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.354+0000 7fd801a94700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd7e006ac90 0x7fd7e006d150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8000f60 tx=0x7fd7f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:31.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.357+0000 7fd7f27fc700 1 -- 172.21.15.47:0/4117611595 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd7ec054310 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.564+0000 7fd803cf8700 1 -- 172.21.15.47:0/4117611595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd7fc04ec60 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.565+0000 7fd7f27fc700 1 -- 172.21.15.47:0/4117611595 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd7ec057930 con 0x7fd7fc0c62b0 2024-05-08T19:22:31.558 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-08T19:22:31.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.567+0000 7fd803cf8700 1 -- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd7e006ac90 msgr2=0x7fd7e006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:31.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.567+0000 7fd803cf8700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd7e006ac90 0x7fd7e006d150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8000f60 tx=0x7fd7f8009040 comp rx=0 tx=0).stop 2024-05-08T19:22:31.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.567+0000 7fd803cf8700 1 -- 172.21.15.47:0/4117611595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7fc0c62b0 msgr2=0x7fd7fc1586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:31.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.567+0000 7fd803cf8700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7fc0c62b0 0x7fd7fc1586b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00c4a0 tx=0x7fd7ec00c860 comp rx=0 tx=0).stop 2024-05-08T19:22:31.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.567+0000 7fd803cf8700 1 -- 172.21.15.47:0/4117611595 shutdown_connections 2024-05-08T19:22:31.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.567+0000 7fd803cf8700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd7e006ac90 0x7fd7e006d150 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.567+0000 7fd803cf8700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7fc152230 0x7fd7fc1483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.567+0000 7fd803cf8700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7fc070470 0x7fd7fc06f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.567+0000 7fd803cf8700 1 --2- 172.21.15.47:0/4117611595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7fc0c62b0 0x7fd7fc1586b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.567+0000 7fd803cf8700 1 -- 172.21.15.47:0/4117611595 >> 172.21.15.47:0/4117611595 conn(0x7fd7fc06b1b0 msgr2=0x7fd7fc14fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:31.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.567+0000 7fd803cf8700 1 -- 172.21.15.47:0/4117611595 shutdown_connections 2024-05-08T19:22:31.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.567+0000 7fd803cf8700 1 -- 172.21.15.47:0/4117611595 wait complete. 2024-05-08T19:22:31.571 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T19:22:31.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.707+0000 7f767c7ef700 1 Processor -- start 2024-05-08T19:22:31.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.707+0000 7f767c7ef700 1 -- start start 2024-05-08T19:22:31.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.708+0000 7f767c7ef700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7674152130 0x7f7674154de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:31.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.708+0000 7f767c7ef700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f76740c0770 0x7f7674155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:31.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.708+0000 7f767c7ef700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76740716a0 con 0x7f7674157f80 2024-05-08T19:22:31.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.708+0000 7f767c7ef700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76740c3a40 con 0x7f7674152130 2024-05-08T19:22:31.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.708+0000 7f767c7ef700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76740c11f0 con 0x7f76740c0770 2024-05-08T19:22:31.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.708+0000 7f767a58b700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7674152130 0x7f7674154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:31.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.709+0000 7f767a58b700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7674152130 0x7f7674154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57110/0 (socket says 172.21.15.47:57110) 2024-05-08T19:22:31.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.709+0000 7f767a58b700 1 -- 172.21.15.47:0/3828221315 learned_addr learned my addr 172.21.15.47:0/3828221315 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:31.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.709+0000 7f7679d8a700 1 --2- 172.21.15.47:0/3828221315 >> v2:172.21.15.177:3300/0 conn(0x7f76740c0770 0x7f7674155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:31.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.709+0000 7f767a58b700 1 -- 172.21.15.47:0/3828221315 >> v2:172.21.15.177:3300/0 conn(0x7f76740c0770 msgr2=0x7f7674155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:31.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.709+0000 7f767a58b700 1 --2- 172.21.15.47:0/3828221315 >> v2:172.21.15.177:3300/0 conn(0x7f76740c0770 0x7f7674155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.709+0000 7f767a58b700 1 -- 172.21.15.47:0/3828221315 >> v1:172.21.15.177:6789/0 conn(0x7f7674157f80 legacy=0x7f7674158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:31.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.709+0000 7f767a58b700 1 -- 172.21.15.47:0/3828221315 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767406b470 con 0x7f7674152130 2024-05-08T19:22:31.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.709+0000 7f767a58b700 1 --2- 172.21.15.47:0/3828221315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674152130 0x7f7674154de0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7674074820 tx=0x7f7664009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c721247388bb28 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:31.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.709+0000 7f7679589700 1 -- 172.21.15.47:0/3828221315 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766400b870 con 0x7f7674152130 2024-05-08T19:22:31.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.709+0000 7f7679589700 1 -- 172.21.15.47:0/3828221315 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766400b9d0 con 0x7f7674152130 2024-05-08T19:22:31.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.709+0000 7f7679589700 1 -- 172.21.15.47:0/3828221315 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766400bd60 con 0x7f7674152130 2024-05-08T19:22:31.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.710+0000 7f767c7ef700 1 -- 172.21.15.47:0/3828221315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674152130 msgr2=0x7f7674154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:31.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.710+0000 7f767c7ef700 1 --2- 172.21.15.47:0/3828221315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674152130 0x7f7674154de0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7674074820 tx=0x7f7664009bd0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.710+0000 7f767c7ef700 1 -- 172.21.15.47:0/3828221315 shutdown_connections 2024-05-08T19:22:31.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.710+0000 7f767c7ef700 1 --2- 172.21.15.47:0/3828221315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674152130 0x7f7674154de0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.710+0000 7f767c7ef700 1 --2- 172.21.15.47:0/3828221315 >> v2:172.21.15.177:3300/0 conn(0x7f76740c0770 0x7f7674155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.710+0000 7f767c7ef700 1 -- 172.21.15.47:0/3828221315 >> 172.21.15.47:0/3828221315 conn(0x7f76740c7120 msgr2=0x7f76740c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:31.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.710+0000 7f767c7ef700 1 -- 172.21.15.47:0/3828221315 shutdown_connections 2024-05-08T19:22:31.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.710+0000 7f767c7ef700 1 -- 172.21.15.47:0/3828221315 wait complete. 2024-05-08T19:22:31.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.711+0000 7f767c7ef700 1 Processor -- start 2024-05-08T19:22:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.711+0000 7f767c7ef700 1 -- start start 2024-05-08T19:22:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f767c7ef700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76740c0770 0x7f76741512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f767c7ef700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674152130 0x7f76741562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f767c7ef700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7674157f80 0x7f7674156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f767c7ef700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76741ed950 con 0x7f7674152130 2024-05-08T19:22:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f767c7ef700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76741edc30 con 0x7f76740c0770 2024-05-08T19:22:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f767c7ef700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76741edf10 con 0x7f7674157f80 2024-05-08T19:22:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f7679d8a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674152130 0x7f76741562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f7679d8a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674152130 0x7f76741562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57124/0 (socket says 172.21.15.47:57124) 2024-05-08T19:22:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f7679d8a700 1 -- 172.21.15.47:0/4053703579 learned_addr learned my addr 172.21.15.47:0/4053703579 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f767a58b700 1 --2- 172.21.15.47:0/4053703579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76740c0770 0x7f76741512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f767ad8c700 1 --2- 172.21.15.47:0/4053703579 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7674157f80 0x7f7674156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f7679d8a700 1 -- 172.21.15.47:0/4053703579 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7674157f80 msgr2=0x7f7674156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f7679d8a700 1 --2- 172.21.15.47:0/4053703579 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7674157f80 0x7f7674156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f7679d8a700 1 -- 172.21.15.47:0/4053703579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76740c0770 msgr2=0x7f76741512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f7679d8a700 1 --2- 172.21.15.47:0/4053703579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76740c0770 0x7f76741512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f7679d8a700 1 -- 172.21.15.47:0/4053703579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7664009550 con 0x7f7674152130 2024-05-08T19:22:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.712+0000 7f7679d8a700 1 --2- 172.21.15.47:0/4053703579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674152130 0x7f76741562d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f767000e810 tx=0x7f767000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.713+0000 7f766affd700 1 -- 172.21.15.47:0/4053703579 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767000c070 con 0x7f7674152130 2024-05-08T19:22:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.713+0000 7f766affd700 1 -- 172.21.15.47:0/4053703579 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7670013610 con 0x7f7674152130 2024-05-08T19:22:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.713+0000 7f767c7ef700 1 -- 172.21.15.47:0/4053703579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76741ee1f0 con 0x7f7674152130 2024-05-08T19:22:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.713+0000 7f766affd700 1 -- 172.21.15.47:0/4053703579 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76700139c0 con 0x7f7674152130 2024-05-08T19:22:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.713+0000 7f767c7ef700 1 -- 172.21.15.47:0/4053703579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7674154360 con 0x7f7674152130 2024-05-08T19:22:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.714+0000 7f767c7ef700 1 -- 172.21.15.47:0/4053703579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767404ec60 con 0x7f7674152130 2024-05-08T19:22:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.714+0000 7f766affd700 1 -- 172.21.15.47:0/4053703579 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7670013b20 con 0x7f7674152130 2024-05-08T19:22:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.715+0000 7f766affd700 1 --2- 172.21.15.47:0/4053703579 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f765806acc0 0x7f765806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:31.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.715+0000 7f766affd700 1 -- 172.21.15.47:0/4053703579 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7670089310 con 0x7f7674152130 2024-05-08T19:22:31.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.715+0000 7f767a58b700 1 --2- 172.21.15.47:0/4053703579 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f765806acc0 0x7f765806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:31.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.715+0000 7f767a58b700 1 --2- 172.21.15.47:0/4053703579 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f765806acc0 0x7f765806d180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7664000c00 tx=0x7f7664008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:31.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.719+0000 7f766affd700 1 -- 172.21.15.47:0/4053703579 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7670054210 con 0x7f7674152130 2024-05-08T19:22:31.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.926+0000 7f767c7ef700 1 -- 172.21.15.47:0/4053703579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f76740c0550 con 0x7f7674152130 2024-05-08T19:22:31.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.926+0000 7f766affd700 1 -- 172.21.15.47:0/4053703579 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7670057830 con 0x7f7674152130 2024-05-08T19:22:31.918 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-08T19:22:31.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.928+0000 7f767c7ef700 1 -- 172.21.15.47:0/4053703579 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f765806acc0 msgr2=0x7f765806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:31.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.928+0000 7f767c7ef700 1 --2- 172.21.15.47:0/4053703579 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f765806acc0 0x7f765806d180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7664000c00 tx=0x7f7664008030 comp rx=0 tx=0).stop 2024-05-08T19:22:31.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.928+0000 7f767c7ef700 1 -- 172.21.15.47:0/4053703579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674152130 msgr2=0x7f76741562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:31.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.928+0000 7f767c7ef700 1 --2- 172.21.15.47:0/4053703579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674152130 0x7f76741562d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f767000e810 tx=0x7f767000eb20 comp rx=0 tx=0).stop 2024-05-08T19:22:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.928+0000 7f767c7ef700 1 -- 172.21.15.47:0/4053703579 shutdown_connections 2024-05-08T19:22:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.928+0000 7f767c7ef700 1 --2- 172.21.15.47:0/4053703579 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f765806acc0 0x7f765806d180 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.928+0000 7f767c7ef700 1 --2- 172.21.15.47:0/4053703579 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7674157f80 0x7f7674156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.928+0000 7f767c7ef700 1 --2- 172.21.15.47:0/4053703579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76740c0770 0x7f76741512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.928+0000 7f767c7ef700 1 --2- 172.21.15.47:0/4053703579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7674152130 0x7f76741562d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.928+0000 7f767c7ef700 1 -- 172.21.15.47:0/4053703579 >> 172.21.15.47:0/4053703579 conn(0x7f76740c7120 msgr2=0x7f7674158410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.928+0000 7f767c7ef700 1 -- 172.21.15.47:0/4053703579 shutdown_connections 2024-05-08T19:22:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:31.928+0000 7f767c7ef700 1 -- 172.21.15.47:0/4053703579 wait complete. 2024-05-08T19:22:31.932 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T19:22:32.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.067+0000 7f46e1da4700 1 Processor -- start 2024-05-08T19:22:32.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.067+0000 7f46e1da4700 1 -- start start 2024-05-08T19:22:32.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.068+0000 7f46e1da4700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46dc0c1520 0x7f46dc0c1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.068+0000 7f46e1da4700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f46dc0c72d0 0x7f46dc158990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.068+0000 7f46e1da4700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46dc070b10 con 0x7f46dc1556d0 2024-05-08T19:22:32.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.068+0000 7f46e1da4700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46dc071040 con 0x7f46dc0c72d0 2024-05-08T19:22:32.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.068+0000 7f46e1da4700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc1549e0 con 0x7f46dc0c1520 2024-05-08T19:22:32.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.068+0000 7f46daffd700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f46dc0c72d0 0x7f46dc158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.068+0000 7f46daffd700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f46dc0c72d0 0x7f46dc158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57140/0 (socket says 172.21.15.47:57140) 2024-05-08T19:22:32.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.068+0000 7f46dbfff700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f46dc1556d0 0x7f46dc06c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34106/0 (socket says 172.21.15.47:34106) 2024-05-08T19:22:32.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.068+0000 7f46daffd700 1 -- 172.21.15.47:0/602099552 learned_addr learned my addr 172.21.15.47:0/602099552 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:32.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.068+0000 7f46db7fe700 1 --2- 172.21.15.47:0/602099552 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46dc0c1520 0x7f46dc0c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.069+0000 7f46da7fc700 1 -- 172.21.15.47:0/602099552 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292566865 0 0) 0x7f46dc070b10 con 0x7f46dc1556d0 2024-05-08T19:22:32.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.069+0000 7f46da7fc700 1 -- 172.21.15.47:0/602099552 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46c80035b0 con 0x7f46dc1556d0 2024-05-08T19:22:32.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.069+0000 7f46daffd700 1 -- 172.21.15.47:0/602099552 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46dc0c1520 msgr2=0x7f46dc0c1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:32.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.069+0000 7f46daffd700 1 --2- 172.21.15.47:0/602099552 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46dc0c1520 0x7f46dc0c1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.069+0000 7f46daffd700 1 -- 172.21.15.47:0/602099552 >> v1:172.21.15.47:6789/0 conn(0x7f46dc1556d0 legacy=0x7f46dc06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.069+0000 7f46daffd700 1 -- 172.21.15.47:0/602099552 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46dc155240 con 0x7f46dc0c72d0 2024-05-08T19:22:32.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.069+0000 7f46daffd700 1 --2- 172.21.15.47:0/602099552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc0c72d0 0x7f46dc158990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0098f0 tx=0x7f46cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821a9f9a3b604183 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:32.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.069+0000 7f46da7fc700 1 -- 172.21.15.47:0/602099552 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc011830 con 0x7f46dc0c72d0 2024-05-08T19:22:32.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.069+0000 7f46da7fc700 1 -- 172.21.15.47:0/602099552 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc011990 con 0x7f46dc0c72d0 2024-05-08T19:22:32.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.069+0000 7f46da7fc700 1 -- 172.21.15.47:0/602099552 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc011d20 con 0x7f46dc0c72d0 2024-05-08T19:22:32.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.070+0000 7f46e1da4700 1 -- 172.21.15.47:0/602099552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc0c72d0 msgr2=0x7f46dc158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.070+0000 7f46e1da4700 1 --2- 172.21.15.47:0/602099552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc0c72d0 0x7f46dc158990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0098f0 tx=0x7f46cc009c00 comp rx=0 tx=0).stop 2024-05-08T19:22:32.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.070+0000 7f46e1da4700 1 -- 172.21.15.47:0/602099552 shutdown_connections 2024-05-08T19:22:32.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.070+0000 7f46e1da4700 1 --2- 172.21.15.47:0/602099552 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46dc0c1520 0x7f46dc0c1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.070+0000 7f46e1da4700 1 --2- 172.21.15.47:0/602099552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc0c72d0 0x7f46dc158990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.070+0000 7f46e1da4700 1 -- 172.21.15.47:0/602099552 >> 172.21.15.47:0/602099552 conn(0x7f46dc0a9ea0 msgr2=0x7f46dc0aa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:32.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.070+0000 7f46e1da4700 1 -- 172.21.15.47:0/602099552 shutdown_connections 2024-05-08T19:22:32.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.070+0000 7f46e1da4700 1 -- 172.21.15.47:0/602099552 wait complete. 2024-05-08T19:22:32.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.071+0000 7f46e1da4700 1 Processor -- start 2024-05-08T19:22:32.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.071+0000 7f46e1da4700 1 -- start start 2024-05-08T19:22:32.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46e1da4700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46dc0c1520 0x7f46dc1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46e1da4700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46dc0c72d0 0x7f46dc1de040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46e1da4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc1556d0 0x7f46dc14e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46e1da4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc1516d0 con 0x7f46dc1556d0 2024-05-08T19:22:32.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46e1da4700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc0adb80 con 0x7f46dc0c72d0 2024-05-08T19:22:32.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46e1da4700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc0ade60 con 0x7f46dc0c1520 2024-05-08T19:22:32.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46dbfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc1556d0 0x7f46dc14e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46dbfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc1556d0 0x7f46dc14e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57144/0 (socket says 172.21.15.47:57144) 2024-05-08T19:22:32.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46dbfff700 1 -- 172.21.15.47:0/342686797 learned_addr learned my addr 172.21.15.47:0/342686797 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:32.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46db7fe700 1 --2- 172.21.15.47:0/342686797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46dc0c1520 0x7f46dc1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46daffd700 1 --2- 172.21.15.47:0/342686797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46dc0c72d0 0x7f46dc1de040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46dbfff700 1 -- 172.21.15.47:0/342686797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46dc0c1520 msgr2=0x7f46dc1509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46dbfff700 1 --2- 172.21.15.47:0/342686797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46dc0c1520 0x7f46dc1509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46dbfff700 1 -- 172.21.15.47:0/342686797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46dc0c72d0 msgr2=0x7f46dc1de040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46dbfff700 1 --2- 172.21.15.47:0/342686797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46dc0c72d0 0x7f46dc1de040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46dbfff700 1 -- 172.21.15.47:0/342686797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc009550 con 0x7f46dc1556d0 2024-05-08T19:22:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.072+0000 7f46dbfff700 1 --2- 172.21.15.47:0/342686797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc1556d0 0x7f46dc14e5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f46d400cbc0 tx=0x7f46d400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.073+0000 7f46d3fff700 1 -- 172.21.15.47:0/342686797 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d400aa40 con 0x7f46dc1556d0 2024-05-08T19:22:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.073+0000 7f46d3fff700 1 -- 172.21.15.47:0/342686797 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d400aba0 con 0x7f46dc1556d0 2024-05-08T19:22:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.073+0000 7f46d3fff700 1 -- 172.21.15.47:0/342686797 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4007070 con 0x7f46dc1556d0 2024-05-08T19:22:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.073+0000 7f46e1da4700 1 -- 172.21.15.47:0/342686797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46dc0ae140 con 0x7f46dc1556d0 2024-05-08T19:22:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.073+0000 7f46e1da4700 1 -- 172.21.15.47:0/342686797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46dc0ae420 con 0x7f46dc1556d0 2024-05-08T19:22:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.074+0000 7f46e1da4700 1 -- 172.21.15.47:0/342686797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46dc0c44f0 con 0x7f46dc1556d0 2024-05-08T19:22:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.074+0000 7f46d3fff700 1 -- 172.21.15.47:0/342686797 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f46d40071d0 con 0x7f46dc1556d0 2024-05-08T19:22:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.074+0000 7f46d3fff700 1 --2- 172.21.15.47:0/342686797 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f46bc06ac90 0x7f46bc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.075+0000 7f46d3fff700 1 -- 172.21.15.47:0/342686797 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f46d4089410 con 0x7f46dc1556d0 2024-05-08T19:22:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.075+0000 7f46db7fe700 1 --2- 172.21.15.47:0/342686797 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f46bc06ac90 0x7f46bc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.075+0000 7f46db7fe700 1 --2- 172.21.15.47:0/342686797 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f46bc06ac90 0x7f46bc06d150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009be0 tx=0x7f46c4009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:32.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.079+0000 7f46d3fff700 1 -- 172.21.15.47:0/342686797 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f46dc0c44f0 con 0x7f46dc1556d0 2024-05-08T19:22:32.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.302+0000 7f46e1da4700 1 -- 172.21.15.47:0/342686797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f46dc0c44f0 con 0x7f46dc1556d0 2024-05-08T19:22:32.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.302+0000 7f46d3fff700 1 -- 172.21.15.47:0/342686797 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f46dc0c44f0 con 0x7f46dc1556d0 2024-05-08T19:22:32.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.305+0000 7f46e1da4700 1 -- 172.21.15.47:0/342686797 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f46bc06ac90 msgr2=0x7f46bc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.305+0000 7f46e1da4700 1 --2- 172.21.15.47:0/342686797 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f46bc06ac90 0x7f46bc06d150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009be0 tx=0x7f46c4009210 comp rx=0 tx=0).stop 2024-05-08T19:22:32.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.305+0000 7f46e1da4700 1 -- 172.21.15.47:0/342686797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc1556d0 msgr2=0x7f46dc14e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.305+0000 7f46e1da4700 1 --2- 172.21.15.47:0/342686797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc1556d0 0x7f46dc14e5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f46d400cbc0 tx=0x7f46d400ced0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.305+0000 7f46e1da4700 1 -- 172.21.15.47:0/342686797 shutdown_connections 2024-05-08T19:22:32.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.305+0000 7f46e1da4700 1 --2- 172.21.15.47:0/342686797 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f46bc06ac90 0x7f46bc06d150 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.305+0000 7f46e1da4700 1 --2- 172.21.15.47:0/342686797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc1556d0 0x7f46dc14e5a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.305+0000 7f46e1da4700 1 --2- 172.21.15.47:0/342686797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46dc0c1520 0x7f46dc1509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.305+0000 7f46e1da4700 1 --2- 172.21.15.47:0/342686797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46dc0c72d0 0x7f46dc1de040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.305+0000 7f46e1da4700 1 -- 172.21.15.47:0/342686797 >> 172.21.15.47:0/342686797 conn(0x7f46dc0a9ea0 msgr2=0x7f46dc0aa280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:32.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.305+0000 7f46e1da4700 1 -- 172.21.15.47:0/342686797 shutdown_connections 2024-05-08T19:22:32.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.305+0000 7f46e1da4700 1 -- 172.21.15.47:0/342686797 wait complete. 2024-05-08T19:22:32.298 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-08T19:22:32.309 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:22:32.309 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T19:22:32.327 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:32.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.502+0000 7fb0b47af700 1 Processor -- start 2024-05-08T19:22:32.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.502+0000 7fb0b47af700 1 -- start start 2024-05-08T19:22:32.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.503+0000 7fb0b47af700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb0ac06e6e0 0x7fb0ac152170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.503+0000 7fb0b47af700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb0ac071f40 0x7fb0ac0723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.503+0000 7fb0b47af700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ac071ab0 con 0x7fb0ac06eac0 2024-05-08T19:22:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.503+0000 7fb0b47af700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ac0c1bc0 con 0x7fb0ac071f40 2024-05-08T19:22:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.503+0000 7fb0b47af700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ac1526b0 con 0x7fb0ac06e6e0 2024-05-08T19:22:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.503+0000 7fb0b1d4a700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb0ac071f40 0x7fb0ac0723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.503+0000 7fb0b2d4c700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb0ac06eac0 0x7fb0ac154ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34118/0 (socket says 172.21.15.47:34118) 2024-05-08T19:22:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.503+0000 7fb0b1d4a700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb0ac071f40 0x7fb0ac0723f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57146/0 (socket says 172.21.15.47:57146) 2024-05-08T19:22:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.503+0000 7fb0b2d4c700 1 -- 172.21.15.47:0/1033521130 learned_addr learned my addr 172.21.15.47:0/1033521130 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.503+0000 7fb0b254b700 1 --2- 172.21.15.47:0/1033521130 >> v2:172.21.15.177:3300/0 conn(0x7fb0ac06e6e0 0x7fb0ac152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.504+0000 7fb0b1d4a700 1 -- 172.21.15.47:0/1033521130 >> v2:172.21.15.177:3300/0 conn(0x7fb0ac06e6e0 msgr2=0x7fb0ac152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.504+0000 7fb0b1d4a700 1 --2- 172.21.15.47:0/1033521130 >> v2:172.21.15.177:3300/0 conn(0x7fb0ac06e6e0 0x7fb0ac152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.504+0000 7fb0b1d4a700 1 -- 172.21.15.47:0/1033521130 >> v1:172.21.15.47:6789/0 conn(0x7fb0ac06eac0 legacy=0x7fb0ac154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.504+0000 7fb0b1549700 1 -- 172.21.15.47:0/1033521130 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978846478 0 0) 0x7fb0ac071ab0 con 0x7fb0ac06eac0 2024-05-08T19:22:32.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.504+0000 7fb0b1d4a700 1 -- 172.21.15.47:0/1033521130 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac0c1e60 con 0x7fb0ac071f40 2024-05-08T19:22:32.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.504+0000 7fb0b1d4a700 1 --2- 172.21.15.47:0/1033521130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac071f40 0x7fb0ac0723f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac06cf90 tx=0x7fb0a8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36aaf048465f49d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:32.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.504+0000 7fb0b1549700 1 -- 172.21.15.47:0/1033521130 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8011830 con 0x7fb0ac071f40 2024-05-08T19:22:32.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.504+0000 7fb0b1549700 1 -- 172.21.15.47:0/1033521130 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a8011990 con 0x7fb0ac071f40 2024-05-08T19:22:32.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.504+0000 7fb0b1549700 1 -- 172.21.15.47:0/1033521130 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8011d20 con 0x7fb0ac071f40 2024-05-08T19:22:32.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.504+0000 7fb0b47af700 1 -- 172.21.15.47:0/1033521130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac071f40 msgr2=0x7fb0ac0723f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.504+0000 7fb0b47af700 1 --2- 172.21.15.47:0/1033521130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac071f40 0x7fb0ac0723f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac06cf90 tx=0x7fb0a8009b20 comp rx=0 tx=0).stop 2024-05-08T19:22:32.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.504+0000 7fb0b47af700 1 -- 172.21.15.47:0/1033521130 shutdown_connections 2024-05-08T19:22:32.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.504+0000 7fb0b47af700 1 --2- 172.21.15.47:0/1033521130 >> v2:172.21.15.177:3300/0 conn(0x7fb0ac06e6e0 0x7fb0ac152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.504+0000 7fb0b47af700 1 --2- 172.21.15.47:0/1033521130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac071f40 0x7fb0ac0723f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.505+0000 7fb0b47af700 1 -- 172.21.15.47:0/1033521130 >> 172.21.15.47:0/1033521130 conn(0x7fb0ac0c7120 msgr2=0x7fb0ac0c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:32.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.505+0000 7fb0b47af700 1 -- 172.21.15.47:0/1033521130 shutdown_connections 2024-05-08T19:22:32.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.505+0000 7fb0b47af700 1 -- 172.21.15.47:0/1033521130 wait complete. 2024-05-08T19:22:32.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.506+0000 7fb0b47af700 1 Processor -- start 2024-05-08T19:22:32.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.506+0000 7fb0b47af700 1 -- start start 2024-05-08T19:22:32.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b47af700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0ac06e6e0 0x7fb0ac1e6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b47af700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac06eac0 0x7fb0ac1e9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b47af700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0ac071f40 0x7fb0ac149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b47af700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac1ea170 con 0x7fb0ac06eac0 2024-05-08T19:22:32.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b47af700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac150c60 con 0x7fb0ac06e6e0 2024-05-08T19:22:32.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b47af700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac150f40 con 0x7fb0ac071f40 2024-05-08T19:22:32.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b1d4a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac06eac0 0x7fb0ac1e9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b1d4a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac06eac0 0x7fb0ac1e9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57152/0 (socket says 172.21.15.47:57152) 2024-05-08T19:22:32.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b1d4a700 1 -- 172.21.15.47:0/1953203025 learned_addr learned my addr 172.21.15.47:0/1953203025 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:32.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b254b700 1 --2- 172.21.15.47:0/1953203025 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0ac06e6e0 0x7fb0ac1e6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b2d4c700 1 --2- 172.21.15.47:0/1953203025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0ac071f40 0x7fb0ac149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b1d4a700 1 -- 172.21.15.47:0/1953203025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0ac071f40 msgr2=0x7fb0ac149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b1d4a700 1 --2- 172.21.15.47:0/1953203025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0ac071f40 0x7fb0ac149ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b1d4a700 1 -- 172.21.15.47:0/1953203025 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0ac06e6e0 msgr2=0x7fb0ac1e6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b1d4a700 1 --2- 172.21.15.47:0/1953203025 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0ac06e6e0 0x7fb0ac1e6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.507+0000 7fb0b1d4a700 1 -- 172.21.15.47:0/1953203025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a80094a0 con 0x7fb0ac06eac0 2024-05-08T19:22:32.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.508+0000 7fb0b1d4a700 1 --2- 172.21.15.47:0/1953203025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac06eac0 0x7fb0ac1e9c30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80090b0 tx=0x7fb0a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:32.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.508+0000 7fb0a2ffd700 1 -- 172.21.15.47:0/1953203025 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80038a0 con 0x7fb0ac06eac0 2024-05-08T19:22:32.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.508+0000 7fb0a2ffd700 1 -- 172.21.15.47:0/1953203025 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a8003a20 con 0x7fb0ac06eac0 2024-05-08T19:22:32.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.508+0000 7fb0b47af700 1 -- 172.21.15.47:0/1953203025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ac1e5f80 con 0x7fb0ac06eac0 2024-05-08T19:22:32.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.508+0000 7fb0a2ffd700 1 -- 172.21.15.47:0/1953203025 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8003dd0 con 0x7fb0ac06eac0 2024-05-08T19:22:32.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.508+0000 7fb0b47af700 1 -- 172.21.15.47:0/1953203025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ac14a430 con 0x7fb0ac06eac0 2024-05-08T19:22:32.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.509+0000 7fb0b47af700 1 -- 172.21.15.47:0/1953203025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ac04ec60 con 0x7fb0ac06eac0 2024-05-08T19:22:32.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.509+0000 7fb0a2ffd700 1 -- 172.21.15.47:0/1953203025 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb0a801a420 con 0x7fb0ac06eac0 2024-05-08T19:22:32.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.510+0000 7fb0a2ffd700 1 --2- 172.21.15.47:0/1953203025 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb09006ac90 0x7fb09006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.510+0000 7fb0a2ffd700 1 -- 172.21.15.47:0/1953203025 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb0a808a9d0 con 0x7fb0ac06eac0 2024-05-08T19:22:32.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.510+0000 7fb0b254b700 1 --2- 172.21.15.47:0/1953203025 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb09006ac90 0x7fb09006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.511+0000 7fb0b254b700 1 --2- 172.21.15.47:0/1953203025 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb09006ac90 0x7fb09006d150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009a10 tx=0x7fb09c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:32.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.514+0000 7fb0a2ffd700 1 -- 172.21.15.47:0/1953203025 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb0a8055950 con 0x7fb0ac06eac0 2024-05-08T19:22:32.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.724+0000 7fb0b47af700 1 -- 172.21.15.47:0/1953203025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0ac0c2cd0 con 0x7fb0ac06eac0 2024-05-08T19:22:32.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.725+0000 7fb0a2ffd700 1 -- 172.21.15.47:0/1953203025 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17878 (secure 0 0 0) 0x7fb0ac0c2cd0 con 0x7fb0ac06eac0 2024-05-08T19:22:32.719 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:32.719 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:24.891864+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:32.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.727+0000 7fb0b47af700 1 -- 172.21.15.47:0/1953203025 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb09006ac90 msgr2=0x7fb09006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.727+0000 7fb0b47af700 1 --2- 172.21.15.47:0/1953203025 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb09006ac90 0x7fb09006d150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009a10 tx=0x7fb09c008040 comp rx=0 tx=0).stop 2024-05-08T19:22:32.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.727+0000 7fb0b47af700 1 -- 172.21.15.47:0/1953203025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac06eac0 msgr2=0x7fb0ac1e9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.727+0000 7fb0b47af700 1 --2- 172.21.15.47:0/1953203025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac06eac0 0x7fb0ac1e9c30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80090b0 tx=0x7fb0a8004750 comp rx=0 tx=0).stop 2024-05-08T19:22:32.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.728+0000 7fb0b47af700 1 -- 172.21.15.47:0/1953203025 shutdown_connections 2024-05-08T19:22:32.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.728+0000 7fb0b47af700 1 --2- 172.21.15.47:0/1953203025 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb09006ac90 0x7fb09006d150 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.728+0000 7fb0b47af700 1 --2- 172.21.15.47:0/1953203025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0ac071f40 0x7fb0ac149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.728+0000 7fb0b47af700 1 --2- 172.21.15.47:0/1953203025 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0ac06e6e0 0x7fb0ac1e6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.728+0000 7fb0b47af700 1 --2- 172.21.15.47:0/1953203025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0ac06eac0 0x7fb0ac1e9c30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.728+0000 7fb0b47af700 1 -- 172.21.15.47:0/1953203025 >> 172.21.15.47:0/1953203025 conn(0x7fb0ac0c7120 msgr2=0x7fb0ac14d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:32.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.728+0000 7fb0b47af700 1 -- 172.21.15.47:0/1953203025 shutdown_connections 2024-05-08T19:22:32.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.728+0000 7fb0b47af700 1 -- 172.21.15.47:0/1953203025 wait complete. 2024-05-08T19:22:32.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T19:22:15.923832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T19:22:18.529792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T19:22:19.389797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T19:22:22.474001+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T19:22:32.733 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T19:22:32.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.869+0000 7f4e9bb2e700 1 Processor -- start 2024-05-08T19:22:32.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.869+0000 7f4e9bb2e700 1 -- start start 2024-05-08T19:22:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.870+0000 7f4e9bb2e700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4e941526f0 0x7f4e9406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.870+0000 7f4e9bb2e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e9406bf10 0x7f4e940c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.870+0000 7f4e9bb2e700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e940ab720 con 0x7f4e940c2be0 2024-05-08T19:22:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.870+0000 7f4e9bb2e700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e940aba00 con 0x7f4e941526f0 2024-05-08T19:22:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.870+0000 7f4e9bb2e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940abce0 con 0x7f4e9406bf10 2024-05-08T19:22:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.870+0000 7f4e990c9700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4e941526f0 0x7f4e9406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.870+0000 7f4e998ca700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4e940c2be0 0x7f4e940aae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34122/0 (socket says 172.21.15.47:34122) 2024-05-08T19:22:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.870+0000 7f4e998ca700 1 -- 172.21.15.47:0/886553571 learned_addr learned my addr 172.21.15.47:0/886553571 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.870+0000 7f4e9a0cb700 1 --2- 172.21.15.47:0/886553571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e9406bf10 0x7f4e940c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.870+0000 7f4e990c9700 1 -- 172.21.15.47:0/886553571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e9406bf10 msgr2=0x7f4e940c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.870+0000 7f4e990c9700 1 --2- 172.21.15.47:0/886553571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e9406bf10 0x7f4e940c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.870+0000 7f4e990c9700 1 -- 172.21.15.47:0/886553571 >> v1:172.21.15.47:6789/0 conn(0x7f4e940c2be0 legacy=0x7f4e940aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.870+0000 7f4e990c9700 1 -- 172.21.15.47:0/886553571 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940c4760 con 0x7f4e941526f0 2024-05-08T19:22:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.870+0000 7f4e988c8700 1 -- 172.21.15.47:0/886553571 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426021183 0 0) 0x7f4e940ab720 con 0x7f4e940c2be0 2024-05-08T19:22:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.870+0000 7f4e990c9700 1 --2- 172.21.15.47:0/886553571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e941526f0 0x7f4e9406b9d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009840 tx=0x7f4e84009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abee59a2aad2db8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.871+0000 7f4e988c8700 1 -- 172.21.15.47:0/886553571 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84011830 con 0x7f4e941526f0 2024-05-08T19:22:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.871+0000 7f4e988c8700 1 -- 172.21.15.47:0/886553571 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e84011990 con 0x7f4e941526f0 2024-05-08T19:22:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.871+0000 7f4e988c8700 1 -- 172.21.15.47:0/886553571 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84011d20 con 0x7f4e941526f0 2024-05-08T19:22:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.871+0000 7f4e9bb2e700 1 -- 172.21.15.47:0/886553571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e941526f0 msgr2=0x7f4e9406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.871+0000 7f4e9bb2e700 1 --2- 172.21.15.47:0/886553571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e941526f0 0x7f4e9406b9d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009840 tx=0x7f4e84009b50 comp rx=0 tx=0).stop 2024-05-08T19:22:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.871+0000 7f4e9bb2e700 1 -- 172.21.15.47:0/886553571 shutdown_connections 2024-05-08T19:22:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.871+0000 7f4e9bb2e700 1 --2- 172.21.15.47:0/886553571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e9406bf10 0x7f4e940c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.871+0000 7f4e9bb2e700 1 --2- 172.21.15.47:0/886553571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e941526f0 0x7f4e9406b9d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.871+0000 7f4e9bb2e700 1 -- 172.21.15.47:0/886553571 >> 172.21.15.47:0/886553571 conn(0x7f4e940c3360 msgr2=0x7f4e940c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.871+0000 7f4e9bb2e700 1 -- 172.21.15.47:0/886553571 shutdown_connections 2024-05-08T19:22:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.871+0000 7f4e9bb2e700 1 -- 172.21.15.47:0/886553571 wait complete. 2024-05-08T19:22:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.873+0000 7f4e9bb2e700 1 Processor -- start 2024-05-08T19:22:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.873+0000 7f4e9bb2e700 1 -- start start 2024-05-08T19:22:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e9bb2e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e9406bf10 0x7f4e940a6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e9bb2e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e940c2be0 0x7f4e941d88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e9bb2e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e941526f0 0x7f4e941d8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e9bb2e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940bfdc0 con 0x7f4e940c2be0 2024-05-08T19:22:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e9bb2e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e941ebb00 con 0x7f4e941526f0 2024-05-08T19:22:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e9bb2e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e941ec030 con 0x7f4e9406bf10 2024-05-08T19:22:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e990c9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e940c2be0 0x7f4e941d88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e990c9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e940c2be0 0x7f4e941d88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57178/0 (socket says 172.21.15.47:57178) 2024-05-08T19:22:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e990c9700 1 -- 172.21.15.47:0/2367727523 learned_addr learned my addr 172.21.15.47:0/2367727523 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e998ca700 1 --2- 172.21.15.47:0/2367727523 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e9406bf10 0x7f4e940a6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e9a0cb700 1 --2- 172.21.15.47:0/2367727523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e941526f0 0x7f4e941d8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e990c9700 1 -- 172.21.15.47:0/2367727523 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e9406bf10 msgr2=0x7f4e940a6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e990c9700 1 --2- 172.21.15.47:0/2367727523 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e9406bf10 0x7f4e940a6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e990c9700 1 -- 172.21.15.47:0/2367727523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e941526f0 msgr2=0x7f4e941d8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:32.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e990c9700 1 --2- 172.21.15.47:0/2367727523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e941526f0 0x7f4e941d8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:32.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e990c9700 1 -- 172.21.15.47:0/2367727523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e840094a0 con 0x7f4e940c2be0 2024-05-08T19:22:32.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.874+0000 7f4e990c9700 1 --2- 172.21.15.47:0/2367727523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e940c2be0 0x7f4e941d88f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4e84014040 tx=0x7f4e84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:32.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.875+0000 7f4e8a7fc700 1 -- 172.21.15.47:0/2367727523 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840036a0 con 0x7f4e940c2be0 2024-05-08T19:22:32.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.875+0000 7f4e8a7fc700 1 -- 172.21.15.47:0/2367727523 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8401f070 con 0x7f4e940c2be0 2024-05-08T19:22:32.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.875+0000 7f4e9bb2e700 1 -- 172.21.15.47:0/2367727523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e941ebd50 con 0x7f4e940c2be0 2024-05-08T19:22:32.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.875+0000 7f4e8a7fc700 1 -- 172.21.15.47:0/2367727523 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84003a60 con 0x7f4e940c2be0 2024-05-08T19:22:32.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.875+0000 7f4e9bb2e700 1 -- 172.21.15.47:0/2367727523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e941db590 con 0x7f4e940c2be0 2024-05-08T19:22:32.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.876+0000 7f4e9bb2e700 1 -- 172.21.15.47:0/2367727523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e940bff00 con 0x7f4e940c2be0 2024-05-08T19:22:32.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.876+0000 7f4e8a7fc700 1 -- 172.21.15.47:0/2367727523 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4e84003bc0 con 0x7f4e940c2be0 2024-05-08T19:22:32.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.876+0000 7f4e8a7fc700 1 --2- 172.21.15.47:0/2367727523 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f4e7806ac90 0x7f4e7806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:32.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.877+0000 7f4e8a7fc700 1 -- 172.21.15.47:0/2367727523 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e84021070 con 0x7f4e940c2be0 2024-05-08T19:22:32.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.877+0000 7f4e998ca700 1 --2- 172.21.15.47:0/2367727523 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f4e7806ac90 0x7f4e7806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:32.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.877+0000 7f4e998ca700 1 --2- 172.21.15.47:0/2367727523 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f4e7806ac90 0x7f4e7806d150 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4e90007fd0 tx=0x7f4e90007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:32.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:32.881+0000 7f4e8a7fc700 1 -- 172.21.15.47:0/2367727523 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4e84055ba0 con 0x7f4e940c2be0 2024-05-08T19:22:33.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.085+0000 7f4e9bb2e700 1 -- 172.21.15.47:0/2367727523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e9404ec60 con 0x7f4e940c2be0 2024-05-08T19:22:33.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.086+0000 7f4e8a7fc700 1 -- 172.21.15.47:0/2367727523 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e840591c0 con 0x7f4e940c2be0 2024-05-08T19:22:33.078 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-08T19:22:33.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.088+0000 7f4e9bb2e700 1 -- 172.21.15.47:0/2367727523 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f4e7806ac90 msgr2=0x7f4e7806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.088+0000 7f4e9bb2e700 1 --2- 172.21.15.47:0/2367727523 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f4e7806ac90 0x7f4e7806d150 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4e90007fd0 tx=0x7f4e90007de0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.088+0000 7f4e9bb2e700 1 -- 172.21.15.47:0/2367727523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e940c2be0 msgr2=0x7f4e941d88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.088+0000 7f4e9bb2e700 1 --2- 172.21.15.47:0/2367727523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e940c2be0 0x7f4e941d88f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4e84014040 tx=0x7f4e84004750 comp rx=0 tx=0).stop 2024-05-08T19:22:33.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.088+0000 7f4e9bb2e700 1 -- 172.21.15.47:0/2367727523 shutdown_connections 2024-05-08T19:22:33.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.088+0000 7f4e9bb2e700 1 --2- 172.21.15.47:0/2367727523 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f4e7806ac90 0x7f4e7806d150 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.088+0000 7f4e9bb2e700 1 --2- 172.21.15.47:0/2367727523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e941526f0 0x7f4e941d8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.088+0000 7f4e9bb2e700 1 --2- 172.21.15.47:0/2367727523 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e9406bf10 0x7f4e940a6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.088+0000 7f4e9bb2e700 1 --2- 172.21.15.47:0/2367727523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e940c2be0 0x7f4e941d88f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.088+0000 7f4e9bb2e700 1 -- 172.21.15.47:0/2367727523 >> 172.21.15.47:0/2367727523 conn(0x7f4e940c3360 msgr2=0x7f4e940c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:33.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.088+0000 7f4e9bb2e700 1 -- 172.21.15.47:0/2367727523 shutdown_connections 2024-05-08T19:22:33.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.088+0000 7f4e9bb2e700 1 -- 172.21.15.47:0/2367727523 wait complete. 2024-05-08T19:22:33.092 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T19:22:33.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.228+0000 7f0b16547700 1 Processor -- start 2024-05-08T19:22:33.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.228+0000 7f0b16547700 1 -- start start 2024-05-08T19:22:33.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.229+0000 7f0b16547700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0b100c36b0 0x7f0b1014b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.229+0000 7f0b16547700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b1014bb30 0x7f0b1006e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.229+0000 7f0b16547700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b100c2030 con 0x7f0b10071910 2024-05-08T19:22:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.229+0000 7f0b16547700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b10072400 con 0x7f0b100c36b0 2024-05-08T19:22:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.229+0000 7f0b16547700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b10152230 con 0x7f0b1014bb30 2024-05-08T19:22:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.229+0000 7f0b0f7fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0b100c36b0 0x7f0b1014b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.229+0000 7f0b0f7fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0b100c36b0 0x7f0b1014b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57192/0 (socket says 172.21.15.47:57192) 2024-05-08T19:22:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.229+0000 7f0b0f7fe700 1 -- 172.21.15.47:0/2484688829 learned_addr learned my addr 172.21.15.47:0/2484688829 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.229+0000 7f0b14ae4700 1 --2- 172.21.15.47:0/2484688829 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b1014bb30 0x7f0b1006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.229+0000 7f0b0f7fe700 1 -- 172.21.15.47:0/2484688829 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b1014bb30 msgr2=0x7f0b1006e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.229+0000 7f0b0f7fe700 1 --2- 172.21.15.47:0/2484688829 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b1014bb30 0x7f0b1006e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.229+0000 7f0b0f7fe700 1 -- 172.21.15.47:0/2484688829 >> v1:172.21.15.177:6789/0 conn(0x7f0b10071910 legacy=0x7f0b10071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.229+0000 7f0b0f7fe700 1 -- 172.21.15.47:0/2484688829 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b10152510 con 0x7f0b100c36b0 2024-05-08T19:22:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.229+0000 7f0b0f7fe700 1 --2- 172.21.15.47:0/2484688829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b100c36b0 0x7f0b1014b5f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0b040098f0 tx=0x7f0b04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b326349f55fb998f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:33.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.229+0000 7f0b0effd700 1 -- 172.21.15.47:0/2484688829 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04011830 con 0x7f0b100c36b0 2024-05-08T19:22:33.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.230+0000 7f0b0effd700 1 -- 172.21.15.47:0/2484688829 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b04011990 con 0x7f0b100c36b0 2024-05-08T19:22:33.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.230+0000 7f0b0effd700 1 -- 172.21.15.47:0/2484688829 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04011d20 con 0x7f0b100c36b0 2024-05-08T19:22:33.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.230+0000 7f0b16547700 1 -- 172.21.15.47:0/2484688829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b100c36b0 msgr2=0x7f0b1014b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.230+0000 7f0b16547700 1 --2- 172.21.15.47:0/2484688829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b100c36b0 0x7f0b1014b5f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0b040098f0 tx=0x7f0b04009c00 comp rx=0 tx=0).stop 2024-05-08T19:22:33.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.230+0000 7f0b16547700 1 -- 172.21.15.47:0/2484688829 shutdown_connections 2024-05-08T19:22:33.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.230+0000 7f0b16547700 1 --2- 172.21.15.47:0/2484688829 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b1014bb30 0x7f0b1006e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.230+0000 7f0b16547700 1 --2- 172.21.15.47:0/2484688829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b100c36b0 0x7f0b1014b5f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.230+0000 7f0b16547700 1 -- 172.21.15.47:0/2484688829 >> 172.21.15.47:0/2484688829 conn(0x7f0b100c7120 msgr2=0x7f0b100c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:33.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.230+0000 7f0b16547700 1 -- 172.21.15.47:0/2484688829 shutdown_connections 2024-05-08T19:22:33.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.230+0000 7f0b16547700 1 -- 172.21.15.47:0/2484688829 wait complete. 2024-05-08T19:22:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.231+0000 7f0b16547700 1 Processor -- start 2024-05-08T19:22:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.231+0000 7f0b16547700 1 -- start start 2024-05-08T19:22:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.232+0000 7f0b16547700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b10071910 0x7f0b101edef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.232+0000 7f0b16547700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b100c36b0 0x7f0b101eb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.232+0000 7f0b16547700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b1014bb30 0x7f0b101446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.232+0000 7f0b16547700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b101dbd60 con 0x7f0b100c36b0 2024-05-08T19:22:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.232+0000 7f0b16547700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b101ee430 con 0x7f0b1014bb30 2024-05-08T19:22:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.232+0000 7f0b16547700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b101eb960 con 0x7f0b10071910 2024-05-08T19:22:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.232+0000 7f0b0f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b100c36b0 0x7f0b101eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.232+0000 7f0b0f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b100c36b0 0x7f0b101eb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57204/0 (socket says 172.21.15.47:57204) 2024-05-08T19:22:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.232+0000 7f0b0f7fe700 1 -- 172.21.15.47:0/3558178592 learned_addr learned my addr 172.21.15.47:0/3558178592 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.232+0000 7f0b14ae4700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b1014bb30 0x7f0b101446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.232+0000 7f0b0ffff700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b10071910 0x7f0b101edef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.232+0000 7f0b0f7fe700 1 -- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b10071910 msgr2=0x7f0b101edef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.233+0000 7f0b0f7fe700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b10071910 0x7f0b101edef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.233+0000 7f0b0f7fe700 1 -- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b1014bb30 msgr2=0x7f0b101446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.233+0000 7f0b0f7fe700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b1014bb30 0x7f0b101446a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.233+0000 7f0b0f7fe700 1 -- 172.21.15.47:0/3558178592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b04009550 con 0x7f0b100c36b0 2024-05-08T19:22:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.233+0000 7f0b14ae4700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b1014bb30 0x7f0b101446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.233+0000 7f0b0ffff700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b10071910 0x7f0b101edef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.233+0000 7f0b0f7fe700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b100c36b0 0x7f0b101eb420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b04000c00 tx=0x7f0b04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.233+0000 7f0b0cff9700 1 -- 172.21.15.47:0/3558178592 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04004570 con 0x7f0b100c36b0 2024-05-08T19:22:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.233+0000 7f0b0cff9700 1 -- 172.21.15.47:0/3558178592 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0401f070 con 0x7f0b100c36b0 2024-05-08T19:22:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.233+0000 7f0b16547700 1 -- 172.21.15.47:0/3558178592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b101dc570 con 0x7f0b100c36b0 2024-05-08T19:22:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.233+0000 7f0b0cff9700 1 -- 172.21.15.47:0/3558178592 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b040038c0 con 0x7f0b100c36b0 2024-05-08T19:22:33.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.233+0000 7f0b16547700 1 -- 172.21.15.47:0/3558178592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b101dbfb0 con 0x7f0b100c36b0 2024-05-08T19:22:33.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.234+0000 7f0b16547700 1 -- 172.21.15.47:0/3558178592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1004ec60 con 0x7f0b100c36b0 2024-05-08T19:22:33.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.234+0000 7f0b0cff9700 1 -- 172.21.15.47:0/3558178592 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0b04021030 con 0x7f0b100c36b0 2024-05-08T19:22:33.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.235+0000 7f0b0cff9700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0afc06ac90 0x7f0afc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.235+0000 7f0b0cff9700 1 -- 172.21.15.47:0/3558178592 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b0408aae0 con 0x7f0b100c36b0 2024-05-08T19:22:33.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.235+0000 7f0b0ffff700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0afc06ac90 0x7f0afc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.235+0000 7f0b0ffff700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0afc06ac90 0x7f0afc06d150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b00000f60 tx=0x7f0b00009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:33.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.239+0000 7f0b0cff9700 1 -- 172.21.15.47:0/3558178592 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0b04055b00 con 0x7f0b100c36b0 2024-05-08T19:22:33.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.444+0000 7f0b16547700 1 -- 172.21.15.47:0/3558178592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b10145360 con 0x7f0b100c36b0 2024-05-08T19:22:33.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.445+0000 7f0b0cff9700 1 -- 172.21.15.47:0/3558178592 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0b040150a0 con 0x7f0b100c36b0 2024-05-08T19:22:33.437 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-08T19:22:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.447+0000 7f0b16547700 1 -- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0afc06ac90 msgr2=0x7f0afc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.447+0000 7f0b16547700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0afc06ac90 0x7f0afc06d150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b00000f60 tx=0x7f0b00009040 comp rx=0 tx=0).stop 2024-05-08T19:22:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.447+0000 7f0b16547700 1 -- 172.21.15.47:0/3558178592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b100c36b0 msgr2=0x7f0b101eb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.447+0000 7f0b16547700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b100c36b0 0x7f0b101eb420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b04000c00 tx=0x7f0b04004750 comp rx=0 tx=0).stop 2024-05-08T19:22:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.447+0000 7f0b16547700 1 -- 172.21.15.47:0/3558178592 shutdown_connections 2024-05-08T19:22:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.447+0000 7f0b16547700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0afc06ac90 0x7f0afc06d150 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.447+0000 7f0b16547700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b1014bb30 0x7f0b101446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.447+0000 7f0b16547700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0b10071910 0x7f0b101edef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.447+0000 7f0b16547700 1 --2- 172.21.15.47:0/3558178592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b100c36b0 0x7f0b101eb420 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.447+0000 7f0b16547700 1 -- 172.21.15.47:0/3558178592 >> 172.21.15.47:0/3558178592 conn(0x7f0b100c7120 msgr2=0x7f0b1006b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.447+0000 7f0b16547700 1 -- 172.21.15.47:0/3558178592 shutdown_connections 2024-05-08T19:22:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.447+0000 7f0b16547700 1 -- 172.21.15.47:0/3558178592 wait complete. 2024-05-08T19:22:33.451 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T19:22:33.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.587+0000 7fa48d4dd700 1 Processor -- start 2024-05-08T19:22:33.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.587+0000 7fa48d4dd700 1 -- start start 2024-05-08T19:22:33.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.588+0000 7fa48d4dd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4880c37f0 0x7fa488071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.588+0000 7fa48d4dd700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa488151690 0x7fa488151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.588+0000 7fa48d4dd700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa488155830 con 0x7fa48814ebe0 2024-05-08T19:22:33.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.588+0000 7fa48d4dd700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4880c1c60 con 0x7fa488151690 2024-05-08T19:22:33.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.588+0000 7fa48d4dd700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa488072bc0 con 0x7fa4880c37f0 2024-05-08T19:22:33.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.588+0000 7fa4877fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa488151690 0x7fa488151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.588+0000 7fa486ffd700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa48814ebe0 0x7fa4880716f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34126/0 (socket says 172.21.15.47:34126) 2024-05-08T19:22:33.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.588+0000 7fa4877fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa488151690 0x7fa488151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57210/0 (socket says 172.21.15.47:57210) 2024-05-08T19:22:33.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.588+0000 7fa486ffd700 1 -- 172.21.15.47:0/3985057341 learned_addr learned my addr 172.21.15.47:0/3985057341 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:33.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.588+0000 7fa4867fc700 1 --2- 172.21.15.47:0/3985057341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4880c37f0 0x7fa488071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.589+0000 7fa4877fe700 1 -- 172.21.15.47:0/3985057341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4880c37f0 msgr2=0x7fa488071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:33.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.589+0000 7fa4877fe700 1 --2- 172.21.15.47:0/3985057341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4880c37f0 0x7fa488071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.589+0000 7fa4877fe700 1 -- 172.21.15.47:0/3985057341 >> v1:172.21.15.47:6789/0 conn(0x7fa48814ebe0 legacy=0x7fa4880716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.589+0000 7fa4877fe700 1 -- 172.21.15.47:0/3985057341 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa488155b10 con 0x7fa488151690 2024-05-08T19:22:33.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.589+0000 7fa485ffb700 1 -- 172.21.15.47:0/3985057341 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582609277 0 0) 0x7fa488155830 con 0x7fa48814ebe0 2024-05-08T19:22:33.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.589+0000 7fa4877fe700 1 --2- 172.21.15.47:0/3985057341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa488151690 0x7fa488151b00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa480009d90 tx=0x7fa48000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fb1d53449aab76 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:33.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.589+0000 7fa485ffb700 1 -- 172.21.15.47:0/3985057341 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000e070 con 0x7fa488151690 2024-05-08T19:22:33.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.589+0000 7fa485ffb700 1 -- 172.21.15.47:0/3985057341 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48000bbd0 con 0x7fa488151690 2024-05-08T19:22:33.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.589+0000 7fa485ffb700 1 -- 172.21.15.47:0/3985057341 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480012430 con 0x7fa488151690 2024-05-08T19:22:33.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.589+0000 7fa48d4dd700 1 -- 172.21.15.47:0/3985057341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa488151690 msgr2=0x7fa488151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.589+0000 7fa48d4dd700 1 --2- 172.21.15.47:0/3985057341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa488151690 0x7fa488151b00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa480009d90 tx=0x7fa48000b330 comp rx=0 tx=0).stop 2024-05-08T19:22:33.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.589+0000 7fa48d4dd700 1 -- 172.21.15.47:0/3985057341 shutdown_connections 2024-05-08T19:22:33.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.589+0000 7fa48d4dd700 1 --2- 172.21.15.47:0/3985057341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa488151690 0x7fa488151b00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.589+0000 7fa48d4dd700 1 --2- 172.21.15.47:0/3985057341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4880c37f0 0x7fa488071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.590+0000 7fa48d4dd700 1 -- 172.21.15.47:0/3985057341 >> 172.21.15.47:0/3985057341 conn(0x7fa4880c71c0 msgr2=0x7fa4880c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:33.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.590+0000 7fa48d4dd700 1 -- 172.21.15.47:0/3985057341 shutdown_connections 2024-05-08T19:22:33.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.590+0000 7fa48d4dd700 1 -- 172.21.15.47:0/3985057341 wait complete. 2024-05-08T19:22:33.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.591+0000 7fa48d4dd700 1 Processor -- start 2024-05-08T19:22:33.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.591+0000 7fa48d4dd700 1 -- start start 2024-05-08T19:22:33.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa48d4dd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4880c37f0 0x7fa4880c0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa48d4dd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa48814ebe0 0x7fa4880c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa48d4dd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa488151690 0x7fa4880c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa48d4dd700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa488149990 con 0x7fa488151690 2024-05-08T19:22:33.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa48d4dd700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa488153be0 con 0x7fa4880c37f0 2024-05-08T19:22:33.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa48d4dd700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa488153ec0 con 0x7fa48814ebe0 2024-05-08T19:22:33.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa4877fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa488151690 0x7fa4880c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa4877fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa488151690 0x7fa4880c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57224/0 (socket says 172.21.15.47:57224) 2024-05-08T19:22:33.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa4877fe700 1 -- 172.21.15.47:0/2243526701 learned_addr learned my addr 172.21.15.47:0/2243526701 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:33.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa486ffd700 1 --2- 172.21.15.47:0/2243526701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4880c37f0 0x7fa4880c0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa4867fc700 1 --2- 172.21.15.47:0/2243526701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa48814ebe0 0x7fa4880c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa4877fe700 1 -- 172.21.15.47:0/2243526701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa48814ebe0 msgr2=0x7fa4880c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa4877fe700 1 --2- 172.21.15.47:0/2243526701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa48814ebe0 0x7fa4880c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa4877fe700 1 -- 172.21.15.47:0/2243526701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4880c37f0 msgr2=0x7fa4880c0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa4877fe700 1 --2- 172.21.15.47:0/2243526701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4880c37f0 0x7fa4880c0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa4877fe700 1 -- 172.21.15.47:0/2243526701 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa480009a70 con 0x7fa488151690 2024-05-08T19:22:33.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa4877fe700 1 --2- 172.21.15.47:0/2243526701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa488151690 0x7fa4880c5500 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa488074170 tx=0x7fa480004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:33.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.592+0000 7fa46f7fe700 1 -- 172.21.15.47:0/2243526701 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480012430 con 0x7fa488151690 2024-05-08T19:22:33.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.593+0000 7fa46f7fe700 1 -- 172.21.15.47:0/2243526701 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa480020070 con 0x7fa488151690 2024-05-08T19:22:33.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.593+0000 7fa48d4dd700 1 -- 172.21.15.47:0/2243526701 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4881541a0 con 0x7fa488151690 2024-05-08T19:22:33.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.593+0000 7fa46f7fe700 1 -- 172.21.15.47:0/2243526701 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480004280 con 0x7fa488151690 2024-05-08T19:22:33.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.593+0000 7fa48d4dd700 1 -- 172.21.15.47:0/2243526701 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4880c0da0 con 0x7fa488151690 2024-05-08T19:22:33.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.594+0000 7fa48d4dd700 1 -- 172.21.15.47:0/2243526701 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4881546c0 con 0x7fa488151690 2024-05-08T19:22:33.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.594+0000 7fa46f7fe700 1 -- 172.21.15.47:0/2243526701 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa4800043e0 con 0x7fa488151690 2024-05-08T19:22:33.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.595+0000 7fa46f7fe700 1 --2- 172.21.15.47:0/2243526701 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa47406ac90 0x7fa47406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.595+0000 7fa46f7fe700 1 -- 172.21.15.47:0/2243526701 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa480022070 con 0x7fa488151690 2024-05-08T19:22:33.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.595+0000 7fa486ffd700 1 --2- 172.21.15.47:0/2243526701 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa47406ac90 0x7fa47406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.595+0000 7fa486ffd700 1 --2- 172.21.15.47:0/2243526701 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa47406ac90 0x7fa47406d150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa47c007fd0 tx=0x7fa47c007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:33.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.599+0000 7fa46f7fe700 1 -- 172.21.15.47:0/2243526701 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa4881546c0 con 0x7fa488151690 2024-05-08T19:22:33.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.805+0000 7fa48d4dd700 1 -- 172.21.15.47:0/2243526701 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4881546c0 con 0x7fa488151690 2024-05-08T19:22:33.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.805+0000 7fa46f7fe700 1 -- 172.21.15.47:0/2243526701 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa4881546c0 con 0x7fa488151690 2024-05-08T19:22:33.797 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-08T19:22:33.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.807+0000 7fa48d4dd700 1 -- 172.21.15.47:0/2243526701 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa47406ac90 msgr2=0x7fa47406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.807+0000 7fa48d4dd700 1 --2- 172.21.15.47:0/2243526701 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa47406ac90 0x7fa47406d150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa47c007fd0 tx=0x7fa47c007de0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.807+0000 7fa48d4dd700 1 -- 172.21.15.47:0/2243526701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa488151690 msgr2=0x7fa4880c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.807+0000 7fa48d4dd700 1 --2- 172.21.15.47:0/2243526701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa488151690 0x7fa4880c5500 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa488074170 tx=0x7fa480004ad0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.807+0000 7fa48d4dd700 1 -- 172.21.15.47:0/2243526701 shutdown_connections 2024-05-08T19:22:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.807+0000 7fa48d4dd700 1 --2- 172.21.15.47:0/2243526701 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa47406ac90 0x7fa47406d150 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.807+0000 7fa48d4dd700 1 --2- 172.21.15.47:0/2243526701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa488151690 0x7fa4880c5500 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.807+0000 7fa48d4dd700 1 --2- 172.21.15.47:0/2243526701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4880c37f0 0x7fa4880c0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.807+0000 7fa48d4dd700 1 --2- 172.21.15.47:0/2243526701 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa48814ebe0 0x7fa4880c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.807+0000 7fa48d4dd700 1 -- 172.21.15.47:0/2243526701 >> 172.21.15.47:0/2243526701 conn(0x7fa4880c71c0 msgr2=0x7fa4880a8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.807+0000 7fa48d4dd700 1 -- 172.21.15.47:0/2243526701 shutdown_connections 2024-05-08T19:22:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.807+0000 7fa48d4dd700 1 -- 172.21.15.47:0/2243526701 wait complete. 2024-05-08T19:22:33.811 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T19:22:33.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.949+0000 7fed2bc2a700 1 Processor -- start 2024-05-08T19:22:33.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.949+0000 7fed2bc2a700 1 -- start start 2024-05-08T19:22:33.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed2bc2a700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed2414ebe0 0x7fed240716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed2bc2a700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fed24151690 0x7fed24151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed2bc2a700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed24155830 con 0x7fed240c37f0 2024-05-08T19:22:33.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed2bc2a700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed240c1c60 con 0x7fed24151690 2024-05-08T19:22:33.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed2bc2a700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed24072bc0 con 0x7fed2414ebe0 2024-05-08T19:22:33.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed2a1c7700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fed24151690 0x7fed24151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed2a1c7700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fed24151690 0x7fed24151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57238/0 (socket says 172.21.15.47:57238) 2024-05-08T19:22:33.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed2a1c7700 1 -- 172.21.15.47:0/2581304802 learned_addr learned my addr 172.21.15.47:0/2581304802 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:33.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed299c6700 1 --2- 172.21.15.47:0/2581304802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed2414ebe0 0x7fed240716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed2a1c7700 1 -- 172.21.15.47:0/2581304802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed2414ebe0 msgr2=0x7fed240716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:33.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed2a1c7700 1 --2- 172.21.15.47:0/2581304802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed2414ebe0 0x7fed240716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed2a1c7700 1 -- 172.21.15.47:0/2581304802 >> v1:172.21.15.177:6789/0 conn(0x7fed240c37f0 legacy=0x7fed24071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed2a1c7700 1 -- 172.21.15.47:0/2581304802 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed24155b10 con 0x7fed24151690 2024-05-08T19:22:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed299c6700 1 --2- 172.21.15.47:0/2581304802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed2414ebe0 0x7fed240716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed2a1c7700 1 --2- 172.21.15.47:0/2581304802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed24151690 0x7fed24151b00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009e50 tx=0x7fed1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a114b628294e704 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed289c4700 1 -- 172.21.15.47:0/2581304802 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c00e070 con 0x7fed24151690 2024-05-08T19:22:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed289c4700 1 -- 172.21.15.47:0/2581304802 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c003a20 con 0x7fed24151690 2024-05-08T19:22:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.950+0000 7fed289c4700 1 -- 172.21.15.47:0/2581304802 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c003dd0 con 0x7fed24151690 2024-05-08T19:22:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.951+0000 7fed2bc2a700 1 -- 172.21.15.47:0/2581304802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed24151690 msgr2=0x7fed24151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.951+0000 7fed2bc2a700 1 --2- 172.21.15.47:0/2581304802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed24151690 0x7fed24151b00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009e50 tx=0x7fed1c00b330 comp rx=0 tx=0).stop 2024-05-08T19:22:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.951+0000 7fed2bc2a700 1 -- 172.21.15.47:0/2581304802 shutdown_connections 2024-05-08T19:22:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.951+0000 7fed2bc2a700 1 --2- 172.21.15.47:0/2581304802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed24151690 0x7fed24151b00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.951+0000 7fed2bc2a700 1 --2- 172.21.15.47:0/2581304802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed2414ebe0 0x7fed240716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.951+0000 7fed2bc2a700 1 -- 172.21.15.47:0/2581304802 >> 172.21.15.47:0/2581304802 conn(0x7fed240c71c0 msgr2=0x7fed240c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:33.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.951+0000 7fed2bc2a700 1 -- 172.21.15.47:0/2581304802 shutdown_connections 2024-05-08T19:22:33.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.951+0000 7fed2bc2a700 1 -- 172.21.15.47:0/2581304802 wait complete. 2024-05-08T19:22:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.952+0000 7fed2bc2a700 1 Processor -- start 2024-05-08T19:22:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.952+0000 7fed2bc2a700 1 -- start start 2024-05-08T19:22:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed2bc2a700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed240c37f0 0x7fed241490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed2bc2a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed2414ebe0 0x7fed24154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed2bc2a700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed24151690 0x7fed241547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed2bc2a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed240a9e60 con 0x7fed2414ebe0 2024-05-08T19:22:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed2bc2a700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed240bca60 con 0x7fed24151690 2024-05-08T19:22:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed2bc2a700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed241495f0 con 0x7fed240c37f0 2024-05-08T19:22:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed291c5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed2414ebe0 0x7fed24154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed291c5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed2414ebe0 0x7fed24154290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57246/0 (socket says 172.21.15.47:57246) 2024-05-08T19:22:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed291c5700 1 -- 172.21.15.47:0/2191124694 learned_addr learned my addr 172.21.15.47:0/2191124694 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed299c6700 1 --2- 172.21.15.47:0/2191124694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed240c37f0 0x7fed241490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed2a1c7700 1 --2- 172.21.15.47:0/2191124694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed24151690 0x7fed241547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed291c5700 1 -- 172.21.15.47:0/2191124694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed240c37f0 msgr2=0x7fed241490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed291c5700 1 --2- 172.21.15.47:0/2191124694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed240c37f0 0x7fed241490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed291c5700 1 -- 172.21.15.47:0/2191124694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed24151690 msgr2=0x7fed241547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed291c5700 1 --2- 172.21.15.47:0/2191124694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed24151690 0x7fed241547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.953+0000 7fed291c5700 1 -- 172.21.15.47:0/2191124694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c009b30 con 0x7fed2414ebe0 2024-05-08T19:22:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.954+0000 7fed291c5700 1 --2- 172.21.15.47:0/2191124694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed2414ebe0 0x7fed24154290 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fed2000c4d0 tx=0x7fed2000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.954+0000 7fed1a7fc700 1 -- 172.21.15.47:0/2191124694 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20011790 con 0x7fed2414ebe0 2024-05-08T19:22:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.954+0000 7fed1a7fc700 1 -- 172.21.15.47:0/2191124694 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed200118f0 con 0x7fed2414ebe0 2024-05-08T19:22:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.954+0000 7fed1a7fc700 1 -- 172.21.15.47:0/2191124694 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20011ca0 con 0x7fed2414ebe0 2024-05-08T19:22:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.954+0000 7fed2bc2a700 1 -- 172.21.15.47:0/2191124694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed24154d10 con 0x7fed2414ebe0 2024-05-08T19:22:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.954+0000 7fed2bc2a700 1 -- 172.21.15.47:0/2191124694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed240bcf90 con 0x7fed2414ebe0 2024-05-08T19:22:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.955+0000 7fed2bc2a700 1 -- 172.21.15.47:0/2191124694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed240c59d0 con 0x7fed2414ebe0 2024-05-08T19:22:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.955+0000 7fed1a7fc700 1 -- 172.21.15.47:0/2191124694 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fed2001c460 con 0x7fed2414ebe0 2024-05-08T19:22:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.956+0000 7fed1a7fc700 1 --2- 172.21.15.47:0/2191124694 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fed0806acc0 0x7fed0806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:33.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.956+0000 7fed1a7fc700 1 -- 172.21.15.47:0/2191124694 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fed200892f0 con 0x7fed2414ebe0 2024-05-08T19:22:33.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.956+0000 7fed299c6700 1 --2- 172.21.15.47:0/2191124694 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fed0806acc0 0x7fed0806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:33.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.956+0000 7fed299c6700 1 --2- 172.21.15.47:0/2191124694 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fed0806acc0 0x7fed0806d180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed14006fd0 tx=0x7fed14008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:33.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:33.960+0000 7fed1a7fc700 1 -- 172.21.15.47:0/2191124694 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fed200541d0 con 0x7fed2414ebe0 2024-05-08T19:22:34.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.167+0000 7fed2bc2a700 1 -- 172.21.15.47:0/2191124694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fed2404ec60 con 0x7fed2414ebe0 2024-05-08T19:22:34.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.167+0000 7fed1a7fc700 1 -- 172.21.15.47:0/2191124694 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fed200577f0 con 0x7fed2414ebe0 2024-05-08T19:22:34.160 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-08T19:22:34.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.169+0000 7fed2bc2a700 1 -- 172.21.15.47:0/2191124694 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fed0806acc0 msgr2=0x7fed0806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:34.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.169+0000 7fed2bc2a700 1 --2- 172.21.15.47:0/2191124694 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fed0806acc0 0x7fed0806d180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed14006fd0 tx=0x7fed14008040 comp rx=0 tx=0).stop 2024-05-08T19:22:34.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.169+0000 7fed2bc2a700 1 -- 172.21.15.47:0/2191124694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed2414ebe0 msgr2=0x7fed24154290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:34.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.169+0000 7fed2bc2a700 1 --2- 172.21.15.47:0/2191124694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed2414ebe0 0x7fed24154290 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fed2000c4d0 tx=0x7fed2000c7e0 comp rx=0 tx=0).stop 2024-05-08T19:22:34.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.169+0000 7fed2bc2a700 1 -- 172.21.15.47:0/2191124694 shutdown_connections 2024-05-08T19:22:34.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.169+0000 7fed2bc2a700 1 --2- 172.21.15.47:0/2191124694 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fed0806acc0 0x7fed0806d180 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:34.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.169+0000 7fed2bc2a700 1 --2- 172.21.15.47:0/2191124694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed24151690 0x7fed241547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:34.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.169+0000 7fed2bc2a700 1 --2- 172.21.15.47:0/2191124694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed240c37f0 0x7fed241490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:34.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.169+0000 7fed2bc2a700 1 --2- 172.21.15.47:0/2191124694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed2414ebe0 0x7fed24154290 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:34.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.169+0000 7fed2bc2a700 1 -- 172.21.15.47:0/2191124694 >> 172.21.15.47:0/2191124694 conn(0x7fed240c71c0 msgr2=0x7fed240a8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:34.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.170+0000 7fed2bc2a700 1 -- 172.21.15.47:0/2191124694 shutdown_connections 2024-05-08T19:22:34.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.170+0000 7fed2bc2a700 1 -- 172.21.15.47:0/2191124694 wait complete. 2024-05-08T19:22:34.174 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T19:22:34.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.308+0000 7fec8dc4e700 1 Processor -- start 2024-05-08T19:22:34.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.308+0000 7fec8dc4e700 1 -- start start 2024-05-08T19:22:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.309+0000 7fec8dc4e700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fec880c2be0 0x7fec881526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.309+0000 7fec8dc4e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec880c4f60 0x7fec880c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.309+0000 7fec8dc4e700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec880ab720 con 0x7fec880aae80 2024-05-08T19:22:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.309+0000 7fec8dc4e700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec880aba00 con 0x7fec880c2be0 2024-05-08T19:22:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.309+0000 7fec8dc4e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec880abce0 con 0x7fec880c4f60 2024-05-08T19:22:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.309+0000 7fec86ffd700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fec880aae80 0x7fec8806b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34130/0 (socket says 172.21.15.47:34130) 2024-05-08T19:22:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.309+0000 7fec86ffd700 1 -- 172.21.15.47:0/746224216 learned_addr learned my addr 172.21.15.47:0/746224216 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.309+0000 7fec87fff700 1 --2- 172.21.15.47:0/746224216 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec880c4f60 0x7fec880c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.309+0000 7fec877fe700 1 --2- 172.21.15.47:0/746224216 >> v2:172.21.15.177:3300/0 conn(0x7fec880c2be0 0x7fec881526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.309+0000 7fec867fc700 1 -- 172.21.15.47:0/746224216 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644749443 0 0) 0x7fec880ab720 con 0x7fec880aae80 2024-05-08T19:22:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.309+0000 7fec867fc700 1 -- 172.21.15.47:0/746224216 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec740035b0 con 0x7fec880aae80 2024-05-08T19:22:34.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.310+0000 7fec87fff700 1 -- 172.21.15.47:0/746224216 >> v2:172.21.15.177:3300/0 conn(0x7fec880c2be0 msgr2=0x7fec881526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:34.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.310+0000 7fec87fff700 1 --2- 172.21.15.47:0/746224216 >> v2:172.21.15.177:3300/0 conn(0x7fec880c2be0 0x7fec881526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:34.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.310+0000 7fec87fff700 1 -- 172.21.15.47:0/746224216 >> v1:172.21.15.47:6789/0 conn(0x7fec880aae80 legacy=0x7fec8806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:34.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.310+0000 7fec87fff700 1 -- 172.21.15.47:0/746224216 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec880c4760 con 0x7fec880c4f60 2024-05-08T19:22:34.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.310+0000 7fec87fff700 1 --2- 172.21.15.47:0/746224216 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec880c4f60 0x7fec880c53f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fec80009d90 tx=0x7fec8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f2651a4bcdb7ab6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:34.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.310+0000 7fec867fc700 1 -- 172.21.15.47:0/746224216 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8000e070 con 0x7fec880c4f60 2024-05-08T19:22:34.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.310+0000 7fec867fc700 1 -- 172.21.15.47:0/746224216 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8000bb20 con 0x7fec880c4f60 2024-05-08T19:22:34.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.310+0000 7fec867fc700 1 -- 172.21.15.47:0/746224216 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8000be90 con 0x7fec880c4f60 2024-05-08T19:22:34.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.311+0000 7fec8dc4e700 1 -- 172.21.15.47:0/746224216 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec880c4f60 msgr2=0x7fec880c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:34.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.311+0000 7fec8dc4e700 1 --2- 172.21.15.47:0/746224216 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec880c4f60 0x7fec880c53f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fec80009d90 tx=0x7fec8000b330 comp rx=0 tx=0).stop 2024-05-08T19:22:34.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.311+0000 7fec8dc4e700 1 -- 172.21.15.47:0/746224216 shutdown_connections 2024-05-08T19:22:34.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.311+0000 7fec8dc4e700 1 --2- 172.21.15.47:0/746224216 >> v2:172.21.15.177:3300/0 conn(0x7fec880c2be0 0x7fec881526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:34.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.311+0000 7fec8dc4e700 1 --2- 172.21.15.47:0/746224216 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec880c4f60 0x7fec880c53f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:34.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.311+0000 7fec8dc4e700 1 -- 172.21.15.47:0/746224216 >> 172.21.15.47:0/746224216 conn(0x7fec880c3360 msgr2=0x7fec880c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:34.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.311+0000 7fec8dc4e700 1 -- 172.21.15.47:0/746224216 shutdown_connections 2024-05-08T19:22:34.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.311+0000 7fec8dc4e700 1 -- 172.21.15.47:0/746224216 wait complete. 2024-05-08T19:22:34.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.312+0000 7fec8dc4e700 1 Processor -- start 2024-05-08T19:22:34.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.312+0000 7fec8dc4e700 1 -- start start 2024-05-08T19:22:34.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec8dc4e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec880aae80 0x7fec881ea3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:34.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec8dc4e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec880c2be0 0x7fec88152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:34.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec8dc4e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec880c4f60 0x7fec8814cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:34.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec8dc4e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec881ea930 con 0x7fec880aae80 2024-05-08T19:22:34.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec8dc4e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec88153e80 con 0x7fec880c2be0 2024-05-08T19:22:34.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec8dc4e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec88072320 con 0x7fec880c4f60 2024-05-08T19:22:34.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec877fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec880aae80 0x7fec881ea3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:34.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec877fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec880aae80 0x7fec881ea3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57262/0 (socket says 172.21.15.47:57262) 2024-05-08T19:22:34.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec877fe700 1 -- 172.21.15.47:0/1297859337 learned_addr learned my addr 172.21.15.47:0/1297859337 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:34.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec86ffd700 1 --2- 172.21.15.47:0/1297859337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec880c2be0 0x7fec88152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:34.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec87fff700 1 --2- 172.21.15.47:0/1297859337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec880c4f60 0x7fec8814cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:34.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec877fe700 1 -- 172.21.15.47:0/1297859337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec880c4f60 msgr2=0x7fec8814cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:34.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec877fe700 1 --2- 172.21.15.47:0/1297859337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec880c4f60 0x7fec8814cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:34.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec877fe700 1 -- 172.21.15.47:0/1297859337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec880c2be0 msgr2=0x7fec88152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:34.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec877fe700 1 --2- 172.21.15.47:0/1297859337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec880c2be0 0x7fec88152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:34.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec877fe700 1 -- 172.21.15.47:0/1297859337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec80009a70 con 0x7fec880aae80 2024-05-08T19:22:34.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.313+0000 7fec877fe700 1 --2- 172.21.15.47:0/1297859337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec880aae80 0x7fec881ea3f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fec7800e9b0 tx=0x7fec7800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:34.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.314+0000 7fec7ffff700 1 -- 172.21.15.47:0/1297859337 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78009710 con 0x7fec880aae80 2024-05-08T19:22:34.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.314+0000 7fec7ffff700 1 -- 172.21.15.47:0/1297859337 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7800ee50 con 0x7fec880aae80 2024-05-08T19:22:34.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.314+0000 7fec8dc4e700 1 -- 172.21.15.47:0/1297859337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec88072600 con 0x7fec880aae80 2024-05-08T19:22:34.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.314+0000 7fec7ffff700 1 -- 172.21.15.47:0/1297859337 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7800ca50 con 0x7fec880aae80 2024-05-08T19:22:34.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.314+0000 7fec8dc4e700 1 -- 172.21.15.47:0/1297859337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec88072bc0 con 0x7fec880aae80 2024-05-08T19:22:34.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.314+0000 7fec8dc4e700 1 -- 172.21.15.47:0/1297859337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8804ec60 con 0x7fec880aae80 2024-05-08T19:22:34.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.315+0000 7fec7ffff700 1 -- 172.21.15.47:0/1297859337 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fec7800cbb0 con 0x7fec880aae80 2024-05-08T19:22:34.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.315+0000 7fec7ffff700 1 --2- 172.21.15.47:0/1297859337 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fec6806ac90 0x7fec6806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:34.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.315+0000 7fec7ffff700 1 -- 172.21.15.47:0/1297859337 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fec780896b0 con 0x7fec880aae80 2024-05-08T19:22:34.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.316+0000 7fec86ffd700 1 --2- 172.21.15.47:0/1297859337 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fec6806ac90 0x7fec6806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:34.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.316+0000 7fec86ffd700 1 --2- 172.21.15.47:0/1297859337 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fec6806ac90 0x7fec6806d150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec70007fd0 tx=0x7fec70009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:34.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.320+0000 7fec7ffff700 1 -- 172.21.15.47:0/1297859337 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fec78054520 con 0x7fec880aae80 2024-05-08T19:22:34.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.544+0000 7fec8dc4e700 1 -- 172.21.15.47:0/1297859337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fec880c3a00 con 0x7fec880aae80 2024-05-08T19:22:34.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.545+0000 7fec7ffff700 1 -- 172.21.15.47:0/1297859337 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fec7800ce60 con 0x7fec880aae80 2024-05-08T19:22:34.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.547+0000 7fec8dc4e700 1 -- 172.21.15.47:0/1297859337 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fec6806ac90 msgr2=0x7fec6806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:34.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.547+0000 7fec8dc4e700 1 --2- 172.21.15.47:0/1297859337 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fec6806ac90 0x7fec6806d150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec70007fd0 tx=0x7fec70009040 comp rx=0 tx=0).stop 2024-05-08T19:22:34.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.547+0000 7fec8dc4e700 1 -- 172.21.15.47:0/1297859337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec880aae80 msgr2=0x7fec881ea3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:34.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.547+0000 7fec8dc4e700 1 --2- 172.21.15.47:0/1297859337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec880aae80 0x7fec881ea3f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fec7800e9b0 tx=0x7fec7800ecc0 comp rx=0 tx=0).stop 2024-05-08T19:22:34.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.547+0000 7fec8dc4e700 1 -- 172.21.15.47:0/1297859337 shutdown_connections 2024-05-08T19:22:34.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.547+0000 7fec8dc4e700 1 --2- 172.21.15.47:0/1297859337 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fec6806ac90 0x7fec6806d150 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:34.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.547+0000 7fec8dc4e700 1 --2- 172.21.15.47:0/1297859337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec880aae80 0x7fec881ea3f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:34.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.547+0000 7fec8dc4e700 1 --2- 172.21.15.47:0/1297859337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec880c4f60 0x7fec8814cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:34.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.547+0000 7fec8dc4e700 1 --2- 172.21.15.47:0/1297859337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec880c2be0 0x7fec88152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:34.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.547+0000 7fec8dc4e700 1 -- 172.21.15.47:0/1297859337 >> 172.21.15.47:0/1297859337 conn(0x7fec880c3360 msgr2=0x7fec8806f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:34.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.547+0000 7fec8dc4e700 1 -- 172.21.15.47:0/1297859337 shutdown_connections 2024-05-08T19:22:34.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:34.547+0000 7fec8dc4e700 1 -- 172.21.15.47:0/1297859337 wait complete. 2024-05-08T19:22:34.540 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-08T19:22:34.551 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi047.front.sepia.ceph.com... 2024-05-08T19:22:34.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:34.551 DEBUG:teuthology.orchestra.run.smithi047:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-08T19:22:34.589 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:ceph-fuse[52977]: fuse finished with error 0 and tester_r 0 2024-05-08T19:22:34.590 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:22:40.691 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-05-08T19:22:40.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:40.692 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-08T19:22:40.725 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:40.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.914+0000 7fc11519e700 1 Processor -- start 2024-05-08T19:22:40.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.914+0000 7fc11519e700 1 -- start start 2024-05-08T19:22:40.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc11519e700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc110071ba0 0x7fc1100a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:40.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc11519e700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11006e530 con 0x7fc110152b40 2024-05-08T19:22:40.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc11519e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1100a96d0 con 0x7fc11014fb30 2024-05-08T19:22:40.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc11519e700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc110072310 con 0x7fc110071ba0 2024-05-08T19:22:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc11499d700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc110152b40 0x7fc110152f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48524/0 (socket says 172.21.15.47:48524) 2024-05-08T19:22:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc11499d700 1 -- 172.21.15.47:0/2349779102 learned_addr learned my addr 172.21.15.47:0/2349779102 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc10f7fe700 1 --2- 172.21.15.47:0/2349779102 >> v2:172.21.15.177:3300/0 conn(0x7fc110071ba0 0x7fc1100a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921468210 0 0) 0x7fc11006e530 con 0x7fc110152b40 2024-05-08T19:22:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0fc0035b0 con 0x7fc110152b40 2024-05-08T19:22:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267946798 0 0) 0x7fc1100a96d0 con 0x7fc11014fb30 2024-05-08T19:22:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc11006e530 con 0x7fc11014fb30 2024-05-08T19:22:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1316727145 0 0) 0x7fc0fc0035b0 con 0x7fc110152b40 2024-05-08T19:22:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 >> v2:172.21.15.177:3300/0 conn(0x7fc110071ba0 msgr2=0x7fc1100a85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc10effd700 1 --2- 172.21.15.47:0/2349779102 >> v2:172.21.15.177:3300/0 conn(0x7fc110071ba0 0x7fc1100a85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 >> v1:172.21.15.177:6789/0 conn(0x7fc11014fb30 legacy=0x7fc1100c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.915+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1100725b0 con 0x7fc110152b40 2024-05-08T19:22:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7fc1080019f0 con 0x7fc110152b40 2024-05-08T19:22:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 >> v1:172.21.15.47:6789/0 conn(0x7fc110152b40 legacy=0x7fc110152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10effd700 1 --2- 172.21.15.47:0/2349779102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0fc003b90 0x7fc0fc003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10effd700 1 --2- 172.21.15.47:0/2349779102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0fc004850 0x7fc0fc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10effd700 1 --2- 172.21.15.47:0/2349779102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0fc005280 0x7fc0fc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc110072310 con 0x7fc0fc004850 2024-05-08T19:22:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc00c1e0 con 0x7fc0fc003b90 2024-05-08T19:22:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc00c3a0 con 0x7fc0fc005280 2024-05-08T19:22:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10f7fe700 1 --2- 172.21.15.47:0/2349779102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0fc004850 0x7fc0fc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10ffff700 1 --2- 172.21.15.47:0/2349779102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0fc003b90 0x7fc0fc003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc11499d700 1 --2- 172.21.15.47:0/2349779102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0fc005280 0x7fc0fc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10f7fe700 1 -- 172.21.15.47:0/2349779102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0fc005280 msgr2=0x7fc0fc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10f7fe700 1 --2- 172.21.15.47:0/2349779102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0fc005280 0x7fc0fc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10f7fe700 1 -- 172.21.15.47:0/2349779102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0fc003b90 msgr2=0x7fc0fc003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10f7fe700 1 --2- 172.21.15.47:0/2349779102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0fc003b90 0x7fc0fc003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10f7fe700 1 -- 172.21.15.47:0/2349779102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0fc0035b0 con 0x7fc0fc004850 2024-05-08T19:22:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc11499d700 1 --2- 172.21.15.47:0/2349779102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0fc005280 0x7fc0fc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc11499d700 1 -- 172.21.15.47:0/2349779102 reap_dead start 2024-05-08T19:22:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10f7fe700 1 --2- 172.21.15.47:0/2349779102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0fc004850 0x7fc0fc004cd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009b30 tx=0x7fc0fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef331454482ee56c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800e6c0 con 0x7fc0fc004850 2024-05-08T19:22:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f800e820 con 0x7fc0fc004850 2024-05-08T19:22:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.916+0000 7fc10effd700 1 -- 172.21.15.47:0/2349779102 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800eb90 con 0x7fc0fc004850 2024-05-08T19:22:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.917+0000 7fc11519e700 1 -- 172.21.15.47:0/2349779102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0fc004850 msgr2=0x7fc0fc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.917+0000 7fc11519e700 1 --2- 172.21.15.47:0/2349779102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0fc004850 0x7fc0fc004cd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009b30 tx=0x7fc0fc005880 comp rx=0 tx=0).stop 2024-05-08T19:22:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.917+0000 7fc11519e700 1 -- 172.21.15.47:0/2349779102 shutdown_connections 2024-05-08T19:22:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.917+0000 7fc11519e700 1 --2- 172.21.15.47:0/2349779102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0fc004850 0x7fc0fc004cd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.917+0000 7fc11519e700 1 -- 172.21.15.47:0/2349779102 >> 172.21.15.47:0/2349779102 conn(0x7fc1100c2950 msgr2=0x7fc1100c2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.917+0000 7fc11519e700 1 -- 172.21.15.47:0/2349779102 shutdown_connections 2024-05-08T19:22:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.917+0000 7fc11519e700 1 -- 172.21.15.47:0/2349779102 wait complete. 2024-05-08T19:22:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.918+0000 7fc11519e700 1 Processor -- start 2024-05-08T19:22:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.919+0000 7fc11519e700 1 -- start start 2024-05-08T19:22:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.919+0000 7fc11519e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0fc004850 0x7fc110141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.919+0000 7fc11519e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc110149fe0 0x7fc1100bf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.919+0000 7fc11519e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc11006c440 0x7fc11014d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.919+0000 7fc11519e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11014b530 con 0x7fc0fc004850 2024-05-08T19:22:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.919+0000 7fc11519e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc110141540 con 0x7fc110149fe0 2024-05-08T19:22:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.919+0000 7fc11519e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100c5b70 con 0x7fc11006c440 2024-05-08T19:22:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.919+0000 7fc10ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0fc004850 0x7fc110141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.919+0000 7fc10ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0fc004850 0x7fc110141000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35540/0 (socket says 172.21.15.47:35540) 2024-05-08T19:22:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.919+0000 7fc10ffff700 1 -- 172.21.15.47:0/1976187289 learned_addr learned my addr 172.21.15.47:0/1976187289 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:40.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.920+0000 7fc10f7fe700 1 --2- 172.21.15.47:0/1976187289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc110149fe0 0x7fc1100bf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:40.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.920+0000 7fc11499d700 1 --2- 172.21.15.47:0/1976187289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc11006c440 0x7fc11014d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:40.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.920+0000 7fc10ffff700 1 -- 172.21.15.47:0/1976187289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc11006c440 msgr2=0x7fc11014d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:40.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.920+0000 7fc10ffff700 1 --2- 172.21.15.47:0/1976187289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc11006c440 0x7fc11014d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:40.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.920+0000 7fc10ffff700 1 -- 172.21.15.47:0/1976187289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc110149fe0 msgr2=0x7fc1100bf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:40.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.920+0000 7fc10ffff700 1 --2- 172.21.15.47:0/1976187289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc110149fe0 0x7fc1100bf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:40.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.920+0000 7fc10ffff700 1 -- 172.21.15.47:0/1976187289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc110140b70 con 0x7fc0fc004850 2024-05-08T19:22:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.920+0000 7fc10ffff700 1 --2- 172.21.15.47:0/1976187289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0fc004850 0x7fc110141000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc10000f7d0 tx=0x7fc10000fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.920+0000 7fc10cff9700 1 -- 172.21.15.47:0/1976187289 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000052e0 con 0x7fc0fc004850 2024-05-08T19:22:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.920+0000 7fc10cff9700 1 -- 172.21.15.47:0/1976187289 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc100005440 con 0x7fc0fc004850 2024-05-08T19:22:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.920+0000 7fc11519e700 1 -- 172.21.15.47:0/1976187289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11006e2f0 con 0x7fc0fc004850 2024-05-08T19:22:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.920+0000 7fc10cff9700 1 -- 172.21.15.47:0/1976187289 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000038c0 con 0x7fc0fc004850 2024-05-08T19:22:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.920+0000 7fc11519e700 1 -- 172.21.15.47:0/1976187289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc110140520 con 0x7fc0fc004850 2024-05-08T19:22:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.921+0000 7fc11519e700 1 -- 172.21.15.47:0/1976187289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc110140380 con 0x7fc0fc004850 2024-05-08T19:22:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.922+0000 7fc10cff9700 1 -- 172.21.15.47:0/1976187289 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc100003a20 con 0x7fc0fc004850 2024-05-08T19:22:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.922+0000 7fc10cff9700 1 --2- 172.21.15.47:0/1976187289 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc0f006ac90 0x7fc0f006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.922+0000 7fc10cff9700 1 -- 172.21.15.47:0/1976187289 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1000893e0 con 0x7fc0fc004850 2024-05-08T19:22:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.922+0000 7fc10f7fe700 1 --2- 172.21.15.47:0/1976187289 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc0f006ac90 0x7fc0f006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.923+0000 7fc10f7fe700 1 --2- 172.21.15.47:0/1976187289 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc0f006ac90 0x7fc0f006d150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80090b0 tx=0x7fc0f8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:40.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:40.927+0000 7fc10cff9700 1 -- 172.21.15.47:0/1976187289 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc110140380 con 0x7fc0fc004850 2024-05-08T19:22:41.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.136+0000 7fc11519e700 1 -- 172.21.15.47:0/1976187289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc110140380 con 0x7fc0fc004850 2024-05-08T19:22:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.137+0000 7fc10cff9700 1 -- 172.21.15.47:0/1976187289 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17878 (secure 0 0 0) 0x7fc110140380 con 0x7fc0fc004850 2024-05-08T19:22:41.128 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:41.129 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:24.891864+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.139+0000 7fc11519e700 1 -- 172.21.15.47:0/1976187289 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc0f006ac90 msgr2=0x7fc0f006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.139+0000 7fc11519e700 1 --2- 172.21.15.47:0/1976187289 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc0f006ac90 0x7fc0f006d150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80090b0 tx=0x7fc0f8008030 comp rx=0 tx=0).stop 2024-05-08T19:22:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.139+0000 7fc11519e700 1 -- 172.21.15.47:0/1976187289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0fc004850 msgr2=0x7fc110141000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.139+0000 7fc11519e700 1 --2- 172.21.15.47:0/1976187289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0fc004850 0x7fc110141000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc10000f7d0 tx=0x7fc10000fb90 comp rx=0 tx=0).stop 2024-05-08T19:22:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.139+0000 7fc11519e700 1 -- 172.21.15.47:0/1976187289 shutdown_connections 2024-05-08T19:22:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.139+0000 7fc11519e700 1 --2- 172.21.15.47:0/1976187289 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc0f006ac90 0x7fc0f006d150 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.139+0000 7fc11519e700 1 --2- 172.21.15.47:0/1976187289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0fc004850 0x7fc110141000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.139+0000 7fc11519e700 1 --2- 172.21.15.47:0/1976187289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc11006c440 0x7fc11014d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.139+0000 7fc11519e700 1 --2- 172.21.15.47:0/1976187289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc110149fe0 0x7fc1100bf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.139+0000 7fc11519e700 1 -- 172.21.15.47:0/1976187289 >> 172.21.15.47:0/1976187289 conn(0x7fc1100c2950 msgr2=0x7fc1100a8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:41.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.140+0000 7fc11519e700 1 -- 172.21.15.47:0/1976187289 shutdown_connections 2024-05-08T19:22:41.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.140+0000 7fc11519e700 1 -- 172.21.15.47:0/1976187289 wait complete. 2024-05-08T19:22:41.143 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:41.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.278+0000 7ffa83ac3700 1 Processor -- start 2024-05-08T19:22:41.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.278+0000 7ffa83ac3700 1 -- start start 2024-05-08T19:22:41.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.279+0000 7ffa83ac3700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ffa7c0c1b20 0x7ffa7c0c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:41.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.279+0000 7ffa83ac3700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa7c13d920 0x7ffa7c154960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:41.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.279+0000 7ffa83ac3700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7c158930 con 0x7ffa7c154ea0 2024-05-08T19:22:41.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.279+0000 7ffa83ac3700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7c0c2840 con 0x7ffa7c0c1b20 2024-05-08T19:22:41.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.279+0000 7ffa83ac3700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c13e1e0 con 0x7ffa7c13d920 2024-05-08T19:22:41.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.279+0000 7ffa82060700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ffa7c154ea0 0x7ffa7c0c0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48538/0 (socket says 172.21.15.47:48538) 2024-05-08T19:22:41.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.279+0000 7ffa82060700 1 -- 172.21.15.47:0/1939701196 learned_addr learned my addr 172.21.15.47:0/1939701196 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:41.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8105e700 1 --2- 172.21.15.47:0/1939701196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa7c13d920 0x7ffa7c154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:41.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8185f700 1 --2- 172.21.15.47:0/1939701196 >> v2:172.21.15.177:3300/0 conn(0x7ffa7c0c1b20 0x7ffa7c0c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:41.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 -- 172.21.15.47:0/1939701196 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587753824 0 0) 0x7ffa7c158930 con 0x7ffa7c154ea0 2024-05-08T19:22:41.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 -- 172.21.15.47:0/1939701196 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa680035b0 con 0x7ffa7c154ea0 2024-05-08T19:22:41.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 -- 172.21.15.47:0/1939701196 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2978792923 0 0) 0x7ffa680035b0 con 0x7ffa7c154ea0 2024-05-08T19:22:41.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 -- 172.21.15.47:0/1939701196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa7c13d920 msgr2=0x7ffa7c154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:41.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 --2- 172.21.15.47:0/1939701196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa7c13d920 0x7ffa7c154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 -- 172.21.15.47:0/1939701196 >> v2:172.21.15.177:3300/0 conn(0x7ffa7c0c1b20 msgr2=0x7ffa7c0c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:41.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 --2- 172.21.15.47:0/1939701196 >> v2:172.21.15.177:3300/0 conn(0x7ffa7c0c1b20 0x7ffa7c0c1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 -- 172.21.15.47:0/1939701196 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c158dc0 con 0x7ffa7c154ea0 2024-05-08T19:22:41.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 -- 172.21.15.47:0/1939701196 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7ffa740019f0 con 0x7ffa7c154ea0 2024-05-08T19:22:41.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 -- 172.21.15.47:0/1939701196 >> v1:172.21.15.47:6789/0 conn(0x7ffa7c154ea0 legacy=0x7ffa7c0c0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:41.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 --2- 172.21.15.47:0/1939701196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa68003a00 0x7ffa68003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:41.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 --2- 172.21.15.47:0/1939701196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa68004850 0x7ffa68004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:41.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 --2- 172.21.15.47:0/1939701196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa7c13d920 0x7ffa68005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:41.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 -- 172.21.15.47:0/1939701196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c0c2840 con 0x7ffa68004850 2024-05-08T19:22:41.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 -- 172.21.15.47:0/1939701196 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c13e1e0 con 0x7ffa68003a00 2024-05-08T19:22:41.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8085d700 1 -- 172.21.15.47:0/1939701196 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6800ba90 con 0x7ffa7c13d920 2024-05-08T19:22:41.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8105e700 1 --2- 172.21.15.47:0/1939701196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa68004850 0x7ffa68004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:41.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8185f700 1 --2- 172.21.15.47:0/1939701196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa68003a00 0x7ffa68003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:41.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa82060700 1 --2- 172.21.15.47:0/1939701196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa7c13d920 0x7ffa68005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:41.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8105e700 1 -- 172.21.15.47:0/1939701196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa7c13d920 msgr2=0x7ffa68005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:41.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8105e700 1 --2- 172.21.15.47:0/1939701196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa7c13d920 0x7ffa68005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8105e700 1 -- 172.21.15.47:0/1939701196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa68003a00 msgr2=0x7ffa68003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:41.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8105e700 1 --2- 172.21.15.47:0/1939701196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa68003a00 0x7ffa68003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.280+0000 7ffa8105e700 1 -- 172.21.15.47:0/1939701196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa680035b0 con 0x7ffa68004850 2024-05-08T19:22:41.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.281+0000 7ffa8105e700 1 --2- 172.21.15.47:0/1939701196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa68004850 0x7ffa68004cd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009b60 tx=0x7ffa68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae93a2ec030e9c7b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:41.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.281+0000 7ffa8085d700 1 -- 172.21.15.47:0/1939701196 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800e6c0 con 0x7ffa68004850 2024-05-08T19:22:41.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.281+0000 7ffa8085d700 1 -- 172.21.15.47:0/1939701196 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7800e820 con 0x7ffa68004850 2024-05-08T19:22:41.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.281+0000 7ffa8085d700 1 -- 172.21.15.47:0/1939701196 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800eb90 con 0x7ffa68004850 2024-05-08T19:22:41.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.281+0000 7ffa83ac3700 1 -- 172.21.15.47:0/1939701196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa68004850 msgr2=0x7ffa68004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:41.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.281+0000 7ffa83ac3700 1 --2- 172.21.15.47:0/1939701196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa68004850 0x7ffa68004cd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009b60 tx=0x7ffa68005880 comp rx=0 tx=0).stop 2024-05-08T19:22:41.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.281+0000 7ffa82060700 1 -- 172.21.15.47:0/1939701196 reap_dead start 2024-05-08T19:22:41.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.281+0000 7ffa83ac3700 1 -- 172.21.15.47:0/1939701196 shutdown_connections 2024-05-08T19:22:41.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.281+0000 7ffa83ac3700 1 -- 172.21.15.47:0/1939701196 >> 172.21.15.47:0/1939701196 conn(0x7ffa7c0c3c20 msgr2=0x7ffa7c0c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:41.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.281+0000 7ffa83ac3700 1 -- 172.21.15.47:0/1939701196 shutdown_connections 2024-05-08T19:22:41.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.281+0000 7ffa83ac3700 1 -- 172.21.15.47:0/1939701196 wait complete. 2024-05-08T19:22:41.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.283+0000 7ffa83ac3700 1 Processor -- start 2024-05-08T19:22:41.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.283+0000 7ffa83ac3700 1 -- start start 2024-05-08T19:22:41.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa83ac3700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa68004850 0x7ffa7c0c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:41.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa83ac3700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa7c0c61c0 0x7ffa7c136000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:41.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa83ac3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa7c06e840 0x7ffa7c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:41.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa83ac3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c133f50 con 0x7ffa7c06e840 2024-05-08T19:22:41.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa83ac3700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c1ea2e0 con 0x7ffa7c0c61c0 2024-05-08T19:22:41.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa83ac3700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c1ea5c0 con 0x7ffa68004850 2024-05-08T19:22:41.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa82060700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa7c06e840 0x7ffa7c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:41.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa82060700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa7c06e840 0x7ffa7c06ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35562/0 (socket says 172.21.15.47:35562) 2024-05-08T19:22:41.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa82060700 1 -- 172.21.15.47:0/1405443561 learned_addr learned my addr 172.21.15.47:0/1405443561 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:41.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa8185f700 1 --2- 172.21.15.47:0/1405443561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa68004850 0x7ffa7c0c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:41.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa8105e700 1 --2- 172.21.15.47:0/1405443561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa7c0c61c0 0x7ffa7c136000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:41.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa82060700 1 -- 172.21.15.47:0/1405443561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa68004850 msgr2=0x7ffa7c0c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:41.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa82060700 1 --2- 172.21.15.47:0/1405443561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa68004850 0x7ffa7c0c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa82060700 1 -- 172.21.15.47:0/1405443561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa7c0c61c0 msgr2=0x7ffa7c136000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:41.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa82060700 1 --2- 172.21.15.47:0/1405443561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa7c0c61c0 0x7ffa7c136000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa82060700 1 -- 172.21.15.47:0/1405443561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c1ea8a0 con 0x7ffa7c06e840 2024-05-08T19:22:41.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.284+0000 7ffa82060700 1 --2- 172.21.15.47:0/1405443561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa7c06e840 0x7ffa7c06ecc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0727d0 tx=0x7ffa74007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:41.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.285+0000 7ffa6e7fc700 1 -- 172.21.15.47:0/1405443561 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400eda0 con 0x7ffa7c06e840 2024-05-08T19:22:41.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.285+0000 7ffa6e7fc700 1 -- 172.21.15.47:0/1405443561 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa74013420 con 0x7ffa7c06e840 2024-05-08T19:22:41.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.285+0000 7ffa83ac3700 1 -- 172.21.15.47:0/1405443561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7c1eab80 con 0x7ffa7c06e840 2024-05-08T19:22:41.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.285+0000 7ffa6e7fc700 1 -- 172.21.15.47:0/1405443561 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa740137d0 con 0x7ffa7c06e840 2024-05-08T19:22:41.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.285+0000 7ffa83ac3700 1 -- 172.21.15.47:0/1405443561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c1e9f90 con 0x7ffa7c06e840 2024-05-08T19:22:41.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.286+0000 7ffa83ac3700 1 -- 172.21.15.47:0/1405443561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7c04ec60 con 0x7ffa7c06e840 2024-05-08T19:22:41.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.286+0000 7ffa6e7fc700 1 -- 172.21.15.47:0/1405443561 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffa74013930 con 0x7ffa7c06e840 2024-05-08T19:22:41.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.287+0000 7ffa6e7fc700 1 --2- 172.21.15.47:0/1405443561 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ffa6006ac90 0x7ffa6006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:41.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.287+0000 7ffa6e7fc700 1 -- 172.21.15.47:0/1405443561 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffa74089c10 con 0x7ffa7c06e840 2024-05-08T19:22:41.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.287+0000 7ffa8185f700 1 --2- 172.21.15.47:0/1405443561 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ffa6006ac90 0x7ffa6006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:41.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.287+0000 7ffa8185f700 1 --2- 172.21.15.47:0/1405443561 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ffa6006ac90 0x7ffa6006d150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009c20 tx=0x7ffa70008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:41.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.291+0000 7ffa6e7fc700 1 -- 172.21.15.47:0/1405443561 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ffa74054b90 con 0x7ffa7c06e840 2024-05-08T19:22:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.497+0000 7ffa83ac3700 1 -- 172.21.15.47:0/1405443561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa7c1549f0 con 0x7ffa7c06e840 2024-05-08T19:22:41.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.499+0000 7ffa6e7fc700 1 -- 172.21.15.47:0/1405443561 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17878 (secure 0 0 0) 0x7ffa740581b0 con 0x7ffa7c06e840 2024-05-08T19:22:41.491 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:41.491 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:24.891864+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.501+0000 7ffa83ac3700 1 -- 172.21.15.47:0/1405443561 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ffa6006ac90 msgr2=0x7ffa6006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.501+0000 7ffa83ac3700 1 --2- 172.21.15.47:0/1405443561 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ffa6006ac90 0x7ffa6006d150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009c20 tx=0x7ffa70008040 comp rx=0 tx=0).stop 2024-05-08T19:22:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.501+0000 7ffa83ac3700 1 -- 172.21.15.47:0/1405443561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa7c06e840 msgr2=0x7ffa7c06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.501+0000 7ffa83ac3700 1 --2- 172.21.15.47:0/1405443561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa7c06e840 0x7ffa7c06ecc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0727d0 tx=0x7ffa74007c90 comp rx=0 tx=0).stop 2024-05-08T19:22:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.501+0000 7ffa83ac3700 1 -- 172.21.15.47:0/1405443561 shutdown_connections 2024-05-08T19:22:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.501+0000 7ffa83ac3700 1 --2- 172.21.15.47:0/1405443561 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ffa6006ac90 0x7ffa6006d150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.501+0000 7ffa83ac3700 1 --2- 172.21.15.47:0/1405443561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa7c06e840 0x7ffa7c06ecc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.501+0000 7ffa83ac3700 1 --2- 172.21.15.47:0/1405443561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa68004850 0x7ffa7c0c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.501+0000 7ffa83ac3700 1 --2- 172.21.15.47:0/1405443561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa7c0c61c0 0x7ffa7c136000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.501+0000 7ffa83ac3700 1 -- 172.21.15.47:0/1405443561 >> 172.21.15.47:0/1405443561 conn(0x7ffa7c0c3c20 msgr2=0x7ffa7c0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.501+0000 7ffa83ac3700 1 -- 172.21.15.47:0/1405443561 shutdown_connections 2024-05-08T19:22:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.501+0000 7ffa83ac3700 1 -- 172.21.15.47:0/1405443561 wait complete. 2024-05-08T19:22:41.505 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-08T19:22:41.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.643+0000 7f9ab1742700 1 Processor -- start 2024-05-08T19:22:41.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.643+0000 7f9ab1742700 1 -- start start 2024-05-08T19:22:41.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.644+0000 7f9ab1742700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9aac152350 0x7f9aac0c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:41.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.644+0000 7f9ab1742700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9aac06d130 0x7f9aac154d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:41.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.644+0000 7f9ab1742700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aac0c4c20 con 0x7f9aac0c77b0 2024-05-08T19:22:41.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.644+0000 7f9ab1742700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aac155970 con 0x7f9aac152350 2024-05-08T19:22:41.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.644+0000 7f9ab1742700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0c5e40 con 0x7f9aac06d130 2024-05-08T19:22:41.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.644+0000 7f9aaa7fc700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9aac06d130 0x7f9aac154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:41.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.644+0000 7f9aaaffd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9aac152350 0x7f9aac0c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:41.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.644+0000 7f9aaa7fc700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9aac06d130 0x7f9aac154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:48672/0 (socket says 172.21.15.47:48672) 2024-05-08T19:22:41.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.644+0000 7f9aaa7fc700 1 -- 172.21.15.47:0/1904427464 learned_addr learned my addr 172.21.15.47:0/1904427464 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:41.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.644+0000 7f9aaaffd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9aac152350 0x7f9aac0c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:38050/0 (socket says 172.21.15.47:38050) 2024-05-08T19:22:41.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.644+0000 7f9aaa7fc700 1 -- 172.21.15.47:0/1904427464 >> v2:172.21.15.177:3300/0 conn(0x7f9aac152350 msgr2=0x7f9aac0c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:41.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.645+0000 7f9aaa7fc700 1 --2- 172.21.15.47:0/1904427464 >> v2:172.21.15.177:3300/0 conn(0x7f9aac152350 0x7f9aac0c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.645+0000 7f9aaa7fc700 1 -- 172.21.15.47:0/1904427464 >> v1:172.21.15.177:6789/0 conn(0x7f9aac0c77b0 legacy=0x7f9aac155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:41.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.645+0000 7f9aaa7fc700 1 -- 172.21.15.47:0/1904427464 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0c54c0 con 0x7f9aac06d130 2024-05-08T19:22:41.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.645+0000 7f9aaaffd700 1 --2- 172.21.15.47:0/1904427464 >> v2:172.21.15.177:3300/0 conn(0x7f9aac152350 0x7f9aac0c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:41.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.645+0000 7f9aaa7fc700 1 --2- 172.21.15.47:0/1904427464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9aac06d130 0x7f9aac154d20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0098f0 tx=0x7f9a9c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86c388450342c72 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:41.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.645+0000 7f9aa9ffb700 1 -- 172.21.15.47:0/1904427464 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c011830 con 0x7f9aac06d130 2024-05-08T19:22:41.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.645+0000 7f9aa9ffb700 1 -- 172.21.15.47:0/1904427464 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c011990 con 0x7f9aac06d130 2024-05-08T19:22:41.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.645+0000 7f9aa9ffb700 1 -- 172.21.15.47:0/1904427464 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c011d20 con 0x7f9aac06d130 2024-05-08T19:22:41.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.645+0000 7f9ab1742700 1 -- 172.21.15.47:0/1904427464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9aac06d130 msgr2=0x7f9aac154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:41.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.645+0000 7f9ab1742700 1 --2- 172.21.15.47:0/1904427464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9aac06d130 0x7f9aac154d20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0098f0 tx=0x7f9a9c009c00 comp rx=0 tx=0).stop 2024-05-08T19:22:41.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.645+0000 7f9ab1742700 1 -- 172.21.15.47:0/1904427464 shutdown_connections 2024-05-08T19:22:41.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.645+0000 7f9ab1742700 1 --2- 172.21.15.47:0/1904427464 >> v2:172.21.15.177:3300/0 conn(0x7f9aac152350 0x7f9aac0c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.645+0000 7f9ab1742700 1 --2- 172.21.15.47:0/1904427464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9aac06d130 0x7f9aac154d20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.645+0000 7f9ab1742700 1 -- 172.21.15.47:0/1904427464 >> 172.21.15.47:0/1904427464 conn(0x7f9aac072510 msgr2=0x7f9aac072920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:41.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.646+0000 7f9ab1742700 1 -- 172.21.15.47:0/1904427464 shutdown_connections 2024-05-08T19:22:41.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.646+0000 7f9ab1742700 1 -- 172.21.15.47:0/1904427464 wait complete. 2024-05-08T19:22:41.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.647+0000 7f9ab1742700 1 Processor -- start 2024-05-08T19:22:41.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.647+0000 7f9ab1742700 1 -- start start 2024-05-08T19:22:41.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9ab1742700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9aac06d130 0x7f9aac156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:41.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9ab1742700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9aac0c77b0 0x7f9aac14ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:41.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9ab1742700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9aac152350 0x7f9aac14cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:41.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9ab1742700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0acb30 con 0x7f9aac152350 2024-05-08T19:22:41.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9ab1742700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac14d4a0 con 0x7f9aac0c77b0 2024-05-08T19:22:41.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9ab1742700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0abaa0 con 0x7f9aac06d130 2024-05-08T19:22:41.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9aab7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9aac152350 0x7f9aac14cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:41.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9aaa7fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9aac0c77b0 0x7f9aac14ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:41.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9aab7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9aac152350 0x7f9aac14cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35570/0 (socket says 172.21.15.47:35570) 2024-05-08T19:22:41.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9aab7fe700 1 -- 172.21.15.47:0/2718658632 learned_addr learned my addr 172.21.15.47:0/2718658632 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:41.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9aaaffd700 1 --2- 172.21.15.47:0/2718658632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9aac06d130 0x7f9aac156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:41.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9aab7fe700 1 -- 172.21.15.47:0/2718658632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9aac06d130 msgr2=0x7f9aac156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:41.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9aab7fe700 1 --2- 172.21.15.47:0/2718658632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9aac06d130 0x7f9aac156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9aab7fe700 1 -- 172.21.15.47:0/2718658632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9aac0c77b0 msgr2=0x7f9aac14ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:41.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9aab7fe700 1 --2- 172.21.15.47:0/2718658632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9aac0c77b0 0x7f9aac14ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9aab7fe700 1 -- 172.21.15.47:0/2718658632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a940094a0 con 0x7f9aac152350 2024-05-08T19:22:41.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9aaa7fc700 1 --2- 172.21.15.47:0/2718658632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9aac0c77b0 0x7f9aac14ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:41.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9aab7fe700 1 --2- 172.21.15.47:0/2718658632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9aac152350 0x7f9aac14cf60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400cc50 tx=0x7f9aa400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:41.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9aa37fe700 1 -- 172.21.15.47:0/2718658632 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4003c00 con 0x7f9aac152350 2024-05-08T19:22:41.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9aa37fe700 1 -- 172.21.15.47:0/2718658632 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa4003d60 con 0x7f9aac152350 2024-05-08T19:22:41.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9aa37fe700 1 -- 172.21.15.47:0/2718658632 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa400aab0 con 0x7f9aac152350 2024-05-08T19:22:41.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.648+0000 7f9ab1742700 1 -- 172.21.15.47:0/2718658632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9c009550 con 0x7f9aac152350 2024-05-08T19:22:41.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.649+0000 7f9ab1742700 1 -- 172.21.15.47:0/2718658632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aac0ac470 con 0x7f9aac152350 2024-05-08T19:22:41.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.650+0000 7f9ab1742700 1 -- 172.21.15.47:0/2718658632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aac1e9ec0 con 0x7f9aac152350 2024-05-08T19:22:41.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.650+0000 7f9aa37fe700 1 -- 172.21.15.47:0/2718658632 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9aa400ac10 con 0x7f9aac152350 2024-05-08T19:22:41.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.650+0000 7f9aa37fe700 1 --2- 172.21.15.47:0/2718658632 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f9a8c06ac90 0x7f9a8c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:41.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.650+0000 7f9aa37fe700 1 -- 172.21.15.47:0/2718658632 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9aa4089510 con 0x7f9aac152350 2024-05-08T19:22:41.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.650+0000 7f9aaaffd700 1 --2- 172.21.15.47:0/2718658632 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f9a8c06ac90 0x7f9a8c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:41.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.651+0000 7f9aaaffd700 1 --2- 172.21.15.47:0/2718658632 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f9a8c06ac90 0x7f9a8c06d150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9aac1520b0 tx=0x7f9a94009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:41.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.655+0000 7f9aa37fe700 1 -- 172.21.15.47:0/2718658632 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9aa4054490 con 0x7f9aac152350 2024-05-08T19:22:41.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.909+0000 7f9ab1742700 1 -- 172.21.15.47:0/2718658632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9aac0acc70 con 0x7f9aac152350 2024-05-08T19:22:41.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.944+0000 7f9aa37fe700 1 -- 172.21.15.47:0/2718658632 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9aa4057ab0 con 0x7f9aac152350 2024-05-08T19:22:41.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.947+0000 7f9ab1742700 1 -- 172.21.15.47:0/2718658632 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f9a8c06ac90 msgr2=0x7f9a8c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:41.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.947+0000 7f9ab1742700 1 --2- 172.21.15.47:0/2718658632 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f9a8c06ac90 0x7f9a8c06d150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9aac1520b0 tx=0x7f9a94009210 comp rx=0 tx=0).stop 2024-05-08T19:22:41.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.947+0000 7f9ab1742700 1 -- 172.21.15.47:0/2718658632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9aac152350 msgr2=0x7f9aac14cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.947+0000 7f9ab1742700 1 --2- 172.21.15.47:0/2718658632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9aac152350 0x7f9aac14cf60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400cc50 tx=0x7f9aa400cf60 comp rx=0 tx=0).stop 2024-05-08T19:22:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.947+0000 7f9ab1742700 1 -- 172.21.15.47:0/2718658632 shutdown_connections 2024-05-08T19:22:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.947+0000 7f9ab1742700 1 --2- 172.21.15.47:0/2718658632 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f9a8c06ac90 0x7f9a8c06d150 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.947+0000 7f9ab1742700 1 --2- 172.21.15.47:0/2718658632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9aac152350 0x7f9aac14cf60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.947+0000 7f9ab1742700 1 --2- 172.21.15.47:0/2718658632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9aac06d130 0x7f9aac156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.947+0000 7f9ab1742700 1 --2- 172.21.15.47:0/2718658632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9aac0c77b0 0x7f9aac14ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.947+0000 7f9ab1742700 1 -- 172.21.15.47:0/2718658632 >> 172.21.15.47:0/2718658632 conn(0x7f9aac072510 msgr2=0x7f9aac0c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.947+0000 7f9ab1742700 1 -- 172.21.15.47:0/2718658632 shutdown_connections 2024-05-08T19:22:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:41.947+0000 7f9ab1742700 1 -- 172.21.15.47:0/2718658632 wait complete. 2024-05-08T19:22:41.950 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-05-08T19:22:41.951 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-08T19:22:42.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.088+0000 7f7e5b096700 1 Processor -- start 2024-05-08T19:22:42.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.088+0000 7f7e5b096700 1 -- start start 2024-05-08T19:22:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e5b096700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7e540c37f0 0x7f7e54071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e5b096700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e54155830 con 0x7f7e5414ebe0 2024-05-08T19:22:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e5b096700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e540c1c60 con 0x7f7e54151690 2024-05-08T19:22:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e5b096700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e54072bc0 con 0x7f7e540c37f0 2024-05-08T19:22:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e58e32700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7e5414ebe0 0x7f7e540716f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48552/0 (socket says 172.21.15.47:48552) 2024-05-08T19:22:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e58e32700 1 -- 172.21.15.47:0/2474365575 learned_addr learned my addr 172.21.15.47:0/2474365575 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e53fff700 1 --2- 172.21.15.47:0/2474365575 >> v2:172.21.15.177:3300/0 conn(0x7f7e540c37f0 0x7f7e54071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e537fe700 1 -- 172.21.15.47:0/2474365575 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866017489 0 0) 0x7f7e54155830 con 0x7f7e5414ebe0 2024-05-08T19:22:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e537fe700 1 -- 172.21.15.47:0/2474365575 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e440035b0 con 0x7f7e5414ebe0 2024-05-08T19:22:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e537fe700 1 -- 172.21.15.47:0/2474365575 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 276130166 0 0) 0x7f7e440035b0 con 0x7f7e5414ebe0 2024-05-08T19:22:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e537fe700 1 -- 172.21.15.47:0/2474365575 >> v2:172.21.15.177:3300/0 conn(0x7f7e540c37f0 msgr2=0x7f7e54071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e537fe700 1 --2- 172.21.15.47:0/2474365575 >> v2:172.21.15.177:3300/0 conn(0x7f7e540c37f0 0x7f7e54071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e537fe700 1 -- 172.21.15.47:0/2474365575 >> v1:172.21.15.177:6789/0 conn(0x7f7e54151690 legacy=0x7f7e54151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e537fe700 1 -- 172.21.15.47:0/2474365575 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e54155b10 con 0x7f7e5414ebe0 2024-05-08T19:22:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e537fe700 1 -- 172.21.15.47:0/2474365575 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f7e48001670 con 0x7f7e5414ebe0 2024-05-08T19:22:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e537fe700 1 -- 172.21.15.47:0/2474365575 >> v1:172.21.15.47:6789/0 conn(0x7f7e5414ebe0 legacy=0x7f7e540716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e537fe700 1 --2- 172.21.15.47:0/2474365575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e44003a00 0x7f7e44003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e537fe700 1 --2- 172.21.15.47:0/2474365575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e44004850 0x7f7e44004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e537fe700 1 --2- 172.21.15.47:0/2474365575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e44005210 0x7f7e4400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e537fe700 1 -- 172.21.15.47:0/2474365575 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e54072bc0 con 0x7f7e44003a00 2024-05-08T19:22:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e537fe700 1 -- 172.21.15.47:0/2474365575 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4400c0b0 con 0x7f7e44005210 2024-05-08T19:22:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.089+0000 7f7e537fe700 1 -- 172.21.15.47:0/2474365575 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4400c270 con 0x7f7e44004850 2024-05-08T19:22:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.090+0000 7f7e58e32700 1 --2- 172.21.15.47:0/2474365575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e44003a00 0x7f7e44003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.090+0000 7f7e59633700 1 --2- 172.21.15.47:0/2474365575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e44005210 0x7f7e4400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.090+0000 7f7e53fff700 1 --2- 172.21.15.47:0/2474365575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e44004850 0x7f7e44004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.090+0000 7f7e58e32700 1 -- 172.21.15.47:0/2474365575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e44004850 msgr2=0x7f7e44004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.090+0000 7f7e58e32700 1 --2- 172.21.15.47:0/2474365575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e44004850 0x7f7e44004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.090+0000 7f7e58e32700 1 -- 172.21.15.47:0/2474365575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e44005210 msgr2=0x7f7e4400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.090+0000 7f7e58e32700 1 --2- 172.21.15.47:0/2474365575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e44005210 0x7f7e4400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.090+0000 7f7e58e32700 1 -- 172.21.15.47:0/2474365575 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e440035b0 con 0x7f7e44003a00 2024-05-08T19:22:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.090+0000 7f7e59633700 1 --2- 172.21.15.47:0/2474365575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e44005210 0x7f7e4400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.090+0000 7f7e59633700 1 -- 172.21.15.47:0/2474365575 reap_dead start 2024-05-08T19:22:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.090+0000 7f7e58e32700 1 --2- 172.21.15.47:0/2474365575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e44003a00 0x7f7e44003e20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800c240 tx=0x7f7e44005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f468ce4147daf046 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.090+0000 7f7e537fe700 1 -- 172.21.15.47:0/2474365575 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48007c10 con 0x7f7e44003a00 2024-05-08T19:22:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.090+0000 7f7e537fe700 1 -- 172.21.15.47:0/2474365575 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4800ce00 con 0x7f7e44003a00 2024-05-08T19:22:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.090+0000 7f7e537fe700 1 -- 172.21.15.47:0/2474365575 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48005ba0 con 0x7f7e44003a00 2024-05-08T19:22:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.091+0000 7f7e5b096700 1 -- 172.21.15.47:0/2474365575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e44003a00 msgr2=0x7f7e44003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.091+0000 7f7e5b096700 1 --2- 172.21.15.47:0/2474365575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e44003a00 0x7f7e44003e20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800c240 tx=0x7f7e44005880 comp rx=0 tx=0).stop 2024-05-08T19:22:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.091+0000 7f7e5b096700 1 -- 172.21.15.47:0/2474365575 shutdown_connections 2024-05-08T19:22:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.091+0000 7f7e5b096700 1 --2- 172.21.15.47:0/2474365575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e44003a00 0x7f7e44003e20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.091+0000 7f7e5b096700 1 -- 172.21.15.47:0/2474365575 >> 172.21.15.47:0/2474365575 conn(0x7f7e540c71c0 msgr2=0x7f7e540c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.091+0000 7f7e5b096700 1 -- 172.21.15.47:0/2474365575 shutdown_connections 2024-05-08T19:22:42.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.091+0000 7f7e5b096700 1 -- 172.21.15.47:0/2474365575 wait complete. 2024-05-08T19:22:42.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.092+0000 7f7e5b096700 1 Processor -- start 2024-05-08T19:22:42.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.092+0000 7f7e5b096700 1 -- start start 2024-05-08T19:22:42.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e5b096700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e44003a00 0x7f7e54071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:42.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e5b096700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e540bc3b0 0x7f7e5414b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:42.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e5b096700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e5414c1f0 0x7f7e5414b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:42.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e5b096700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e541eb610 con 0x7f7e44003a00 2024-05-08T19:22:42.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e5b096700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5414bb00 con 0x7f7e5414c1f0 2024-05-08T19:22:42.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e5b096700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e54154c50 con 0x7f7e540bc3b0 2024-05-08T19:22:42.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e58e32700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e44003a00 0x7f7e54071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:42.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e58e32700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e44003a00 0x7f7e54071860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35594/0 (socket says 172.21.15.47:35594) 2024-05-08T19:22:42.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e58e32700 1 -- 172.21.15.47:0/4278950763 learned_addr learned my addr 172.21.15.47:0/4278950763 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:42.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e53fff700 1 --2- 172.21.15.47:0/4278950763 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e540bc3b0 0x7f7e5414b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:42.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e59633700 1 --2- 172.21.15.47:0/4278950763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e5414c1f0 0x7f7e5414b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:42.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e58e32700 1 -- 172.21.15.47:0/4278950763 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e540bc3b0 msgr2=0x7f7e5414b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:42.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e58e32700 1 --2- 172.21.15.47:0/4278950763 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e540bc3b0 0x7f7e5414b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:42.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e58e32700 1 -- 172.21.15.47:0/4278950763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e5414c1f0 msgr2=0x7f7e5414b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e58e32700 1 --2- 172.21.15.47:0/4278950763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e5414c1f0 0x7f7e5414b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e58e32700 1 -- 172.21.15.47:0/4278950763 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e54154970 con 0x7f7e44003a00 2024-05-08T19:22:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e58e32700 1 --2- 172.21.15.47:0/4278950763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e44003a00 0x7f7e54071860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400c080 tx=0x7f7e48001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.093+0000 7f7e517fa700 1 -- 172.21.15.47:0/4278950763 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48001670 con 0x7f7e44003a00 2024-05-08T19:22:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.094+0000 7f7e517fa700 1 -- 172.21.15.47:0/4278950763 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e480070d0 con 0x7f7e44003a00 2024-05-08T19:22:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.094+0000 7f7e5b096700 1 -- 172.21.15.47:0/4278950763 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e541eb230 con 0x7f7e44003a00 2024-05-08T19:22:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.094+0000 7f7e517fa700 1 -- 172.21.15.47:0/4278950763 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48007480 con 0x7f7e44003a00 2024-05-08T19:22:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.094+0000 7f7e5b096700 1 -- 172.21.15.47:0/4278950763 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5414bcc0 con 0x7f7e44003a00 2024-05-08T19:22:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.094+0000 7f7e5b096700 1 -- 172.21.15.47:0/4278950763 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5414be50 con 0x7f7e44003a00 2024-05-08T19:22:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.095+0000 7f7e517fa700 1 -- 172.21.15.47:0/4278950763 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7e480075e0 con 0x7f7e44003a00 2024-05-08T19:22:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.095+0000 7f7e517fa700 1 --2- 172.21.15.47:0/4278950763 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f7e3806ac90 0x7f7e3806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.095+0000 7f7e517fa700 1 -- 172.21.15.47:0/4278950763 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e4808a7d0 con 0x7f7e44003a00 2024-05-08T19:22:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.096+0000 7f7e53fff700 1 --2- 172.21.15.47:0/4278950763 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f7e3806ac90 0x7f7e3806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.096+0000 7f7e53fff700 1 --2- 172.21.15.47:0/4278950763 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f7e3806ac90 0x7f7e3806d150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e5414fa30 tx=0x7f7e40008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:42.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.100+0000 7f7e517fa700 1 -- 172.21.15.47:0/4278950763 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7e480557d0 con 0x7f7e44003a00 2024-05-08T19:22:42.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.362+0000 7f7e5b096700 1 -- 172.21.15.47:0/4278950763 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7e54067190 con 0x7f7e44003a00 2024-05-08T19:22:42.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.947+0000 7f7e517fa700 1 -- 172.21.15.47:0/4278950763 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7e48058df0 con 0x7f7e44003a00 2024-05-08T19:22:42.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.950+0000 7f7e5b096700 1 -- 172.21.15.47:0/4278950763 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f7e3806ac90 msgr2=0x7f7e3806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:42.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.950+0000 7f7e5b096700 1 --2- 172.21.15.47:0/4278950763 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f7e3806ac90 0x7f7e3806d150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e5414fa30 tx=0x7f7e40008040 comp rx=0 tx=0).stop 2024-05-08T19:22:42.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.950+0000 7f7e5b096700 1 -- 172.21.15.47:0/4278950763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e44003a00 msgr2=0x7f7e54071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:42.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.950+0000 7f7e5b096700 1 --2- 172.21.15.47:0/4278950763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e44003a00 0x7f7e54071860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400c080 tx=0x7f7e48001a00 comp rx=0 tx=0).stop 2024-05-08T19:22:42.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.950+0000 7f7e5b096700 1 -- 172.21.15.47:0/4278950763 shutdown_connections 2024-05-08T19:22:42.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.950+0000 7f7e5b096700 1 --2- 172.21.15.47:0/4278950763 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f7e3806ac90 0x7f7e3806d150 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:42.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.950+0000 7f7e5b096700 1 --2- 172.21.15.47:0/4278950763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e44003a00 0x7f7e54071860 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:42.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.950+0000 7f7e5b096700 1 --2- 172.21.15.47:0/4278950763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e5414c1f0 0x7f7e5414b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:42.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.950+0000 7f7e5b096700 1 --2- 172.21.15.47:0/4278950763 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e540bc3b0 0x7f7e5414b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:42.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.950+0000 7f7e5b096700 1 -- 172.21.15.47:0/4278950763 >> 172.21.15.47:0/4278950763 conn(0x7f7e540c71c0 msgr2=0x7f7e5414df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:42.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.950+0000 7f7e5b096700 1 -- 172.21.15.47:0/4278950763 shutdown_connections 2024-05-08T19:22:42.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:42.950+0000 7f7e5b096700 1 -- 172.21.15.47:0/4278950763 wait complete. 2024-05-08T19:22:42.956 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-08T19:22:42.956 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T19:22:43.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.098+0000 7fa62e859700 1 Processor -- start 2024-05-08T19:22:43.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.098+0000 7fa62e859700 1 -- start start 2024-05-08T19:22:43.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa62e859700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa628152160 0x7fa6280c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa62e859700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa6280c5110 0x7fa62806c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa62e859700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6280c8d60 con 0x7fa628154900 2024-05-08T19:22:43.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa62e859700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62806c530 con 0x7fa6280c5110 2024-05-08T19:22:43.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa62e859700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa628154e70 con 0x7fa628152160 2024-05-08T19:22:43.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa6277fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa6280c5110 0x7fa62806c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa6277fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa6280c5110 0x7fa62806c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35596/0 (socket says 172.21.15.47:35596) 2024-05-08T19:22:43.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa6277fe700 1 -- 172.21.15.47:0/3500491122 learned_addr learned my addr 172.21.15.47:0/3500491122 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:43.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa627fff700 1 --2- 172.21.15.47:0/3500491122 >> v2:172.21.15.177:3300/0 conn(0x7fa628152160 0x7fa6280c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa6277fe700 1 -- 172.21.15.47:0/3500491122 >> v2:172.21.15.177:3300/0 conn(0x7fa628152160 msgr2=0x7fa6280c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:43.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa6277fe700 1 --2- 172.21.15.47:0/3500491122 >> v2:172.21.15.177:3300/0 conn(0x7fa628152160 0x7fa6280c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa6277fe700 1 -- 172.21.15.47:0/3500491122 >> v1:172.21.15.177:6789/0 conn(0x7fa628154900 legacy=0x7fa62806cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:43.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa6277fe700 1 -- 172.21.15.47:0/3500491122 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa628155150 con 0x7fa6280c5110 2024-05-08T19:22:43.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa6277fe700 1 --2- 172.21.15.47:0/3500491122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6280c5110 0x7fa62806c980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa6280acce0 tx=0x7fa61c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0c09a02e6859c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:43.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa626ffd700 1 -- 172.21.15.47:0/3500491122 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c011830 con 0x7fa6280c5110 2024-05-08T19:22:43.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa626ffd700 1 -- 172.21.15.47:0/3500491122 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c011990 con 0x7fa6280c5110 2024-05-08T19:22:43.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.099+0000 7fa626ffd700 1 -- 172.21.15.47:0/3500491122 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c011d20 con 0x7fa6280c5110 2024-05-08T19:22:43.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.100+0000 7fa62e859700 1 -- 172.21.15.47:0/3500491122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6280c5110 msgr2=0x7fa62806c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:43.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.100+0000 7fa62e859700 1 --2- 172.21.15.47:0/3500491122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6280c5110 0x7fa62806c980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa6280acce0 tx=0x7fa61c009bd0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.100+0000 7fa62e859700 1 -- 172.21.15.47:0/3500491122 shutdown_connections 2024-05-08T19:22:43.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.100+0000 7fa62e859700 1 --2- 172.21.15.47:0/3500491122 >> v2:172.21.15.177:3300/0 conn(0x7fa628152160 0x7fa6280c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.100+0000 7fa62e859700 1 --2- 172.21.15.47:0/3500491122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6280c5110 0x7fa62806c980 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.100+0000 7fa62e859700 1 -- 172.21.15.47:0/3500491122 >> 172.21.15.47:0/3500491122 conn(0x7fa6280abea0 msgr2=0x7fa6280ac2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:43.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.100+0000 7fa62e859700 1 -- 172.21.15.47:0/3500491122 shutdown_connections 2024-05-08T19:22:43.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.100+0000 7fa62e859700 1 -- 172.21.15.47:0/3500491122 wait complete. 2024-05-08T19:22:43.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.101+0000 7fa62e859700 1 Processor -- start 2024-05-08T19:22:43.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.101+0000 7fa62e859700 1 -- start start 2024-05-08T19:22:43.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.102+0000 7fa62e859700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6280c5110 0x7fa6281ee530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.102+0000 7fa62e859700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa628152160 0x7fa6281e1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.102+0000 7fa62e859700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa628154900 0x7fa6280a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.102+0000 7fa62e859700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280ca810 con 0x7fa6280c5110 2024-05-08T19:22:43.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.102+0000 7fa62e859700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280c9ef0 con 0x7fa628152160 2024-05-08T19:22:43.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.102+0000 7fa62e859700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280c9110 con 0x7fa628154900 2024-05-08T19:22:43.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.102+0000 7fa627fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6280c5110 0x7fa6281ee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.102+0000 7fa627fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6280c5110 0x7fa6281ee530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35608/0 (socket says 172.21.15.47:35608) 2024-05-08T19:22:43.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.102+0000 7fa627fff700 1 -- 172.21.15.47:0/1697427146 learned_addr learned my addr 172.21.15.47:0/1697427146 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:43.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.102+0000 7fa6277fe700 1 --2- 172.21.15.47:0/1697427146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa628152160 0x7fa6281e1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.102+0000 7fa62cdf6700 1 --2- 172.21.15.47:0/1697427146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa628154900 0x7fa6280a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.103+0000 7fa627fff700 1 -- 172.21.15.47:0/1697427146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa628154900 msgr2=0x7fa6280a9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:43.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.103+0000 7fa627fff700 1 --2- 172.21.15.47:0/1697427146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa628154900 0x7fa6280a9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.103+0000 7fa627fff700 1 -- 172.21.15.47:0/1697427146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa628152160 msgr2=0x7fa6281e1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:43.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.103+0000 7fa627fff700 1 --2- 172.21.15.47:0/1697427146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa628152160 0x7fa6281e1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.103+0000 7fa627fff700 1 -- 172.21.15.47:0/1697427146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c009550 con 0x7fa6280c5110 2024-05-08T19:22:43.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.103+0000 7fa6277fe700 1 --2- 172.21.15.47:0/1697427146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa628152160 0x7fa6281e1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:43.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.103+0000 7fa627fff700 1 --2- 172.21.15.47:0/1697427146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6280c5110 0x7fa6281ee530 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa61800e9e0 tx=0x7fa61800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:43.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.103+0000 7fa624ff9700 1 -- 172.21.15.47:0/1697427146 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618009710 con 0x7fa6280c5110 2024-05-08T19:22:43.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.103+0000 7fa624ff9700 1 -- 172.21.15.47:0/1697427146 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61800c850 con 0x7fa6280c5110 2024-05-08T19:22:43.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.103+0000 7fa62e859700 1 -- 172.21.15.47:0/1697427146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6281eea70 con 0x7fa6280c5110 2024-05-08T19:22:43.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.103+0000 7fa624ff9700 1 -- 172.21.15.47:0/1697427146 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61800cbc0 con 0x7fa6280c5110 2024-05-08T19:22:43.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.103+0000 7fa62e859700 1 -- 172.21.15.47:0/1697427146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6280c9c10 con 0x7fa6280c5110 2024-05-08T19:22:43.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.104+0000 7fa62e859700 1 -- 172.21.15.47:0/1697427146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6280ab610 con 0x7fa6280c5110 2024-05-08T19:22:43.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.104+0000 7fa624ff9700 1 -- 172.21.15.47:0/1697427146 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa61800cd20 con 0x7fa6280c5110 2024-05-08T19:22:43.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.105+0000 7fa624ff9700 1 --2- 172.21.15.47:0/1697427146 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa61406ac90 0x7fa61406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.105+0000 7fa624ff9700 1 -- 172.21.15.47:0/1697427146 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa618089540 con 0x7fa6280c5110 2024-05-08T19:22:43.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.105+0000 7fa6277fe700 1 --2- 172.21.15.47:0/1697427146 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa61406ac90 0x7fa61406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.105+0000 7fa6277fe700 1 --2- 172.21.15.47:0/1697427146 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa61406ac90 0x7fa61406d150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009c10 tx=0x7fa61c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:43.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.109+0000 7fa624ff9700 1 -- 172.21.15.47:0/1697427146 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa6280ab610 con 0x7fa6280c5110 2024-05-08T19:22:43.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.365+0000 7fa62e859700 1 -- 172.21.15.47:0/1697427146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6281eea70 con 0x7fa6280c5110 2024-05-08T19:22:43.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.365+0000 7fa624ff9700 1 -- 172.21.15.47:0/1697427146 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7fa6281eea70 con 0x7fa6280c5110 2024-05-08T19:22:43.356 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:43.356 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3927983771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3927983771},{"type":"v1","addr":"172.21.15.47:6833","nonce":3927983771}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/201830514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":201830514},{"type":"v1","addr":"172.21.15.47:6835","nonce":201830514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1266001461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1266001461},{"type":"v1","addr":"172.21.15.177:6836","nonce":1266001461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T19:22:20.424727+0000","modified":"2024-05-08T19:22:42.943964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/2990594738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2990594738},{"type":"v1","addr":"172.21.15.177:6837","nonce":2990594738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T19:22:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.367+0000 7fa62e859700 1 -- 172.21.15.47:0/1697427146 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa61406ac90 msgr2=0x7fa61406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.367+0000 7fa62e859700 1 --2- 172.21.15.47:0/1697427146 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa61406ac90 0x7fa61406d150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009c10 tx=0x7fa61c008030 comp rx=0 tx=0).stop 2024-05-08T19:22:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.367+0000 7fa62e859700 1 -- 172.21.15.47:0/1697427146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6280c5110 msgr2=0x7fa6281ee530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.367+0000 7fa62e859700 1 --2- 172.21.15.47:0/1697427146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6280c5110 0x7fa6281ee530 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa61800e9e0 tx=0x7fa61800eda0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.367+0000 7fa62e859700 1 -- 172.21.15.47:0/1697427146 shutdown_connections 2024-05-08T19:22:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.367+0000 7fa62e859700 1 --2- 172.21.15.47:0/1697427146 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa61406ac90 0x7fa61406d150 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.367+0000 7fa62e859700 1 --2- 172.21.15.47:0/1697427146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6280c5110 0x7fa6281ee530 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.367+0000 7fa62e859700 1 --2- 172.21.15.47:0/1697427146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa628154900 0x7fa6280a9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.367+0000 7fa62e859700 1 --2- 172.21.15.47:0/1697427146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa628152160 0x7fa6281e1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.367+0000 7fa62e859700 1 -- 172.21.15.47:0/1697427146 >> 172.21.15.47:0/1697427146 conn(0x7fa6280abea0 msgr2=0x7fa628150c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:43.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.367+0000 7fa62e859700 1 -- 172.21.15.47:0/1697427146 shutdown_connections 2024-05-08T19:22:43.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.368+0000 7fa62e859700 1 -- 172.21.15.47:0/1697427146 wait complete. 2024-05-08T19:22:43.360 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-05-08T19:22:43.371 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:43.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.506+0000 7fd48253a700 1 Processor -- start 2024-05-08T19:22:43.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.506+0000 7fd48253a700 1 -- start start 2024-05-08T19:22:43.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd48253a700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd47c152130 0x7fd47c158920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd48253a700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd47c06e890 0x7fd47c06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd48253a700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47c0c4570 con 0x7fd47c0702a0 2024-05-08T19:22:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd48253a700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47c0c2830 con 0x7fd47c152130 2024-05-08T19:22:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd48253a700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47c0c4850 con 0x7fd47c06e890 2024-05-08T19:22:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd47bfff700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd47c152130 0x7fd47c158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd47bfff700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd47c152130 0x7fd47c158920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35620/0 (socket says 172.21.15.47:35620) 2024-05-08T19:22:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd47bfff700 1 -- 172.21.15.47:0/1383570022 learned_addr learned my addr 172.21.15.47:0/1383570022 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd480ad7700 1 --2- 172.21.15.47:0/1383570022 >> v2:172.21.15.177:3300/0 conn(0x7fd47c06e890 0x7fd47c06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd47bfff700 1 -- 172.21.15.47:0/1383570022 >> v2:172.21.15.177:3300/0 conn(0x7fd47c06e890 msgr2=0x7fd47c06ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd47bfff700 1 --2- 172.21.15.47:0/1383570022 >> v2:172.21.15.177:3300/0 conn(0x7fd47c06e890 0x7fd47c06ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd47bfff700 1 -- 172.21.15.47:0/1383570022 >> v1:172.21.15.177:6789/0 conn(0x7fd47c0702a0 legacy=0x7fd47c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd47bfff700 1 -- 172.21.15.47:0/1383570022 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c0c2030 con 0x7fd47c152130 2024-05-08T19:22:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd480ad7700 1 --2- 172.21.15.47:0/1383570022 >> v2:172.21.15.177:3300/0 conn(0x7fd47c06e890 0x7fd47c06ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd47bfff700 1 --2- 172.21.15.47:0/1383570022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd47c152130 0x7fd47c158920 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0c5c20 tx=0x7fd46c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2634813ae94f368b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:43.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd47affd700 1 -- 172.21.15.47:0/1383570022 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c004230 con 0x7fd47c152130 2024-05-08T19:22:43.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd47affd700 1 -- 172.21.15.47:0/1383570022 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c004390 con 0x7fd47c152130 2024-05-08T19:22:43.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.507+0000 7fd47affd700 1 -- 172.21.15.47:0/1383570022 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0036a0 con 0x7fd47c152130 2024-05-08T19:22:43.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.508+0000 7fd48253a700 1 -- 172.21.15.47:0/1383570022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd47c152130 msgr2=0x7fd47c158920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:43.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.508+0000 7fd48253a700 1 --2- 172.21.15.47:0/1383570022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd47c152130 0x7fd47c158920 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0c5c20 tx=0x7fd46c009bd0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.508+0000 7fd48253a700 1 -- 172.21.15.47:0/1383570022 shutdown_connections 2024-05-08T19:22:43.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.508+0000 7fd48253a700 1 --2- 172.21.15.47:0/1383570022 >> v2:172.21.15.177:3300/0 conn(0x7fd47c06e890 0x7fd47c06ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.508+0000 7fd48253a700 1 --2- 172.21.15.47:0/1383570022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd47c152130 0x7fd47c158920 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.508+0000 7fd48253a700 1 -- 172.21.15.47:0/1383570022 >> 172.21.15.47:0/1383570022 conn(0x7fd47c072dd0 msgr2=0x7fd47c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:43.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.508+0000 7fd48253a700 1 -- 172.21.15.47:0/1383570022 shutdown_connections 2024-05-08T19:22:43.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.508+0000 7fd48253a700 1 -- 172.21.15.47:0/1383570022 wait complete. 2024-05-08T19:22:43.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.509+0000 7fd48253a700 1 Processor -- start 2024-05-08T19:22:43.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.509+0000 7fd48253a700 1 -- start start 2024-05-08T19:22:43.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd48253a700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd47c06e890 0x7fd47c14d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd48253a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd47c0702a0 0x7fd47c0c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd48253a700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd47c152130 0x7fd47c1ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd48253a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c152840 con 0x7fd47c0702a0 2024-05-08T19:22:43.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd48253a700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c0ab510 con 0x7fd47c06e890 2024-05-08T19:22:43.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd48253a700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c152c60 con 0x7fd47c152130 2024-05-08T19:22:43.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd47b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd47c0702a0 0x7fd47c0c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd47b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd47c0702a0 0x7fd47c0c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35628/0 (socket says 172.21.15.47:35628) 2024-05-08T19:22:43.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd47b7fe700 1 -- 172.21.15.47:0/4120203754 learned_addr learned my addr 172.21.15.47:0/4120203754 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:43.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd47bfff700 1 --2- 172.21.15.47:0/4120203754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd47c06e890 0x7fd47c14d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd480ad7700 1 --2- 172.21.15.47:0/4120203754 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd47c152130 0x7fd47c1ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd47b7fe700 1 -- 172.21.15.47:0/4120203754 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd47c152130 msgr2=0x7fd47c1ed4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:43.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd47b7fe700 1 --2- 172.21.15.47:0/4120203754 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd47c152130 0x7fd47c1ed4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd47b7fe700 1 -- 172.21.15.47:0/4120203754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd47c06e890 msgr2=0x7fd47c14d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:43.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd47b7fe700 1 --2- 172.21.15.47:0/4120203754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd47c06e890 0x7fd47c14d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.510+0000 7fd47b7fe700 1 -- 172.21.15.47:0/4120203754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c009550 con 0x7fd47c0702a0 2024-05-08T19:22:43.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.511+0000 7fd47b7fe700 1 --2- 172.21.15.47:0/4120203754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd47c0702a0 0x7fd47c0c7860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd47000c4d0 tx=0x7fd47000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:43.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.511+0000 7fd478ff9700 1 -- 172.21.15.47:0/4120203754 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470011790 con 0x7fd47c0702a0 2024-05-08T19:22:43.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.511+0000 7fd478ff9700 1 -- 172.21.15.47:0/4120203754 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4700118f0 con 0x7fd47c0702a0 2024-05-08T19:22:43.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.511+0000 7fd48253a700 1 -- 172.21.15.47:0/4120203754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47c0aafc0 con 0x7fd47c0702a0 2024-05-08T19:22:43.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.511+0000 7fd478ff9700 1 -- 172.21.15.47:0/4120203754 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470011ca0 con 0x7fd47c0702a0 2024-05-08T19:22:43.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.511+0000 7fd48253a700 1 -- 172.21.15.47:0/4120203754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47c14d850 con 0x7fd47c0702a0 2024-05-08T19:22:43.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.512+0000 7fd48253a700 1 -- 172.21.15.47:0/4120203754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47c1525a0 con 0x7fd47c0702a0 2024-05-08T19:22:43.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.512+0000 7fd478ff9700 1 -- 172.21.15.47:0/4120203754 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd47001c460 con 0x7fd47c0702a0 2024-05-08T19:22:43.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.512+0000 7fd478ff9700 1 --2- 172.21.15.47:0/4120203754 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd46806ac90 0x7fd46806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.513+0000 7fd478ff9700 1 -- 172.21.15.47:0/4120203754 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd470089430 con 0x7fd47c0702a0 2024-05-08T19:22:43.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.513+0000 7fd47bfff700 1 --2- 172.21.15.47:0/4120203754 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd46806ac90 0x7fd46806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.513+0000 7fd47bfff700 1 --2- 172.21.15.47:0/4120203754 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd46806ac90 0x7fd46806d150 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009130 tx=0x7fd46c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:43.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.517+0000 7fd478ff9700 1 -- 172.21.15.47:0/4120203754 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd47c1525a0 con 0x7fd47c0702a0 2024-05-08T19:22:43.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.726+0000 7fd48253a700 1 -- 172.21.15.47:0/4120203754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd47c152980 con 0x7fd47c0702a0 2024-05-08T19:22:43.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.727+0000 7fd478ff9700 1 -- 172.21.15.47:0/4120203754 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17878 (secure 0 0 0) 0x7fd47c152980 con 0x7fd47c0702a0 2024-05-08T19:22:43.719 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:43.719 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:24.891864+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:43.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.730+0000 7fd48253a700 1 -- 172.21.15.47:0/4120203754 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd46806ac90 msgr2=0x7fd46806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:43.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.730+0000 7fd48253a700 1 --2- 172.21.15.47:0/4120203754 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd46806ac90 0x7fd46806d150 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009130 tx=0x7fd46c008030 comp rx=0 tx=0).stop 2024-05-08T19:22:43.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.730+0000 7fd48253a700 1 -- 172.21.15.47:0/4120203754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd47c0702a0 msgr2=0x7fd47c0c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:43.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.730+0000 7fd48253a700 1 --2- 172.21.15.47:0/4120203754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd47c0702a0 0x7fd47c0c7860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd47000c4d0 tx=0x7fd47000c890 comp rx=0 tx=0).stop 2024-05-08T19:22:43.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.730+0000 7fd48253a700 1 -- 172.21.15.47:0/4120203754 shutdown_connections 2024-05-08T19:22:43.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.730+0000 7fd48253a700 1 --2- 172.21.15.47:0/4120203754 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd46806ac90 0x7fd46806d150 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.730+0000 7fd48253a700 1 --2- 172.21.15.47:0/4120203754 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd47c152130 0x7fd47c1ed4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.730+0000 7fd48253a700 1 --2- 172.21.15.47:0/4120203754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd47c06e890 0x7fd47c14d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.730+0000 7fd48253a700 1 --2- 172.21.15.47:0/4120203754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd47c0702a0 0x7fd47c0c7860 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.730+0000 7fd48253a700 1 -- 172.21.15.47:0/4120203754 >> 172.21.15.47:0/4120203754 conn(0x7fd47c072dd0 msgr2=0x7fd47c06ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:43.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.730+0000 7fd48253a700 1 -- 172.21.15.47:0/4120203754 shutdown_connections 2024-05-08T19:22:43.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.730+0000 7fd48253a700 1 -- 172.21.15.47:0/4120203754 wait complete. 2024-05-08T19:22:43.734 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-08T19:22:43.734 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T19:22:43.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.869+0000 7f9a86412700 1 Processor -- start 2024-05-08T19:22:43.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.869+0000 7f9a86412700 1 -- start start 2024-05-08T19:22:43.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.870+0000 7f9a86412700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a800ac4e0 0x7f9a800a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.870+0000 7f9a86412700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9a8006e6e0 0x7f9a800ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.870+0000 7f9a86412700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8006f7a0 con 0x7f9a801562d0 2024-05-08T19:22:43.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.870+0000 7f9a86412700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a80071fd0 con 0x7f9a8006e6e0 2024-05-08T19:22:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.870+0000 7f9a86412700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a800a8930 con 0x7f9a800ac4e0 2024-05-08T19:22:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.870+0000 7f9a7f7fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9a8006e6e0 0x7f9a800ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.870+0000 7f9a7f7fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9a8006e6e0 0x7f9a800ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35644/0 (socket says 172.21.15.47:35644) 2024-05-08T19:22:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.870+0000 7f9a7f7fe700 1 -- 172.21.15.47:0/2052910119 learned_addr learned my addr 172.21.15.47:0/2052910119 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.870+0000 7f9a7ffff700 1 --2- 172.21.15.47:0/2052910119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a800ac4e0 0x7f9a800a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.870+0000 7f9a7f7fe700 1 -- 172.21.15.47:0/2052910119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a800ac4e0 msgr2=0x7f9a800a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.870+0000 7f9a7f7fe700 1 --2- 172.21.15.47:0/2052910119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a800ac4e0 0x7f9a800a9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.870+0000 7f9a7f7fe700 1 -- 172.21.15.47:0/2052910119 >> v1:172.21.15.177:6789/0 conn(0x7f9a801562d0 legacy=0x7f9a80156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.870+0000 7f9a7f7fe700 1 -- 172.21.15.47:0/2052910119 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a80152890 con 0x7f9a8006e6e0 2024-05-08T19:22:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.870+0000 7f9a7f7fe700 1 --2- 172.21.15.47:0/2052910119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a8006e6e0 0x7f9a800ac8c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9a680098f0 tx=0x7f9a68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbaa9c7d0d69076a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.870+0000 7f9a7effd700 1 -- 172.21.15.47:0/2052910119 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6800b8a0 con 0x7f9a8006e6e0 2024-05-08T19:22:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.871+0000 7f9a7effd700 1 -- 172.21.15.47:0/2052910119 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6800ba00 con 0x7f9a8006e6e0 2024-05-08T19:22:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.871+0000 7f9a7effd700 1 -- 172.21.15.47:0/2052910119 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6800bd90 con 0x7f9a8006e6e0 2024-05-08T19:22:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.871+0000 7f9a86412700 1 -- 172.21.15.47:0/2052910119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a8006e6e0 msgr2=0x7f9a800ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.871+0000 7f9a86412700 1 --2- 172.21.15.47:0/2052910119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a8006e6e0 0x7f9a800ac8c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9a680098f0 tx=0x7f9a68009c00 comp rx=0 tx=0).stop 2024-05-08T19:22:43.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.871+0000 7f9a86412700 1 -- 172.21.15.47:0/2052910119 shutdown_connections 2024-05-08T19:22:43.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.871+0000 7f9a86412700 1 --2- 172.21.15.47:0/2052910119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a800ac4e0 0x7f9a800a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.871+0000 7f9a86412700 1 --2- 172.21.15.47:0/2052910119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a8006e6e0 0x7f9a800ac8c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.871+0000 7f9a86412700 1 -- 172.21.15.47:0/2052910119 >> 172.21.15.47:0/2052910119 conn(0x7f9a800c7120 msgr2=0x7f9a800c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:43.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.871+0000 7f9a86412700 1 -- 172.21.15.47:0/2052910119 shutdown_connections 2024-05-08T19:22:43.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.871+0000 7f9a86412700 1 -- 172.21.15.47:0/2052910119 wait complete. 2024-05-08T19:22:43.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.872+0000 7f9a86412700 1 Processor -- start 2024-05-08T19:22:43.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.873+0000 7f9a86412700 1 -- start start 2024-05-08T19:22:43.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.873+0000 7f9a86412700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a8006e6e0 0x7f9a800c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.873+0000 7f9a86412700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a800ac4e0 0x7f9a800c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.873+0000 7f9a86412700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a801562d0 0x7f9a80146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.873+0000 7f9a86412700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a80147730 con 0x7f9a800ac4e0 2024-05-08T19:22:43.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.873+0000 7f9a86412700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a80155ca0 con 0x7f9a801562d0 2024-05-08T19:22:43.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.873+0000 7f9a86412700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a80147e20 con 0x7f9a8006e6e0 2024-05-08T19:22:43.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.873+0000 7f9a7f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a800ac4e0 0x7f9a800c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.873+0000 7f9a7f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a800ac4e0 0x7f9a800c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35660/0 (socket says 172.21.15.47:35660) 2024-05-08T19:22:43.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.873+0000 7f9a7f7fe700 1 -- 172.21.15.47:0/844451482 learned_addr learned my addr 172.21.15.47:0/844451482 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:43.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.874+0000 7f9a849af700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a801562d0 0x7f9a80146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.874+0000 7f9a7ffff700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a8006e6e0 0x7f9a800c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.874+0000 7f9a7f7fe700 1 -- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a8006e6e0 msgr2=0x7f9a800c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:43.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.874+0000 7f9a7f7fe700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a8006e6e0 0x7f9a800c2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.874+0000 7f9a7f7fe700 1 -- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a801562d0 msgr2=0x7f9a80146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:43.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.874+0000 7f9a7f7fe700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a801562d0 0x7f9a80146ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:43.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.874+0000 7f9a7f7fe700 1 -- 172.21.15.47:0/844451482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a68009550 con 0x7f9a800ac4e0 2024-05-08T19:22:43.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.874+0000 7f9a849af700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a801562d0 0x7f9a80146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:43.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.874+0000 7f9a7ffff700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a8006e6e0 0x7f9a800c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:43.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.874+0000 7f9a7f7fe700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a800ac4e0 0x7f9a800c68b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9a68014040 tx=0x7f9a68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:43.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.874+0000 7f9a7cff9700 1 -- 172.21.15.47:0/844451482 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a680036a0 con 0x7f9a800ac4e0 2024-05-08T19:22:43.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.874+0000 7f9a7cff9700 1 -- 172.21.15.47:0/844451482 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6801e070 con 0x7f9a800ac4e0 2024-05-08T19:22:43.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.874+0000 7f9a86412700 1 -- 172.21.15.47:0/844451482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a80147980 con 0x7f9a800ac4e0 2024-05-08T19:22:43.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.874+0000 7f9a7cff9700 1 -- 172.21.15.47:0/844451482 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68003a60 con 0x7f9a800ac4e0 2024-05-08T19:22:43.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.874+0000 7f9a86412700 1 -- 172.21.15.47:0/844451482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a800c6df0 con 0x7f9a800ac4e0 2024-05-08T19:22:43.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.875+0000 7f9a86412700 1 -- 172.21.15.47:0/844451482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a80153be0 con 0x7f9a800ac4e0 2024-05-08T19:22:43.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.875+0000 7f9a7cff9700 1 -- 172.21.15.47:0/844451482 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9a68003bc0 con 0x7f9a800ac4e0 2024-05-08T19:22:43.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.876+0000 7f9a7cff9700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f9a6006ac90 0x7f9a6006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:43.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.876+0000 7f9a7cff9700 1 -- 172.21.15.47:0/844451482 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a68020070 con 0x7f9a800ac4e0 2024-05-08T19:22:43.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.876+0000 7f9a7ffff700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f9a6006ac90 0x7f9a6006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:43.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.877+0000 7f9a7ffff700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f9a6006ac90 0x7f9a6006d150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9a800a8e10 tx=0x7f9a70008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:43.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:43.881+0000 7f9a7cff9700 1 -- 172.21.15.47:0/844451482 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9a80153be0 con 0x7f9a800ac4e0 2024-05-08T19:22:44.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.088+0000 7f9a86412700 1 -- 172.21.15.47:0/844451482 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a80071c60 con 0x7f9a6006ac90 2024-05-08T19:22:44.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.099+0000 7f9a7cff9700 1 -- 172.21.15.47:0/844451482 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345349 (secure 0 0 0) 0x7f9a700133f0 con 0x7f9a6006ac90 2024-05-08T19:22:44.094 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:44.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.102+0000 7f9a86412700 1 -- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f9a6006ac90 msgr2=0x7f9a6006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.102+0000 7f9a86412700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f9a6006ac90 0x7f9a6006d150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9a800a8e10 tx=0x7f9a70008040 comp rx=0 tx=0).stop 2024-05-08T19:22:44.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.102+0000 7f9a86412700 1 -- 172.21.15.47:0/844451482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a800ac4e0 msgr2=0x7f9a800c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.102+0000 7f9a86412700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a800ac4e0 0x7f9a800c68b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9a68014040 tx=0x7f9a68004750 comp rx=0 tx=0).stop 2024-05-08T19:22:44.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.102+0000 7f9a86412700 1 -- 172.21.15.47:0/844451482 shutdown_connections 2024-05-08T19:22:44.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.102+0000 7f9a86412700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f9a6006ac90 0x7f9a6006d150 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.102+0000 7f9a86412700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a801562d0 0x7f9a80146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.102+0000 7f9a86412700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a8006e6e0 0x7f9a800c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.102+0000 7f9a86412700 1 --2- 172.21.15.47:0/844451482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a800ac4e0 0x7f9a800c68b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.102+0000 7f9a86412700 1 -- 172.21.15.47:0/844451482 >> 172.21.15.47:0/844451482 conn(0x7f9a800c7120 msgr2=0x7f9a80151480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.102+0000 7f9a86412700 1 -- 172.21.15.47:0/844451482 shutdown_connections 2024-05-08T19:22:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.103+0000 7f9a86412700 1 -- 172.21.15.47:0/844451482 wait complete. 2024-05-08T19:22:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-08T19:22:44.106 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-05-08T19:22:43.870745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218376,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756344,"statfs":{"total":773094113280,"available":772870496256,"internally_reserved":0,"allocated":2228224,"data_stored":1988164,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003814"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888597+0000","last_change":"2024-05-08T19:22:20.461758+0000","last_active":"2024-05-08T19:22:24.888597+0000","last_peered":"2024-05-08T19:22:24.888597+0000","last_clean":"2024-05-08T19:22:24.888597+0000","last_became_active":"2024-05-08T19:22:20.461515+0000","last_became_peered":"2024-05-08T19:22:20.461515+0000","last_unstale":"2024-05-08T19:22:24.888597+0000","last_undegraded":"2024-05-08T19:22:24.888597+0000","last_fullsized":"2024-05-08T19:22:24.888597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879290+0000","last_change":"2024-05-08T19:22:20.434929+0000","last_active":"2024-05-08T19:22:24.879290+0000","last_peered":"2024-05-08T19:22:24.879290+0000","last_clean":"2024-05-08T19:22:24.879290+0000","last_became_active":"2024-05-08T19:22:20.434629+0000","last_became_peered":"2024-05-08T19:22:20.434629+0000","last_unstale":"2024-05-08T19:22:24.879290+0000","last_undegraded":"2024-05-08T19:22:24.879290+0000","last_fullsized":"2024-05-08T19:22:24.879290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878900+0000","last_change":"2024-05-08T19:22:20.449450+0000","last_active":"2024-05-08T19:22:24.878900+0000","last_peered":"2024-05-08T19:22:24.878900+0000","last_clean":"2024-05-08T19:22:24.878900+0000","last_became_active":"2024-05-08T19:22:20.449184+0000","last_became_peered":"2024-05-08T19:22:20.449184+0000","last_unstale":"2024-05-08T19:22:24.878900+0000","last_undegraded":"2024-05-08T19:22:24.878900+0000","last_fullsized":"2024-05-08T19:22:24.878900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875678+0000","last_change":"2024-05-08T19:22:20.449919+0000","last_active":"2024-05-08T19:22:24.875678+0000","last_peered":"2024-05-08T19:22:24.875678+0000","last_clean":"2024-05-08T19:22:24.875678+0000","last_became_active":"2024-05-08T19:22:20.449637+0000","last_became_peered":"2024-05-08T19:22:20.449637+0000","last_unstale":"2024-05-08T19:22:24.875678+0000","last_undegraded":"2024-05-08T19:22:24.875678+0000","last_fullsized":"2024-05-08T19:22:24.875678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888369+0000","last_change":"2024-05-08T19:22:20.449676+0000","last_active":"2024-05-08T19:22:24.888369+0000","last_peered":"2024-05-08T19:22:24.888369+0000","last_clean":"2024-05-08T19:22:24.888369+0000","last_became_active":"2024-05-08T19:22:20.449347+0000","last_became_peered":"2024-05-08T19:22:20.449347+0000","last_unstale":"2024-05-08T19:22:24.888369+0000","last_undegraded":"2024-05-08T19:22:24.888369+0000","last_fullsized":"2024-05-08T19:22:24.888369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:29.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875620+0000","last_change":"2024-05-08T19:22:20.447174+0000","last_active":"2024-05-08T19:22:24.875620+0000","last_peered":"2024-05-08T19:22:24.875620+0000","last_clean":"2024-05-08T19:22:24.875620+0000","last_became_active":"2024-05-08T19:22:20.446893+0000","last_became_peered":"2024-05-08T19:22:20.446893+0000","last_unstale":"2024-05-08T19:22:24.875620+0000","last_undegraded":"2024-05-08T19:22:24.875620+0000","last_fullsized":"2024-05-08T19:22:24.875620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:25.101779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888313+0000","last_change":"2024-05-08T19:22:20.446830+0000","last_active":"2024-05-08T19:22:24.888313+0000","last_peered":"2024-05-08T19:22:24.888313+0000","last_clean":"2024-05-08T19:22:24.888313+0000","last_became_active":"2024-05-08T19:22:20.446520+0000","last_became_peered":"2024-05-08T19:22:20.446520+0000","last_unstale":"2024-05-08T19:22:24.888313+0000","last_undegraded":"2024-05-08T19:22:24.888313+0000","last_fullsized":"2024-05-08T19:22:24.888313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:25.101779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879197+0000","last_change":"2024-05-08T19:22:20.447313+0000","last_active":"2024-05-08T19:22:24.879197+0000","last_peered":"2024-05-08T19:22:24.879197+0000","last_clean":"2024-05-08T19:22:24.879197+0000","last_became_active":"2024-05-08T19:22:20.447031+0000","last_became_peered":"2024-05-08T19:22:20.447031+0000","last_unstale":"2024-05-08T19:22:24.879197+0000","last_undegraded":"2024-05-08T19:22:24.879197+0000","last_fullsized":"2024-05-08T19:22:24.879197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888578+0000","last_change":"2024-05-08T19:22:20.447186+0000","last_active":"2024-05-08T19:22:24.888578+0000","last_peered":"2024-05-08T19:22:24.888578+0000","last_clean":"2024-05-08T19:22:24.888578+0000","last_became_active":"2024-05-08T19:22:20.446803+0000","last_became_peered":"2024-05-08T19:22:20.446803+0000","last_unstale":"2024-05-08T19:22:24.888578+0000","last_undegraded":"2024-05-08T19:22:24.888578+0000","last_fullsized":"2024-05-08T19:22:24.888578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885037+0000","last_change":"2024-05-08T19:22:20.462899+0000","last_active":"2024-05-08T19:22:24.885037+0000","last_peered":"2024-05-08T19:22:24.885037+0000","last_clean":"2024-05-08T19:22:24.885037+0000","last_became_active":"2024-05-08T19:22:20.461395+0000","last_became_peered":"2024-05-08T19:22:20.461395+0000","last_unstale":"2024-05-08T19:22:24.885037+0000","last_undegraded":"2024-05-08T19:22:24.885037+0000","last_fullsized":"2024-05-08T19:22:24.885037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885018+0000","last_change":"2024-05-08T19:22:20.459545+0000","last_active":"2024-05-08T19:22:24.885018+0000","last_peered":"2024-05-08T19:22:24.885018+0000","last_clean":"2024-05-08T19:22:24.885018+0000","last_became_active":"2024-05-08T19:22:20.459253+0000","last_became_peered":"2024-05-08T19:22:20.459253+0000","last_unstale":"2024-05-08T19:22:24.885018+0000","last_undegraded":"2024-05-08T19:22:24.885018+0000","last_fullsized":"2024-05-08T19:22:24.885018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882661+0000","last_change":"2024-05-08T19:22:20.462193+0000","last_active":"2024-05-08T19:22:24.882661+0000","last_peered":"2024-05-08T19:22:24.882661+0000","last_clean":"2024-05-08T19:22:24.882661+0000","last_became_active":"2024-05-08T19:22:20.461852+0000","last_became_peered":"2024-05-08T19:22:20.461852+0000","last_unstale":"2024-05-08T19:22:24.882661+0000","last_undegraded":"2024-05-08T19:22:24.882661+0000","last_fullsized":"2024-05-08T19:22:24.882661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:51.431376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879318+0000","last_change":"2024-05-08T19:22:20.453169+0000","last_active":"2024-05-08T19:22:24.879318+0000","last_peered":"2024-05-08T19:22:24.879318+0000","last_clean":"2024-05-08T19:22:24.879318+0000","last_became_active":"2024-05-08T19:22:20.452884+0000","last_became_peered":"2024-05-08T19:22:20.452884+0000","last_unstale":"2024-05-08T19:22:24.879318+0000","last_undegraded":"2024-05-08T19:22:24.879318+0000","last_fullsized":"2024-05-08T19:22:24.879318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878772+0000","last_change":"2024-05-08T19:22:20.435745+0000","last_active":"2024-05-08T19:22:24.878772+0000","last_peered":"2024-05-08T19:22:24.878772+0000","last_clean":"2024-05-08T19:22:24.878772+0000","last_became_active":"2024-05-08T19:22:20.435456+0000","last_became_peered":"2024-05-08T19:22:20.435456+0000","last_unstale":"2024-05-08T19:22:24.878772+0000","last_undegraded":"2024-05-08T19:22:24.878772+0000","last_fullsized":"2024-05-08T19:22:24.878772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879116+0000","last_change":"2024-05-08T19:22:20.444615+0000","last_active":"2024-05-08T19:22:24.879116+0000","last_peered":"2024-05-08T19:22:24.879116+0000","last_clean":"2024-05-08T19:22:24.879116+0000","last_became_active":"2024-05-08T19:22:20.444369+0000","last_became_peered":"2024-05-08T19:22:20.444369+0000","last_unstale":"2024-05-08T19:22:24.879116+0000","last_undegraded":"2024-05-08T19:22:24.879116+0000","last_fullsized":"2024-05-08T19:22:24.879116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875527+0000","last_change":"2024-05-08T19:22:20.445391+0000","last_active":"2024-05-08T19:22:24.875527+0000","last_peered":"2024-05-08T19:22:24.875527+0000","last_clean":"2024-05-08T19:22:24.875527+0000","last_became_active":"2024-05-08T19:22:20.444996+0000","last_became_peered":"2024-05-08T19:22:20.444996+0000","last_unstale":"2024-05-08T19:22:24.875527+0000","last_undegraded":"2024-05-08T19:22:24.875527+0000","last_fullsized":"2024-05-08T19:22:24.875527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875748+0000","last_change":"2024-05-08T19:22:20.451170+0000","last_active":"2024-05-08T19:22:24.875748+0000","last_peered":"2024-05-08T19:22:24.875748+0000","last_clean":"2024-05-08T19:22:24.875748+0000","last_became_active":"2024-05-08T19:22:20.450843+0000","last_became_peered":"2024-05-08T19:22:20.450843+0000","last_unstale":"2024-05-08T19:22:24.875748+0000","last_undegraded":"2024-05-08T19:22:24.875748+0000","last_fullsized":"2024-05-08T19:22:24.875748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.886301+0000","last_change":"2024-05-08T19:22:20.462503+0000","last_active":"2024-05-08T19:22:24.886301+0000","last_peered":"2024-05-08T19:22:24.886301+0000","last_clean":"2024-05-08T19:22:24.886301+0000","last_became_active":"2024-05-08T19:22:20.462266+0000","last_became_peered":"2024-05-08T19:22:20.462266+0000","last_unstale":"2024-05-08T19:22:24.886301+0000","last_undegraded":"2024-05-08T19:22:24.886301+0000","last_fullsized":"2024-05-08T19:22:24.886301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:04.174914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888517+0000","last_change":"2024-05-08T19:22:20.454128+0000","last_active":"2024-05-08T19:22:24.888517+0000","last_peered":"2024-05-08T19:22:24.888517+0000","last_clean":"2024-05-08T19:22:24.888517+0000","last_became_active":"2024-05-08T19:22:20.453834+0000","last_became_peered":"2024-05-08T19:22:20.453834+0000","last_unstale":"2024-05-08T19:22:24.888517+0000","last_undegraded":"2024-05-08T19:22:24.888517+0000","last_fullsized":"2024-05-08T19:22:24.888517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:23.193366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879275+0000","last_change":"2024-05-08T19:22:24.616532+0000","last_active":"2024-05-08T19:22:24.879275+0000","last_peered":"2024-05-08T19:22:24.879275+0000","last_clean":"2024-05-08T19:22:24.879275+0000","last_became_active":"2024-05-08T19:22:24.616128+0000","last_became_peered":"2024-05-08T19:22:24.616128+0000","last_unstale":"2024-05-08T19:22:24.879275+0000","last_undegraded":"2024-05-08T19:22:24.879275+0000","last_fullsized":"2024-05-08T19:22:24.879275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:44.356550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.459339+0000","last_change":"2024-05-08T19:22:20.012743+0000","last_active":"2024-05-08T19:22:24.459339+0000","last_peered":"2024-05-08T19:22:24.459339+0000","last_clean":"2024-05-08T19:22:24.459339+0000","last_became_active":"2024-05-08T19:22:20.012453+0000","last_became_peered":"2024-05-08T19:22:20.012453+0000","last_unstale":"2024-05-08T19:22:24.459339+0000","last_undegraded":"2024-05-08T19:22:24.459339+0000","last_fullsized":"2024-05-08T19:22:24.459339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:52.547906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879448+0000","last_change":"2024-05-08T19:22:20.464578+0000","last_active":"2024-05-08T19:22:24.879448+0000","last_peered":"2024-05-08T19:22:24.879448+0000","last_clean":"2024-05-08T19:22:24.879448+0000","last_became_active":"2024-05-08T19:22:20.464396+0000","last_became_peered":"2024-05-08T19:22:20.464396+0000","last_unstale":"2024-05-08T19:22:24.879448+0000","last_undegraded":"2024-05-08T19:22:24.879448+0000","last_fullsized":"2024-05-08T19:22:24.879448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882432+0000","last_change":"2024-05-08T19:22:24.469561+0000","last_active":"2024-05-08T19:22:24.882432+0000","last_peered":"2024-05-08T19:22:24.882432+0000","last_clean":"2024-05-08T19:22:24.882432+0000","last_became_active":"2024-05-08T19:22:24.469161+0000","last_became_peered":"2024-05-08T19:22:24.469161+0000","last_unstale":"2024-05-08T19:22:24.882432+0000","last_undegraded":"2024-05-08T19:22:24.882432+0000","last_fullsized":"2024-05-08T19:22:24.882432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:50.011809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.449197+0000","last_change":"2024-05-08T19:22:20.006198+0000","last_active":"2024-05-08T19:22:24.449197+0000","last_peered":"2024-05-08T19:22:24.449197+0000","last_clean":"2024-05-08T19:22:24.449197+0000","last_became_active":"2024-05-08T19:22:20.005723+0000","last_became_peered":"2024-05-08T19:22:20.005723+0000","last_unstale":"2024-05-08T19:22:24.449197+0000","last_undegraded":"2024-05-08T19:22:24.449197+0000","last_fullsized":"2024-05-08T19:22:24.449197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878995+0000","last_change":"2024-05-08T19:22:20.451485+0000","last_active":"2024-05-08T19:22:24.878995+0000","last_peered":"2024-05-08T19:22:24.878995+0000","last_clean":"2024-05-08T19:22:24.878995+0000","last_became_active":"2024-05-08T19:22:20.446380+0000","last_became_peered":"2024-05-08T19:22:20.446380+0000","last_unstale":"2024-05-08T19:22:24.878995+0000","last_undegraded":"2024-05-08T19:22:24.878995+0000","last_fullsized":"2024-05-08T19:22:24.878995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:47.856077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882551+0000","last_change":"2024-05-08T19:22:24.465354+0000","last_active":"2024-05-08T19:22:24.882551+0000","last_peered":"2024-05-08T19:22:24.882551+0000","last_clean":"2024-05-08T19:22:24.882551+0000","last_became_active":"2024-05-08T19:22:24.464669+0000","last_became_peered":"2024-05-08T19:22:24.464669+0000","last_unstale":"2024-05-08T19:22:24.882551+0000","last_undegraded":"2024-05-08T19:22:24.882551+0000","last_fullsized":"2024-05-08T19:22:24.882551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:29.398413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612530+0000","last_change":"2024-05-08T19:22:20.014506+0000","last_active":"2024-05-08T19:22:24.612530+0000","last_peered":"2024-05-08T19:22:24.612530+0000","last_clean":"2024-05-08T19:22:24.612530+0000","last_became_active":"2024-05-08T19:22:20.014239+0000","last_became_peered":"2024-05-08T19:22:20.014239+0000","last_unstale":"2024-05-08T19:22:24.612530+0000","last_undegraded":"2024-05-08T19:22:24.612530+0000","last_fullsized":"2024-05-08T19:22:24.612530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:23.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875653+0000","last_change":"2024-05-08T19:22:20.460913+0000","last_active":"2024-05-08T19:22:24.875653+0000","last_peered":"2024-05-08T19:22:24.875653+0000","last_clean":"2024-05-08T19:22:24.875653+0000","last_became_active":"2024-05-08T19:22:20.460601+0000","last_became_peered":"2024-05-08T19:22:20.460601+0000","last_unstale":"2024-05-08T19:22:24.875653+0000","last_undegraded":"2024-05-08T19:22:24.875653+0000","last_fullsized":"2024-05-08T19:22:24.875653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882504+0000","last_change":"2024-05-08T19:22:24.479649+0000","last_active":"2024-05-08T19:22:24.882504+0000","last_peered":"2024-05-08T19:22:24.882504+0000","last_clean":"2024-05-08T19:22:24.882504+0000","last_became_active":"2024-05-08T19:22:24.479255+0000","last_became_peered":"2024-05-08T19:22:24.479255+0000","last_unstale":"2024-05-08T19:22:24.882504+0000","last_undegraded":"2024-05-08T19:22:24.882504+0000","last_fullsized":"2024-05-08T19:22:24.882504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612447+0000","last_change":"2024-05-08T19:22:20.014093+0000","last_active":"2024-05-08T19:22:24.612447+0000","last_peered":"2024-05-08T19:22:24.612447+0000","last_clean":"2024-05-08T19:22:24.612447+0000","last_became_active":"2024-05-08T19:22:20.013793+0000","last_became_peered":"2024-05-08T19:22:20.013793+0000","last_unstale":"2024-05-08T19:22:24.612447+0000","last_undegraded":"2024-05-08T19:22:24.612447+0000","last_fullsized":"2024-05-08T19:22:24.612447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875700+0000","last_change":"2024-05-08T19:22:20.455505+0000","last_active":"2024-05-08T19:22:24.875700+0000","last_peered":"2024-05-08T19:22:24.875700+0000","last_clean":"2024-05-08T19:22:24.875700+0000","last_became_active":"2024-05-08T19:22:20.455148+0000","last_became_peered":"2024-05-08T19:22:20.455148+0000","last_unstale":"2024-05-08T19:22:24.875700+0000","last_undegraded":"2024-05-08T19:22:24.875700+0000","last_fullsized":"2024-05-08T19:22:24.875700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879418+0000","last_change":"2024-05-08T19:22:24.465009+0000","last_active":"2024-05-08T19:22:24.879418+0000","last_peered":"2024-05-08T19:22:24.879418+0000","last_clean":"2024-05-08T19:22:24.879418+0000","last_became_active":"2024-05-08T19:22:24.464422+0000","last_became_peered":"2024-05-08T19:22:24.464422+0000","last_unstale":"2024-05-08T19:22:24.879418+0000","last_undegraded":"2024-05-08T19:22:24.879418+0000","last_fullsized":"2024-05-08T19:22:24.879418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:12.830755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.449208+0000","last_change":"2024-05-08T19:22:20.011515+0000","last_active":"2024-05-08T19:22:24.449208+0000","last_peered":"2024-05-08T19:22:24.449208+0000","last_clean":"2024-05-08T19:22:24.449208+0000","last_became_active":"2024-05-08T19:22:20.011183+0000","last_became_peered":"2024-05-08T19:22:20.011183+0000","last_unstale":"2024-05-08T19:22:24.449208+0000","last_undegraded":"2024-05-08T19:22:24.449208+0000","last_fullsized":"2024-05-08T19:22:24.449208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882529+0000","last_change":"2024-05-08T19:22:20.439371+0000","last_active":"2024-05-08T19:22:24.882529+0000","last_peered":"2024-05-08T19:22:24.882529+0000","last_clean":"2024-05-08T19:22:24.882529+0000","last_became_active":"2024-05-08T19:22:20.439096+0000","last_became_peered":"2024-05-08T19:22:20.439096+0000","last_unstale":"2024-05-08T19:22:24.882529+0000","last_undegraded":"2024-05-08T19:22:24.882529+0000","last_fullsized":"2024-05-08T19:22:24.882529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:56.795619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.886255+0000","last_change":"2024-05-08T19:22:24.476370+0000","last_active":"2024-05-08T19:22:24.886255+0000","last_peered":"2024-05-08T19:22:24.886255+0000","last_clean":"2024-05-08T19:22:24.886255+0000","last_became_active":"2024-05-08T19:22:24.475891+0000","last_became_peered":"2024-05-08T19:22:24.475891+0000","last_unstale":"2024-05-08T19:22:24.886255+0000","last_undegraded":"2024-05-08T19:22:24.886255+0000","last_fullsized":"2024-05-08T19:22:24.886255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:58.674524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458227+0000","last_change":"2024-05-08T19:22:20.004185+0000","last_active":"2024-05-08T19:22:24.458227+0000","last_peered":"2024-05-08T19:22:24.458227+0000","last_clean":"2024-05-08T19:22:24.458227+0000","last_became_active":"2024-05-08T19:22:20.003513+0000","last_became_peered":"2024-05-08T19:22:20.003513+0000","last_unstale":"2024-05-08T19:22:24.458227+0000","last_undegraded":"2024-05-08T19:22:24.458227+0000","last_fullsized":"2024-05-08T19:22:24.458227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878842+0000","last_change":"2024-05-08T19:22:20.446538+0000","last_active":"2024-05-08T19:22:24.878842+0000","last_peered":"2024-05-08T19:22:24.878842+0000","last_clean":"2024-05-08T19:22:24.878842+0000","last_became_active":"2024-05-08T19:22:20.445238+0000","last_became_peered":"2024-05-08T19:22:20.445238+0000","last_unstale":"2024-05-08T19:22:24.878842+0000","last_undegraded":"2024-05-08T19:22:24.878842+0000","last_fullsized":"2024-05-08T19:22:24.878842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885078+0000","last_change":"2024-05-08T19:22:24.479665+0000","last_active":"2024-05-08T19:22:24.885078+0000","last_peered":"2024-05-08T19:22:24.885078+0000","last_clean":"2024-05-08T19:22:24.885078+0000","last_became_active":"2024-05-08T19:22:24.478998+0000","last_became_peered":"2024-05-08T19:22:24.478998+0000","last_unstale":"2024-05-08T19:22:24.885078+0000","last_undegraded":"2024-05-08T19:22:24.885078+0000","last_fullsized":"2024-05-08T19:22:24.885078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:55.287155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.448886+0000","last_change":"2024-05-08T19:22:20.002850+0000","last_active":"2024-05-08T19:22:24.448886+0000","last_peered":"2024-05-08T19:22:24.448886+0000","last_clean":"2024-05-08T19:22:24.448886+0000","last_became_active":"2024-05-08T19:22:20.002534+0000","last_became_peered":"2024-05-08T19:22:20.002534+0000","last_unstale":"2024-05-08T19:22:24.448886+0000","last_undegraded":"2024-05-08T19:22:24.448886+0000","last_fullsized":"2024-05-08T19:22:24.448886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879154+0000","last_change":"2024-05-08T19:22:20.436698+0000","last_active":"2024-05-08T19:22:24.879154+0000","last_peered":"2024-05-08T19:22:24.879154+0000","last_clean":"2024-05-08T19:22:24.879154+0000","last_became_active":"2024-05-08T19:22:20.436431+0000","last_became_peered":"2024-05-08T19:22:20.436431+0000","last_unstale":"2024-05-08T19:22:24.879154+0000","last_undegraded":"2024-05-08T19:22:24.879154+0000","last_fullsized":"2024-05-08T19:22:24.879154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878964+0000","last_change":"2024-05-08T19:22:24.617420+0000","last_active":"2024-05-08T19:22:24.878964+0000","last_peered":"2024-05-08T19:22:24.878964+0000","last_clean":"2024-05-08T19:22:24.878964+0000","last_became_active":"2024-05-08T19:22:24.617030+0000","last_became_peered":"2024-05-08T19:22:24.617030+0000","last_unstale":"2024-05-08T19:22:24.878964+0000","last_undegraded":"2024-05-08T19:22:24.878964+0000","last_fullsized":"2024-05-08T19:22:24.878964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:29.274973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.451218+0000","last_change":"2024-05-08T19:22:20.003949+0000","last_active":"2024-05-08T19:22:24.451218+0000","last_peered":"2024-05-08T19:22:24.451218+0000","last_clean":"2024-05-08T19:22:24.451218+0000","last_became_active":"2024-05-08T19:22:20.003365+0000","last_became_peered":"2024-05-08T19:22:20.003365+0000","last_unstale":"2024-05-08T19:22:24.451218+0000","last_undegraded":"2024-05-08T19:22:24.451218+0000","last_fullsized":"2024-05-08T19:22:24.451218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879173+0000","last_change":"2024-05-08T19:22:20.437480+0000","last_active":"2024-05-08T19:22:24.879173+0000","last_peered":"2024-05-08T19:22:24.879173+0000","last_clean":"2024-05-08T19:22:24.879173+0000","last_became_active":"2024-05-08T19:22:20.437214+0000","last_became_peered":"2024-05-08T19:22:20.437214+0000","last_unstale":"2024-05-08T19:22:24.879173+0000","last_undegraded":"2024-05-08T19:22:24.879173+0000","last_fullsized":"2024-05-08T19:22:24.879173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879220+0000","last_change":"2024-05-08T19:22:24.615730+0000","last_active":"2024-05-08T19:22:24.879220+0000","last_peered":"2024-05-08T19:22:24.879220+0000","last_clean":"2024-05-08T19:22:24.879220+0000","last_became_active":"2024-05-08T19:22:24.615351+0000","last_became_peered":"2024-05-08T19:22:24.615351+0000","last_unstale":"2024-05-08T19:22:24.879220+0000","last_undegraded":"2024-05-08T19:22:24.879220+0000","last_fullsized":"2024-05-08T19:22:24.879220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458351+0000","last_change":"2024-05-08T19:22:20.002400+0000","last_active":"2024-05-08T19:22:24.458351+0000","last_peered":"2024-05-08T19:22:24.458351+0000","last_clean":"2024-05-08T19:22:24.458351+0000","last_became_active":"2024-05-08T19:22:20.001990+0000","last_became_peered":"2024-05-08T19:22:20.001990+0000","last_unstale":"2024-05-08T19:22:24.458351+0000","last_undegraded":"2024-05-08T19:22:24.458351+0000","last_fullsized":"2024-05-08T19:22:24.458351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875730+0000","last_change":"2024-05-08T19:22:20.447742+0000","last_active":"2024-05-08T19:22:24.875730+0000","last_peered":"2024-05-08T19:22:24.875730+0000","last_clean":"2024-05-08T19:22:24.875730+0000","last_became_active":"2024-05-08T19:22:20.447475+0000","last_became_peered":"2024-05-08T19:22:20.447475+0000","last_unstale":"2024-05-08T19:22:24.875730+0000","last_undegraded":"2024-05-08T19:22:24.875730+0000","last_fullsized":"2024-05-08T19:22:24.875730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879120+0000","last_change":"2024-05-08T19:22:24.469872+0000","last_active":"2024-05-08T19:22:24.879120+0000","last_peered":"2024-05-08T19:22:24.879120+0000","last_clean":"2024-05-08T19:22:24.879120+0000","last_became_active":"2024-05-08T19:22:24.469176+0000","last_became_peered":"2024-05-08T19:22:24.469176+0000","last_unstale":"2024-05-08T19:22:24.879120+0000","last_undegraded":"2024-05-08T19:22:24.879120+0000","last_fullsized":"2024-05-08T19:22:24.879120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:04.818467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.451462+0000","last_change":"2024-05-08T19:22:20.001272+0000","last_active":"2024-05-08T19:22:24.451462+0000","last_peered":"2024-05-08T19:22:24.451462+0000","last_clean":"2024-05-08T19:22:24.451462+0000","last_became_active":"2024-05-08T19:22:20.000981+0000","last_became_peered":"2024-05-08T19:22:20.000981+0000","last_unstale":"2024-05-08T19:22:24.451462+0000","last_undegraded":"2024-05-08T19:22:24.451462+0000","last_fullsized":"2024-05-08T19:22:24.451462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879018+0000","last_change":"2024-05-08T19:22:20.446938+0000","last_active":"2024-05-08T19:22:24.879018+0000","last_peered":"2024-05-08T19:22:24.879018+0000","last_clean":"2024-05-08T19:22:24.879018+0000","last_became_active":"2024-05-08T19:22:20.446644+0000","last_became_peered":"2024-05-08T19:22:20.446644+0000","last_unstale":"2024-05-08T19:22:24.879018+0000","last_undegraded":"2024-05-08T19:22:24.879018+0000","last_fullsized":"2024-05-08T19:22:24.879018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:39:35.443674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882595+0000","last_change":"2024-05-08T19:22:24.465089+0000","last_active":"2024-05-08T19:22:24.882595+0000","last_peered":"2024-05-08T19:22:24.882595+0000","last_clean":"2024-05-08T19:22:24.882595+0000","last_became_active":"2024-05-08T19:22:24.464178+0000","last_became_peered":"2024-05-08T19:22:24.464178+0000","last_unstale":"2024-05-08T19:22:24.882595+0000","last_undegraded":"2024-05-08T19:22:24.882595+0000","last_fullsized":"2024-05-08T19:22:24.882595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466970+0000","last_change":"2024-05-08T19:22:20.001300+0000","last_active":"2024-05-08T19:22:24.466970+0000","last_peered":"2024-05-08T19:22:24.466970+0000","last_clean":"2024-05-08T19:22:24.466970+0000","last_became_active":"2024-05-08T19:22:20.000985+0000","last_became_peered":"2024-05-08T19:22:20.000985+0000","last_unstale":"2024-05-08T19:22:24.466970+0000","last_undegraded":"2024-05-08T19:22:24.466970+0000","last_fullsized":"2024-05-08T19:22:24.466970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:50.426177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882648+0000","last_change":"2024-05-08T19:22:20.447801+0000","last_active":"2024-05-08T19:22:24.882648+0000","last_peered":"2024-05-08T19:22:24.882648+0000","last_clean":"2024-05-08T19:22:24.882648+0000","last_became_active":"2024-05-08T19:22:20.447538+0000","last_became_peered":"2024-05-08T19:22:20.447538+0000","last_unstale":"2024-05-08T19:22:24.882648+0000","last_undegraded":"2024-05-08T19:22:24.882648+0000","last_fullsized":"2024-05-08T19:22:24.882648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:14.706653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879217+0000","last_change":"2024-05-08T19:22:24.479544+0000","last_active":"2024-05-08T19:22:24.879217+0000","last_peered":"2024-05-08T19:22:24.879217+0000","last_clean":"2024-05-08T19:22:24.879217+0000","last_became_active":"2024-05-08T19:22:24.479071+0000","last_became_peered":"2024-05-08T19:22:24.479071+0000","last_unstale":"2024-05-08T19:22:24.879217+0000","last_undegraded":"2024-05-08T19:22:24.879217+0000","last_fullsized":"2024-05-08T19:22:24.879217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:19.704360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T19:22:30.073584+0000","last_change":"2024-05-08T19:22:20.011799+0000","last_active":"2024-05-08T19:22:30.073584+0000","last_peered":"2024-05-08T19:22:30.073584+0000","last_clean":"2024-05-08T19:22:30.073584+0000","last_became_active":"2024-05-08T19:22:20.011331+0000","last_became_peered":"2024-05-08T19:22:20.011331+0000","last_unstale":"2024-05-08T19:22:30.073584+0000","last_undegraded":"2024-05-08T19:22:30.073584+0000","last_fullsized":"2024-05-08T19:22:30.073584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888497+0000","last_change":"2024-05-08T19:22:20.447583+0000","last_active":"2024-05-08T19:22:24.888497+0000","last_peered":"2024-05-08T19:22:24.888497+0000","last_clean":"2024-05-08T19:22:24.888497+0000","last_became_active":"2024-05-08T19:22:20.447243+0000","last_became_peered":"2024-05-08T19:22:20.447243+0000","last_unstale":"2024-05-08T19:22:24.888497+0000","last_undegraded":"2024-05-08T19:22:24.888497+0000","last_fullsized":"2024-05-08T19:22:24.888497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875687+0000","last_change":"2024-05-08T19:22:24.615622+0000","last_active":"2024-05-08T19:22:24.875687+0000","last_peered":"2024-05-08T19:22:24.875687+0000","last_clean":"2024-05-08T19:22:24.875687+0000","last_became_active":"2024-05-08T19:22:24.614790+0000","last_became_peered":"2024-05-08T19:22:24.614790+0000","last_unstale":"2024-05-08T19:22:24.875687+0000","last_undegraded":"2024-05-08T19:22:24.875687+0000","last_fullsized":"2024-05-08T19:22:24.875687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457513+0000","last_change":"2024-05-08T19:22:20.006367+0000","last_active":"2024-05-08T19:22:24.457513+0000","last_peered":"2024-05-08T19:22:24.457513+0000","last_clean":"2024-05-08T19:22:24.457513+0000","last_became_active":"2024-05-08T19:22:20.005738+0000","last_became_peered":"2024-05-08T19:22:20.005738+0000","last_unstale":"2024-05-08T19:22:24.457513+0000","last_undegraded":"2024-05-08T19:22:24.457513+0000","last_fullsized":"2024-05-08T19:22:24.457513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878788+0000","last_change":"2024-05-08T19:22:20.448713+0000","last_active":"2024-05-08T19:22:24.878788+0000","last_peered":"2024-05-08T19:22:24.878788+0000","last_clean":"2024-05-08T19:22:24.878788+0000","last_became_active":"2024-05-08T19:22:20.448268+0000","last_became_peered":"2024-05-08T19:22:20.448268+0000","last_unstale":"2024-05-08T19:22:24.878788+0000","last_undegraded":"2024-05-08T19:22:24.878788+0000","last_fullsized":"2024-05-08T19:22:24.878788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879370+0000","last_change":"2024-05-08T19:22:24.614076+0000","last_active":"2024-05-08T19:22:24.879370+0000","last_peered":"2024-05-08T19:22:24.879370+0000","last_clean":"2024-05-08T19:22:24.879370+0000","last_became_active":"2024-05-08T19:22:24.613698+0000","last_became_peered":"2024-05-08T19:22:24.613698+0000","last_unstale":"2024-05-08T19:22:24.879370+0000","last_undegraded":"2024-05-08T19:22:24.879370+0000","last_fullsized":"2024-05-08T19:22:24.879370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:26.030709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.450746+0000","last_change":"2024-05-08T19:22:20.011480+0000","last_active":"2024-05-08T19:22:24.450746+0000","last_peered":"2024-05-08T19:22:24.450746+0000","last_clean":"2024-05-08T19:22:24.450746+0000","last_became_active":"2024-05-08T19:22:20.011188+0000","last_became_peered":"2024-05-08T19:22:20.011188+0000","last_unstale":"2024-05-08T19:22:24.450746+0000","last_undegraded":"2024-05-08T19:22:24.450746+0000","last_fullsized":"2024-05-08T19:22:24.450746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888393+0000","last_change":"2024-05-08T19:22:20.455818+0000","last_active":"2024-05-08T19:22:24.888393+0000","last_peered":"2024-05-08T19:22:24.888393+0000","last_clean":"2024-05-08T19:22:24.888393+0000","last_became_active":"2024-05-08T19:22:20.455562+0000","last_became_peered":"2024-05-08T19:22:20.455562+0000","last_unstale":"2024-05-08T19:22:24.888393+0000","last_undegraded":"2024-05-08T19:22:24.888393+0000","last_fullsized":"2024-05-08T19:22:24.888393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879484+0000","last_change":"2024-05-08T19:22:24.616812+0000","last_active":"2024-05-08T19:22:24.879484+0000","last_peered":"2024-05-08T19:22:24.879484+0000","last_clean":"2024-05-08T19:22:24.879484+0000","last_became_active":"2024-05-08T19:22:24.615618+0000","last_became_peered":"2024-05-08T19:22:24.615618+0000","last_unstale":"2024-05-08T19:22:24.879484+0000","last_undegraded":"2024-05-08T19:22:24.879484+0000","last_fullsized":"2024-05-08T19:22:24.879484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:21.559278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457687+0000","last_change":"2024-05-08T19:22:20.004327+0000","last_active":"2024-05-08T19:22:24.457687+0000","last_peered":"2024-05-08T19:22:24.457687+0000","last_clean":"2024-05-08T19:22:24.457687+0000","last_became_active":"2024-05-08T19:22:20.003725+0000","last_became_peered":"2024-05-08T19:22:20.003725+0000","last_unstale":"2024-05-08T19:22:24.457687+0000","last_undegraded":"2024-05-08T19:22:24.457687+0000","last_fullsized":"2024-05-08T19:22:24.457687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884871+0000","last_change":"2024-05-08T19:22:20.459536+0000","last_active":"2024-05-08T19:22:24.884871+0000","last_peered":"2024-05-08T19:22:24.884871+0000","last_clean":"2024-05-08T19:22:24.884871+0000","last_became_active":"2024-05-08T19:22:20.452496+0000","last_became_peered":"2024-05-08T19:22:20.452496+0000","last_unstale":"2024-05-08T19:22:24.884871+0000","last_undegraded":"2024-05-08T19:22:24.884871+0000","last_fullsized":"2024-05-08T19:22:24.884871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878916+0000","last_change":"2024-05-08T19:22:24.478351+0000","last_active":"2024-05-08T19:22:24.878916+0000","last_peered":"2024-05-08T19:22:24.878916+0000","last_clean":"2024-05-08T19:22:24.878916+0000","last_became_active":"2024-05-08T19:22:24.477728+0000","last_became_peered":"2024-05-08T19:22:24.477728+0000","last_unstale":"2024-05-08T19:22:24.878916+0000","last_undegraded":"2024-05-08T19:22:24.878916+0000","last_fullsized":"2024-05-08T19:22:24.878916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457653+0000","last_change":"2024-05-08T19:22:20.008346+0000","last_active":"2024-05-08T19:22:24.457653+0000","last_peered":"2024-05-08T19:22:24.457653+0000","last_clean":"2024-05-08T19:22:24.457653+0000","last_became_active":"2024-05-08T19:22:20.007985+0000","last_became_peered":"2024-05-08T19:22:20.007985+0000","last_unstale":"2024-05-08T19:22:24.457653+0000","last_undegraded":"2024-05-08T19:22:24.457653+0000","last_fullsized":"2024-05-08T19:22:24.457653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888351+0000","last_change":"2024-05-08T19:22:20.458860+0000","last_active":"2024-05-08T19:22:24.888351+0000","last_peered":"2024-05-08T19:22:24.888351+0000","last_clean":"2024-05-08T19:22:24.888351+0000","last_became_active":"2024-05-08T19:22:20.458588+0000","last_became_peered":"2024-05-08T19:22:20.458588+0000","last_unstale":"2024-05-08T19:22:24.888351+0000","last_undegraded":"2024-05-08T19:22:24.888351+0000","last_fullsized":"2024-05-08T19:22:24.888351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882450+0000","last_change":"2024-05-08T19:22:24.464132+0000","last_active":"2024-05-08T19:22:24.882450+0000","last_peered":"2024-05-08T19:22:24.882450+0000","last_clean":"2024-05-08T19:22:24.882450+0000","last_became_active":"2024-05-08T19:22:24.463741+0000","last_became_peered":"2024-05-08T19:22:24.463741+0000","last_unstale":"2024-05-08T19:22:24.882450+0000","last_undegraded":"2024-05-08T19:22:24.882450+0000","last_fullsized":"2024-05-08T19:22:24.882450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:13.044112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.451210+0000","last_change":"2024-05-08T19:22:20.005994+0000","last_active":"2024-05-08T19:22:24.451210+0000","last_peered":"2024-05-08T19:22:24.451210+0000","last_clean":"2024-05-08T19:22:24.451210+0000","last_became_active":"2024-05-08T19:22:20.005680+0000","last_became_peered":"2024-05-08T19:22:20.005680+0000","last_unstale":"2024-05-08T19:22:24.451210+0000","last_undegraded":"2024-05-08T19:22:24.451210+0000","last_fullsized":"2024-05-08T19:22:24.451210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:18.387895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888538+0000","last_change":"2024-05-08T19:22:20.449812+0000","last_active":"2024-05-08T19:22:24.888538+0000","last_peered":"2024-05-08T19:22:24.888538+0000","last_clean":"2024-05-08T19:22:24.888538+0000","last_became_active":"2024-05-08T19:22:20.449512+0000","last_became_peered":"2024-05-08T19:22:20.449512+0000","last_unstale":"2024-05-08T19:22:24.888538+0000","last_undegraded":"2024-05-08T19:22:24.888538+0000","last_fullsized":"2024-05-08T19:22:24.888538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879207+0000","last_change":"2024-05-08T19:22:24.478647+0000","last_active":"2024-05-08T19:22:24.879207+0000","last_peered":"2024-05-08T19:22:24.879207+0000","last_clean":"2024-05-08T19:22:24.879207+0000","last_became_active":"2024-05-08T19:22:24.478248+0000","last_became_peered":"2024-05-08T19:22:24.478248+0000","last_unstale":"2024-05-08T19:22:24.879207+0000","last_undegraded":"2024-05-08T19:22:24.879207+0000","last_fullsized":"2024-05-08T19:22:24.879207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:26.651711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.469393+0000","last_change":"2024-05-08T19:22:20.003344+0000","last_active":"2024-05-08T19:22:24.469393+0000","last_peered":"2024-05-08T19:22:24.469393+0000","last_clean":"2024-05-08T19:22:24.469393+0000","last_became_active":"2024-05-08T19:22:20.003055+0000","last_became_peered":"2024-05-08T19:22:20.003055+0000","last_unstale":"2024-05-08T19:22:24.469393+0000","last_undegraded":"2024-05-08T19:22:24.469393+0000","last_fullsized":"2024-05-08T19:22:24.469393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875711+0000","last_change":"2024-05-08T19:22:20.450523+0000","last_active":"2024-05-08T19:22:24.875711+0000","last_peered":"2024-05-08T19:22:24.875711+0000","last_clean":"2024-05-08T19:22:24.875711+0000","last_became_active":"2024-05-08T19:22:20.449693+0000","last_became_peered":"2024-05-08T19:22:20.449693+0000","last_unstale":"2024-05-08T19:22:24.875711+0000","last_undegraded":"2024-05-08T19:22:24.875711+0000","last_fullsized":"2024-05-08T19:22:24.875711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879227+0000","last_change":"2024-05-08T19:22:24.472926+0000","last_active":"2024-05-08T19:22:24.879227+0000","last_peered":"2024-05-08T19:22:24.879227+0000","last_clean":"2024-05-08T19:22:24.879227+0000","last_became_active":"2024-05-08T19:22:24.472518+0000","last_became_peered":"2024-05-08T19:22:24.472518+0000","last_unstale":"2024-05-08T19:22:24.879227+0000","last_undegraded":"2024-05-08T19:22:24.879227+0000","last_fullsized":"2024-05-08T19:22:24.879227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.450651+0000","last_change":"2024-05-08T19:22:20.007824+0000","last_active":"2024-05-08T19:22:24.450651+0000","last_peered":"2024-05-08T19:22:24.450651+0000","last_clean":"2024-05-08T19:22:24.450651+0000","last_became_active":"2024-05-08T19:22:20.007542+0000","last_became_peered":"2024-05-08T19:22:20.007542+0000","last_unstale":"2024-05-08T19:22:24.450651+0000","last_undegraded":"2024-05-08T19:22:24.450651+0000","last_fullsized":"2024-05-08T19:22:24.450651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882574+0000","last_change":"2024-05-08T19:22:20.443326+0000","last_active":"2024-05-08T19:22:24.882574+0000","last_peered":"2024-05-08T19:22:24.882574+0000","last_clean":"2024-05-08T19:22:24.882574+0000","last_became_active":"2024-05-08T19:22:20.443049+0000","last_became_peered":"2024-05-08T19:22:20.443049+0000","last_unstale":"2024-05-08T19:22:24.882574+0000","last_undegraded":"2024-05-08T19:22:24.882574+0000","last_fullsized":"2024-05-08T19:22:24.882574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:04.174914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879300+0000","last_change":"2024-05-08T19:22:24.479362+0000","last_active":"2024-05-08T19:22:24.879300+0000","last_peered":"2024-05-08T19:22:24.879300+0000","last_clean":"2024-05-08T19:22:24.879300+0000","last_became_active":"2024-05-08T19:22:24.478640+0000","last_became_peered":"2024-05-08T19:22:24.478640+0000","last_unstale":"2024-05-08T19:22:24.879300+0000","last_undegraded":"2024-05-08T19:22:24.879300+0000","last_fullsized":"2024-05-08T19:22:24.879300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879078+0000","last_change":"2024-05-08T19:22:20.449968+0000","last_active":"2024-05-08T19:22:24.879078+0000","last_peered":"2024-05-08T19:22:24.879078+0000","last_clean":"2024-05-08T19:22:24.879078+0000","last_became_active":"2024-05-08T19:22:20.449709+0000","last_became_peered":"2024-05-08T19:22:20.449709+0000","last_unstale":"2024-05-08T19:22:24.879078+0000","last_undegraded":"2024-05-08T19:22:24.879078+0000","last_fullsized":"2024-05-08T19:22:24.879078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457916+0000","last_change":"2024-05-08T19:22:20.004708+0000","last_active":"2024-05-08T19:22:24.457916+0000","last_peered":"2024-05-08T19:22:24.457916+0000","last_clean":"2024-05-08T19:22:24.457916+0000","last_became_active":"2024-05-08T19:22:20.004404+0000","last_became_peered":"2024-05-08T19:22:20.004404+0000","last_unstale":"2024-05-08T19:22:24.457916+0000","last_undegraded":"2024-05-08T19:22:24.457916+0000","last_fullsized":"2024-05-08T19:22:24.457916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884988+0000","last_change":"2024-05-08T19:22:24.617952+0000","last_active":"2024-05-08T19:22:24.884988+0000","last_peered":"2024-05-08T19:22:24.884988+0000","last_clean":"2024-05-08T19:22:24.884988+0000","last_became_active":"2024-05-08T19:22:24.617627+0000","last_became_peered":"2024-05-08T19:22:24.617627+0000","last_unstale":"2024-05-08T19:22:24.884988+0000","last_undegraded":"2024-05-08T19:22:24.884988+0000","last_fullsized":"2024-05-08T19:22:24.884988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:57.825616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879298+0000","last_change":"2024-05-08T19:22:20.447152+0000","last_active":"2024-05-08T19:22:24.879298+0000","last_peered":"2024-05-08T19:22:24.879298+0000","last_clean":"2024-05-08T19:22:24.879298+0000","last_became_active":"2024-05-08T19:22:20.446864+0000","last_became_peered":"2024-05-08T19:22:20.446864+0000","last_unstale":"2024-05-08T19:22:24.879298+0000","last_undegraded":"2024-05-08T19:22:24.879298+0000","last_fullsized":"2024-05-08T19:22:24.879298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.450537+0000","last_change":"2024-05-08T19:22:20.003790+0000","last_active":"2024-05-08T19:22:24.450537+0000","last_peered":"2024-05-08T19:22:24.450537+0000","last_clean":"2024-05-08T19:22:24.450537+0000","last_became_active":"2024-05-08T19:22:20.003441+0000","last_became_peered":"2024-05-08T19:22:20.003441+0000","last_unstale":"2024-05-08T19:22:24.450537+0000","last_undegraded":"2024-05-08T19:22:24.450537+0000","last_fullsized":"2024-05-08T19:22:24.450537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612146+0000","last_change":"2024-05-08T19:22:17.117278+0000","last_active":"2024-05-08T19:22:24.612146+0000","last_peered":"2024-05-08T19:22:24.612146+0000","last_clean":"2024-05-08T19:22:24.612146+0000","last_became_active":"2024-05-08T19:22:17.116272+0000","last_became_peered":"2024-05-08T19:22:17.116272+0000","last_unstale":"2024-05-08T19:22:24.612146+0000","last_undegraded":"2024-05-08T19:22:24.612146+0000","last_fullsized":"2024-05-08T19:22:24.612146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_clean_scrub_stamp":"2024-05-08T19:22:15.924359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:37.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878934+0000","last_change":"2024-05-08T19:22:24.617594+0000","last_active":"2024-05-08T19:22:24.878934+0000","last_peered":"2024-05-08T19:22:24.878934+0000","last_clean":"2024-05-08T19:22:24.878934+0000","last_became_active":"2024-05-08T19:22:24.616486+0000","last_became_peered":"2024-05-08T19:22:24.616486+0000","last_unstale":"2024-05-08T19:22:24.878934+0000","last_undegraded":"2024-05-08T19:22:24.878934+0000","last_fullsized":"2024-05-08T19:22:24.878934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878747+0000","last_change":"2024-05-08T19:22:20.445458+0000","last_active":"2024-05-08T19:22:24.878747+0000","last_peered":"2024-05-08T19:22:24.878747+0000","last_clean":"2024-05-08T19:22:24.878747+0000","last_became_active":"2024-05-08T19:22:20.445191+0000","last_became_peered":"2024-05-08T19:22:20.445191+0000","last_unstale":"2024-05-08T19:22:24.878747+0000","last_undegraded":"2024-05-08T19:22:24.878747+0000","last_fullsized":"2024-05-08T19:22:24.878747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612265+0000","last_change":"2024-05-08T19:22:20.015288+0000","last_active":"2024-05-08T19:22:24.612265+0000","last_peered":"2024-05-08T19:22:24.612265+0000","last_clean":"2024-05-08T19:22:24.612265+0000","last_became_active":"2024-05-08T19:22:20.015062+0000","last_became_peered":"2024-05-08T19:22:20.015062+0000","last_unstale":"2024-05-08T19:22:24.612265+0000","last_undegraded":"2024-05-08T19:22:24.612265+0000","last_fullsized":"2024-05-08T19:22:24.612265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:12.577297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878827+0000","last_change":"2024-05-08T19:22:24.614066+0000","last_active":"2024-05-08T19:22:24.878827+0000","last_peered":"2024-05-08T19:22:24.878827+0000","last_clean":"2024-05-08T19:22:24.878827+0000","last_became_active":"2024-05-08T19:22:24.613661+0000","last_became_peered":"2024-05-08T19:22:24.613661+0000","last_unstale":"2024-05-08T19:22:24.878827+0000","last_undegraded":"2024-05-08T19:22:24.878827+0000","last_fullsized":"2024-05-08T19:22:24.878827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612417+0000","last_change":"2024-05-08T19:22:20.015193+0000","last_active":"2024-05-08T19:22:24.612417+0000","last_peered":"2024-05-08T19:22:24.612417+0000","last_clean":"2024-05-08T19:22:24.612417+0000","last_became_active":"2024-05-08T19:22:20.014926+0000","last_became_peered":"2024-05-08T19:22:20.014926+0000","last_unstale":"2024-05-08T19:22:24.612417+0000","last_undegraded":"2024-05-08T19:22:24.612417+0000","last_fullsized":"2024-05-08T19:22:24.612417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:13.701454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879254+0000","last_change":"2024-05-08T19:22:20.446453+0000","last_active":"2024-05-08T19:22:24.879254+0000","last_peered":"2024-05-08T19:22:24.879254+0000","last_clean":"2024-05-08T19:22:24.879254+0000","last_became_active":"2024-05-08T19:22:20.446194+0000","last_became_peered":"2024-05-08T19:22:20.446194+0000","last_unstale":"2024-05-08T19:22:24.879254+0000","last_undegraded":"2024-05-08T19:22:24.879254+0000","last_fullsized":"2024-05-08T19:22:24.879254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879174+0000","last_change":"2024-05-08T19:22:24.615481+0000","last_active":"2024-05-08T19:22:24.879174+0000","last_peered":"2024-05-08T19:22:24.879174+0000","last_clean":"2024-05-08T19:22:24.879174+0000","last_became_active":"2024-05-08T19:22:24.615069+0000","last_became_peered":"2024-05-08T19:22:24.615069+0000","last_unstale":"2024-05-08T19:22:24.879174+0000","last_undegraded":"2024-05-08T19:22:24.879174+0000","last_fullsized":"2024-05-08T19:22:24.879174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:28.211177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T19:22:25.515484+0000","last_change":"2024-05-08T19:22:20.001642+0000","last_active":"2024-05-08T19:22:25.515484+0000","last_peered":"2024-05-08T19:22:25.515484+0000","last_clean":"2024-05-08T19:22:25.515484+0000","last_became_active":"2024-05-08T19:22:20.001339+0000","last_became_peered":"2024-05-08T19:22:20.001339+0000","last_unstale":"2024-05-08T19:22:25.515484+0000","last_undegraded":"2024-05-08T19:22:25.515484+0000","last_fullsized":"2024-05-08T19:22:25.515484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879506+0000","last_change":"2024-05-08T19:22:20.447909+0000","last_active":"2024-05-08T19:22:24.879506+0000","last_peered":"2024-05-08T19:22:24.879506+0000","last_clean":"2024-05-08T19:22:24.879506+0000","last_became_active":"2024-05-08T19:22:20.447526+0000","last_became_peered":"2024-05-08T19:22:20.447526+0000","last_unstale":"2024-05-08T19:22:24.879506+0000","last_undegraded":"2024-05-08T19:22:24.879506+0000","last_fullsized":"2024-05-08T19:22:24.879506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882471+0000","last_change":"2024-05-08T19:22:24.614812+0000","last_active":"2024-05-08T19:22:24.882471+0000","last_peered":"2024-05-08T19:22:24.882471+0000","last_clean":"2024-05-08T19:22:24.882471+0000","last_became_active":"2024-05-08T19:22:24.614433+0000","last_became_peered":"2024-05-08T19:22:24.614433+0000","last_unstale":"2024-05-08T19:22:24.882471+0000","last_undegraded":"2024-05-08T19:22:24.882471+0000","last_fullsized":"2024-05-08T19:22:24.882471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:07.924115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458250+0000","last_change":"2024-05-08T19:22:20.012651+0000","last_active":"2024-05-08T19:22:24.458250+0000","last_peered":"2024-05-08T19:22:24.458250+0000","last_clean":"2024-05-08T19:22:24.458250+0000","last_became_active":"2024-05-08T19:22:20.012383+0000","last_became_peered":"2024-05-08T19:22:20.012383+0000","last_unstale":"2024-05-08T19:22:24.458250+0000","last_undegraded":"2024-05-08T19:22:24.458250+0000","last_fullsized":"2024-05-08T19:22:24.458250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878980+0000","last_change":"2024-05-08T19:22:20.436459+0000","last_active":"2024-05-08T19:22:24.878980+0000","last_peered":"2024-05-08T19:22:24.878980+0000","last_clean":"2024-05-08T19:22:24.878980+0000","last_became_active":"2024-05-08T19:22:20.435680+0000","last_became_peered":"2024-05-08T19:22:20.435680+0000","last_unstale":"2024-05-08T19:22:24.878980+0000","last_undegraded":"2024-05-08T19:22:24.878980+0000","last_fullsized":"2024-05-08T19:22:24.878980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:09.166091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882688+0000","last_change":"2024-05-08T19:22:24.473208+0000","last_active":"2024-05-08T19:22:24.882688+0000","last_peered":"2024-05-08T19:22:24.882688+0000","last_clean":"2024-05-08T19:22:24.882688+0000","last_became_active":"2024-05-08T19:22:24.472782+0000","last_became_peered":"2024-05-08T19:22:24.472782+0000","last_unstale":"2024-05-08T19:22:24.882688+0000","last_undegraded":"2024-05-08T19:22:24.882688+0000","last_fullsized":"2024-05-08T19:22:24.882688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612122+0000","last_change":"2024-05-08T19:22:20.014848+0000","last_active":"2024-05-08T19:22:24.612122+0000","last_peered":"2024-05-08T19:22:24.612122+0000","last_clean":"2024-05-08T19:22:24.612122+0000","last_became_active":"2024-05-08T19:22:20.013739+0000","last_became_peered":"2024-05-08T19:22:20.013739+0000","last_unstale":"2024-05-08T19:22:24.612122+0000","last_undegraded":"2024-05-08T19:22:24.612122+0000","last_fullsized":"2024-05-08T19:22:24.612122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:03.169714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882485+0000","last_change":"2024-05-08T19:22:20.447451+0000","last_active":"2024-05-08T19:22:24.882485+0000","last_peered":"2024-05-08T19:22:24.882485+0000","last_clean":"2024-05-08T19:22:24.882485+0000","last_became_active":"2024-05-08T19:22:20.447180+0000","last_became_peered":"2024-05-08T19:22:20.447180+0000","last_unstale":"2024-05-08T19:22:24.882485+0000","last_undegraded":"2024-05-08T19:22:24.882485+0000","last_fullsized":"2024-05-08T19:22:24.882485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879310+0000","last_change":"2024-05-08T19:22:24.614091+0000","last_active":"2024-05-08T19:22:24.879310+0000","last_peered":"2024-05-08T19:22:24.879310+0000","last_clean":"2024-05-08T19:22:24.879310+0000","last_became_active":"2024-05-08T19:22:24.613677+0000","last_became_peered":"2024-05-08T19:22:24.613677+0000","last_unstale":"2024-05-08T19:22:24.879310+0000","last_undegraded":"2024-05-08T19:22:24.879310+0000","last_fullsized":"2024-05-08T19:22:24.879310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:50.011809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466472+0000","last_change":"2024-05-08T19:22:20.011528+0000","last_active":"2024-05-08T19:22:24.466472+0000","last_peered":"2024-05-08T19:22:24.466472+0000","last_clean":"2024-05-08T19:22:24.466472+0000","last_became_active":"2024-05-08T19:22:20.011262+0000","last_became_peered":"2024-05-08T19:22:20.011262+0000","last_unstale":"2024-05-08T19:22:24.466472+0000","last_undegraded":"2024-05-08T19:22:24.466472+0000","last_fullsized":"2024-05-08T19:22:24.466472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879088+0000","last_change":"2024-05-08T19:22:20.438689+0000","last_active":"2024-05-08T19:22:24.879088+0000","last_peered":"2024-05-08T19:22:24.879088+0000","last_clean":"2024-05-08T19:22:24.879088+0000","last_became_active":"2024-05-08T19:22:20.438434+0000","last_became_peered":"2024-05-08T19:22:20.438434+0000","last_unstale":"2024-05-08T19:22:24.879088+0000","last_undegraded":"2024-05-08T19:22:24.879088+0000","last_fullsized":"2024-05-08T19:22:24.879088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882616+0000","last_change":"2024-05-08T19:22:24.473569+0000","last_active":"2024-05-08T19:22:24.882616+0000","last_peered":"2024-05-08T19:22:24.882616+0000","last_clean":"2024-05-08T19:22:24.882616+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:22:24.882616+0000","last_undegraded":"2024-05-08T19:22:24.882616+0000","last_fullsized":"2024-05-08T19:22:24.882616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:22.875469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466685+0000","last_change":"2024-05-08T19:22:20.007101+0000","last_active":"2024-05-08T19:22:24.466685+0000","last_peered":"2024-05-08T19:22:24.466685+0000","last_clean":"2024-05-08T19:22:24.466685+0000","last_became_active":"2024-05-08T19:22:20.006772+0000","last_became_peered":"2024-05-08T19:22:20.006772+0000","last_unstale":"2024-05-08T19:22:24.466685+0000","last_undegraded":"2024-05-08T19:22:24.466685+0000","last_fullsized":"2024-05-08T19:22:24.466685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:23.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879350+0000","last_change":"2024-05-08T19:22:20.436696+0000","last_active":"2024-05-08T19:22:24.879350+0000","last_peered":"2024-05-08T19:22:24.879350+0000","last_clean":"2024-05-08T19:22:24.879350+0000","last_became_active":"2024-05-08T19:22:20.436373+0000","last_became_peered":"2024-05-08T19:22:20.436373+0000","last_unstale":"2024-05-08T19:22:24.879350+0000","last_undegraded":"2024-05-08T19:22:24.879350+0000","last_fullsized":"2024-05-08T19:22:24.879350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882673+0000","last_change":"2024-05-08T19:22:24.478232+0000","last_active":"2024-05-08T19:22:24.882673+0000","last_peered":"2024-05-08T19:22:24.882673+0000","last_clean":"2024-05-08T19:22:24.882673+0000","last_became_active":"2024-05-08T19:22:24.477941+0000","last_became_peered":"2024-05-08T19:22:24.477941+0000","last_unstale":"2024-05-08T19:22:24.882673+0000","last_undegraded":"2024-05-08T19:22:24.882673+0000","last_fullsized":"2024-05-08T19:22:24.882673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612523+0000","last_change":"2024-05-08T19:22:20.014076+0000","last_active":"2024-05-08T19:22:24.612523+0000","last_peered":"2024-05-08T19:22:24.612523+0000","last_clean":"2024-05-08T19:22:24.612523+0000","last_became_active":"2024-05-08T19:22:20.013748+0000","last_became_peered":"2024-05-08T19:22:20.013748+0000","last_unstale":"2024-05-08T19:22:24.612523+0000","last_undegraded":"2024-05-08T19:22:24.612523+0000","last_fullsized":"2024-05-08T19:22:24.612523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:50.426177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884937+0000","last_change":"2024-05-08T19:22:20.457103+0000","last_active":"2024-05-08T19:22:24.884937+0000","last_peered":"2024-05-08T19:22:24.884937+0000","last_clean":"2024-05-08T19:22:24.884937+0000","last_became_active":"2024-05-08T19:22:20.456850+0000","last_became_peered":"2024-05-08T19:22:20.456850+0000","last_unstale":"2024-05-08T19:22:24.884937+0000","last_undegraded":"2024-05-08T19:22:24.884937+0000","last_fullsized":"2024-05-08T19:22:24.884937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884914+0000","last_change":"2024-05-08T19:22:24.614410+0000","last_active":"2024-05-08T19:22:24.884914+0000","last_peered":"2024-05-08T19:22:24.884914+0000","last_clean":"2024-05-08T19:22:24.884914+0000","last_became_active":"2024-05-08T19:22:24.613904+0000","last_became_peered":"2024-05-08T19:22:24.613904+0000","last_unstale":"2024-05-08T19:22:24.884914+0000","last_undegraded":"2024-05-08T19:22:24.884914+0000","last_fullsized":"2024-05-08T19:22:24.884914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:03.465351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458521+0000","last_change":"2024-05-08T19:22:20.000763+0000","last_active":"2024-05-08T19:22:24.458521+0000","last_peered":"2024-05-08T19:22:24.458521+0000","last_clean":"2024-05-08T19:22:24.458521+0000","last_became_active":"2024-05-08T19:22:20.000454+0000","last_became_peered":"2024-05-08T19:22:20.000454+0000","last_unstale":"2024-05-08T19:22:24.458521+0000","last_undegraded":"2024-05-08T19:22:24.458521+0000","last_fullsized":"2024-05-08T19:22:24.458521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888465+0000","last_change":"2024-05-08T19:22:20.456485+0000","last_active":"2024-05-08T19:22:24.888465+0000","last_peered":"2024-05-08T19:22:24.888465+0000","last_clean":"2024-05-08T19:22:24.888465+0000","last_became_active":"2024-05-08T19:22:20.456225+0000","last_became_peered":"2024-05-08T19:22:20.456225+0000","last_unstale":"2024-05-08T19:22:24.888465+0000","last_undegraded":"2024-05-08T19:22:24.888465+0000","last_fullsized":"2024-05-08T19:22:24.888465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878808+0000","last_change":"2024-05-08T19:22:24.473117+0000","last_active":"2024-05-08T19:22:24.878808+0000","last_peered":"2024-05-08T19:22:24.878808+0000","last_clean":"2024-05-08T19:22:24.878808+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:22:24.878808+0000","last_undegraded":"2024-05-08T19:22:24.878808+0000","last_fullsized":"2024-05-08T19:22:24.878808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466917+0000","last_change":"2024-05-08T19:22:20.006312+0000","last_active":"2024-05-08T19:22:24.466917+0000","last_peered":"2024-05-08T19:22:24.466917+0000","last_clean":"2024-05-08T19:22:24.466917+0000","last_became_active":"2024-05-08T19:22:20.005996+0000","last_became_peered":"2024-05-08T19:22:20.005996+0000","last_unstale":"2024-05-08T19:22:24.466917+0000","last_undegraded":"2024-05-08T19:22:24.466917+0000","last_fullsized":"2024-05-08T19:22:24.466917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:13.701454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875666+0000","last_change":"2024-05-08T19:22:20.452861+0000","last_active":"2024-05-08T19:22:24.875666+0000","last_peered":"2024-05-08T19:22:24.875666+0000","last_clean":"2024-05-08T19:22:24.875666+0000","last_became_active":"2024-05-08T19:22:20.452600+0000","last_became_peered":"2024-05-08T19:22:20.452600+0000","last_unstale":"2024-05-08T19:22:24.875666+0000","last_undegraded":"2024-05-08T19:22:24.875666+0000","last_fullsized":"2024-05-08T19:22:24.875666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875543+0000","last_change":"2024-05-08T19:22:24.614345+0000","last_active":"2024-05-08T19:22:24.875543+0000","last_peered":"2024-05-08T19:22:24.875543+0000","last_clean":"2024-05-08T19:22:24.875543+0000","last_became_active":"2024-05-08T19:22:24.613948+0000","last_became_peered":"2024-05-08T19:22:24.613948+0000","last_unstale":"2024-05-08T19:22:24.875543+0000","last_undegraded":"2024-05-08T19:22:24.875543+0000","last_fullsized":"2024-05-08T19:22:24.875543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457773+0000","last_change":"2024-05-08T19:22:20.004844+0000","last_active":"2024-05-08T19:22:24.457773+0000","last_peered":"2024-05-08T19:22:24.457773+0000","last_clean":"2024-05-08T19:22:24.457773+0000","last_became_active":"2024-05-08T19:22:20.004254+0000","last_became_peered":"2024-05-08T19:22:20.004254+0000","last_unstale":"2024-05-08T19:22:24.457773+0000","last_undegraded":"2024-05-08T19:22:24.457773+0000","last_fullsized":"2024-05-08T19:22:24.457773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888558+0000","last_change":"2024-05-08T19:22:20.455712+0000","last_active":"2024-05-08T19:22:24.888558+0000","last_peered":"2024-05-08T19:22:24.888558+0000","last_clean":"2024-05-08T19:22:24.888558+0000","last_became_active":"2024-05-08T19:22:20.455493+0000","last_became_peered":"2024-05-08T19:22:20.455493+0000","last_unstale":"2024-05-08T19:22:24.888558+0000","last_undegraded":"2024-05-08T19:22:24.888558+0000","last_fullsized":"2024-05-08T19:22:24.888558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:28.743156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884892+0000","last_change":"2024-05-08T19:22:20.459104+0000","last_active":"2024-05-08T19:22:24.884892+0000","last_peered":"2024-05-08T19:22:24.884892+0000","last_clean":"2024-05-08T19:22:24.884892+0000","last_became_active":"2024-05-08T19:22:20.452169+0000","last_became_peered":"2024-05-08T19:22:20.452169+0000","last_unstale":"2024-05-08T19:22:24.884892+0000","last_undegraded":"2024-05-08T19:22:24.884892+0000","last_fullsized":"2024-05-08T19:22:24.884892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.886216+0000","last_change":"2024-05-08T19:22:20.449335+0000","last_active":"2024-05-08T19:22:24.886216+0000","last_peered":"2024-05-08T19:22:24.886216+0000","last_clean":"2024-05-08T19:22:24.886216+0000","last_became_active":"2024-05-08T19:22:20.449047+0000","last_became_peered":"2024-05-08T19:22:20.449047+0000","last_unstale":"2024-05-08T19:22:24.886216+0000","last_undegraded":"2024-05-08T19:22:24.886216+0000","last_fullsized":"2024-05-08T19:22:24.886216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875600+0000","last_change":"2024-05-08T19:22:20.452192+0000","last_active":"2024-05-08T19:22:24.875600+0000","last_peered":"2024-05-08T19:22:24.875600+0000","last_clean":"2024-05-08T19:22:24.875600+0000","last_became_active":"2024-05-08T19:22:20.451625+0000","last_became_peered":"2024-05-08T19:22:20.451625+0000","last_unstale":"2024-05-08T19:22:24.875600+0000","last_undegraded":"2024-05-08T19:22:24.875600+0000","last_fullsized":"2024-05-08T19:22:24.875600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878859+0000","last_change":"2024-05-08T19:22:20.441131+0000","last_active":"2024-05-08T19:22:24.878859+0000","last_peered":"2024-05-08T19:22:24.878859+0000","last_clean":"2024-05-08T19:22:24.878859+0000","last_became_active":"2024-05-08T19:22:20.440718+0000","last_became_peered":"2024-05-08T19:22:20.440718+0000","last_unstale":"2024-05-08T19:22:24.878859+0000","last_undegraded":"2024-05-08T19:22:24.878859+0000","last_fullsized":"2024-05-08T19:22:24.878859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879397+0000","last_change":"2024-05-08T19:22:20.444479+0000","last_active":"2024-05-08T19:22:24.879397+0000","last_peered":"2024-05-08T19:22:24.879397+0000","last_clean":"2024-05-08T19:22:24.879397+0000","last_became_active":"2024-05-08T19:22:20.444219+0000","last_became_peered":"2024-05-08T19:22:20.444219+0000","last_unstale":"2024-05-08T19:22:24.879397+0000","last_undegraded":"2024-05-08T19:22:24.879397+0000","last_fullsized":"2024-05-08T19:22:24.879397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879264+0000","last_change":"2024-05-08T19:22:20.436874+0000","last_active":"2024-05-08T19:22:24.879264+0000","last_peered":"2024-05-08T19:22:24.879264+0000","last_clean":"2024-05-08T19:22:24.879264+0000","last_became_active":"2024-05-08T19:22:20.436626+0000","last_became_peered":"2024-05-08T19:22:20.436626+0000","last_unstale":"2024-05-08T19:22:24.879264+0000","last_undegraded":"2024-05-08T19:22:24.879264+0000","last_fullsized":"2024-05-08T19:22:24.879264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885056+0000","last_change":"2024-05-08T19:22:20.462445+0000","last_active":"2024-05-08T19:22:24.885056+0000","last_peered":"2024-05-08T19:22:24.885056+0000","last_clean":"2024-05-08T19:22:24.885056+0000","last_became_active":"2024-05-08T19:22:20.461547+0000","last_became_peered":"2024-05-08T19:22:20.461547+0000","last_unstale":"2024-05-08T19:22:24.885056+0000","last_undegraded":"2024-05-08T19:22:24.885056+0000","last_fullsized":"2024-05-08T19:22:24.885056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879523+0000","last_change":"2024-05-08T19:22:20.443498+0000","last_active":"2024-05-08T19:22:24.879523+0000","last_peered":"2024-05-08T19:22:24.879523+0000","last_clean":"2024-05-08T19:22:24.879523+0000","last_became_active":"2024-05-08T19:22:20.442667+0000","last_became_peered":"2024-05-08T19:22:20.442667+0000","last_unstale":"2024-05-08T19:22:24.879523+0000","last_undegraded":"2024-05-08T19:22:24.879523+0000","last_fullsized":"2024-05-08T19:22:24.879523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875577+0000","last_change":"2024-05-08T19:22:20.448722+0000","last_active":"2024-05-08T19:22:24.875577+0000","last_peered":"2024-05-08T19:22:24.875577+0000","last_clean":"2024-05-08T19:22:24.875577+0000","last_became_active":"2024-05-08T19:22:20.448449+0000","last_became_peered":"2024-05-08T19:22:20.448449+0000","last_unstale":"2024-05-08T19:22:24.875577+0000","last_undegraded":"2024-05-08T19:22:24.875577+0000","last_fullsized":"2024-05-08T19:22:24.875577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879255+0000","last_change":"2024-05-08T19:22:20.450677+0000","last_active":"2024-05-08T19:22:24.879255+0000","last_peered":"2024-05-08T19:22:24.879255+0000","last_clean":"2024-05-08T19:22:24.879255+0000","last_became_active":"2024-05-08T19:22:20.450217+0000","last_became_peered":"2024-05-08T19:22:20.450217+0000","last_unstale":"2024-05-08T19:22:24.879255+0000","last_undegraded":"2024-05-08T19:22:24.879255+0000","last_fullsized":"2024-05-08T19:22:24.879255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875609+0000","last_change":"2024-05-08T19:22:20.453450+0000","last_active":"2024-05-08T19:22:24.875609+0000","last_peered":"2024-05-08T19:22:24.875609+0000","last_clean":"2024-05-08T19:22:24.875609+0000","last_became_active":"2024-05-08T19:22:20.453191+0000","last_became_peered":"2024-05-08T19:22:20.453191+0000","last_unstale":"2024-05-08T19:22:24.875609+0000","last_undegraded":"2024-05-08T19:22:24.875609+0000","last_fullsized":"2024-05-08T19:22:24.875609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878873+0000","last_change":"2024-05-08T19:22:20.452591+0000","last_active":"2024-05-08T19:22:24.878873+0000","last_peered":"2024-05-08T19:22:24.878873+0000","last_clean":"2024-05-08T19:22:24.878873+0000","last_became_active":"2024-05-08T19:22:20.451209+0000","last_became_peered":"2024-05-08T19:22:20.451209+0000","last_unstale":"2024-05-08T19:22:24.878873+0000","last_undegraded":"2024-05-08T19:22:24.878873+0000","last_fullsized":"2024-05-08T19:22:24.878873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884969+0000","last_change":"2024-05-08T19:22:20.461584+0000","last_active":"2024-05-08T19:22:24.884969+0000","last_peered":"2024-05-08T19:22:24.884969+0000","last_clean":"2024-05-08T19:22:24.884969+0000","last_became_active":"2024-05-08T19:22:20.461097+0000","last_became_peered":"2024-05-08T19:22:20.461097+0000","last_unstale":"2024-05-08T19:22:24.884969+0000","last_undegraded":"2024-05-08T19:22:24.884969+0000","last_fullsized":"2024-05-08T19:22:24.884969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":690730,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":690786,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T19:22:44.112 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T19:22:44.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.280+0000 7f0bf8055700 1 Processor -- start 2024-05-08T19:22:44.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.281+0000 7f0bf8055700 1 -- start start 2024-05-08T19:22:44.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.281+0000 7f0bf8055700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0bf00c0d90 0x7f0bf015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:44.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.281+0000 7f0bf8055700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf0154d00 con 0x7f0bf006ed60 2024-05-08T19:22:44.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.281+0000 7f0bf8055700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf01555a0 con 0x7f0bf0155a30 2024-05-08T19:22:44.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.281+0000 7f0bf8055700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf00c12e0 con 0x7f0bf00c0d90 2024-05-08T19:22:44.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.281+0000 7f0bf65f2700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0bf00c0d90 0x7f0bf015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:44.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.281+0000 7f0bf5df1700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0bf006ed60 0x7f0bf014ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48558/0 (socket says 172.21.15.47:48558) 2024-05-08T19:22:44.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.281+0000 7f0bf5df1700 1 -- 172.21.15.47:0/3945609879 learned_addr learned my addr 172.21.15.47:0/3945609879 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:44.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.282+0000 7f0bf65f2700 1 -- 172.21.15.47:0/3945609879 >> v1:172.21.15.177:6789/0 conn(0x7f0bf0155a30 legacy=0x7f0bf00c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.282+0000 7f0bf65f2700 1 -- 172.21.15.47:0/3945609879 >> v1:172.21.15.47:6789/0 conn(0x7f0bf006ed60 legacy=0x7f0bf014ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.282+0000 7f0bf65f2700 1 -- 172.21.15.47:0/3945609879 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf0154f50 con 0x7f0bf00c0d90 2024-05-08T19:22:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.282+0000 7f0bf65f2700 1 --2- 172.21.15.47:0/3945609879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bf00c0d90 0x7f0bf015d0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009d90 tx=0x7f0be800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee56c56f4c2898d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.282+0000 7f0bf4def700 1 -- 172.21.15.47:0/3945609879 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be800e070 con 0x7f0bf00c0d90 2024-05-08T19:22:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.282+0000 7f0bf4def700 1 -- 172.21.15.47:0/3945609879 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be800bbd0 con 0x7f0bf00c0d90 2024-05-08T19:22:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.282+0000 7f0bf4def700 1 -- 172.21.15.47:0/3945609879 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8012430 con 0x7f0bf00c0d90 2024-05-08T19:22:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.283+0000 7f0bf8055700 1 -- 172.21.15.47:0/3945609879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bf00c0d90 msgr2=0x7f0bf015d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.283+0000 7f0bf8055700 1 --2- 172.21.15.47:0/3945609879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bf00c0d90 0x7f0bf015d0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009d90 tx=0x7f0be800b330 comp rx=0 tx=0).stop 2024-05-08T19:22:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.283+0000 7f0bf8055700 1 -- 172.21.15.47:0/3945609879 shutdown_connections 2024-05-08T19:22:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.283+0000 7f0bf8055700 1 --2- 172.21.15.47:0/3945609879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bf00c0d90 0x7f0bf015d0a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.283+0000 7f0bf8055700 1 -- 172.21.15.47:0/3945609879 >> 172.21.15.47:0/3945609879 conn(0x7f0bf006a9c0 msgr2=0x7f0bf006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.283+0000 7f0bf8055700 1 -- 172.21.15.47:0/3945609879 shutdown_connections 2024-05-08T19:22:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.283+0000 7f0bf8055700 1 -- 172.21.15.47:0/3945609879 wait complete. 2024-05-08T19:22:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.284+0000 7f0bf8055700 1 Processor -- start 2024-05-08T19:22:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.284+0000 7f0bf8055700 1 -- start start 2024-05-08T19:22:44.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf8055700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bf006ed60 0x7f0bf0146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:44.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf8055700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bf00c0d90 0x7f0bf01e5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:44.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf8055700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bf0155a30 0x7f0bf01e5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:44.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf8055700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf0145940 con 0x7f0bf0155a30 2024-05-08T19:22:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf8055700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf01452d0 con 0x7f0bf006ed60 2024-05-08T19:22:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf8055700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf0151610 con 0x7f0bf00c0d90 2024-05-08T19:22:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf65f2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bf0155a30 0x7f0bf01e5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf65f2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bf0155a30 0x7f0bf01e5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35682/0 (socket says 172.21.15.47:35682) 2024-05-08T19:22:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf65f2700 1 -- 172.21.15.47:0/3887884292 learned_addr learned my addr 172.21.15.47:0/3887884292 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf5df1700 1 --2- 172.21.15.47:0/3887884292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bf006ed60 0x7f0bf0146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf55f0700 1 --2- 172.21.15.47:0/3887884292 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bf00c0d90 0x7f0bf01e5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf65f2700 1 -- 172.21.15.47:0/3887884292 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bf00c0d90 msgr2=0x7f0bf01e5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf65f2700 1 --2- 172.21.15.47:0/3887884292 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bf00c0d90 0x7f0bf01e5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf65f2700 1 -- 172.21.15.47:0/3887884292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bf006ed60 msgr2=0x7f0bf0146720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf65f2700 1 --2- 172.21.15.47:0/3887884292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bf006ed60 0x7f0bf0146720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf65f2700 1 -- 172.21.15.47:0/3887884292 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be8009a70 con 0x7f0bf0155a30 2024-05-08T19:22:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf65f2700 1 --2- 172.21.15.47:0/3887884292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bf0155a30 0x7f0bf01e5590 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0bf006bf10 tx=0x7f0be8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0be27fc700 1 -- 172.21.15.47:0/3887884292 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8012e50 con 0x7f0bf0155a30 2024-05-08T19:22:44.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0be27fc700 1 -- 172.21.15.47:0/3887884292 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be8020070 con 0x7f0bf0155a30 2024-05-08T19:22:44.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf8055700 1 -- 172.21.15.47:0/3887884292 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf014f470 con 0x7f0bf0155a30 2024-05-08T19:22:44.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0be27fc700 1 -- 172.21.15.47:0/3887884292 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8004280 con 0x7f0bf0155a30 2024-05-08T19:22:44.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.285+0000 7f0bf8055700 1 -- 172.21.15.47:0/3887884292 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf0151330 con 0x7f0bf0155a30 2024-05-08T19:22:44.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.286+0000 7f0bf8055700 1 -- 172.21.15.47:0/3887884292 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf0145ab0 con 0x7f0bf0155a30 2024-05-08T19:22:44.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.287+0000 7f0be27fc700 1 -- 172.21.15.47:0/3887884292 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0be80043e0 con 0x7f0bf0155a30 2024-05-08T19:22:44.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.287+0000 7f0be27fc700 1 --2- 172.21.15.47:0/3887884292 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0bd406ac90 0x7f0bd406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:44.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.287+0000 7f0be27fc700 1 -- 172.21.15.47:0/3887884292 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0be8022070 con 0x7f0bf0155a30 2024-05-08T19:22:44.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.287+0000 7f0bf5df1700 1 --2- 172.21.15.47:0/3887884292 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0bd406ac90 0x7f0bd406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:44.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.288+0000 7f0bf5df1700 1 --2- 172.21.15.47:0/3887884292 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0bd406ac90 0x7f0bd406d150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0bec005910 tx=0x7f0bec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:44.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.292+0000 7f0be27fc700 1 -- 172.21.15.47:0/3887884292 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0bf0145ab0 con 0x7f0bf0155a30 2024-05-08T19:22:44.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.497+0000 7f0bf8055700 1 -- 172.21.15.47:0/3887884292 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0bf014f2f0 con 0x7f0bd406ac90 2024-05-08T19:22:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.507+0000 7f0be27fc700 1 -- 172.21.15.47:0/3887884292 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345349 (secure 0 0 0) 0x7f0bec001580 con 0x7f0bd406ac90 2024-05-08T19:22:44.503 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.511+0000 7f0bf8055700 1 -- 172.21.15.47:0/3887884292 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0bd406ac90 msgr2=0x7f0bd406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.511+0000 7f0bf8055700 1 --2- 172.21.15.47:0/3887884292 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0bd406ac90 0x7f0bd406d150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0bec005910 tx=0x7f0bec009040 comp rx=0 tx=0).stop 2024-05-08T19:22:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.511+0000 7f0bf8055700 1 -- 172.21.15.47:0/3887884292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bf0155a30 msgr2=0x7f0bf01e5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.511+0000 7f0bf8055700 1 --2- 172.21.15.47:0/3887884292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bf0155a30 0x7f0bf01e5590 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0bf006bf10 tx=0x7f0be8004ad0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.511+0000 7f0bf8055700 1 -- 172.21.15.47:0/3887884292 shutdown_connections 2024-05-08T19:22:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.511+0000 7f0bf8055700 1 --2- 172.21.15.47:0/3887884292 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0bd406ac90 0x7f0bd406d150 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.511+0000 7f0bf8055700 1 --2- 172.21.15.47:0/3887884292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bf0155a30 0x7f0bf01e5590 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.511+0000 7f0bf8055700 1 --2- 172.21.15.47:0/3887884292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bf006ed60 0x7f0bf0146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.511+0000 7f0bf8055700 1 --2- 172.21.15.47:0/3887884292 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bf00c0d90 0x7f0bf01e5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.511+0000 7f0bf8055700 1 -- 172.21.15.47:0/3887884292 >> 172.21.15.47:0/3887884292 conn(0x7f0bf006a9c0 msgr2=0x7f0bf00c1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.511+0000 7f0bf8055700 1 -- 172.21.15.47:0/3887884292 shutdown_connections 2024-05-08T19:22:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.511+0000 7f0bf8055700 1 -- 172.21.15.47:0/3887884292 wait complete. 2024-05-08T19:22:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-08T19:22:44.515 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-05-08T19:22:43.870745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218376,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756344,"statfs":{"total":773094113280,"available":772870496256,"internally_reserved":0,"allocated":2228224,"data_stored":1988164,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003814"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888597+0000","last_change":"2024-05-08T19:22:20.461758+0000","last_active":"2024-05-08T19:22:24.888597+0000","last_peered":"2024-05-08T19:22:24.888597+0000","last_clean":"2024-05-08T19:22:24.888597+0000","last_became_active":"2024-05-08T19:22:20.461515+0000","last_became_peered":"2024-05-08T19:22:20.461515+0000","last_unstale":"2024-05-08T19:22:24.888597+0000","last_undegraded":"2024-05-08T19:22:24.888597+0000","last_fullsized":"2024-05-08T19:22:24.888597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879290+0000","last_change":"2024-05-08T19:22:20.434929+0000","last_active":"2024-05-08T19:22:24.879290+0000","last_peered":"2024-05-08T19:22:24.879290+0000","last_clean":"2024-05-08T19:22:24.879290+0000","last_became_active":"2024-05-08T19:22:20.434629+0000","last_became_peered":"2024-05-08T19:22:20.434629+0000","last_unstale":"2024-05-08T19:22:24.879290+0000","last_undegraded":"2024-05-08T19:22:24.879290+0000","last_fullsized":"2024-05-08T19:22:24.879290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878900+0000","last_change":"2024-05-08T19:22:20.449450+0000","last_active":"2024-05-08T19:22:24.878900+0000","last_peered":"2024-05-08T19:22:24.878900+0000","last_clean":"2024-05-08T19:22:24.878900+0000","last_became_active":"2024-05-08T19:22:20.449184+0000","last_became_peered":"2024-05-08T19:22:20.449184+0000","last_unstale":"2024-05-08T19:22:24.878900+0000","last_undegraded":"2024-05-08T19:22:24.878900+0000","last_fullsized":"2024-05-08T19:22:24.878900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875678+0000","last_change":"2024-05-08T19:22:20.449919+0000","last_active":"2024-05-08T19:22:24.875678+0000","last_peered":"2024-05-08T19:22:24.875678+0000","last_clean":"2024-05-08T19:22:24.875678+0000","last_became_active":"2024-05-08T19:22:20.449637+0000","last_became_peered":"2024-05-08T19:22:20.449637+0000","last_unstale":"2024-05-08T19:22:24.875678+0000","last_undegraded":"2024-05-08T19:22:24.875678+0000","last_fullsized":"2024-05-08T19:22:24.875678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888369+0000","last_change":"2024-05-08T19:22:20.449676+0000","last_active":"2024-05-08T19:22:24.888369+0000","last_peered":"2024-05-08T19:22:24.888369+0000","last_clean":"2024-05-08T19:22:24.888369+0000","last_became_active":"2024-05-08T19:22:20.449347+0000","last_became_peered":"2024-05-08T19:22:20.449347+0000","last_unstale":"2024-05-08T19:22:24.888369+0000","last_undegraded":"2024-05-08T19:22:24.888369+0000","last_fullsized":"2024-05-08T19:22:24.888369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:29.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875620+0000","last_change":"2024-05-08T19:22:20.447174+0000","last_active":"2024-05-08T19:22:24.875620+0000","last_peered":"2024-05-08T19:22:24.875620+0000","last_clean":"2024-05-08T19:22:24.875620+0000","last_became_active":"2024-05-08T19:22:20.446893+0000","last_became_peered":"2024-05-08T19:22:20.446893+0000","last_unstale":"2024-05-08T19:22:24.875620+0000","last_undegraded":"2024-05-08T19:22:24.875620+0000","last_fullsized":"2024-05-08T19:22:24.875620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:25.101779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888313+0000","last_change":"2024-05-08T19:22:20.446830+0000","last_active":"2024-05-08T19:22:24.888313+0000","last_peered":"2024-05-08T19:22:24.888313+0000","last_clean":"2024-05-08T19:22:24.888313+0000","last_became_active":"2024-05-08T19:22:20.446520+0000","last_became_peered":"2024-05-08T19:22:20.446520+0000","last_unstale":"2024-05-08T19:22:24.888313+0000","last_undegraded":"2024-05-08T19:22:24.888313+0000","last_fullsized":"2024-05-08T19:22:24.888313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:25.101779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879197+0000","last_change":"2024-05-08T19:22:20.447313+0000","last_active":"2024-05-08T19:22:24.879197+0000","last_peered":"2024-05-08T19:22:24.879197+0000","last_clean":"2024-05-08T19:22:24.879197+0000","last_became_active":"2024-05-08T19:22:20.447031+0000","last_became_peered":"2024-05-08T19:22:20.447031+0000","last_unstale":"2024-05-08T19:22:24.879197+0000","last_undegraded":"2024-05-08T19:22:24.879197+0000","last_fullsized":"2024-05-08T19:22:24.879197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888578+0000","last_change":"2024-05-08T19:22:20.447186+0000","last_active":"2024-05-08T19:22:24.888578+0000","last_peered":"2024-05-08T19:22:24.888578+0000","last_clean":"2024-05-08T19:22:24.888578+0000","last_became_active":"2024-05-08T19:22:20.446803+0000","last_became_peered":"2024-05-08T19:22:20.446803+0000","last_unstale":"2024-05-08T19:22:24.888578+0000","last_undegraded":"2024-05-08T19:22:24.888578+0000","last_fullsized":"2024-05-08T19:22:24.888578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885037+0000","last_change":"2024-05-08T19:22:20.462899+0000","last_active":"2024-05-08T19:22:24.885037+0000","last_peered":"2024-05-08T19:22:24.885037+0000","last_clean":"2024-05-08T19:22:24.885037+0000","last_became_active":"2024-05-08T19:22:20.461395+0000","last_became_peered":"2024-05-08T19:22:20.461395+0000","last_unstale":"2024-05-08T19:22:24.885037+0000","last_undegraded":"2024-05-08T19:22:24.885037+0000","last_fullsized":"2024-05-08T19:22:24.885037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885018+0000","last_change":"2024-05-08T19:22:20.459545+0000","last_active":"2024-05-08T19:22:24.885018+0000","last_peered":"2024-05-08T19:22:24.885018+0000","last_clean":"2024-05-08T19:22:24.885018+0000","last_became_active":"2024-05-08T19:22:20.459253+0000","last_became_peered":"2024-05-08T19:22:20.459253+0000","last_unstale":"2024-05-08T19:22:24.885018+0000","last_undegraded":"2024-05-08T19:22:24.885018+0000","last_fullsized":"2024-05-08T19:22:24.885018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882661+0000","last_change":"2024-05-08T19:22:20.462193+0000","last_active":"2024-05-08T19:22:24.882661+0000","last_peered":"2024-05-08T19:22:24.882661+0000","last_clean":"2024-05-08T19:22:24.882661+0000","last_became_active":"2024-05-08T19:22:20.461852+0000","last_became_peered":"2024-05-08T19:22:20.461852+0000","last_unstale":"2024-05-08T19:22:24.882661+0000","last_undegraded":"2024-05-08T19:22:24.882661+0000","last_fullsized":"2024-05-08T19:22:24.882661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:51.431376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879318+0000","last_change":"2024-05-08T19:22:20.453169+0000","last_active":"2024-05-08T19:22:24.879318+0000","last_peered":"2024-05-08T19:22:24.879318+0000","last_clean":"2024-05-08T19:22:24.879318+0000","last_became_active":"2024-05-08T19:22:20.452884+0000","last_became_peered":"2024-05-08T19:22:20.452884+0000","last_unstale":"2024-05-08T19:22:24.879318+0000","last_undegraded":"2024-05-08T19:22:24.879318+0000","last_fullsized":"2024-05-08T19:22:24.879318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878772+0000","last_change":"2024-05-08T19:22:20.435745+0000","last_active":"2024-05-08T19:22:24.878772+0000","last_peered":"2024-05-08T19:22:24.878772+0000","last_clean":"2024-05-08T19:22:24.878772+0000","last_became_active":"2024-05-08T19:22:20.435456+0000","last_became_peered":"2024-05-08T19:22:20.435456+0000","last_unstale":"2024-05-08T19:22:24.878772+0000","last_undegraded":"2024-05-08T19:22:24.878772+0000","last_fullsized":"2024-05-08T19:22:24.878772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879116+0000","last_change":"2024-05-08T19:22:20.444615+0000","last_active":"2024-05-08T19:22:24.879116+0000","last_peered":"2024-05-08T19:22:24.879116+0000","last_clean":"2024-05-08T19:22:24.879116+0000","last_became_active":"2024-05-08T19:22:20.444369+0000","last_became_peered":"2024-05-08T19:22:20.444369+0000","last_unstale":"2024-05-08T19:22:24.879116+0000","last_undegraded":"2024-05-08T19:22:24.879116+0000","last_fullsized":"2024-05-08T19:22:24.879116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875527+0000","last_change":"2024-05-08T19:22:20.445391+0000","last_active":"2024-05-08T19:22:24.875527+0000","last_peered":"2024-05-08T19:22:24.875527+0000","last_clean":"2024-05-08T19:22:24.875527+0000","last_became_active":"2024-05-08T19:22:20.444996+0000","last_became_peered":"2024-05-08T19:22:20.444996+0000","last_unstale":"2024-05-08T19:22:24.875527+0000","last_undegraded":"2024-05-08T19:22:24.875527+0000","last_fullsized":"2024-05-08T19:22:24.875527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875748+0000","last_change":"2024-05-08T19:22:20.451170+0000","last_active":"2024-05-08T19:22:24.875748+0000","last_peered":"2024-05-08T19:22:24.875748+0000","last_clean":"2024-05-08T19:22:24.875748+0000","last_became_active":"2024-05-08T19:22:20.450843+0000","last_became_peered":"2024-05-08T19:22:20.450843+0000","last_unstale":"2024-05-08T19:22:24.875748+0000","last_undegraded":"2024-05-08T19:22:24.875748+0000","last_fullsized":"2024-05-08T19:22:24.875748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.886301+0000","last_change":"2024-05-08T19:22:20.462503+0000","last_active":"2024-05-08T19:22:24.886301+0000","last_peered":"2024-05-08T19:22:24.886301+0000","last_clean":"2024-05-08T19:22:24.886301+0000","last_became_active":"2024-05-08T19:22:20.462266+0000","last_became_peered":"2024-05-08T19:22:20.462266+0000","last_unstale":"2024-05-08T19:22:24.886301+0000","last_undegraded":"2024-05-08T19:22:24.886301+0000","last_fullsized":"2024-05-08T19:22:24.886301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:04.174914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888517+0000","last_change":"2024-05-08T19:22:20.454128+0000","last_active":"2024-05-08T19:22:24.888517+0000","last_peered":"2024-05-08T19:22:24.888517+0000","last_clean":"2024-05-08T19:22:24.888517+0000","last_became_active":"2024-05-08T19:22:20.453834+0000","last_became_peered":"2024-05-08T19:22:20.453834+0000","last_unstale":"2024-05-08T19:22:24.888517+0000","last_undegraded":"2024-05-08T19:22:24.888517+0000","last_fullsized":"2024-05-08T19:22:24.888517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:23.193366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879275+0000","last_change":"2024-05-08T19:22:24.616532+0000","last_active":"2024-05-08T19:22:24.879275+0000","last_peered":"2024-05-08T19:22:24.879275+0000","last_clean":"2024-05-08T19:22:24.879275+0000","last_became_active":"2024-05-08T19:22:24.616128+0000","last_became_peered":"2024-05-08T19:22:24.616128+0000","last_unstale":"2024-05-08T19:22:24.879275+0000","last_undegraded":"2024-05-08T19:22:24.879275+0000","last_fullsized":"2024-05-08T19:22:24.879275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:44.356550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.459339+0000","last_change":"2024-05-08T19:22:20.012743+0000","last_active":"2024-05-08T19:22:24.459339+0000","last_peered":"2024-05-08T19:22:24.459339+0000","last_clean":"2024-05-08T19:22:24.459339+0000","last_became_active":"2024-05-08T19:22:20.012453+0000","last_became_peered":"2024-05-08T19:22:20.012453+0000","last_unstale":"2024-05-08T19:22:24.459339+0000","last_undegraded":"2024-05-08T19:22:24.459339+0000","last_fullsized":"2024-05-08T19:22:24.459339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:52.547906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879448+0000","last_change":"2024-05-08T19:22:20.464578+0000","last_active":"2024-05-08T19:22:24.879448+0000","last_peered":"2024-05-08T19:22:24.879448+0000","last_clean":"2024-05-08T19:22:24.879448+0000","last_became_active":"2024-05-08T19:22:20.464396+0000","last_became_peered":"2024-05-08T19:22:20.464396+0000","last_unstale":"2024-05-08T19:22:24.879448+0000","last_undegraded":"2024-05-08T19:22:24.879448+0000","last_fullsized":"2024-05-08T19:22:24.879448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882432+0000","last_change":"2024-05-08T19:22:24.469561+0000","last_active":"2024-05-08T19:22:24.882432+0000","last_peered":"2024-05-08T19:22:24.882432+0000","last_clean":"2024-05-08T19:22:24.882432+0000","last_became_active":"2024-05-08T19:22:24.469161+0000","last_became_peered":"2024-05-08T19:22:24.469161+0000","last_unstale":"2024-05-08T19:22:24.882432+0000","last_undegraded":"2024-05-08T19:22:24.882432+0000","last_fullsized":"2024-05-08T19:22:24.882432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:50.011809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.449197+0000","last_change":"2024-05-08T19:22:20.006198+0000","last_active":"2024-05-08T19:22:24.449197+0000","last_peered":"2024-05-08T19:22:24.449197+0000","last_clean":"2024-05-08T19:22:24.449197+0000","last_became_active":"2024-05-08T19:22:20.005723+0000","last_became_peered":"2024-05-08T19:22:20.005723+0000","last_unstale":"2024-05-08T19:22:24.449197+0000","last_undegraded":"2024-05-08T19:22:24.449197+0000","last_fullsized":"2024-05-08T19:22:24.449197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878995+0000","last_change":"2024-05-08T19:22:20.451485+0000","last_active":"2024-05-08T19:22:24.878995+0000","last_peered":"2024-05-08T19:22:24.878995+0000","last_clean":"2024-05-08T19:22:24.878995+0000","last_became_active":"2024-05-08T19:22:20.446380+0000","last_became_peered":"2024-05-08T19:22:20.446380+0000","last_unstale":"2024-05-08T19:22:24.878995+0000","last_undegraded":"2024-05-08T19:22:24.878995+0000","last_fullsized":"2024-05-08T19:22:24.878995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:47.856077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882551+0000","last_change":"2024-05-08T19:22:24.465354+0000","last_active":"2024-05-08T19:22:24.882551+0000","last_peered":"2024-05-08T19:22:24.882551+0000","last_clean":"2024-05-08T19:22:24.882551+0000","last_became_active":"2024-05-08T19:22:24.464669+0000","last_became_peered":"2024-05-08T19:22:24.464669+0000","last_unstale":"2024-05-08T19:22:24.882551+0000","last_undegraded":"2024-05-08T19:22:24.882551+0000","last_fullsized":"2024-05-08T19:22:24.882551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:29.398413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612530+0000","last_change":"2024-05-08T19:22:20.014506+0000","last_active":"2024-05-08T19:22:24.612530+0000","last_peered":"2024-05-08T19:22:24.612530+0000","last_clean":"2024-05-08T19:22:24.612530+0000","last_became_active":"2024-05-08T19:22:20.014239+0000","last_became_peered":"2024-05-08T19:22:20.014239+0000","last_unstale":"2024-05-08T19:22:24.612530+0000","last_undegraded":"2024-05-08T19:22:24.612530+0000","last_fullsized":"2024-05-08T19:22:24.612530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:23.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875653+0000","last_change":"2024-05-08T19:22:20.460913+0000","last_active":"2024-05-08T19:22:24.875653+0000","last_peered":"2024-05-08T19:22:24.875653+0000","last_clean":"2024-05-08T19:22:24.875653+0000","last_became_active":"2024-05-08T19:22:20.460601+0000","last_became_peered":"2024-05-08T19:22:20.460601+0000","last_unstale":"2024-05-08T19:22:24.875653+0000","last_undegraded":"2024-05-08T19:22:24.875653+0000","last_fullsized":"2024-05-08T19:22:24.875653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882504+0000","last_change":"2024-05-08T19:22:24.479649+0000","last_active":"2024-05-08T19:22:24.882504+0000","last_peered":"2024-05-08T19:22:24.882504+0000","last_clean":"2024-05-08T19:22:24.882504+0000","last_became_active":"2024-05-08T19:22:24.479255+0000","last_became_peered":"2024-05-08T19:22:24.479255+0000","last_unstale":"2024-05-08T19:22:24.882504+0000","last_undegraded":"2024-05-08T19:22:24.882504+0000","last_fullsized":"2024-05-08T19:22:24.882504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612447+0000","last_change":"2024-05-08T19:22:20.014093+0000","last_active":"2024-05-08T19:22:24.612447+0000","last_peered":"2024-05-08T19:22:24.612447+0000","last_clean":"2024-05-08T19:22:24.612447+0000","last_became_active":"2024-05-08T19:22:20.013793+0000","last_became_peered":"2024-05-08T19:22:20.013793+0000","last_unstale":"2024-05-08T19:22:24.612447+0000","last_undegraded":"2024-05-08T19:22:24.612447+0000","last_fullsized":"2024-05-08T19:22:24.612447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875700+0000","last_change":"2024-05-08T19:22:20.455505+0000","last_active":"2024-05-08T19:22:24.875700+0000","last_peered":"2024-05-08T19:22:24.875700+0000","last_clean":"2024-05-08T19:22:24.875700+0000","last_became_active":"2024-05-08T19:22:20.455148+0000","last_became_peered":"2024-05-08T19:22:20.455148+0000","last_unstale":"2024-05-08T19:22:24.875700+0000","last_undegraded":"2024-05-08T19:22:24.875700+0000","last_fullsized":"2024-05-08T19:22:24.875700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879418+0000","last_change":"2024-05-08T19:22:24.465009+0000","last_active":"2024-05-08T19:22:24.879418+0000","last_peered":"2024-05-08T19:22:24.879418+0000","last_clean":"2024-05-08T19:22:24.879418+0000","last_became_active":"2024-05-08T19:22:24.464422+0000","last_became_peered":"2024-05-08T19:22:24.464422+0000","last_unstale":"2024-05-08T19:22:24.879418+0000","last_undegraded":"2024-05-08T19:22:24.879418+0000","last_fullsized":"2024-05-08T19:22:24.879418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:12.830755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.449208+0000","last_change":"2024-05-08T19:22:20.011515+0000","last_active":"2024-05-08T19:22:24.449208+0000","last_peered":"2024-05-08T19:22:24.449208+0000","last_clean":"2024-05-08T19:22:24.449208+0000","last_became_active":"2024-05-08T19:22:20.011183+0000","last_became_peered":"2024-05-08T19:22:20.011183+0000","last_unstale":"2024-05-08T19:22:24.449208+0000","last_undegraded":"2024-05-08T19:22:24.449208+0000","last_fullsized":"2024-05-08T19:22:24.449208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882529+0000","last_change":"2024-05-08T19:22:20.439371+0000","last_active":"2024-05-08T19:22:24.882529+0000","last_peered":"2024-05-08T19:22:24.882529+0000","last_clean":"2024-05-08T19:22:24.882529+0000","last_became_active":"2024-05-08T19:22:20.439096+0000","last_became_peered":"2024-05-08T19:22:20.439096+0000","last_unstale":"2024-05-08T19:22:24.882529+0000","last_undegraded":"2024-05-08T19:22:24.882529+0000","last_fullsized":"2024-05-08T19:22:24.882529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:56.795619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.886255+0000","last_change":"2024-05-08T19:22:24.476370+0000","last_active":"2024-05-08T19:22:24.886255+0000","last_peered":"2024-05-08T19:22:24.886255+0000","last_clean":"2024-05-08T19:22:24.886255+0000","last_became_active":"2024-05-08T19:22:24.475891+0000","last_became_peered":"2024-05-08T19:22:24.475891+0000","last_unstale":"2024-05-08T19:22:24.886255+0000","last_undegraded":"2024-05-08T19:22:24.886255+0000","last_fullsized":"2024-05-08T19:22:24.886255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:58.674524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458227+0000","last_change":"2024-05-08T19:22:20.004185+0000","last_active":"2024-05-08T19:22:24.458227+0000","last_peered":"2024-05-08T19:22:24.458227+0000","last_clean":"2024-05-08T19:22:24.458227+0000","last_became_active":"2024-05-08T19:22:20.003513+0000","last_became_peered":"2024-05-08T19:22:20.003513+0000","last_unstale":"2024-05-08T19:22:24.458227+0000","last_undegraded":"2024-05-08T19:22:24.458227+0000","last_fullsized":"2024-05-08T19:22:24.458227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878842+0000","last_change":"2024-05-08T19:22:20.446538+0000","last_active":"2024-05-08T19:22:24.878842+0000","last_peered":"2024-05-08T19:22:24.878842+0000","last_clean":"2024-05-08T19:22:24.878842+0000","last_became_active":"2024-05-08T19:22:20.445238+0000","last_became_peered":"2024-05-08T19:22:20.445238+0000","last_unstale":"2024-05-08T19:22:24.878842+0000","last_undegraded":"2024-05-08T19:22:24.878842+0000","last_fullsized":"2024-05-08T19:22:24.878842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885078+0000","last_change":"2024-05-08T19:22:24.479665+0000","last_active":"2024-05-08T19:22:24.885078+0000","last_peered":"2024-05-08T19:22:24.885078+0000","last_clean":"2024-05-08T19:22:24.885078+0000","last_became_active":"2024-05-08T19:22:24.478998+0000","last_became_peered":"2024-05-08T19:22:24.478998+0000","last_unstale":"2024-05-08T19:22:24.885078+0000","last_undegraded":"2024-05-08T19:22:24.885078+0000","last_fullsized":"2024-05-08T19:22:24.885078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:55.287155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.448886+0000","last_change":"2024-05-08T19:22:20.002850+0000","last_active":"2024-05-08T19:22:24.448886+0000","last_peered":"2024-05-08T19:22:24.448886+0000","last_clean":"2024-05-08T19:22:24.448886+0000","last_became_active":"2024-05-08T19:22:20.002534+0000","last_became_peered":"2024-05-08T19:22:20.002534+0000","last_unstale":"2024-05-08T19:22:24.448886+0000","last_undegraded":"2024-05-08T19:22:24.448886+0000","last_fullsized":"2024-05-08T19:22:24.448886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879154+0000","last_change":"2024-05-08T19:22:20.436698+0000","last_active":"2024-05-08T19:22:24.879154+0000","last_peered":"2024-05-08T19:22:24.879154+0000","last_clean":"2024-05-08T19:22:24.879154+0000","last_became_active":"2024-05-08T19:22:20.436431+0000","last_became_peered":"2024-05-08T19:22:20.436431+0000","last_unstale":"2024-05-08T19:22:24.879154+0000","last_undegraded":"2024-05-08T19:22:24.879154+0000","last_fullsized":"2024-05-08T19:22:24.879154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878964+0000","last_change":"2024-05-08T19:22:24.617420+0000","last_active":"2024-05-08T19:22:24.878964+0000","last_peered":"2024-05-08T19:22:24.878964+0000","last_clean":"2024-05-08T19:22:24.878964+0000","last_became_active":"2024-05-08T19:22:24.617030+0000","last_became_peered":"2024-05-08T19:22:24.617030+0000","last_unstale":"2024-05-08T19:22:24.878964+0000","last_undegraded":"2024-05-08T19:22:24.878964+0000","last_fullsized":"2024-05-08T19:22:24.878964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:29.274973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.451218+0000","last_change":"2024-05-08T19:22:20.003949+0000","last_active":"2024-05-08T19:22:24.451218+0000","last_peered":"2024-05-08T19:22:24.451218+0000","last_clean":"2024-05-08T19:22:24.451218+0000","last_became_active":"2024-05-08T19:22:20.003365+0000","last_became_peered":"2024-05-08T19:22:20.003365+0000","last_unstale":"2024-05-08T19:22:24.451218+0000","last_undegraded":"2024-05-08T19:22:24.451218+0000","last_fullsized":"2024-05-08T19:22:24.451218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879173+0000","last_change":"2024-05-08T19:22:20.437480+0000","last_active":"2024-05-08T19:22:24.879173+0000","last_peered":"2024-05-08T19:22:24.879173+0000","last_clean":"2024-05-08T19:22:24.879173+0000","last_became_active":"2024-05-08T19:22:20.437214+0000","last_became_peered":"2024-05-08T19:22:20.437214+0000","last_unstale":"2024-05-08T19:22:24.879173+0000","last_undegraded":"2024-05-08T19:22:24.879173+0000","last_fullsized":"2024-05-08T19:22:24.879173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879220+0000","last_change":"2024-05-08T19:22:24.615730+0000","last_active":"2024-05-08T19:22:24.879220+0000","last_peered":"2024-05-08T19:22:24.879220+0000","last_clean":"2024-05-08T19:22:24.879220+0000","last_became_active":"2024-05-08T19:22:24.615351+0000","last_became_peered":"2024-05-08T19:22:24.615351+0000","last_unstale":"2024-05-08T19:22:24.879220+0000","last_undegraded":"2024-05-08T19:22:24.879220+0000","last_fullsized":"2024-05-08T19:22:24.879220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458351+0000","last_change":"2024-05-08T19:22:20.002400+0000","last_active":"2024-05-08T19:22:24.458351+0000","last_peered":"2024-05-08T19:22:24.458351+0000","last_clean":"2024-05-08T19:22:24.458351+0000","last_became_active":"2024-05-08T19:22:20.001990+0000","last_became_peered":"2024-05-08T19:22:20.001990+0000","last_unstale":"2024-05-08T19:22:24.458351+0000","last_undegraded":"2024-05-08T19:22:24.458351+0000","last_fullsized":"2024-05-08T19:22:24.458351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875730+0000","last_change":"2024-05-08T19:22:20.447742+0000","last_active":"2024-05-08T19:22:24.875730+0000","last_peered":"2024-05-08T19:22:24.875730+0000","last_clean":"2024-05-08T19:22:24.875730+0000","last_became_active":"2024-05-08T19:22:20.447475+0000","last_became_peered":"2024-05-08T19:22:20.447475+0000","last_unstale":"2024-05-08T19:22:24.875730+0000","last_undegraded":"2024-05-08T19:22:24.875730+0000","last_fullsized":"2024-05-08T19:22:24.875730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879120+0000","last_change":"2024-05-08T19:22:24.469872+0000","last_active":"2024-05-08T19:22:24.879120+0000","last_peered":"2024-05-08T19:22:24.879120+0000","last_clean":"2024-05-08T19:22:24.879120+0000","last_became_active":"2024-05-08T19:22:24.469176+0000","last_became_peered":"2024-05-08T19:22:24.469176+0000","last_unstale":"2024-05-08T19:22:24.879120+0000","last_undegraded":"2024-05-08T19:22:24.879120+0000","last_fullsized":"2024-05-08T19:22:24.879120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:04.818467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.451462+0000","last_change":"2024-05-08T19:22:20.001272+0000","last_active":"2024-05-08T19:22:24.451462+0000","last_peered":"2024-05-08T19:22:24.451462+0000","last_clean":"2024-05-08T19:22:24.451462+0000","last_became_active":"2024-05-08T19:22:20.000981+0000","last_became_peered":"2024-05-08T19:22:20.000981+0000","last_unstale":"2024-05-08T19:22:24.451462+0000","last_undegraded":"2024-05-08T19:22:24.451462+0000","last_fullsized":"2024-05-08T19:22:24.451462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879018+0000","last_change":"2024-05-08T19:22:20.446938+0000","last_active":"2024-05-08T19:22:24.879018+0000","last_peered":"2024-05-08T19:22:24.879018+0000","last_clean":"2024-05-08T19:22:24.879018+0000","last_became_active":"2024-05-08T19:22:20.446644+0000","last_became_peered":"2024-05-08T19:22:20.446644+0000","last_unstale":"2024-05-08T19:22:24.879018+0000","last_undegraded":"2024-05-08T19:22:24.879018+0000","last_fullsized":"2024-05-08T19:22:24.879018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:39:35.443674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882595+0000","last_change":"2024-05-08T19:22:24.465089+0000","last_active":"2024-05-08T19:22:24.882595+0000","last_peered":"2024-05-08T19:22:24.882595+0000","last_clean":"2024-05-08T19:22:24.882595+0000","last_became_active":"2024-05-08T19:22:24.464178+0000","last_became_peered":"2024-05-08T19:22:24.464178+0000","last_unstale":"2024-05-08T19:22:24.882595+0000","last_undegraded":"2024-05-08T19:22:24.882595+0000","last_fullsized":"2024-05-08T19:22:24.882595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466970+0000","last_change":"2024-05-08T19:22:20.001300+0000","last_active":"2024-05-08T19:22:24.466970+0000","last_peered":"2024-05-08T19:22:24.466970+0000","last_clean":"2024-05-08T19:22:24.466970+0000","last_became_active":"2024-05-08T19:22:20.000985+0000","last_became_peered":"2024-05-08T19:22:20.000985+0000","last_unstale":"2024-05-08T19:22:24.466970+0000","last_undegraded":"2024-05-08T19:22:24.466970+0000","last_fullsized":"2024-05-08T19:22:24.466970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:50.426177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882648+0000","last_change":"2024-05-08T19:22:20.447801+0000","last_active":"2024-05-08T19:22:24.882648+0000","last_peered":"2024-05-08T19:22:24.882648+0000","last_clean":"2024-05-08T19:22:24.882648+0000","last_became_active":"2024-05-08T19:22:20.447538+0000","last_became_peered":"2024-05-08T19:22:20.447538+0000","last_unstale":"2024-05-08T19:22:24.882648+0000","last_undegraded":"2024-05-08T19:22:24.882648+0000","last_fullsized":"2024-05-08T19:22:24.882648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:14.706653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879217+0000","last_change":"2024-05-08T19:22:24.479544+0000","last_active":"2024-05-08T19:22:24.879217+0000","last_peered":"2024-05-08T19:22:24.879217+0000","last_clean":"2024-05-08T19:22:24.879217+0000","last_became_active":"2024-05-08T19:22:24.479071+0000","last_became_peered":"2024-05-08T19:22:24.479071+0000","last_unstale":"2024-05-08T19:22:24.879217+0000","last_undegraded":"2024-05-08T19:22:24.879217+0000","last_fullsized":"2024-05-08T19:22:24.879217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:19.704360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T19:22:30.073584+0000","last_change":"2024-05-08T19:22:20.011799+0000","last_active":"2024-05-08T19:22:30.073584+0000","last_peered":"2024-05-08T19:22:30.073584+0000","last_clean":"2024-05-08T19:22:30.073584+0000","last_became_active":"2024-05-08T19:22:20.011331+0000","last_became_peered":"2024-05-08T19:22:20.011331+0000","last_unstale":"2024-05-08T19:22:30.073584+0000","last_undegraded":"2024-05-08T19:22:30.073584+0000","last_fullsized":"2024-05-08T19:22:30.073584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888497+0000","last_change":"2024-05-08T19:22:20.447583+0000","last_active":"2024-05-08T19:22:24.888497+0000","last_peered":"2024-05-08T19:22:24.888497+0000","last_clean":"2024-05-08T19:22:24.888497+0000","last_became_active":"2024-05-08T19:22:20.447243+0000","last_became_peered":"2024-05-08T19:22:20.447243+0000","last_unstale":"2024-05-08T19:22:24.888497+0000","last_undegraded":"2024-05-08T19:22:24.888497+0000","last_fullsized":"2024-05-08T19:22:24.888497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875687+0000","last_change":"2024-05-08T19:22:24.615622+0000","last_active":"2024-05-08T19:22:24.875687+0000","last_peered":"2024-05-08T19:22:24.875687+0000","last_clean":"2024-05-08T19:22:24.875687+0000","last_became_active":"2024-05-08T19:22:24.614790+0000","last_became_peered":"2024-05-08T19:22:24.614790+0000","last_unstale":"2024-05-08T19:22:24.875687+0000","last_undegraded":"2024-05-08T19:22:24.875687+0000","last_fullsized":"2024-05-08T19:22:24.875687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457513+0000","last_change":"2024-05-08T19:22:20.006367+0000","last_active":"2024-05-08T19:22:24.457513+0000","last_peered":"2024-05-08T19:22:24.457513+0000","last_clean":"2024-05-08T19:22:24.457513+0000","last_became_active":"2024-05-08T19:22:20.005738+0000","last_became_peered":"2024-05-08T19:22:20.005738+0000","last_unstale":"2024-05-08T19:22:24.457513+0000","last_undegraded":"2024-05-08T19:22:24.457513+0000","last_fullsized":"2024-05-08T19:22:24.457513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878788+0000","last_change":"2024-05-08T19:22:20.448713+0000","last_active":"2024-05-08T19:22:24.878788+0000","last_peered":"2024-05-08T19:22:24.878788+0000","last_clean":"2024-05-08T19:22:24.878788+0000","last_became_active":"2024-05-08T19:22:20.448268+0000","last_became_peered":"2024-05-08T19:22:20.448268+0000","last_unstale":"2024-05-08T19:22:24.878788+0000","last_undegraded":"2024-05-08T19:22:24.878788+0000","last_fullsized":"2024-05-08T19:22:24.878788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879370+0000","last_change":"2024-05-08T19:22:24.614076+0000","last_active":"2024-05-08T19:22:24.879370+0000","last_peered":"2024-05-08T19:22:24.879370+0000","last_clean":"2024-05-08T19:22:24.879370+0000","last_became_active":"2024-05-08T19:22:24.613698+0000","last_became_peered":"2024-05-08T19:22:24.613698+0000","last_unstale":"2024-05-08T19:22:24.879370+0000","last_undegraded":"2024-05-08T19:22:24.879370+0000","last_fullsized":"2024-05-08T19:22:24.879370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:26.030709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.450746+0000","last_change":"2024-05-08T19:22:20.011480+0000","last_active":"2024-05-08T19:22:24.450746+0000","last_peered":"2024-05-08T19:22:24.450746+0000","last_clean":"2024-05-08T19:22:24.450746+0000","last_became_active":"2024-05-08T19:22:20.011188+0000","last_became_peered":"2024-05-08T19:22:20.011188+0000","last_unstale":"2024-05-08T19:22:24.450746+0000","last_undegraded":"2024-05-08T19:22:24.450746+0000","last_fullsized":"2024-05-08T19:22:24.450746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888393+0000","last_change":"2024-05-08T19:22:20.455818+0000","last_active":"2024-05-08T19:22:24.888393+0000","last_peered":"2024-05-08T19:22:24.888393+0000","last_clean":"2024-05-08T19:22:24.888393+0000","last_became_active":"2024-05-08T19:22:20.455562+0000","last_became_peered":"2024-05-08T19:22:20.455562+0000","last_unstale":"2024-05-08T19:22:24.888393+0000","last_undegraded":"2024-05-08T19:22:24.888393+0000","last_fullsized":"2024-05-08T19:22:24.888393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879484+0000","last_change":"2024-05-08T19:22:24.616812+0000","last_active":"2024-05-08T19:22:24.879484+0000","last_peered":"2024-05-08T19:22:24.879484+0000","last_clean":"2024-05-08T19:22:24.879484+0000","last_became_active":"2024-05-08T19:22:24.615618+0000","last_became_peered":"2024-05-08T19:22:24.615618+0000","last_unstale":"2024-05-08T19:22:24.879484+0000","last_undegraded":"2024-05-08T19:22:24.879484+0000","last_fullsized":"2024-05-08T19:22:24.879484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:21.559278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457687+0000","last_change":"2024-05-08T19:22:20.004327+0000","last_active":"2024-05-08T19:22:24.457687+0000","last_peered":"2024-05-08T19:22:24.457687+0000","last_clean":"2024-05-08T19:22:24.457687+0000","last_became_active":"2024-05-08T19:22:20.003725+0000","last_became_peered":"2024-05-08T19:22:20.003725+0000","last_unstale":"2024-05-08T19:22:24.457687+0000","last_undegraded":"2024-05-08T19:22:24.457687+0000","last_fullsized":"2024-05-08T19:22:24.457687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884871+0000","last_change":"2024-05-08T19:22:20.459536+0000","last_active":"2024-05-08T19:22:24.884871+0000","last_peered":"2024-05-08T19:22:24.884871+0000","last_clean":"2024-05-08T19:22:24.884871+0000","last_became_active":"2024-05-08T19:22:20.452496+0000","last_became_peered":"2024-05-08T19:22:20.452496+0000","last_unstale":"2024-05-08T19:22:24.884871+0000","last_undegraded":"2024-05-08T19:22:24.884871+0000","last_fullsized":"2024-05-08T19:22:24.884871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878916+0000","last_change":"2024-05-08T19:22:24.478351+0000","last_active":"2024-05-08T19:22:24.878916+0000","last_peered":"2024-05-08T19:22:24.878916+0000","last_clean":"2024-05-08T19:22:24.878916+0000","last_became_active":"2024-05-08T19:22:24.477728+0000","last_became_peered":"2024-05-08T19:22:24.477728+0000","last_unstale":"2024-05-08T19:22:24.878916+0000","last_undegraded":"2024-05-08T19:22:24.878916+0000","last_fullsized":"2024-05-08T19:22:24.878916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457653+0000","last_change":"2024-05-08T19:22:20.008346+0000","last_active":"2024-05-08T19:22:24.457653+0000","last_peered":"2024-05-08T19:22:24.457653+0000","last_clean":"2024-05-08T19:22:24.457653+0000","last_became_active":"2024-05-08T19:22:20.007985+0000","last_became_peered":"2024-05-08T19:22:20.007985+0000","last_unstale":"2024-05-08T19:22:24.457653+0000","last_undegraded":"2024-05-08T19:22:24.457653+0000","last_fullsized":"2024-05-08T19:22:24.457653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888351+0000","last_change":"2024-05-08T19:22:20.458860+0000","last_active":"2024-05-08T19:22:24.888351+0000","last_peered":"2024-05-08T19:22:24.888351+0000","last_clean":"2024-05-08T19:22:24.888351+0000","last_became_active":"2024-05-08T19:22:20.458588+0000","last_became_peered":"2024-05-08T19:22:20.458588+0000","last_unstale":"2024-05-08T19:22:24.888351+0000","last_undegraded":"2024-05-08T19:22:24.888351+0000","last_fullsized":"2024-05-08T19:22:24.888351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882450+0000","last_change":"2024-05-08T19:22:24.464132+0000","last_active":"2024-05-08T19:22:24.882450+0000","last_peered":"2024-05-08T19:22:24.882450+0000","last_clean":"2024-05-08T19:22:24.882450+0000","last_became_active":"2024-05-08T19:22:24.463741+0000","last_became_peered":"2024-05-08T19:22:24.463741+0000","last_unstale":"2024-05-08T19:22:24.882450+0000","last_undegraded":"2024-05-08T19:22:24.882450+0000","last_fullsized":"2024-05-08T19:22:24.882450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:13.044112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.451210+0000","last_change":"2024-05-08T19:22:20.005994+0000","last_active":"2024-05-08T19:22:24.451210+0000","last_peered":"2024-05-08T19:22:24.451210+0000","last_clean":"2024-05-08T19:22:24.451210+0000","last_became_active":"2024-05-08T19:22:20.005680+0000","last_became_peered":"2024-05-08T19:22:20.005680+0000","last_unstale":"2024-05-08T19:22:24.451210+0000","last_undegraded":"2024-05-08T19:22:24.451210+0000","last_fullsized":"2024-05-08T19:22:24.451210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:18.387895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888538+0000","last_change":"2024-05-08T19:22:20.449812+0000","last_active":"2024-05-08T19:22:24.888538+0000","last_peered":"2024-05-08T19:22:24.888538+0000","last_clean":"2024-05-08T19:22:24.888538+0000","last_became_active":"2024-05-08T19:22:20.449512+0000","last_became_peered":"2024-05-08T19:22:20.449512+0000","last_unstale":"2024-05-08T19:22:24.888538+0000","last_undegraded":"2024-05-08T19:22:24.888538+0000","last_fullsized":"2024-05-08T19:22:24.888538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879207+0000","last_change":"2024-05-08T19:22:24.478647+0000","last_active":"2024-05-08T19:22:24.879207+0000","last_peered":"2024-05-08T19:22:24.879207+0000","last_clean":"2024-05-08T19:22:24.879207+0000","last_became_active":"2024-05-08T19:22:24.478248+0000","last_became_peered":"2024-05-08T19:22:24.478248+0000","last_unstale":"2024-05-08T19:22:24.879207+0000","last_undegraded":"2024-05-08T19:22:24.879207+0000","last_fullsized":"2024-05-08T19:22:24.879207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:26.651711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.469393+0000","last_change":"2024-05-08T19:22:20.003344+0000","last_active":"2024-05-08T19:22:24.469393+0000","last_peered":"2024-05-08T19:22:24.469393+0000","last_clean":"2024-05-08T19:22:24.469393+0000","last_became_active":"2024-05-08T19:22:20.003055+0000","last_became_peered":"2024-05-08T19:22:20.003055+0000","last_unstale":"2024-05-08T19:22:24.469393+0000","last_undegraded":"2024-05-08T19:22:24.469393+0000","last_fullsized":"2024-05-08T19:22:24.469393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875711+0000","last_change":"2024-05-08T19:22:20.450523+0000","last_active":"2024-05-08T19:22:24.875711+0000","last_peered":"2024-05-08T19:22:24.875711+0000","last_clean":"2024-05-08T19:22:24.875711+0000","last_became_active":"2024-05-08T19:22:20.449693+0000","last_became_peered":"2024-05-08T19:22:20.449693+0000","last_unstale":"2024-05-08T19:22:24.875711+0000","last_undegraded":"2024-05-08T19:22:24.875711+0000","last_fullsized":"2024-05-08T19:22:24.875711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879227+0000","last_change":"2024-05-08T19:22:24.472926+0000","last_active":"2024-05-08T19:22:24.879227+0000","last_peered":"2024-05-08T19:22:24.879227+0000","last_clean":"2024-05-08T19:22:24.879227+0000","last_became_active":"2024-05-08T19:22:24.472518+0000","last_became_peered":"2024-05-08T19:22:24.472518+0000","last_unstale":"2024-05-08T19:22:24.879227+0000","last_undegraded":"2024-05-08T19:22:24.879227+0000","last_fullsized":"2024-05-08T19:22:24.879227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.450651+0000","last_change":"2024-05-08T19:22:20.007824+0000","last_active":"2024-05-08T19:22:24.450651+0000","last_peered":"2024-05-08T19:22:24.450651+0000","last_clean":"2024-05-08T19:22:24.450651+0000","last_became_active":"2024-05-08T19:22:20.007542+0000","last_became_peered":"2024-05-08T19:22:20.007542+0000","last_unstale":"2024-05-08T19:22:24.450651+0000","last_undegraded":"2024-05-08T19:22:24.450651+0000","last_fullsized":"2024-05-08T19:22:24.450651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882574+0000","last_change":"2024-05-08T19:22:20.443326+0000","last_active":"2024-05-08T19:22:24.882574+0000","last_peered":"2024-05-08T19:22:24.882574+0000","last_clean":"2024-05-08T19:22:24.882574+0000","last_became_active":"2024-05-08T19:22:20.443049+0000","last_became_peered":"2024-05-08T19:22:20.443049+0000","last_unstale":"2024-05-08T19:22:24.882574+0000","last_undegraded":"2024-05-08T19:22:24.882574+0000","last_fullsized":"2024-05-08T19:22:24.882574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:04.174914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879300+0000","last_change":"2024-05-08T19:22:24.479362+0000","last_active":"2024-05-08T19:22:24.879300+0000","last_peered":"2024-05-08T19:22:24.879300+0000","last_clean":"2024-05-08T19:22:24.879300+0000","last_became_active":"2024-05-08T19:22:24.478640+0000","last_became_peered":"2024-05-08T19:22:24.478640+0000","last_unstale":"2024-05-08T19:22:24.879300+0000","last_undegraded":"2024-05-08T19:22:24.879300+0000","last_fullsized":"2024-05-08T19:22:24.879300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879078+0000","last_change":"2024-05-08T19:22:20.449968+0000","last_active":"2024-05-08T19:22:24.879078+0000","last_peered":"2024-05-08T19:22:24.879078+0000","last_clean":"2024-05-08T19:22:24.879078+0000","last_became_active":"2024-05-08T19:22:20.449709+0000","last_became_peered":"2024-05-08T19:22:20.449709+0000","last_unstale":"2024-05-08T19:22:24.879078+0000","last_undegraded":"2024-05-08T19:22:24.879078+0000","last_fullsized":"2024-05-08T19:22:24.879078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457916+0000","last_change":"2024-05-08T19:22:20.004708+0000","last_active":"2024-05-08T19:22:24.457916+0000","last_peered":"2024-05-08T19:22:24.457916+0000","last_clean":"2024-05-08T19:22:24.457916+0000","last_became_active":"2024-05-08T19:22:20.004404+0000","last_became_peered":"2024-05-08T19:22:20.004404+0000","last_unstale":"2024-05-08T19:22:24.457916+0000","last_undegraded":"2024-05-08T19:22:24.457916+0000","last_fullsized":"2024-05-08T19:22:24.457916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884988+0000","last_change":"2024-05-08T19:22:24.617952+0000","last_active":"2024-05-08T19:22:24.884988+0000","last_peered":"2024-05-08T19:22:24.884988+0000","last_clean":"2024-05-08T19:22:24.884988+0000","last_became_active":"2024-05-08T19:22:24.617627+0000","last_became_peered":"2024-05-08T19:22:24.617627+0000","last_unstale":"2024-05-08T19:22:24.884988+0000","last_undegraded":"2024-05-08T19:22:24.884988+0000","last_fullsized":"2024-05-08T19:22:24.884988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:57.825616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879298+0000","last_change":"2024-05-08T19:22:20.447152+0000","last_active":"2024-05-08T19:22:24.879298+0000","last_peered":"2024-05-08T19:22:24.879298+0000","last_clean":"2024-05-08T19:22:24.879298+0000","last_became_active":"2024-05-08T19:22:20.446864+0000","last_became_peered":"2024-05-08T19:22:20.446864+0000","last_unstale":"2024-05-08T19:22:24.879298+0000","last_undegraded":"2024-05-08T19:22:24.879298+0000","last_fullsized":"2024-05-08T19:22:24.879298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.450537+0000","last_change":"2024-05-08T19:22:20.003790+0000","last_active":"2024-05-08T19:22:24.450537+0000","last_peered":"2024-05-08T19:22:24.450537+0000","last_clean":"2024-05-08T19:22:24.450537+0000","last_became_active":"2024-05-08T19:22:20.003441+0000","last_became_peered":"2024-05-08T19:22:20.003441+0000","last_unstale":"2024-05-08T19:22:24.450537+0000","last_undegraded":"2024-05-08T19:22:24.450537+0000","last_fullsized":"2024-05-08T19:22:24.450537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612146+0000","last_change":"2024-05-08T19:22:17.117278+0000","last_active":"2024-05-08T19:22:24.612146+0000","last_peered":"2024-05-08T19:22:24.612146+0000","last_clean":"2024-05-08T19:22:24.612146+0000","last_became_active":"2024-05-08T19:22:17.116272+0000","last_became_peered":"2024-05-08T19:22:17.116272+0000","last_unstale":"2024-05-08T19:22:24.612146+0000","last_undegraded":"2024-05-08T19:22:24.612146+0000","last_fullsized":"2024-05-08T19:22:24.612146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_clean_scrub_stamp":"2024-05-08T19:22:15.924359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:37.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878934+0000","last_change":"2024-05-08T19:22:24.617594+0000","last_active":"2024-05-08T19:22:24.878934+0000","last_peered":"2024-05-08T19:22:24.878934+0000","last_clean":"2024-05-08T19:22:24.878934+0000","last_became_active":"2024-05-08T19:22:24.616486+0000","last_became_peered":"2024-05-08T19:22:24.616486+0000","last_unstale":"2024-05-08T19:22:24.878934+0000","last_undegraded":"2024-05-08T19:22:24.878934+0000","last_fullsized":"2024-05-08T19:22:24.878934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878747+0000","last_change":"2024-05-08T19:22:20.445458+0000","last_active":"2024-05-08T19:22:24.878747+0000","last_peered":"2024-05-08T19:22:24.878747+0000","last_clean":"2024-05-08T19:22:24.878747+0000","last_became_active":"2024-05-08T19:22:20.445191+0000","last_became_peered":"2024-05-08T19:22:20.445191+0000","last_unstale":"2024-05-08T19:22:24.878747+0000","last_undegraded":"2024-05-08T19:22:24.878747+0000","last_fullsized":"2024-05-08T19:22:24.878747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612265+0000","last_change":"2024-05-08T19:22:20.015288+0000","last_active":"2024-05-08T19:22:24.612265+0000","last_peered":"2024-05-08T19:22:24.612265+0000","last_clean":"2024-05-08T19:22:24.612265+0000","last_became_active":"2024-05-08T19:22:20.015062+0000","last_became_peered":"2024-05-08T19:22:20.015062+0000","last_unstale":"2024-05-08T19:22:24.612265+0000","last_undegraded":"2024-05-08T19:22:24.612265+0000","last_fullsized":"2024-05-08T19:22:24.612265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:12.577297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878827+0000","last_change":"2024-05-08T19:22:24.614066+0000","last_active":"2024-05-08T19:22:24.878827+0000","last_peered":"2024-05-08T19:22:24.878827+0000","last_clean":"2024-05-08T19:22:24.878827+0000","last_became_active":"2024-05-08T19:22:24.613661+0000","last_became_peered":"2024-05-08T19:22:24.613661+0000","last_unstale":"2024-05-08T19:22:24.878827+0000","last_undegraded":"2024-05-08T19:22:24.878827+0000","last_fullsized":"2024-05-08T19:22:24.878827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612417+0000","last_change":"2024-05-08T19:22:20.015193+0000","last_active":"2024-05-08T19:22:24.612417+0000","last_peered":"2024-05-08T19:22:24.612417+0000","last_clean":"2024-05-08T19:22:24.612417+0000","last_became_active":"2024-05-08T19:22:20.014926+0000","last_became_peered":"2024-05-08T19:22:20.014926+0000","last_unstale":"2024-05-08T19:22:24.612417+0000","last_undegraded":"2024-05-08T19:22:24.612417+0000","last_fullsized":"2024-05-08T19:22:24.612417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:13.701454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879254+0000","last_change":"2024-05-08T19:22:20.446453+0000","last_active":"2024-05-08T19:22:24.879254+0000","last_peered":"2024-05-08T19:22:24.879254+0000","last_clean":"2024-05-08T19:22:24.879254+0000","last_became_active":"2024-05-08T19:22:20.446194+0000","last_became_peered":"2024-05-08T19:22:20.446194+0000","last_unstale":"2024-05-08T19:22:24.879254+0000","last_undegraded":"2024-05-08T19:22:24.879254+0000","last_fullsized":"2024-05-08T19:22:24.879254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879174+0000","last_change":"2024-05-08T19:22:24.615481+0000","last_active":"2024-05-08T19:22:24.879174+0000","last_peered":"2024-05-08T19:22:24.879174+0000","last_clean":"2024-05-08T19:22:24.879174+0000","last_became_active":"2024-05-08T19:22:24.615069+0000","last_became_peered":"2024-05-08T19:22:24.615069+0000","last_unstale":"2024-05-08T19:22:24.879174+0000","last_undegraded":"2024-05-08T19:22:24.879174+0000","last_fullsized":"2024-05-08T19:22:24.879174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:28.211177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T19:22:25.515484+0000","last_change":"2024-05-08T19:22:20.001642+0000","last_active":"2024-05-08T19:22:25.515484+0000","last_peered":"2024-05-08T19:22:25.515484+0000","last_clean":"2024-05-08T19:22:25.515484+0000","last_became_active":"2024-05-08T19:22:20.001339+0000","last_became_peered":"2024-05-08T19:22:20.001339+0000","last_unstale":"2024-05-08T19:22:25.515484+0000","last_undegraded":"2024-05-08T19:22:25.515484+0000","last_fullsized":"2024-05-08T19:22:25.515484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879506+0000","last_change":"2024-05-08T19:22:20.447909+0000","last_active":"2024-05-08T19:22:24.879506+0000","last_peered":"2024-05-08T19:22:24.879506+0000","last_clean":"2024-05-08T19:22:24.879506+0000","last_became_active":"2024-05-08T19:22:20.447526+0000","last_became_peered":"2024-05-08T19:22:20.447526+0000","last_unstale":"2024-05-08T19:22:24.879506+0000","last_undegraded":"2024-05-08T19:22:24.879506+0000","last_fullsized":"2024-05-08T19:22:24.879506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882471+0000","last_change":"2024-05-08T19:22:24.614812+0000","last_active":"2024-05-08T19:22:24.882471+0000","last_peered":"2024-05-08T19:22:24.882471+0000","last_clean":"2024-05-08T19:22:24.882471+0000","last_became_active":"2024-05-08T19:22:24.614433+0000","last_became_peered":"2024-05-08T19:22:24.614433+0000","last_unstale":"2024-05-08T19:22:24.882471+0000","last_undegraded":"2024-05-08T19:22:24.882471+0000","last_fullsized":"2024-05-08T19:22:24.882471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:07.924115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458250+0000","last_change":"2024-05-08T19:22:20.012651+0000","last_active":"2024-05-08T19:22:24.458250+0000","last_peered":"2024-05-08T19:22:24.458250+0000","last_clean":"2024-05-08T19:22:24.458250+0000","last_became_active":"2024-05-08T19:22:20.012383+0000","last_became_peered":"2024-05-08T19:22:20.012383+0000","last_unstale":"2024-05-08T19:22:24.458250+0000","last_undegraded":"2024-05-08T19:22:24.458250+0000","last_fullsized":"2024-05-08T19:22:24.458250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878980+0000","last_change":"2024-05-08T19:22:20.436459+0000","last_active":"2024-05-08T19:22:24.878980+0000","last_peered":"2024-05-08T19:22:24.878980+0000","last_clean":"2024-05-08T19:22:24.878980+0000","last_became_active":"2024-05-08T19:22:20.435680+0000","last_became_peered":"2024-05-08T19:22:20.435680+0000","last_unstale":"2024-05-08T19:22:24.878980+0000","last_undegraded":"2024-05-08T19:22:24.878980+0000","last_fullsized":"2024-05-08T19:22:24.878980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:09.166091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882688+0000","last_change":"2024-05-08T19:22:24.473208+0000","last_active":"2024-05-08T19:22:24.882688+0000","last_peered":"2024-05-08T19:22:24.882688+0000","last_clean":"2024-05-08T19:22:24.882688+0000","last_became_active":"2024-05-08T19:22:24.472782+0000","last_became_peered":"2024-05-08T19:22:24.472782+0000","last_unstale":"2024-05-08T19:22:24.882688+0000","last_undegraded":"2024-05-08T19:22:24.882688+0000","last_fullsized":"2024-05-08T19:22:24.882688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612122+0000","last_change":"2024-05-08T19:22:20.014848+0000","last_active":"2024-05-08T19:22:24.612122+0000","last_peered":"2024-05-08T19:22:24.612122+0000","last_clean":"2024-05-08T19:22:24.612122+0000","last_became_active":"2024-05-08T19:22:20.013739+0000","last_became_peered":"2024-05-08T19:22:20.013739+0000","last_unstale":"2024-05-08T19:22:24.612122+0000","last_undegraded":"2024-05-08T19:22:24.612122+0000","last_fullsized":"2024-05-08T19:22:24.612122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:03.169714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882485+0000","last_change":"2024-05-08T19:22:20.447451+0000","last_active":"2024-05-08T19:22:24.882485+0000","last_peered":"2024-05-08T19:22:24.882485+0000","last_clean":"2024-05-08T19:22:24.882485+0000","last_became_active":"2024-05-08T19:22:20.447180+0000","last_became_peered":"2024-05-08T19:22:20.447180+0000","last_unstale":"2024-05-08T19:22:24.882485+0000","last_undegraded":"2024-05-08T19:22:24.882485+0000","last_fullsized":"2024-05-08T19:22:24.882485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879310+0000","last_change":"2024-05-08T19:22:24.614091+0000","last_active":"2024-05-08T19:22:24.879310+0000","last_peered":"2024-05-08T19:22:24.879310+0000","last_clean":"2024-05-08T19:22:24.879310+0000","last_became_active":"2024-05-08T19:22:24.613677+0000","last_became_peered":"2024-05-08T19:22:24.613677+0000","last_unstale":"2024-05-08T19:22:24.879310+0000","last_undegraded":"2024-05-08T19:22:24.879310+0000","last_fullsized":"2024-05-08T19:22:24.879310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:50.011809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466472+0000","last_change":"2024-05-08T19:22:20.011528+0000","last_active":"2024-05-08T19:22:24.466472+0000","last_peered":"2024-05-08T19:22:24.466472+0000","last_clean":"2024-05-08T19:22:24.466472+0000","last_became_active":"2024-05-08T19:22:20.011262+0000","last_became_peered":"2024-05-08T19:22:20.011262+0000","last_unstale":"2024-05-08T19:22:24.466472+0000","last_undegraded":"2024-05-08T19:22:24.466472+0000","last_fullsized":"2024-05-08T19:22:24.466472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879088+0000","last_change":"2024-05-08T19:22:20.438689+0000","last_active":"2024-05-08T19:22:24.879088+0000","last_peered":"2024-05-08T19:22:24.879088+0000","last_clean":"2024-05-08T19:22:24.879088+0000","last_became_active":"2024-05-08T19:22:20.438434+0000","last_became_peered":"2024-05-08T19:22:20.438434+0000","last_unstale":"2024-05-08T19:22:24.879088+0000","last_undegraded":"2024-05-08T19:22:24.879088+0000","last_fullsized":"2024-05-08T19:22:24.879088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882616+0000","last_change":"2024-05-08T19:22:24.473569+0000","last_active":"2024-05-08T19:22:24.882616+0000","last_peered":"2024-05-08T19:22:24.882616+0000","last_clean":"2024-05-08T19:22:24.882616+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:22:24.882616+0000","last_undegraded":"2024-05-08T19:22:24.882616+0000","last_fullsized":"2024-05-08T19:22:24.882616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:22.875469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466685+0000","last_change":"2024-05-08T19:22:20.007101+0000","last_active":"2024-05-08T19:22:24.466685+0000","last_peered":"2024-05-08T19:22:24.466685+0000","last_clean":"2024-05-08T19:22:24.466685+0000","last_became_active":"2024-05-08T19:22:20.006772+0000","last_became_peered":"2024-05-08T19:22:20.006772+0000","last_unstale":"2024-05-08T19:22:24.466685+0000","last_undegraded":"2024-05-08T19:22:24.466685+0000","last_fullsized":"2024-05-08T19:22:24.466685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:23.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879350+0000","last_change":"2024-05-08T19:22:20.436696+0000","last_active":"2024-05-08T19:22:24.879350+0000","last_peered":"2024-05-08T19:22:24.879350+0000","last_clean":"2024-05-08T19:22:24.879350+0000","last_became_active":"2024-05-08T19:22:20.436373+0000","last_became_peered":"2024-05-08T19:22:20.436373+0000","last_unstale":"2024-05-08T19:22:24.879350+0000","last_undegraded":"2024-05-08T19:22:24.879350+0000","last_fullsized":"2024-05-08T19:22:24.879350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882673+0000","last_change":"2024-05-08T19:22:24.478232+0000","last_active":"2024-05-08T19:22:24.882673+0000","last_peered":"2024-05-08T19:22:24.882673+0000","last_clean":"2024-05-08T19:22:24.882673+0000","last_became_active":"2024-05-08T19:22:24.477941+0000","last_became_peered":"2024-05-08T19:22:24.477941+0000","last_unstale":"2024-05-08T19:22:24.882673+0000","last_undegraded":"2024-05-08T19:22:24.882673+0000","last_fullsized":"2024-05-08T19:22:24.882673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612523+0000","last_change":"2024-05-08T19:22:20.014076+0000","last_active":"2024-05-08T19:22:24.612523+0000","last_peered":"2024-05-08T19:22:24.612523+0000","last_clean":"2024-05-08T19:22:24.612523+0000","last_became_active":"2024-05-08T19:22:20.013748+0000","last_became_peered":"2024-05-08T19:22:20.013748+0000","last_unstale":"2024-05-08T19:22:24.612523+0000","last_undegraded":"2024-05-08T19:22:24.612523+0000","last_fullsized":"2024-05-08T19:22:24.612523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:50.426177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884937+0000","last_change":"2024-05-08T19:22:20.457103+0000","last_active":"2024-05-08T19:22:24.884937+0000","last_peered":"2024-05-08T19:22:24.884937+0000","last_clean":"2024-05-08T19:22:24.884937+0000","last_became_active":"2024-05-08T19:22:20.456850+0000","last_became_peered":"2024-05-08T19:22:20.456850+0000","last_unstale":"2024-05-08T19:22:24.884937+0000","last_undegraded":"2024-05-08T19:22:24.884937+0000","last_fullsized":"2024-05-08T19:22:24.884937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884914+0000","last_change":"2024-05-08T19:22:24.614410+0000","last_active":"2024-05-08T19:22:24.884914+0000","last_peered":"2024-05-08T19:22:24.884914+0000","last_clean":"2024-05-08T19:22:24.884914+0000","last_became_active":"2024-05-08T19:22:24.613904+0000","last_became_peered":"2024-05-08T19:22:24.613904+0000","last_unstale":"2024-05-08T19:22:24.884914+0000","last_undegraded":"2024-05-08T19:22:24.884914+0000","last_fullsized":"2024-05-08T19:22:24.884914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:03.465351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458521+0000","last_change":"2024-05-08T19:22:20.000763+0000","last_active":"2024-05-08T19:22:24.458521+0000","last_peered":"2024-05-08T19:22:24.458521+0000","last_clean":"2024-05-08T19:22:24.458521+0000","last_became_active":"2024-05-08T19:22:20.000454+0000","last_became_peered":"2024-05-08T19:22:20.000454+0000","last_unstale":"2024-05-08T19:22:24.458521+0000","last_undegraded":"2024-05-08T19:22:24.458521+0000","last_fullsized":"2024-05-08T19:22:24.458521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888465+0000","last_change":"2024-05-08T19:22:20.456485+0000","last_active":"2024-05-08T19:22:24.888465+0000","last_peered":"2024-05-08T19:22:24.888465+0000","last_clean":"2024-05-08T19:22:24.888465+0000","last_became_active":"2024-05-08T19:22:20.456225+0000","last_became_peered":"2024-05-08T19:22:20.456225+0000","last_unstale":"2024-05-08T19:22:24.888465+0000","last_undegraded":"2024-05-08T19:22:24.888465+0000","last_fullsized":"2024-05-08T19:22:24.888465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878808+0000","last_change":"2024-05-08T19:22:24.473117+0000","last_active":"2024-05-08T19:22:24.878808+0000","last_peered":"2024-05-08T19:22:24.878808+0000","last_clean":"2024-05-08T19:22:24.878808+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:22:24.878808+0000","last_undegraded":"2024-05-08T19:22:24.878808+0000","last_fullsized":"2024-05-08T19:22:24.878808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466917+0000","last_change":"2024-05-08T19:22:20.006312+0000","last_active":"2024-05-08T19:22:24.466917+0000","last_peered":"2024-05-08T19:22:24.466917+0000","last_clean":"2024-05-08T19:22:24.466917+0000","last_became_active":"2024-05-08T19:22:20.005996+0000","last_became_peered":"2024-05-08T19:22:20.005996+0000","last_unstale":"2024-05-08T19:22:24.466917+0000","last_undegraded":"2024-05-08T19:22:24.466917+0000","last_fullsized":"2024-05-08T19:22:24.466917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:13.701454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875666+0000","last_change":"2024-05-08T19:22:20.452861+0000","last_active":"2024-05-08T19:22:24.875666+0000","last_peered":"2024-05-08T19:22:24.875666+0000","last_clean":"2024-05-08T19:22:24.875666+0000","last_became_active":"2024-05-08T19:22:20.452600+0000","last_became_peered":"2024-05-08T19:22:20.452600+0000","last_unstale":"2024-05-08T19:22:24.875666+0000","last_undegraded":"2024-05-08T19:22:24.875666+0000","last_fullsized":"2024-05-08T19:22:24.875666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875543+0000","last_change":"2024-05-08T19:22:24.614345+0000","last_active":"2024-05-08T19:22:24.875543+0000","last_peered":"2024-05-08T19:22:24.875543+0000","last_clean":"2024-05-08T19:22:24.875543+0000","last_became_active":"2024-05-08T19:22:24.613948+0000","last_became_peered":"2024-05-08T19:22:24.613948+0000","last_unstale":"2024-05-08T19:22:24.875543+0000","last_undegraded":"2024-05-08T19:22:24.875543+0000","last_fullsized":"2024-05-08T19:22:24.875543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457773+0000","last_change":"2024-05-08T19:22:20.004844+0000","last_active":"2024-05-08T19:22:24.457773+0000","last_peered":"2024-05-08T19:22:24.457773+0000","last_clean":"2024-05-08T19:22:24.457773+0000","last_became_active":"2024-05-08T19:22:20.004254+0000","last_became_peered":"2024-05-08T19:22:20.004254+0000","last_unstale":"2024-05-08T19:22:24.457773+0000","last_undegraded":"2024-05-08T19:22:24.457773+0000","last_fullsized":"2024-05-08T19:22:24.457773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888558+0000","last_change":"2024-05-08T19:22:20.455712+0000","last_active":"2024-05-08T19:22:24.888558+0000","last_peered":"2024-05-08T19:22:24.888558+0000","last_clean":"2024-05-08T19:22:24.888558+0000","last_became_active":"2024-05-08T19:22:20.455493+0000","last_became_peered":"2024-05-08T19:22:20.455493+0000","last_unstale":"2024-05-08T19:22:24.888558+0000","last_undegraded":"2024-05-08T19:22:24.888558+0000","last_fullsized":"2024-05-08T19:22:24.888558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:28.743156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884892+0000","last_change":"2024-05-08T19:22:20.459104+0000","last_active":"2024-05-08T19:22:24.884892+0000","last_peered":"2024-05-08T19:22:24.884892+0000","last_clean":"2024-05-08T19:22:24.884892+0000","last_became_active":"2024-05-08T19:22:20.452169+0000","last_became_peered":"2024-05-08T19:22:20.452169+0000","last_unstale":"2024-05-08T19:22:24.884892+0000","last_undegraded":"2024-05-08T19:22:24.884892+0000","last_fullsized":"2024-05-08T19:22:24.884892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.886216+0000","last_change":"2024-05-08T19:22:20.449335+0000","last_active":"2024-05-08T19:22:24.886216+0000","last_peered":"2024-05-08T19:22:24.886216+0000","last_clean":"2024-05-08T19:22:24.886216+0000","last_became_active":"2024-05-08T19:22:20.449047+0000","last_became_peered":"2024-05-08T19:22:20.449047+0000","last_unstale":"2024-05-08T19:22:24.886216+0000","last_undegraded":"2024-05-08T19:22:24.886216+0000","last_fullsized":"2024-05-08T19:22:24.886216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875600+0000","last_change":"2024-05-08T19:22:20.452192+0000","last_active":"2024-05-08T19:22:24.875600+0000","last_peered":"2024-05-08T19:22:24.875600+0000","last_clean":"2024-05-08T19:22:24.875600+0000","last_became_active":"2024-05-08T19:22:20.451625+0000","last_became_peered":"2024-05-08T19:22:20.451625+0000","last_unstale":"2024-05-08T19:22:24.875600+0000","last_undegraded":"2024-05-08T19:22:24.875600+0000","last_fullsized":"2024-05-08T19:22:24.875600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878859+0000","last_change":"2024-05-08T19:22:20.441131+0000","last_active":"2024-05-08T19:22:24.878859+0000","last_peered":"2024-05-08T19:22:24.878859+0000","last_clean":"2024-05-08T19:22:24.878859+0000","last_became_active":"2024-05-08T19:22:20.440718+0000","last_became_peered":"2024-05-08T19:22:20.440718+0000","last_unstale":"2024-05-08T19:22:24.878859+0000","last_undegraded":"2024-05-08T19:22:24.878859+0000","last_fullsized":"2024-05-08T19:22:24.878859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879397+0000","last_change":"2024-05-08T19:22:20.444479+0000","last_active":"2024-05-08T19:22:24.879397+0000","last_peered":"2024-05-08T19:22:24.879397+0000","last_clean":"2024-05-08T19:22:24.879397+0000","last_became_active":"2024-05-08T19:22:20.444219+0000","last_became_peered":"2024-05-08T19:22:20.444219+0000","last_unstale":"2024-05-08T19:22:24.879397+0000","last_undegraded":"2024-05-08T19:22:24.879397+0000","last_fullsized":"2024-05-08T19:22:24.879397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879264+0000","last_change":"2024-05-08T19:22:20.436874+0000","last_active":"2024-05-08T19:22:24.879264+0000","last_peered":"2024-05-08T19:22:24.879264+0000","last_clean":"2024-05-08T19:22:24.879264+0000","last_became_active":"2024-05-08T19:22:20.436626+0000","last_became_peered":"2024-05-08T19:22:20.436626+0000","last_unstale":"2024-05-08T19:22:24.879264+0000","last_undegraded":"2024-05-08T19:22:24.879264+0000","last_fullsized":"2024-05-08T19:22:24.879264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885056+0000","last_change":"2024-05-08T19:22:20.462445+0000","last_active":"2024-05-08T19:22:24.885056+0000","last_peered":"2024-05-08T19:22:24.885056+0000","last_clean":"2024-05-08T19:22:24.885056+0000","last_became_active":"2024-05-08T19:22:20.461547+0000","last_became_peered":"2024-05-08T19:22:20.461547+0000","last_unstale":"2024-05-08T19:22:24.885056+0000","last_undegraded":"2024-05-08T19:22:24.885056+0000","last_fullsized":"2024-05-08T19:22:24.885056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879523+0000","last_change":"2024-05-08T19:22:20.443498+0000","last_active":"2024-05-08T19:22:24.879523+0000","last_peered":"2024-05-08T19:22:24.879523+0000","last_clean":"2024-05-08T19:22:24.879523+0000","last_became_active":"2024-05-08T19:22:20.442667+0000","last_became_peered":"2024-05-08T19:22:20.442667+0000","last_unstale":"2024-05-08T19:22:24.879523+0000","last_undegraded":"2024-05-08T19:22:24.879523+0000","last_fullsized":"2024-05-08T19:22:24.879523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875577+0000","last_change":"2024-05-08T19:22:20.448722+0000","last_active":"2024-05-08T19:22:24.875577+0000","last_peered":"2024-05-08T19:22:24.875577+0000","last_clean":"2024-05-08T19:22:24.875577+0000","last_became_active":"2024-05-08T19:22:20.448449+0000","last_became_peered":"2024-05-08T19:22:20.448449+0000","last_unstale":"2024-05-08T19:22:24.875577+0000","last_undegraded":"2024-05-08T19:22:24.875577+0000","last_fullsized":"2024-05-08T19:22:24.875577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879255+0000","last_change":"2024-05-08T19:22:20.450677+0000","last_active":"2024-05-08T19:22:24.879255+0000","last_peered":"2024-05-08T19:22:24.879255+0000","last_clean":"2024-05-08T19:22:24.879255+0000","last_became_active":"2024-05-08T19:22:20.450217+0000","last_became_peered":"2024-05-08T19:22:20.450217+0000","last_unstale":"2024-05-08T19:22:24.879255+0000","last_undegraded":"2024-05-08T19:22:24.879255+0000","last_fullsized":"2024-05-08T19:22:24.879255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875609+0000","last_change":"2024-05-08T19:22:20.453450+0000","last_active":"2024-05-08T19:22:24.875609+0000","last_peered":"2024-05-08T19:22:24.875609+0000","last_clean":"2024-05-08T19:22:24.875609+0000","last_became_active":"2024-05-08T19:22:20.453191+0000","last_became_peered":"2024-05-08T19:22:20.453191+0000","last_unstale":"2024-05-08T19:22:24.875609+0000","last_undegraded":"2024-05-08T19:22:24.875609+0000","last_fullsized":"2024-05-08T19:22:24.875609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878873+0000","last_change":"2024-05-08T19:22:20.452591+0000","last_active":"2024-05-08T19:22:24.878873+0000","last_peered":"2024-05-08T19:22:24.878873+0000","last_clean":"2024-05-08T19:22:24.878873+0000","last_became_active":"2024-05-08T19:22:20.451209+0000","last_became_peered":"2024-05-08T19:22:20.451209+0000","last_unstale":"2024-05-08T19:22:24.878873+0000","last_undegraded":"2024-05-08T19:22:24.878873+0000","last_fullsized":"2024-05-08T19:22:24.878873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884969+0000","last_change":"2024-05-08T19:22:20.461584+0000","last_active":"2024-05-08T19:22:24.884969+0000","last_peered":"2024-05-08T19:22:24.884969+0000","last_clean":"2024-05-08T19:22:24.884969+0000","last_became_active":"2024-05-08T19:22:20.461097+0000","last_became_peered":"2024-05-08T19:22:20.461097+0000","last_unstale":"2024-05-08T19:22:24.884969+0000","last_undegraded":"2024-05-08T19:22:24.884969+0000","last_fullsized":"2024-05-08T19:22:24.884969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":690730,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":690786,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T19:22:44.520 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-08T19:22:44.520 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T19:22:44.520 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T19:22:44.521 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T19:22:44.521 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T19:22:44.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.689+0000 7fdeea128700 1 Processor -- start 2024-05-08T19:22:44.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.689+0000 7fdeea128700 1 -- start start 2024-05-08T19:22:44.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.690+0000 7fdeea128700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdee4150080 0x7fdee40c0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:44.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.690+0000 7fdeea128700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee4066a70 con 0x7fdee4156220 2024-05-08T19:22:44.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.690+0000 7fdeea128700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee40c5950 con 0x7fdee40c6180 2024-05-08T19:22:44.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.690+0000 7fdeea128700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee4150460 con 0x7fdee4150080 2024-05-08T19:22:44.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.690+0000 7fdee3fff700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fdee4156220 0x7fdee4156670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48568/0 (socket says 172.21.15.47:48568) 2024-05-08T19:22:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.690+0000 7fdee3fff700 1 -- 172.21.15.47:0/16485917 learned_addr learned my addr 172.21.15.47:0/16485917 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.690+0000 7fdee37fe700 1 --2- 172.21.15.47:0/16485917 >> v2:172.21.15.177:3300/0 conn(0x7fdee4150080 0x7fdee40c0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.690+0000 7fdee27fc700 1 -- 172.21.15.47:0/16485917 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046623408 0 0) 0x7fdee4066a70 con 0x7fdee4156220 2024-05-08T19:22:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.690+0000 7fdee27fc700 1 -- 172.21.15.47:0/16485917 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdecc0035b0 con 0x7fdee4156220 2024-05-08T19:22:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.690+0000 7fdee27fc700 1 -- 172.21.15.47:0/16485917 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4135748540 0 0) 0x7fdecc0035b0 con 0x7fdee4156220 2024-05-08T19:22:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.690+0000 7fdee27fc700 1 -- 172.21.15.47:0/16485917 >> v2:172.21.15.177:3300/0 conn(0x7fdee4150080 msgr2=0x7fdee40c0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.690+0000 7fdee27fc700 1 --2- 172.21.15.47:0/16485917 >> v2:172.21.15.177:3300/0 conn(0x7fdee4150080 0x7fdee40c0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.690+0000 7fdee27fc700 1 -- 172.21.15.47:0/16485917 >> v1:172.21.15.177:6789/0 conn(0x7fdee40c6180 legacy=0x7fdee406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.690+0000 7fdee27fc700 1 -- 172.21.15.47:0/16485917 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee4153370 con 0x7fdee4156220 2024-05-08T19:22:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.690+0000 7fdee27fc700 1 -- 172.21.15.47:0/16485917 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7fdedc0019f0 con 0x7fdee4156220 2024-05-08T19:22:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee37fe700 1 --2- 172.21.15.47:0/16485917 >> v2:172.21.15.177:3300/0 conn(0x7fdee4150080 0x7fdee40c0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee27fc700 1 -- 172.21.15.47:0/16485917 >> v1:172.21.15.47:6789/0 conn(0x7fdee4156220 legacy=0x7fdee4156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee27fc700 1 --2- 172.21.15.47:0/16485917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdecc003a00 0x7fdecc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee27fc700 1 --2- 172.21.15.47:0/16485917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdecc004850 0x7fdecc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee27fc700 1 --2- 172.21.15.47:0/16485917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdecc005210 0x7fdecc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee27fc700 1 -- 172.21.15.47:0/16485917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee4150460 con 0x7fdecc003a00 2024-05-08T19:22:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee27fc700 1 -- 172.21.15.47:0/16485917 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc00c0b0 con 0x7fdecc004850 2024-05-08T19:22:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee27fc700 1 -- 172.21.15.47:0/16485917 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc00c270 con 0x7fdecc005210 2024-05-08T19:22:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee37fe700 1 --2- 172.21.15.47:0/16485917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdecc003a00 0x7fdecc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee2ffd700 1 --2- 172.21.15.47:0/16485917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdecc004850 0x7fdecc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee3fff700 1 --2- 172.21.15.47:0/16485917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdecc005210 0x7fdecc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee37fe700 1 -- 172.21.15.47:0/16485917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdecc005210 msgr2=0x7fdecc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee37fe700 1 --2- 172.21.15.47:0/16485917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdecc005210 0x7fdecc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee37fe700 1 -- 172.21.15.47:0/16485917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdecc004850 msgr2=0x7fdecc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee37fe700 1 --2- 172.21.15.47:0/16485917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdecc004850 0x7fdecc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee37fe700 1 -- 172.21.15.47:0/16485917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc0035b0 con 0x7fdecc003a00 2024-05-08T19:22:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee3fff700 1 -- 172.21.15.47:0/16485917 reap_dead start 2024-05-08T19:22:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee2ffd700 1 --2- 172.21.15.47:0/16485917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdecc004850 0x7fdecc004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee37fe700 1 --2- 172.21.15.47:0/16485917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdecc003a00 0x7fdecc003e20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fded4009d30 tx=0x7fdecc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c689571bae8f67 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee27fc700 1 -- 172.21.15.47:0/16485917 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4009e80 con 0x7fdecc003a00 2024-05-08T19:22:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee27fc700 1 -- 172.21.15.47:0/16485917 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded400e9a0 con 0x7fdecc003a00 2024-05-08T19:22:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.691+0000 7fdee27fc700 1 -- 172.21.15.47:0/16485917 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded400ed10 con 0x7fdecc003a00 2024-05-08T19:22:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.692+0000 7fdeea128700 1 -- 172.21.15.47:0/16485917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdecc003a00 msgr2=0x7fdecc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.692+0000 7fdeea128700 1 --2- 172.21.15.47:0/16485917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdecc003a00 0x7fdecc003e20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fded4009d30 tx=0x7fdecc005880 comp rx=0 tx=0).stop 2024-05-08T19:22:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.692+0000 7fdeea128700 1 -- 172.21.15.47:0/16485917 shutdown_connections 2024-05-08T19:22:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.692+0000 7fdeea128700 1 --2- 172.21.15.47:0/16485917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdecc003a00 0x7fdecc003e20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.692+0000 7fdeea128700 1 -- 172.21.15.47:0/16485917 >> 172.21.15.47:0/16485917 conn(0x7fdee40c3280 msgr2=0x7fdee40c3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.692+0000 7fdeea128700 1 -- 172.21.15.47:0/16485917 shutdown_connections 2024-05-08T19:22:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.692+0000 7fdeea128700 1 -- 172.21.15.47:0/16485917 wait complete. 2024-05-08T19:22:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.693+0000 7fdeea128700 1 Processor -- start 2024-05-08T19:22:44.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.693+0000 7fdeea128700 1 -- start start 2024-05-08T19:22:44.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdeea128700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdecc003a00 0x7fdee414ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:44.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdeea128700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdee414ce70 0x7fdee414be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:44.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdeea128700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdee414c380 0x7fdee41edba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:44.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdeea128700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee40c0f40 con 0x7fdee414c380 2024-05-08T19:22:44.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdeea128700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee4151000 con 0x7fdecc003a00 2024-05-08T19:22:44.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdeea128700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee414cd00 con 0x7fdee414ce70 2024-05-08T19:22:44.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdee3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdee414c380 0x7fdee41edba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:44.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdee3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdee414c380 0x7fdee41edba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35688/0 (socket says 172.21.15.47:35688) 2024-05-08T19:22:44.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdee3fff700 1 -- 172.21.15.47:0/1870158164 learned_addr learned my addr 172.21.15.47:0/1870158164 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:44.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdee37fe700 1 --2- 172.21.15.47:0/1870158164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdecc003a00 0x7fdee414ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:44.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdee2ffd700 1 --2- 172.21.15.47:0/1870158164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdee414ce70 0x7fdee414be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdee3fff700 1 -- 172.21.15.47:0/1870158164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdee414ce70 msgr2=0x7fdee414be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdee3fff700 1 --2- 172.21.15.47:0/1870158164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdee414ce70 0x7fdee414be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdee3fff700 1 -- 172.21.15.47:0/1870158164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdecc003a00 msgr2=0x7fdee414ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdee3fff700 1 --2- 172.21.15.47:0/1870158164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdecc003a00 0x7fdee414ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdee3fff700 1 -- 172.21.15.47:0/1870158164 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee4151e00 con 0x7fdee414c380 2024-05-08T19:22:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.694+0000 7fdee3fff700 1 --2- 172.21.15.47:0/1870158164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdee414c380 0x7fdee41edba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdee4070bf0 tx=0x7fdedc00e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.695+0000 7fdecbfff700 1 -- 172.21.15.47:0/1870158164 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc017070 con 0x7fdee414c380 2024-05-08T19:22:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.695+0000 7fdecbfff700 1 -- 172.21.15.47:0/1870158164 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc00eb20 con 0x7fdee414c380 2024-05-08T19:22:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.695+0000 7fdeea128700 1 -- 172.21.15.47:0/1870158164 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee4152960 con 0x7fdee414c380 2024-05-08T19:22:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.695+0000 7fdecbfff700 1 -- 172.21.15.47:0/1870158164 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00ecd0 con 0x7fdee414c380 2024-05-08T19:22:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.695+0000 7fdeea128700 1 -- 172.21.15.47:0/1870158164 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee4150860 con 0x7fdee414c380 2024-05-08T19:22:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.696+0000 7fdeea128700 1 -- 172.21.15.47:0/1870158164 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee4152af0 con 0x7fdee414c380 2024-05-08T19:22:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.696+0000 7fdecbfff700 1 -- 172.21.15.47:0/1870158164 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdedc013420 con 0x7fdee414c380 2024-05-08T19:22:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.696+0000 7fdecbfff700 1 --2- 172.21.15.47:0/1870158164 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fded006ac90 0x7fded006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.697+0000 7fdecbfff700 1 -- 172.21.15.47:0/1870158164 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdedc089110 con 0x7fdee414c380 2024-05-08T19:22:44.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.697+0000 7fdee37fe700 1 --2- 172.21.15.47:0/1870158164 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fded006ac90 0x7fded006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:44.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.697+0000 7fdee37fe700 1 --2- 172.21.15.47:0/1870158164 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fded006ac90 0x7fded006d150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fded40090b0 tx=0x7fded401e040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:44.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.701+0000 7fdecbfff700 1 -- 172.21.15.47:0/1870158164 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdedc054000 con 0x7fdee414c380 2024-05-08T19:22:44.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.971+0000 7fdeea128700 1 -- 172.21.15.47:0/1870158164 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdee404ec60 con 0x7fdee414c380 2024-05-08T19:22:44.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.974+0000 7fdecbfff700 1 -- 172.21.15.47:0/1870158164 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170943 (secure 0 0 0) 0x7fdedc057620 con 0x7fdee414c380 2024-05-08T19:22:44.968 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:44.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.977+0000 7fdeea128700 1 -- 172.21.15.47:0/1870158164 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fded006ac90 msgr2=0x7fded006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.977+0000 7fdeea128700 1 --2- 172.21.15.47:0/1870158164 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fded006ac90 0x7fded006d150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fded40090b0 tx=0x7fded401e040 comp rx=0 tx=0).stop 2024-05-08T19:22:44.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.977+0000 7fdeea128700 1 -- 172.21.15.47:0/1870158164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdee414c380 msgr2=0x7fdee41edba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:44.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.977+0000 7fdeea128700 1 --2- 172.21.15.47:0/1870158164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdee414c380 0x7fdee41edba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdee4070bf0 tx=0x7fdedc00e440 comp rx=0 tx=0).stop 2024-05-08T19:22:44.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.977+0000 7fdeea128700 1 -- 172.21.15.47:0/1870158164 shutdown_connections 2024-05-08T19:22:44.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.977+0000 7fdeea128700 1 --2- 172.21.15.47:0/1870158164 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fded006ac90 0x7fded006d150 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.977+0000 7fdeea128700 1 --2- 172.21.15.47:0/1870158164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdee414c380 0x7fdee41edba0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.977+0000 7fdeea128700 1 --2- 172.21.15.47:0/1870158164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdecc003a00 0x7fdee414ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.977+0000 7fdeea128700 1 --2- 172.21.15.47:0/1870158164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdee414ce70 0x7fdee414be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:44.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.977+0000 7fdeea128700 1 -- 172.21.15.47:0/1870158164 >> 172.21.15.47:0/1870158164 conn(0x7fdee40c3280 msgr2=0x7fdee4071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:44.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.977+0000 7fdeea128700 1 -- 172.21.15.47:0/1870158164 shutdown_connections 2024-05-08T19:22:44.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:44.977+0000 7fdeea128700 1 -- 172.21.15.47:0/1870158164 wait complete. 2024-05-08T19:22:44.981 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":46523},{"type":"v1","addr":"172.21.15.177:6833","nonce":46523}]},"active_addr":"172.21.15.177:6833/46523","active_change":"2024-05-08T19:22:09.857189+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4098,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":881550857}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":1708720306}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":2968054091}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":2599326080}]}]} 2024-05-08T19:22:44.985 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T19:22:44.985 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T19:22:44.985 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:45.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.119+0000 7fe39c6b9700 1 Processor -- start 2024-05-08T19:22:45.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.119+0000 7fe39c6b9700 1 -- start start 2024-05-08T19:22:45.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.120+0000 7fe39c6b9700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe39414ff20 0x7fe3940c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.120+0000 7fe39c6b9700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe3940c4b80 0x7fe3940c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.120+0000 7fe39c6b9700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe394152b70 con 0x7fe39406f0b0 2024-05-08T19:22:45.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.120+0000 7fe39c6b9700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe394150300 con 0x7fe3940c4b80 2024-05-08T19:22:45.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.120+0000 7fe39c6b9700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39406f850 con 0x7fe39414ff20 2024-05-08T19:22:45.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.120+0000 7fe39ac56700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe3940c4b80 0x7fe3940c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.120+0000 7fe39ac56700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe3940c4b80 0x7fe3940c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35692/0 (socket says 172.21.15.47:35692) 2024-05-08T19:22:45.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.120+0000 7fe39ac56700 1 -- 172.21.15.47:0/2592145102 learned_addr learned my addr 172.21.15.47:0/2592145102 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:45.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.120+0000 7fe39a455700 1 --2- 172.21.15.47:0/2592145102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe39414ff20 0x7fe3940c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.120+0000 7fe39ac56700 1 -- 172.21.15.47:0/2592145102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe39414ff20 msgr2=0x7fe3940c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:45.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.120+0000 7fe39ac56700 1 --2- 172.21.15.47:0/2592145102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe39414ff20 0x7fe3940c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.120+0000 7fe39ac56700 1 -- 172.21.15.47:0/2592145102 >> v1:172.21.15.177:6789/0 conn(0x7fe39406f0b0 legacy=0x7fe394156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.120+0000 7fe39ac56700 1 -- 172.21.15.47:0/2592145102 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe394152e50 con 0x7fe3940c4b80 2024-05-08T19:22:45.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.121+0000 7fe39ac56700 1 --2- 172.21.15.47:0/2592145102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3940c4b80 0x7fe3940c8450 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009e80 tx=0x7fe38c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a77beb6ad368bc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.121+0000 7fe399453700 1 -- 172.21.15.47:0/2592145102 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00e070 con 0x7fe3940c4b80 2024-05-08T19:22:45.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.121+0000 7fe399453700 1 -- 172.21.15.47:0/2592145102 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c00b8d0 con 0x7fe3940c4b80 2024-05-08T19:22:45.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.121+0000 7fe399453700 1 -- 172.21.15.47:0/2592145102 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00bc80 con 0x7fe3940c4b80 2024-05-08T19:22:45.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.121+0000 7fe39c6b9700 1 -- 172.21.15.47:0/2592145102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3940c4b80 msgr2=0x7fe3940c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.121+0000 7fe39c6b9700 1 --2- 172.21.15.47:0/2592145102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3940c4b80 0x7fe3940c8450 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009e80 tx=0x7fe38c00b330 comp rx=0 tx=0).stop 2024-05-08T19:22:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.121+0000 7fe39c6b9700 1 -- 172.21.15.47:0/2592145102 shutdown_connections 2024-05-08T19:22:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.121+0000 7fe39c6b9700 1 --2- 172.21.15.47:0/2592145102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3940c4b80 0x7fe3940c8450 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.121+0000 7fe39c6b9700 1 --2- 172.21.15.47:0/2592145102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe39414ff20 0x7fe3940c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.121+0000 7fe39c6b9700 1 -- 172.21.15.47:0/2592145102 >> 172.21.15.47:0/2592145102 conn(0x7fe39406a9c0 msgr2=0x7fe39406ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.121+0000 7fe39c6b9700 1 -- 172.21.15.47:0/2592145102 shutdown_connections 2024-05-08T19:22:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.121+0000 7fe39c6b9700 1 -- 172.21.15.47:0/2592145102 wait complete. 2024-05-08T19:22:45.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.123+0000 7fe39c6b9700 1 Processor -- start 2024-05-08T19:22:45.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.123+0000 7fe39c6b9700 1 -- start start 2024-05-08T19:22:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe39c6b9700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe39406f0b0 0x7fe394147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe39c6b9700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3940c4b80 0x7fe39414df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe39c6b9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe39414ff20 0x7fe394145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe39c6b9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3941eb140 con 0x7fe39414ff20 2024-05-08T19:22:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe39c6b9700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3941eb390 con 0x7fe39406f0b0 2024-05-08T19:22:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe39c6b9700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3941eb670 con 0x7fe3940c4b80 2024-05-08T19:22:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe39ac56700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe39414ff20 0x7fe394145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe39ac56700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe39414ff20 0x7fe394145200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35706/0 (socket says 172.21.15.47:35706) 2024-05-08T19:22:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe39ac56700 1 -- 172.21.15.47:0/1420192632 learned_addr learned my addr 172.21.15.47:0/1420192632 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe399c54700 1 --2- 172.21.15.47:0/1420192632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3940c4b80 0x7fe39414df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe39a455700 1 --2- 172.21.15.47:0/1420192632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe39406f0b0 0x7fe394147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe39ac56700 1 -- 172.21.15.47:0/1420192632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3940c4b80 msgr2=0x7fe39414df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe39ac56700 1 --2- 172.21.15.47:0/1420192632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3940c4b80 0x7fe39414df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe39ac56700 1 -- 172.21.15.47:0/1420192632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe39406f0b0 msgr2=0x7fe394147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe39ac56700 1 --2- 172.21.15.47:0/1420192632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe39406f0b0 0x7fe394147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.124+0000 7fe39ac56700 1 -- 172.21.15.47:0/1420192632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c009b30 con 0x7fe39414ff20 2024-05-08T19:22:45.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.125+0000 7fe39ac56700 1 --2- 172.21.15.47:0/1420192632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe39414ff20 0x7fe394145200 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe38c012000 tx=0x7fe38c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.125+0000 7fe38affd700 1 -- 172.21.15.47:0/1420192632 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c004800 con 0x7fe39414ff20 2024-05-08T19:22:45.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.125+0000 7fe38affd700 1 -- 172.21.15.47:0/1420192632 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c004960 con 0x7fe39414ff20 2024-05-08T19:22:45.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.125+0000 7fe38affd700 1 -- 172.21.15.47:0/1420192632 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c01c680 con 0x7fe39414ff20 2024-05-08T19:22:45.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.125+0000 7fe39c6b9700 1 -- 172.21.15.47:0/1420192632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3941eb950 con 0x7fe39414ff20 2024-05-08T19:22:45.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.125+0000 7fe39c6b9700 1 -- 172.21.15.47:0/1420192632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3941ebf10 con 0x7fe39414ff20 2024-05-08T19:22:45.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.126+0000 7fe39c6b9700 1 -- 172.21.15.47:0/1420192632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3941e7c20 con 0x7fe39414ff20 2024-05-08T19:22:45.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.126+0000 7fe38affd700 1 -- 172.21.15.47:0/1420192632 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe38c01c7e0 con 0x7fe39414ff20 2024-05-08T19:22:45.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.126+0000 7fe38affd700 1 --2- 172.21.15.47:0/1420192632 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe37806ac90 0x7fe37806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.127+0000 7fe38affd700 1 -- 172.21.15.47:0/1420192632 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe38c08afa0 con 0x7fe39414ff20 2024-05-08T19:22:45.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.127+0000 7fe39a455700 1 --2- 172.21.15.47:0/1420192632 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe37806ac90 0x7fe37806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.127+0000 7fe39a455700 1 --2- 172.21.15.47:0/1420192632 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe37806ac90 0x7fe37806d150 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe384009b40 tx=0x7fe384009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.131+0000 7fe38affd700 1 -- 172.21.15.47:0/1420192632 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe38c055e80 con 0x7fe39414ff20 2024-05-08T19:22:45.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.337+0000 7fe39c6b9700 1 -- 172.21.15.47:0/1420192632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe39404ec60 con 0x7fe39414ff20 2024-05-08T19:22:45.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.338+0000 7fe38affd700 1 -- 172.21.15.47:0/1420192632 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17878 (secure 0 0 0) 0x7fe38c0594a0 con 0x7fe39414ff20 2024-05-08T19:22:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:45.331 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:24.891864+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:45.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.340+0000 7fe39c6b9700 1 -- 172.21.15.47:0/1420192632 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe37806ac90 msgr2=0x7fe37806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.340+0000 7fe39c6b9700 1 --2- 172.21.15.47:0/1420192632 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe37806ac90 0x7fe37806d150 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe384009b40 tx=0x7fe384009210 comp rx=0 tx=0).stop 2024-05-08T19:22:45.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.340+0000 7fe39c6b9700 1 -- 172.21.15.47:0/1420192632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe39414ff20 msgr2=0x7fe394145200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.340+0000 7fe39c6b9700 1 --2- 172.21.15.47:0/1420192632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe39414ff20 0x7fe394145200 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe38c012000 tx=0x7fe38c004ad0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.340+0000 7fe39c6b9700 1 -- 172.21.15.47:0/1420192632 shutdown_connections 2024-05-08T19:22:45.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.340+0000 7fe39c6b9700 1 --2- 172.21.15.47:0/1420192632 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe37806ac90 0x7fe37806d150 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.340+0000 7fe39c6b9700 1 --2- 172.21.15.47:0/1420192632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe39414ff20 0x7fe394145200 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.340+0000 7fe39c6b9700 1 --2- 172.21.15.47:0/1420192632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe39406f0b0 0x7fe394147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.340+0000 7fe39c6b9700 1 --2- 172.21.15.47:0/1420192632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3940c4b80 0x7fe39414df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.340+0000 7fe39c6b9700 1 -- 172.21.15.47:0/1420192632 >> 172.21.15.47:0/1420192632 conn(0x7fe39406a9c0 msgr2=0x7fe3940c5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:45.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.340+0000 7fe39c6b9700 1 -- 172.21.15.47:0/1420192632 shutdown_connections 2024-05-08T19:22:45.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.340+0000 7fe39c6b9700 1 -- 172.21.15.47:0/1420192632 wait complete. 2024-05-08T19:22:45.345 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T19:22:45.345 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:45.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.478+0000 7f63a7a48700 1 Processor -- start 2024-05-08T19:22:45.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.478+0000 7f63a7a48700 1 -- start start 2024-05-08T19:22:45.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.479+0000 7f63a7a48700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a006bc40 0x7f63a00bfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.479+0000 7f63a7a48700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f63a0155150 0x7f63a00c05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.479+0000 7f63a7a48700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a00c1950 con 0x7f63a006f490 2024-05-08T19:22:45.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.479+0000 7f63a7a48700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a00c1180 con 0x7f63a0155150 2024-05-08T19:22:45.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.479+0000 7f63a7a48700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a0154970 con 0x7f63a006bc40 2024-05-08T19:22:45.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.479+0000 7f63a4fe3700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f63a006f490 0x7f63a0066780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48574/0 (socket says 172.21.15.47:48574) 2024-05-08T19:22:45.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.479+0000 7f63a4fe3700 1 -- 172.21.15.47:0/2222889359 learned_addr learned my addr 172.21.15.47:0/2222889359 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:45.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.479+0000 7f63a5fe5700 1 --2- 172.21.15.47:0/2222889359 >> v2:172.21.15.177:3300/0 conn(0x7f63a0155150 0x7f63a00c05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.480+0000 7f63a57e4700 1 --2- 172.21.15.47:0/2222889359 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a006bc40 0x7f63a00bfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.480+0000 7f6397fff700 1 -- 172.21.15.47:0/2222889359 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969835921 0 0) 0x7f63a00c1950 con 0x7f63a006f490 2024-05-08T19:22:45.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.480+0000 7f6397fff700 1 -- 172.21.15.47:0/2222889359 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f638c0035b0 con 0x7f63a006f490 2024-05-08T19:22:45.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.480+0000 7f63a5fe5700 1 -- 172.21.15.47:0/2222889359 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a006bc40 msgr2=0x7f63a00bfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:45.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.480+0000 7f63a5fe5700 1 --2- 172.21.15.47:0/2222889359 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a006bc40 0x7f63a00bfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.480+0000 7f6397fff700 1 -- 172.21.15.47:0/2222889359 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3383275404 0 0) 0x7f638c0035b0 con 0x7f63a006f490 2024-05-08T19:22:45.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.480+0000 7f63a5fe5700 1 -- 172.21.15.47:0/2222889359 >> v1:172.21.15.47:6789/0 conn(0x7f63a006f490 legacy=0x7f63a0066780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.480+0000 7f63a5fe5700 1 -- 172.21.15.47:0/2222889359 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a00c1390 con 0x7f63a0155150 2024-05-08T19:22:45.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.480+0000 7f63a5fe5700 1 --2- 172.21.15.47:0/2222889359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a0155150 0x7f63a00c05f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6398009d90 tx=0x7f639800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91767d152e4447d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.480+0000 7f6397fff700 1 -- 172.21.15.47:0/2222889359 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639800e070 con 0x7f63a0155150 2024-05-08T19:22:45.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.480+0000 7f6397fff700 1 -- 172.21.15.47:0/2222889359 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6398003a20 con 0x7f63a0155150 2024-05-08T19:22:45.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.480+0000 7f6397fff700 1 -- 172.21.15.47:0/2222889359 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c001670 con 0x7f63a0155150 2024-05-08T19:22:45.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.481+0000 7f63a7a48700 1 -- 172.21.15.47:0/2222889359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a0155150 msgr2=0x7f63a00c05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.481+0000 7f63a7a48700 1 --2- 172.21.15.47:0/2222889359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a0155150 0x7f63a00c05f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6398009d90 tx=0x7f639800b330 comp rx=0 tx=0).stop 2024-05-08T19:22:45.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.481+0000 7f63a7a48700 1 -- 172.21.15.47:0/2222889359 shutdown_connections 2024-05-08T19:22:45.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.481+0000 7f63a7a48700 1 --2- 172.21.15.47:0/2222889359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a0155150 0x7f63a00c05f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.481+0000 7f63a7a48700 1 --2- 172.21.15.47:0/2222889359 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a006bc40 0x7f63a00bfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.481+0000 7f63a7a48700 1 -- 172.21.15.47:0/2222889359 >> 172.21.15.47:0/2222889359 conn(0x7f63a00c3280 msgr2=0x7f63a00c3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:45.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.481+0000 7f63a7a48700 1 -- 172.21.15.47:0/2222889359 shutdown_connections 2024-05-08T19:22:45.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.481+0000 7f63a7a48700 1 -- 172.21.15.47:0/2222889359 wait complete. 2024-05-08T19:22:45.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.483+0000 7f63a7a48700 1 Processor -- start 2024-05-08T19:22:45.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.483+0000 7f63a7a48700 1 -- start start 2024-05-08T19:22:45.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.483+0000 7f63a7a48700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a006bc40 0x7f63a01e9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.483+0000 7f63a7a48700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a006f490 0x7f63a014fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.483+0000 7f63a7a48700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63a0155150 0x7f63a01500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a7a48700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a00aac10 con 0x7f63a0155150 2024-05-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a7a48700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a01ea970 con 0x7f63a006f490 2024-05-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a7a48700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a00aa2e0 con 0x7f63a006bc40 2024-05-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a5fe5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63a0155150 0x7f63a01500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a5fe5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63a0155150 0x7f63a01500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35712/0 (socket says 172.21.15.47:35712) 2024-05-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a5fe5700 1 -- 172.21.15.47:0/4293780475 learned_addr learned my addr 172.21.15.47:0/4293780475 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a57e4700 1 --2- 172.21.15.47:0/4293780475 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a006bc40 0x7f63a01e9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a4fe3700 1 --2- 172.21.15.47:0/4293780475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a006f490 0x7f63a014fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a5fe5700 1 -- 172.21.15.47:0/4293780475 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a006bc40 msgr2=0x7f63a01e9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a5fe5700 1 --2- 172.21.15.47:0/4293780475 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a006bc40 0x7f63a01e9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a5fe5700 1 -- 172.21.15.47:0/4293780475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a006f490 msgr2=0x7f63a014fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a5fe5700 1 --2- 172.21.15.47:0/4293780475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a006f490 0x7f63a014fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a5fe5700 1 -- 172.21.15.47:0/4293780475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6398009a70 con 0x7f63a0155150 2024-05-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a4fe3700 1 --2- 172.21.15.47:0/4293780475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a006f490 0x7f63a014fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a5fe5700 1 --2- 172.21.15.47:0/4293780475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63a0155150 0x7f63a01500a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f63a0074750 tx=0x7f6398004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f6395ffb700 1 -- 172.21.15.47:0/4293780475 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63980044c0 con 0x7f63a0155150 2024-05-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f6395ffb700 1 -- 172.21.15.47:0/4293780475 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6398004640 con 0x7f63a0155150 2024-05-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a7a48700 1 -- 172.21.15.47:0/4293780475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a00aa5c0 con 0x7f63a0155150 2024-05-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f6395ffb700 1 -- 172.21.15.47:0/4293780475 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398012430 con 0x7f63a0155150 2024-05-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.484+0000 7f63a7a48700 1 -- 172.21.15.47:0/4293780475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a0072d40 con 0x7f63a0155150 2024-05-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.485+0000 7f63a7a48700 1 -- 172.21.15.47:0/4293780475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a004ec60 con 0x7f63a0155150 2024-05-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.486+0000 7f6395ffb700 1 -- 172.21.15.47:0/4293780475 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6398012590 con 0x7f63a0155150 2024-05-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.486+0000 7f6395ffb700 1 --2- 172.21.15.47:0/4293780475 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f638406ac90 0x7f638406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.486+0000 7f6395ffb700 1 -- 172.21.15.47:0/4293780475 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f639808b370 con 0x7f63a0155150 2024-05-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.486+0000 7f63a57e4700 1 --2- 172.21.15.47:0/4293780475 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f638406ac90 0x7f638406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.487+0000 7f63a57e4700 1 --2- 172.21.15.47:0/4293780475 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f638406ac90 0x7f638406d150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6390009ad0 tx=0x7f6390008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.491+0000 7f6395ffb700 1 -- 172.21.15.47:0/4293780475 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f63980561d0 con 0x7f63a0155150 2024-05-08T19:22:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.699+0000 7f63a7a48700 1 -- 172.21.15.47:0/4293780475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63a00aad50 con 0x7f63a0155150 2024-05-08T19:22:45.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.700+0000 7f6395ffb700 1 -- 172.21.15.47:0/4293780475 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f63980597f0 con 0x7f63a0155150 2024-05-08T19:22:45.693 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:45.693 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:24.891864+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.702+0000 7f63a7a48700 1 -- 172.21.15.47:0/4293780475 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f638406ac90 msgr2=0x7f638406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.702+0000 7f63a7a48700 1 --2- 172.21.15.47:0/4293780475 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f638406ac90 0x7f638406d150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6390009ad0 tx=0x7f6390008040 comp rx=0 tx=0).stop 2024-05-08T19:22:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.702+0000 7f63a7a48700 1 -- 172.21.15.47:0/4293780475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63a0155150 msgr2=0x7f63a01500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.702+0000 7f63a7a48700 1 --2- 172.21.15.47:0/4293780475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63a0155150 0x7f63a01500a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f63a0074750 tx=0x7f6398004ad0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.702+0000 7f63a7a48700 1 -- 172.21.15.47:0/4293780475 shutdown_connections 2024-05-08T19:22:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.702+0000 7f63a7a48700 1 --2- 172.21.15.47:0/4293780475 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f638406ac90 0x7f638406d150 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.702+0000 7f63a7a48700 1 --2- 172.21.15.47:0/4293780475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63a0155150 0x7f63a01500a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.702+0000 7f63a7a48700 1 --2- 172.21.15.47:0/4293780475 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a006bc40 0x7f63a01e9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.702+0000 7f63a7a48700 1 --2- 172.21.15.47:0/4293780475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a006f490 0x7f63a014fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.702+0000 7f63a7a48700 1 -- 172.21.15.47:0/4293780475 >> 172.21.15.47:0/4293780475 conn(0x7f63a00c3280 msgr2=0x7f63a00c5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.702+0000 7f63a7a48700 1 -- 172.21.15.47:0/4293780475 shutdown_connections 2024-05-08T19:22:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.702+0000 7f63a7a48700 1 -- 172.21.15.47:0/4293780475 wait complete. 2024-05-08T19:22:45.707 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T19:22:45.708 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T19:22:45.708 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T19:22:45.709 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T19:22:45.709 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-08T19:22:45.709 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-08T19:22:45.710 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-08T19:22:45.710 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-08T19:22:45.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.929+0000 7fd9f14e8700 1 Processor -- start 2024-05-08T19:22:45.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.929+0000 7fd9f14e8700 1 -- start start 2024-05-08T19:22:45.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.930+0000 7fd9f14e8700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9ec06e880 0x7fd9ec15c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.930+0000 7fd9f14e8700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ec0c1020 con 0x7fd9ec06edd0 2024-05-08T19:22:45.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.930+0000 7fd9f14e8700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ec14eb00 con 0x7fd9ec06e370 2024-05-08T19:22:45.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.930+0000 7fd9f14e8700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec071a50 con 0x7fd9ec06e880 2024-05-08T19:22:45.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.931+0000 7fd9eaffd700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fd9ec06e370 0x7fd9ec072860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:57840/0 (socket says 172.21.15.47:57840) 2024-05-08T19:22:45.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.931+0000 7fd9eaffd700 1 -- 172.21.15.47:0/1470068678 learned_addr learned my addr 172.21.15.47:0/1470068678 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:45.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.931+0000 7fd9eb7fe700 1 --2- 172.21.15.47:0/1470068678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9ec06e880 0x7fd9ec15c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.931+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569388702 0 0) 0x7fd9ec14eb00 con 0x7fd9ec06e370 2024-05-08T19:22:45.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.931+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9d40034d0 con 0x7fd9ec06e370 2024-05-08T19:22:45.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.931+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626951875 0 0) 0x7fd9ec0c1020 con 0x7fd9ec06edd0 2024-05-08T19:22:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.931+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9ec14eb00 con 0x7fd9ec06edd0 2024-05-08T19:22:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.932+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2898718600 0 0) 0x7fd9ec14eb00 con 0x7fd9ec06edd0 2024-05-08T19:22:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.932+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9ec06e880 msgr2=0x7fd9ec15c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.932+0000 7fd9e9ffb700 1 --2- 172.21.15.47:0/1470068678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9ec06e880 0x7fd9ec15c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.932+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 >> v1:172.21.15.177:6789/0 conn(0x7fd9ec06e370 legacy=0x7fd9ec072860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.932+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec0c6190 con 0x7fd9ec06edd0 2024-05-08T19:22:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.932+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7fd9dc001520 con 0x7fd9ec06edd0 2024-05-08T19:22:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.932+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 >> v1:172.21.15.47:6789/0 conn(0x7fd9ec06edd0 legacy=0x7fd9ec06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.932+0000 7fd9e9ffb700 1 --2- 172.21.15.47:0/1470068678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9d4003d60 0x7fd9d40088e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.932+0000 7fd9e9ffb700 1 --2- 172.21.15.47:0/1470068678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9d40041d0 0x7fd9d400aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.932+0000 7fd9e9ffb700 1 --2- 172.21.15.47:0/1470068678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9d400b520 0x7fd9d400d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.932+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e0001230 con 0x7fd9d40041d0 2024-05-08T19:22:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.932+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d400e290 con 0x7fd9d400b520 2024-05-08T19:22:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.932+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d400e450 con 0x7fd9d4003d60 2024-05-08T19:22:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.932+0000 7fd9eaffd700 1 --2- 172.21.15.47:0/1470068678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9d4003d60 0x7fd9d40088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.932+0000 7fd9ea7fc700 1 --2- 172.21.15.47:0/1470068678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9d40041d0 0x7fd9d400aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.933+0000 7fd9ea7fc700 1 -- 172.21.15.47:0/1470068678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9d4003d60 msgr2=0x7fd9d40088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.933+0000 7fd9ea7fc700 1 --2- 172.21.15.47:0/1470068678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9d4003d60 0x7fd9d40088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.933+0000 7fd9ea7fc700 1 -- 172.21.15.47:0/1470068678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9d400b520 msgr2=0x7fd9d400d9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T19:22:45.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.933+0000 7fd9ea7fc700 1 --2- 172.21.15.47:0/1470068678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9d400b520 0x7fd9d400d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.933+0000 7fd9ea7fc700 1 -- 172.21.15.47:0/1470068678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec0c6190 con 0x7fd9d40041d0 2024-05-08T19:22:45.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.933+0000 7fd9ea7fc700 1 --2- 172.21.15.47:0/1470068678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9d40041d0 0x7fd9d400aeb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec1556a0 tx=0x7fd9d4003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d67b7a9b3229a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.933+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc00caf0 con 0x7fd9d40041d0 2024-05-08T19:22:45.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.933+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc00cc50 con 0x7fd9d40041d0 2024-05-08T19:22:45.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.933+0000 7fd9e9ffb700 1 -- 172.21.15.47:0/1470068678 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc012420 con 0x7fd9d40041d0 2024-05-08T19:22:45.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.934+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1470068678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9d40041d0 msgr2=0x7fd9d400aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.934+0000 7fd9f14e8700 1 --2- 172.21.15.47:0/1470068678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9d40041d0 0x7fd9d400aeb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec1556a0 tx=0x7fd9d4003780 comp rx=0 tx=0).stop 2024-05-08T19:22:45.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.934+0000 7fd9eb7fe700 1 -- 172.21.15.47:0/1470068678 reap_dead start 2024-05-08T19:22:45.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.935+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1470068678 shutdown_connections 2024-05-08T19:22:45.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.935+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1470068678 >> 172.21.15.47:0/1470068678 conn(0x7fd9ec0c33d0 msgr2=0x7fd9ec0c37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:45.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.937+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1470068678 shutdown_connections 2024-05-08T19:22:45.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.937+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1470068678 wait complete. 2024-05-08T19:22:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.939+0000 7fd9f14e8700 1 Processor -- start 2024-05-08T19:22:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.939+0000 7fd9f14e8700 1 -- start start 2024-05-08T19:22:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.939+0000 7fd9f14e8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9d40041d0 0x7fd9ec1ee5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.939+0000 7fd9f14e8700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9ec1523e0 0x7fd9ec0a7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.939+0000 7fd9f14e8700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9ec153450 0x7fd9ec1f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.939+0000 7fd9f14e8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec1eeb80 con 0x7fd9d40041d0 2024-05-08T19:22:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.939+0000 7fd9f14e8700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec1f1240 con 0x7fd9ec153450 2024-05-08T19:22:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.939+0000 7fd9f14e8700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec150840 con 0x7fd9ec1523e0 2024-05-08T19:22:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.940+0000 7fd9eaffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9d40041d0 0x7fd9ec1ee5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.940+0000 7fd9eaffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9d40041d0 0x7fd9ec1ee5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35736/0 (socket says 172.21.15.47:35736) 2024-05-08T19:22:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.940+0000 7fd9eaffd700 1 -- 172.21.15.47:0/1621214274 learned_addr learned my addr 172.21.15.47:0/1621214274 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.940+0000 7fd9eb7fe700 1 --2- 172.21.15.47:0/1621214274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9ec153450 0x7fd9ec1f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.940+0000 7fd9ea7fc700 1 --2- 172.21.15.47:0/1621214274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9ec1523e0 0x7fd9ec0a7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.940+0000 7fd9eb7fe700 1 -- 172.21.15.47:0/1621214274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9ec1523e0 msgr2=0x7fd9ec0a7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.940+0000 7fd9eb7fe700 1 --2- 172.21.15.47:0/1621214274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd9ec1523e0 0x7fd9ec0a7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.940+0000 7fd9eb7fe700 1 -- 172.21.15.47:0/1621214274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9d40041d0 msgr2=0x7fd9ec1ee5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.940+0000 7fd9eb7fe700 1 --2- 172.21.15.47:0/1621214274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9d40041d0 0x7fd9ec1ee5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.940+0000 7fd9eb7fe700 1 -- 172.21.15.47:0/1621214274 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec150b20 con 0x7fd9ec153450 2024-05-08T19:22:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.940+0000 7fd9eb7fe700 1 --2- 172.21.15.47:0/1621214274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9ec153450 0x7fd9ec1f16d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0c32e0 tx=0x7fd9e4009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.941+0000 7fd9d37fe700 1 -- 172.21.15.47:0/1621214274 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e400ca30 con 0x7fd9ec153450 2024-05-08T19:22:45.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.941+0000 7fd9d37fe700 1 -- 172.21.15.47:0/1621214274 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e400f040 con 0x7fd9ec153450 2024-05-08T19:22:45.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.941+0000 7fd9d37fe700 1 -- 172.21.15.47:0/1621214274 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e400cdd0 con 0x7fd9ec153450 2024-05-08T19:22:45.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.941+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1621214274 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec150e00 con 0x7fd9ec153450 2024-05-08T19:22:45.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.941+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1621214274 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ec153b30 con 0x7fd9ec153450 2024-05-08T19:22:45.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.942+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1621214274 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9ec071190 con 0x7fd9ec153450 2024-05-08T19:22:45.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.943+0000 7f0535107700 1 Processor -- start 2024-05-08T19:22:45.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.944+0000 7fd9d37fe700 1 -- 172.21.15.47:0/1621214274 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd9e4014480 con 0x7fd9ec153450 2024-05-08T19:22:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.943+0000 7f0535107700 1 -- start start 2024-05-08T19:22:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.943+0000 7f0535107700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f05300c78c0 0x7f0530070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.943+0000 7f0535107700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f05300c46c0 0x7f05300c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.943+0000 7f0535107700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0530153430 con 0x7f05300c74e0 2024-05-08T19:22:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.943+0000 7f0535107700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0530071250 con 0x7f05300c46c0 2024-05-08T19:22:45.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.943+0000 7f0535107700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0530153960 con 0x7f05300c78c0 2024-05-08T19:22:45.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.944+0000 7f052e59c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f05300c78c0 0x7f0530070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.944+0000 7f052e59c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f05300c78c0 0x7f0530070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:38208/0 (socket says 172.21.15.47:38208) 2024-05-08T19:22:45.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.944+0000 7f052e59c700 1 -- 172.21.15.47:0/659236039 learned_addr learned my addr 172.21.15.47:0/659236039 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:45.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.944+0000 7f052f59e700 1 --2- 172.21.15.47:0/659236039 >> v2:172.21.15.47:3300/0 conn(0x7f05300c46c0 0x7f05300c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.944+0000 7fd9d37fe700 1 --2- 172.21.15.47:0/1621214274 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd9d806ac90 0x7fd9d806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.944+0000 7fd9d37fe700 1 -- 172.21.15.47:0/1621214274 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd9e408a1e0 con 0x7fd9ec153450 2024-05-08T19:22:45.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.944+0000 7f052f59e700 1 -- 172.21.15.47:0/659236039 >> v2:172.21.15.177:3300/0 conn(0x7f05300c78c0 msgr2=0x7f0530070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:45.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.944+0000 7f052f59e700 1 --2- 172.21.15.47:0/659236039 >> v2:172.21.15.177:3300/0 conn(0x7f05300c78c0 0x7f0530070d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.944+0000 7f052f59e700 1 -- 172.21.15.47:0/659236039 >> v1:172.21.15.177:6789/0 conn(0x7f05300c74e0 legacy=0x7f053006ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.944+0000 7f052f59e700 1 -- 172.21.15.47:0/659236039 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053006eaf0 con 0x7f05300c46c0 2024-05-08T19:22:45.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.944+0000 7fd9d37fe700 1 --2- 172.21.15.47:0/1621214274 >> [v2:172.21.15.47:6808/46997,v1:172.21.15.47:6809/46997] conn(0x7fd9d8074250 0x7fd9d8076690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.944+0000 7fd9d37fe700 1 -- 172.21.15.47:0/1621214274 --> [v2:172.21.15.47:6808/46997,v1:172.21.15.47:6809/46997] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9d8076d60 con 0x7fd9d8074250 2024-05-08T19:22:45.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.944+0000 7fd9d37fe700 1 -- 172.21.15.47:0/1621214274 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9e408a630 con 0x7fd9ec153450 2024-05-08T19:22:45.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.945+0000 7f052f59e700 1 --2- 172.21.15.47:0/659236039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05300c46c0 0x7f05300c2ec0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0530062640 tx=0x7f052800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de10e3fcd5d9ae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.945+0000 7fd9eaffd700 1 --2- 172.21.15.47:0/1621214274 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd9d806ac90 0x7fd9d806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.945+0000 7f052dd9b700 1 -- 172.21.15.47:0/659236039 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052800e070 con 0x7f05300c46c0 2024-05-08T19:22:45.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.945+0000 7f052dd9b700 1 -- 172.21.15.47:0/659236039 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052800bb20 con 0x7f05300c46c0 2024-05-08T19:22:45.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.945+0000 7f052dd9b700 1 -- 172.21.15.47:0/659236039 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528012430 con 0x7f05300c46c0 2024-05-08T19:22:45.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.945+0000 7fd9eaffd700 1 --2- 172.21.15.47:0/1621214274 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd9d806ac90 0x7fd9d806d150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec14e790 tx=0x7fd9e00014a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.946+0000 7f0535107700 1 -- 172.21.15.47:0/659236039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05300c46c0 msgr2=0x7f05300c2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.946+0000 7f0535107700 1 --2- 172.21.15.47:0/659236039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05300c46c0 0x7f05300c2ec0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0530062640 tx=0x7f052800b330 comp rx=0 tx=0).stop 2024-05-08T19:22:45.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.946+0000 7fd9ea7fc700 1 --2- 172.21.15.47:0/1621214274 >> [v2:172.21.15.47:6808/46997,v1:172.21.15.47:6809/46997] conn(0x7fd9d8074250 0x7fd9d8076690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.946+0000 7fd9ea7fc700 1 --2- 172.21.15.47:0/1621214274 >> [v2:172.21.15.47:6808/46997,v1:172.21.15.47:6809/46997] conn(0x7fd9d8074250 0x7fd9d8076690 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.946+0000 7f0535107700 1 -- 172.21.15.47:0/659236039 shutdown_connections 2024-05-08T19:22:45.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.946+0000 7f0535107700 1 --2- 172.21.15.47:0/659236039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05300c46c0 0x7f05300c2ec0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.946+0000 7f0535107700 1 --2- 172.21.15.47:0/659236039 >> v2:172.21.15.177:3300/0 conn(0x7f05300c78c0 0x7f0530070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.946+0000 7f0535107700 1 -- 172.21.15.47:0/659236039 >> 172.21.15.47:0/659236039 conn(0x7f05300a9ea0 msgr2=0x7f05300aa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:45.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.946+0000 7f0535107700 1 -- 172.21.15.47:0/659236039 shutdown_connections 2024-05-08T19:22:45.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.947+0000 7f0535107700 1 -- 172.21.15.47:0/659236039 wait complete. 2024-05-08T19:22:45.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.948+0000 7f0535107700 1 Processor -- start 2024-05-08T19:22:45.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.948+0000 7f0535107700 1 -- start start 2024-05-08T19:22:45.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.949+0000 7fd9d37fe700 1 -- 172.21.15.47:0/1621214274 <== osd.2 v2:172.21.15.47:6808/46997 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd9d8076d60 con 0x7fd9d8074250 2024-05-08T19:22:45.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.949+0000 7f0535107700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05300c46c0 0x7f05301e7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.949+0000 7f0535107700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05300c74e0 0x7f053014b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.949+0000 7f0535107700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05300c78c0 0x7f05301eb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.949+0000 7f0535107700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05300bda40 con 0x7f05300c46c0 2024-05-08T19:22:45.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.949+0000 7f0535107700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05301eb3e0 con 0x7f05300c78c0 2024-05-08T19:22:45.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.949+0000 7f0535107700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05301eb0e0 con 0x7f05300c74e0 2024-05-08T19:22:45.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.949+0000 7f052f59e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05300c78c0 0x7f05301eb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.949+0000 7f052f59e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05300c78c0 0x7f05301eb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:38224/0 (socket says 172.21.15.47:38224) 2024-05-08T19:22:45.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.949+0000 7f052f59e700 1 -- 172.21.15.47:0/2303601372 learned_addr learned my addr 172.21.15.47:0/2303601372 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:45.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.949+0000 7f052e59c700 1 --2- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05300c74e0 0x7f053014b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.950+0000 7fa298570700 1 Processor -- start 2024-05-08T19:22:45.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.950+0000 7f052f59e700 1 -- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05300c74e0 msgr2=0x7f053014b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.950+0000 7f052f59e700 1 --2- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05300c74e0 0x7f053014b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.950+0000 7f052f59e700 1 -- 172.21.15.47:0/2303601372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05300c46c0 msgr2=0x7f05301e7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.950+0000 7f052f59e700 1 --2- 172.21.15.47:0/2303601372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05300c46c0 0x7f05301e7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.950+0000 7f052f59e700 1 -- 172.21.15.47:0/2303601372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528009a70 con 0x7f05300c78c0 2024-05-08T19:22:45.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.950+0000 7f052f59e700 1 --2- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05300c78c0 0x7f05301eb870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f052800b680 tx=0x7f0528004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.950+0000 7f05177fe700 1 -- 172.21.15.47:0/2303601372 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528012430 con 0x7f05300c78c0 2024-05-08T19:22:45.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.950+0000 7f05177fe700 1 -- 172.21.15.47:0/2303601372 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0528020070 con 0x7f05300c78c0 2024-05-08T19:22:45.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.950+0000 7f0535107700 1 -- 172.21.15.47:0/2303601372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053014b910 con 0x7f05300c78c0 2024-05-08T19:22:45.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.950+0000 7f0535107700 1 -- 172.21.15.47:0/2303601372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05300c1dc0 con 0x7f05300c78c0 2024-05-08T19:22:45.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.951+0000 7f0535107700 1 -- 172.21.15.47:0/2303601372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0510000fc0 con 0x7f05300c78c0 2024-05-08T19:22:45.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.950+0000 7fa298570700 1 -- start start 2024-05-08T19:22:45.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.951+0000 7fa298570700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa29006c710 0x7fa2900726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.951+0000 7fa298570700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa29006dd80 0x7fa29006e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.951+0000 7fa298570700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2900c29b0 con 0x7fa2900abb20 2024-05-08T19:22:45.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.951+0000 7fa298570700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa290159670 con 0x7fa29006dd80 2024-05-08T19:22:45.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.951+0000 7fa298570700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29006e6f0 con 0x7fa29006c710 2024-05-08T19:22:45.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.951+0000 7f05177fe700 1 -- 172.21.15.47:0/2303601372 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528004040 con 0x7f05300c78c0 2024-05-08T19:22:45.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.952+0000 7fe402a93700 1 Processor -- start 2024-05-08T19:22:45.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.952+0000 7fa2ce228700 1 Processor -- start 2024-05-08T19:22:45.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.952+0000 7fe402a93700 1 -- start start 2024-05-08T19:22:45.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.949+0000 7f0174e57700 1 Processor -- start 2024-05-08T19:22:45.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.949+0000 7f0174e57700 1 -- start start 2024-05-08T19:22:45.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.951+0000 7f0174e57700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0170152ce0 0x7f01700726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.951+0000 7f0174e57700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f017006b4e0 0x7f01700c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.951+0000 7f0174e57700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017006dc00 con 0x7f017006e090 2024-05-08T19:22:45.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.951+0000 7f0174e57700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017006d3a0 con 0x7f017006b4e0 2024-05-08T19:22:45.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.951+0000 7f0174e57700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0170159b20 con 0x7f0170152ce0 2024-05-08T19:22:45.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.952+0000 7f016e59c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0170152ce0 0x7f01700726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.953+0000 7f016ed9d700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f017006e090 0x7f0170070670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48598/0 (socket says 172.21.15.47:48598) 2024-05-08T19:22:45.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.953+0000 7f016ed9d700 1 -- 172.21.15.47:0/1572021670 learned_addr learned my addr 172.21.15.47:0/1572021670 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:45.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.953+0000 7fe402a93700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe3fc0abb20 0x7fe3fc0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.953+0000 7fe402a93700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3fc06c710 0x7fe3fc070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.953+0000 7fe402a93700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe3fc070bb0 0x7fe3fc06dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.953+0000 7fe402a93700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc159670 con 0x7fe3fc070bb0 2024-05-08T19:22:45.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.953+0000 7fe402a93700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc0c29b0 con 0x7fe3fc0abb20 2024-05-08T19:22:45.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.953+0000 7fe402a93700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc159b40 con 0x7fe3fc06c710 2024-05-08T19:22:45.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7fe401030700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe3fc070bb0 0x7fe3fc06dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7fe401030700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe3fc070bb0 0x7fe3fc06dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35780/0 (socket says 172.21.15.47:35780) 2024-05-08T19:22:45.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7fe401030700 1 -- 172.21.15.47:0/3569855919 learned_addr learned my addr 172.21.15.47:0/3569855919 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:45.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7fa29630c700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa2900abb20 0x7fa290070670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48608/0 (socket says 172.21.15.47:48608) 2024-05-08T19:22:45.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7fa29630c700 1 -- 172.21.15.47:0/2740679949 learned_addr learned my addr 172.21.15.47:0/2740679949 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:45.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.953+0000 7f05177fe700 1 -- 172.21.15.47:0/2303601372 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f05280041a0 con 0x7f05300c78c0 2024-05-08T19:22:45.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7f05177fe700 1 --2- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f051c06ace0 0x7f051c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7f05177fe700 1 -- 172.21.15.47:0/2303601372 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0528022070 con 0x7f05300c78c0 2024-05-08T19:22:45.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7f05177fe700 1 --2- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:6802/47187,v1:172.21.15.177:6804/47187] conn(0x7f051c074320 0x7f051c076760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7f05177fe700 1 -- 172.21.15.47:0/2303601372 --> [v2:172.21.15.177:6802/47187,v1:172.21.15.177:6804/47187] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f051c076e30 con 0x7f051c074320 2024-05-08T19:22:45.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7f05177fe700 1 -- 172.21.15.47:0/2303601372 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f052808bb70 con 0x7f05300c78c0 2024-05-08T19:22:45.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7f052ed9d700 1 --2- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f051c06ace0 0x7f051c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7fe40082f700 1 --2- 172.21.15.47:0/3569855919 >> v2:172.21.15.177:3300/0 conn(0x7fe3fc0abb20 0x7fe3fc0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7fe401030700 1 -- 172.21.15.47:0/3569855919 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3fc06c710 msgr2=0x7fe3fc070670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T19:22:45.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7fe401030700 1 --2- 172.21.15.47:0/3569855919 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3fc06c710 0x7fe3fc070670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7fe401030700 1 -- 172.21.15.47:0/3569855919 >> v2:172.21.15.177:3300/0 conn(0x7fe3fc0abb20 msgr2=0x7fe3fc0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:45.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7fe401030700 1 --2- 172.21.15.47:0/3569855919 >> v2:172.21.15.177:3300/0 conn(0x7fe3fc0abb20 0x7fe3fc0726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7fe401030700 1 -- 172.21.15.47:0/3569855919 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc159860 con 0x7fe3fc070bb0 2024-05-08T19:22:45.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7fa7a31ce700 1 Processor -- start 2024-05-08T19:22:45.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7fa7a31ce700 1 -- start start 2024-05-08T19:22:45.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.955+0000 7fa296b0d700 1 --2- 172.21.15.47:0/2740679949 >> v2:172.21.15.47:3300/0 conn(0x7fa29006dd80 0x7fa29006e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7f052e59c700 1 --2- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:6802/47187,v1:172.21.15.177:6804/47187] conn(0x7f051c074320 0x7f051c076760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.955+0000 7f052ed9d700 1 --2- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f051c06ace0 0x7f051c06d1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0524000f60 tx=0x7f0524007a40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7f016dd9b700 1 --2- 172.21.15.47:0/1572021670 >> v2:172.21.15.47:3300/0 conn(0x7f017006b4e0 0x7f01700c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.955+0000 7f016dd9b700 1 -- 172.21.15.47:0/1572021670 >> v2:172.21.15.177:3300/0 conn(0x7f0170152ce0 msgr2=0x7f01700726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:45.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.955+0000 7f016dd9b700 1 --2- 172.21.15.47:0/1572021670 >> v2:172.21.15.177:3300/0 conn(0x7f0170152ce0 0x7f01700726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.955+0000 7f016dd9b700 1 -- 172.21.15.47:0/1572021670 >> v1:172.21.15.47:6789/0 conn(0x7f017006e090 legacy=0x7f0170070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.955+0000 7f016dd9b700 1 -- 172.21.15.47:0/1572021670 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017006d5b0 con 0x7f017006b4e0 2024-05-08T19:22:45.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.955+0000 7f016e59c700 1 --2- 172.21.15.47:0/1572021670 >> v2:172.21.15.177:3300/0 conn(0x7f0170152ce0 0x7f01700726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:45.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.955+0000 7f016dd9b700 1 --2- 172.21.15.47:0/1572021670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f017006b4e0 0x7f01700c0aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0170074140 tx=0x7f0164009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972a039431fc6d07 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.955+0000 7f052e59c700 1 --2- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:6802/47187,v1:172.21.15.177:6804/47187] conn(0x7f051c074320 0x7f051c076760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.955+0000 7fa29530a700 1 -- 172.21.15.47:0/2740679949 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304409935 0 0) 0x7fa2900c29b0 con 0x7fa2900abb20 2024-05-08T19:22:45.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.955+0000 7fa29530a700 1 -- 172.21.15.47:0/2740679949 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa27c0035b0 con 0x7fa2900abb20 2024-05-08T19:22:45.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7fa296b0d700 1 -- 172.21.15.47:0/2740679949 >> v2:172.21.15.177:3300/0 conn(0x7fa29006c710 msgr2=0x7fa2900726a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T19:22:45.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7fa296b0d700 1 --2- 172.21.15.47:0/2740679949 >> v2:172.21.15.177:3300/0 conn(0x7fa29006c710 0x7fa2900726a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7fa296b0d700 1 -- 172.21.15.47:0/2740679949 >> v1:172.21.15.47:6789/0 conn(0x7fa2900abb20 legacy=0x7fa290070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7fa296b0d700 1 -- 172.21.15.47:0/2740679949 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa290159b40 con 0x7fa29006dd80 2024-05-08T19:22:45.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7fa7a31ce700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c06b9d0 0x7fa79c072b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7fa7a31ce700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa79c0c60a0 0x7fa79c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7fa7a31ce700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa79c0c47d0 0x7fa79c1526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7fa7a31ce700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c1599b0 con 0x7fa79c0c47d0 2024-05-08T19:22:45.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7fa7a31ce700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c072050 con 0x7fa79c0c60a0 2024-05-08T19:22:45.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7fa7a31ce700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c072330 con 0x7fa79c06b9d0 2024-05-08T19:22:45.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7f05177fe700 1 -- 172.21.15.47:0/2303601372 <== osd.4 v2:172.21.15.177:6802/47187 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f051c076e30 con 0x7f051c074320 2024-05-08T19:22:45.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.952+0000 7fa2ce228700 1 -- start start 2024-05-08T19:22:45.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.953+0000 7fa2ce228700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa2c806d940 0x7fa2c806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.953+0000 7fa2ce228700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa2c8070670 0x7fa2c80c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.953+0000 7fa2ce228700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c8151490 con 0x7fa2c806e260 2024-05-08T19:22:45.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.953+0000 7fa2ce228700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c8071cc0 con 0x7fa2c806d940 2024-05-08T19:22:45.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.953+0000 7fa2ce228700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c8151770 con 0x7fa2c8070670 2024-05-08T19:22:45.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7fa2c6ffd700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa2c806e260 0x7fa2c814a650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48610/0 (socket says 172.21.15.47:48610) 2024-05-08T19:22:45.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.954+0000 7fa2c6ffd700 1 -- 172.21.15.47:0/155591322 learned_addr learned my addr 172.21.15.47:0/155591322 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:45.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7fa296b0d700 1 --2- 172.21.15.47:0/2740679949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa29006dd80 0x7fa29006e1b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa29006e920 tx=0x7fa28c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f25179b5c06a4a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7fa2c7fff700 1 --2- 172.21.15.47:0/155591322 >> v2:172.21.15.177:3300/0 conn(0x7fa2c8070670 0x7fa2c80c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7fa29530a700 1 -- 172.21.15.47:0/2740679949 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c011830 con 0x7fa29006dd80 2024-05-08T19:22:45.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7fa29530a700 1 -- 172.21.15.47:0/2740679949 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c011990 con 0x7fa29006dd80 2024-05-08T19:22:45.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7fa29530a700 1 -- 172.21.15.47:0/2740679949 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c011d20 con 0x7fa29006dd80 2024-05-08T19:22:45.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7fa2c7fff700 1 -- 172.21.15.47:0/155591322 >> v2:172.21.15.47:3300/0 conn(0x7fa2c806d940 msgr2=0x7fa2c806dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:45.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7fa2c7fff700 1 --2- 172.21.15.47:0/155591322 >> v2:172.21.15.47:3300/0 conn(0x7fa2c806d940 0x7fa2c806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7fa2c7fff700 1 -- 172.21.15.47:0/155591322 >> v1:172.21.15.47:6789/0 conn(0x7fa2c806e260 legacy=0x7fa2c814a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7fa2c7fff700 1 -- 172.21.15.47:0/155591322 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c80711b0 con 0x7fa2c8070670 2024-05-08T19:22:45.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.958+0000 7fa2c7fff700 1 --2- 172.21.15.47:0/155591322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2c8070670 0x7fa2c80c0aa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa2c806ba50 tx=0x7fa2c000d4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0f1a4af4d222bec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7fa7a0f6a700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c06b9d0 0x7fa79c072b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7fa7a0f6a700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c06b9d0 0x7fa79c072b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:48888/0 (socket says 172.21.15.47:48888) 2024-05-08T19:22:45.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7fa7a0f6a700 1 -- 172.21.15.47:0/1354826006 learned_addr learned my addr 172.21.15.47:0/1354826006 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:45.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7fa79bfff700 1 --2- 172.21.15.47:0/1354826006 >> v2:172.21.15.177:3300/0 conn(0x7fa79c0c60a0 0x7fa79c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7fa7a0f6a700 1 -- 172.21.15.47:0/1354826006 >> v2:172.21.15.177:3300/0 conn(0x7fa79c0c60a0 msgr2=0x7fa79c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:45.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7fa7a0f6a700 1 --2- 172.21.15.47:0/1354826006 >> v2:172.21.15.177:3300/0 conn(0x7fa79c0c60a0 0x7fa79c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7fa7a0f6a700 1 -- 172.21.15.47:0/1354826006 >> v2:172.21.15.47:3300/0 conn(0x7fa79c0c47d0 msgr2=0x7fa79c1526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:45.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7fa7a0f6a700 1 --2- 172.21.15.47:0/1354826006 >> v2:172.21.15.47:3300/0 conn(0x7fa79c0c47d0 0x7fa79c1526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7fa7a0f6a700 1 -- 172.21.15.47:0/1354826006 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c072610 con 0x7fa79c06b9d0 2024-05-08T19:22:45.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.958+0000 7fa7a0f6a700 1 --2- 172.21.15.47:0/1354826006 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c06b9d0 0x7fa79c072b30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa79c074790 tx=0x7fa78c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dc215580b06e5ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7f016d59a700 1 -- 172.21.15.47:0/1572021670 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0164011830 con 0x7f017006b4e0 2024-05-08T19:22:45.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7f016d59a700 1 -- 172.21.15.47:0/1572021670 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0164011990 con 0x7f017006b4e0 2024-05-08T19:22:45.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.956+0000 7f016d59a700 1 -- 172.21.15.47:0/1572021670 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0164011d20 con 0x7f017006b4e0 2024-05-08T19:22:45.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7f0174e57700 1 -- 172.21.15.47:0/1572021670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f017006b4e0 msgr2=0x7f01700c0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.957+0000 7f0174e57700 1 --2- 172.21.15.47:0/1572021670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f017006b4e0 0x7f01700c0aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0170074140 tx=0x7f0164009b20 comp rx=0 tx=0).stop 2024-05-08T19:22:45.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.958+0000 7fa298570700 1 -- 172.21.15.47:0/2740679949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa29006dd80 msgr2=0x7fa29006e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.958+0000 7fa298570700 1 --2- 172.21.15.47:0/2740679949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa29006dd80 0x7fa29006e1b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa29006e920 tx=0x7fa28c009b20 comp rx=0 tx=0).stop 2024-05-08T19:22:45.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.958+0000 7f0174e57700 1 -- 172.21.15.47:0/1572021670 shutdown_connections 2024-05-08T19:22:45.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.958+0000 7f0174e57700 1 --2- 172.21.15.47:0/1572021670 >> v2:172.21.15.177:3300/0 conn(0x7f0170152ce0 0x7f01700726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.958+0000 7f0174e57700 1 --2- 172.21.15.47:0/1572021670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f017006b4e0 0x7f01700c0aa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.958+0000 7f0174e57700 1 -- 172.21.15.47:0/1572021670 >> 172.21.15.47:0/1572021670 conn(0x7f017006a9c0 msgr2=0x7f017006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:45.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.958+0000 7fa79b7fe700 1 -- 172.21.15.47:0/1354826006 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c011830 con 0x7fa79c06b9d0 2024-05-08T19:22:45.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.958+0000 7fa79b7fe700 1 -- 172.21.15.47:0/1354826006 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c011990 con 0x7fa79c06b9d0 2024-05-08T19:22:45.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.958+0000 7fa79b7fe700 1 -- 172.21.15.47:0/1354826006 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c011d20 con 0x7fa79c06b9d0 2024-05-08T19:22:45.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.959+0000 7fa2c67fc700 1 -- 172.21.15.47:0/155591322 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0010070 con 0x7fa2c8070670 2024-05-08T19:22:45.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.959+0000 7fa2c67fc700 1 -- 172.21.15.47:0/155591322 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c000db70 con 0x7fa2c8070670 2024-05-08T19:22:45.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.959+0000 7fa2c67fc700 1 -- 172.21.15.47:0/155591322 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0007aa0 con 0x7fa2c8070670 2024-05-08T19:22:45.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.959+0000 7fe401030700 1 --2- 172.21.15.47:0/3569855919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3fc070bb0 0x7fe3fc06dd80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc06edf0 tx=0x7fe3f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6038af1451fb82b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.959+0000 7fa298570700 1 -- 172.21.15.47:0/2740679949 shutdown_connections 2024-05-08T19:22:45.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.959+0000 7fa298570700 1 --2- 172.21.15.47:0/2740679949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa29006dd80 0x7fa29006e1b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.959+0000 7fa298570700 1 --2- 172.21.15.47:0/2740679949 >> v2:172.21.15.177:3300/0 conn(0x7fa29006c710 0x7fa2900726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.959+0000 7fa298570700 1 -- 172.21.15.47:0/2740679949 >> 172.21.15.47:0/2740679949 conn(0x7fa29006a9c0 msgr2=0x7fa29006ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:45.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.959+0000 7fa298570700 1 -- 172.21.15.47:0/2740679949 shutdown_connections 2024-05-08T19:22:45.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.959+0000 7fe3fb7fe700 1 -- 172.21.15.47:0/3569855919 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400e070 con 0x7fe3fc070bb0 2024-05-08T19:22:45.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.959+0000 7fe3fb7fe700 1 -- 172.21.15.47:0/3569855919 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f400b9c0 con 0x7fe3fc070bb0 2024-05-08T19:22:45.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.959+0000 7fe3fb7fe700 1 -- 172.21.15.47:0/3569855919 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400bd70 con 0x7fe3fc070bb0 2024-05-08T19:22:45.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.959+0000 7fa7a31ce700 1 -- 172.21.15.47:0/1354826006 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c06b9d0 msgr2=0x7fa79c072b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.959+0000 7fa7a31ce700 1 --2- 172.21.15.47:0/1354826006 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c06b9d0 0x7fa79c072b30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa79c074790 tx=0x7fa78c009bd0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.960+0000 7fa2ce228700 1 -- 172.21.15.47:0/155591322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2c8070670 msgr2=0x7fa2c80c0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.960+0000 7fa2ce228700 1 --2- 172.21.15.47:0/155591322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2c8070670 0x7fa2c80c0aa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa2c806ba50 tx=0x7fa2c000d4c0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.960+0000 7fa2ce228700 1 -- 172.21.15.47:0/155591322 shutdown_connections 2024-05-08T19:22:45.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.960+0000 7fa2ce228700 1 --2- 172.21.15.47:0/155591322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2c8070670 0x7fa2c80c0aa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.960+0000 7fa2ce228700 1 --2- 172.21.15.47:0/155591322 >> v2:172.21.15.47:3300/0 conn(0x7fa2c806d940 0x7fa2c806dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.960+0000 7fa2ce228700 1 -- 172.21.15.47:0/155591322 >> 172.21.15.47:0/155591322 conn(0x7fa2c806a9c0 msgr2=0x7fa2c806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:45.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.960+0000 7fe402a93700 1 -- 172.21.15.47:0/3569855919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3fc070bb0 msgr2=0x7fe3fc06dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.960+0000 7fe402a93700 1 --2- 172.21.15.47:0/3569855919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3fc070bb0 0x7fe3fc06dd80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc06edf0 tx=0x7fe3f400b330 comp rx=0 tx=0).stop 2024-05-08T19:22:45.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.961+0000 7fe402a93700 1 -- 172.21.15.47:0/3569855919 shutdown_connections 2024-05-08T19:22:45.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.961+0000 7fe402a93700 1 --2- 172.21.15.47:0/3569855919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3fc070bb0 0x7fe3fc06dd80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.961+0000 7fe402a93700 1 --2- 172.21.15.47:0/3569855919 >> v2:172.21.15.177:3300/0 conn(0x7fe3fc0abb20 0x7fe3fc0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.961+0000 7fe402a93700 1 --2- 172.21.15.47:0/3569855919 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3fc06c710 0x7fe3fc070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.961+0000 7fe402a93700 1 -- 172.21.15.47:0/3569855919 >> 172.21.15.47:0/3569855919 conn(0x7fe3fc06a9c0 msgr2=0x7fe3fc06ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:45.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.959+0000 7fa298570700 1 -- 172.21.15.47:0/2740679949 wait complete. 2024-05-08T19:22:45.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.961+0000 7fa7a31ce700 1 -- 172.21.15.47:0/1354826006 shutdown_connections 2024-05-08T19:22:45.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.961+0000 7fa7a31ce700 1 --2- 172.21.15.47:0/1354826006 >> v2:172.21.15.47:3300/0 conn(0x7fa79c0c47d0 0x7fa79c1526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.961+0000 7fa298570700 1 Processor -- start 2024-05-08T19:22:45.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.961+0000 7fa7a31ce700 1 --2- 172.21.15.47:0/1354826006 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c06b9d0 0x7fa79c072b30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.961+0000 7fa7a31ce700 1 --2- 172.21.15.47:0/1354826006 >> v2:172.21.15.177:3300/0 conn(0x7fa79c0c60a0 0x7fa79c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.961+0000 7fa7a31ce700 1 -- 172.21.15.47:0/1354826006 >> 172.21.15.47:0/1354826006 conn(0x7fa79c0c33d0 msgr2=0x7fa79c0c37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:45.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.961+0000 7fa7a31ce700 1 -- 172.21.15.47:0/1354826006 shutdown_connections 2024-05-08T19:22:45.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.961+0000 7fa7a31ce700 1 -- 172.21.15.47:0/1354826006 wait complete. 2024-05-08T19:22:45.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.961+0000 7fe402a93700 1 -- 172.21.15.47:0/3569855919 shutdown_connections 2024-05-08T19:22:45.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.963+0000 7fa7a31ce700 1 Processor -- start 2024-05-08T19:22:45.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.963+0000 7fa7a31ce700 1 -- start start 2024-05-08T19:22:45.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.962+0000 7fe402a93700 1 -- 172.21.15.47:0/3569855919 wait complete. 2024-05-08T19:22:45.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.964+0000 7fe402a93700 1 Processor -- start 2024-05-08T19:22:45.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.965+0000 7fa2ce228700 1 -- 172.21.15.47:0/155591322 shutdown_connections 2024-05-08T19:22:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.964+0000 7fa7a31ce700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa79c06b9d0 0x7fa79c155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.964+0000 7fa7a31ce700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa79c0c47d0 0x7fa79c1543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.964+0000 7fa7a31ce700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c0c60a0 0x7fa79c1e2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.964+0000 7fa7a31ce700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c1f2480 con 0x7fa79c06b9d0 2024-05-08T19:22:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.964+0000 7fa7a31ce700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c1f2ce0 con 0x7fa79c0c47d0 2024-05-08T19:22:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.964+0000 7fa7a31ce700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c156500 con 0x7fa79c0c60a0 2024-05-08T19:22:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.964+0000 7fe402a93700 1 -- start start 2024-05-08T19:22:45.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fa79bfff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa79c0c47d0 0x7fa79c1543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fa79bfff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa79c0c47d0 0x7fa79c1543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:38296/0 (socket says 172.21.15.47:38296) 2024-05-08T19:22:45.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fa79bfff700 1 -- 172.21.15.47:0/2680506462 learned_addr learned my addr 172.21.15.47:0/2680506462 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:45.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.965+0000 7fe402a93700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3fc06c710 0x7fe3fc1e2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.965+0000 7fe402a93700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3fc070bb0 0x7fe3fc156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.965+0000 7fe402a93700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3fc0abb20 0x7fe3fc156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.965+0000 7fe402a93700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc15c990 con 0x7fe3fc0abb20 2024-05-08T19:22:45.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.965+0000 7fe402a93700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc15cf10 con 0x7fe3fc070bb0 2024-05-08T19:22:45.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.965+0000 7fe402a93700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc15a3e0 con 0x7fe3fc06c710 2024-05-08T19:22:45.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fe40082f700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3fc06c710 0x7fe3fc1e2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fe40082f700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3fc06c710 0x7fe3fc1e2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:48918/0 (socket says 172.21.15.47:48918) 2024-05-08T19:22:45.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fe40082f700 1 -- 172.21.15.47:0/1564457112 learned_addr learned my addr 172.21.15.47:0/1564457112 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:45.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fe3fbfff700 1 --2- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3fc070bb0 0x7fe3fc156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fa7a176b700 1 --2- 172.21.15.47:0/2680506462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c0c60a0 0x7fa79c1e2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fa79bfff700 1 -- 172.21.15.47:0/2680506462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c0c60a0 msgr2=0x7fa79c1e2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fa79bfff700 1 --2- 172.21.15.47:0/2680506462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa79c0c60a0 0x7fa79c1e2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fa79bfff700 1 -- 172.21.15.47:0/2680506462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa79c06b9d0 msgr2=0x7fa79c155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fa79bfff700 1 --2- 172.21.15.47:0/2680506462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa79c06b9d0 0x7fa79c155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.967+0000 7fa79bfff700 1 -- 172.21.15.47:0/2680506462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c009550 con 0x7fa79c0c47d0 2024-05-08T19:22:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fe40082f700 1 -- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3fc070bb0 msgr2=0x7fe3fc156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fe40082f700 1 --2- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3fc070bb0 0x7fe3fc156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fe40082f700 1 -- 172.21.15.47:0/1564457112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3fc0abb20 msgr2=0x7fe3fc156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fe40082f700 1 --2- 172.21.15.47:0/1564457112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3fc0abb20 0x7fe3fc156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.966+0000 7fe40082f700 1 -- 172.21.15.47:0/1564457112 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f4009b30 con 0x7fe3fc06c710 2024-05-08T19:22:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.965+0000 7fa2ce228700 1 -- 172.21.15.47:0/155591322 wait complete. 2024-05-08T19:22:45.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.967+0000 7fa2ce228700 1 Processor -- start 2024-05-08T19:22:45.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.967+0000 7fe40082f700 1 --2- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3fc06c710 0x7fe3fc1e2820 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00c7f0 tx=0x7fe3ec00cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.967+0000 7fa79bfff700 1 --2- 172.21.15.47:0/2680506462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa79c0c47d0 0x7fa79c1543c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa79000e840 tx=0x7fa79000ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.967+0000 7fe3f97fa700 1 -- 172.21.15.47:0/1564457112 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec011800 con 0x7fe3fc06c710 2024-05-08T19:22:45.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.967+0000 7fe3f97fa700 1 -- 172.21.15.47:0/1564457112 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec011960 con 0x7fe3fc06c710 2024-05-08T19:22:45.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.967+0000 7fe3f97fa700 1 -- 172.21.15.47:0/1564457112 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec011cd0 con 0x7fe3fc06c710 2024-05-08T19:22:45.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.967+0000 7fa7997fa700 1 -- 172.21.15.47:0/2680506462 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790009590 con 0x7fa79c0c47d0 2024-05-08T19:22:45.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.967+0000 7fa7997fa700 1 -- 172.21.15.47:0/2680506462 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa790013680 con 0x7fa79c0c47d0 2024-05-08T19:22:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.967+0000 7fa7997fa700 1 -- 172.21.15.47:0/2680506462 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790013a10 con 0x7fa79c0c47d0 2024-05-08T19:22:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.967+0000 7fa7a31ce700 1 -- 172.21.15.47:0/2680506462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79c0c2f70 con 0x7fa79c0c47d0 2024-05-08T19:22:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.967+0000 7fa7a31ce700 1 -- 172.21.15.47:0/2680506462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c1f2970 con 0x7fa79c0c47d0 2024-05-08T19:22:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.968+0000 7fa7a31ce700 1 -- 172.21.15.47:0/2680506462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa79c0c2df0 con 0x7fa79c0c47d0 2024-05-08T19:22:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.967+0000 7fa2ce228700 1 -- start start 2024-05-08T19:22:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.968+0000 7fa2ce228700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2c806d940 0x7fa2c8148d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.968+0000 7fa2ce228700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2c8070670 0x7fa2c8146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.968+0000 7fa2ce228700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2c80a96c0 0x7fa2c8145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.968+0000 7fa2ce228700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c8149680 con 0x7fa2c806d940 2024-05-08T19:22:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.968+0000 7fa2ce228700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c8145280 con 0x7fa2c80a96c0 2024-05-08T19:22:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.968+0000 7fa2ce228700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c80c5520 con 0x7fa2c8070670 2024-05-08T19:22:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.969+0000 7fe402a93700 1 -- 172.21.15.47:0/1564457112 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc0c5a60 con 0x7fe3fc06c710 2024-05-08T19:22:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.969+0000 7fe402a93700 1 -- 172.21.15.47:0/1564457112 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc15cba0 con 0x7fe3fc06c710 2024-05-08T19:22:45.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.969+0000 7fa2c6ffd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2c8070670 0x7fa2c8146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.969+0000 7fa2c6ffd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2c8070670 0x7fa2c8146450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:48924/0 (socket says 172.21.15.47:48924) 2024-05-08T19:22:45.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.969+0000 7fa2c6ffd700 1 -- 172.21.15.47:0/456414477 learned_addr learned my addr 172.21.15.47:0/456414477 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:45.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.969+0000 7fa2c7fff700 1 --2- 172.21.15.47:0/456414477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2c80a96c0 0x7fa2c8145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.970+0000 7fe402a93700 1 -- 172.21.15.47:0/1564457112 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3dc000fc0 con 0x7fe3fc06c710 2024-05-08T19:22:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.970+0000 7fa298570700 1 -- start start 2024-05-08T19:22:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.971+0000 7fa298570700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa29006c710 0x7fa290138e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.971+0000 7fa298570700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa29006dd80 0x7fa290142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.971+0000 7fa298570700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2900abb20 0x7fa290144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.971+0000 7fa298570700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900bb340 con 0x7fa2900abb20 2024-05-08T19:22:45.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.971+0000 7fa298570700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29015b080 con 0x7fa29006dd80 2024-05-08T19:22:45.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.971+0000 7fa298570700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29015b600 con 0x7fa29006c710 2024-05-08T19:22:45.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.971+0000 7f0174e57700 1 -- 172.21.15.47:0/1572021670 shutdown_connections 2024-05-08T19:22:45.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.970+0000 7fa2c77fe700 1 --2- 172.21.15.47:0/456414477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2c806d940 0x7fa2c8148d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.971+0000 7fa2c77fe700 1 -- 172.21.15.47:0/456414477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2c8070670 msgr2=0x7fa2c8146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.971+0000 7fa2c77fe700 1 --2- 172.21.15.47:0/456414477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2c8070670 0x7fa2c8146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.971+0000 7fa2c77fe700 1 -- 172.21.15.47:0/456414477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2c80a96c0 msgr2=0x7fa2c8145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.971+0000 7fa2c77fe700 1 --2- 172.21.15.47:0/456414477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2c80a96c0 0x7fa2c8145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.971+0000 7fa2c77fe700 1 -- 172.21.15.47:0/456414477 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c0007910 con 0x7fa2c806d940 2024-05-08T19:22:45.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fa7997fa700 1 -- 172.21.15.47:0/2680506462 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa790013b70 con 0x7fa79c0c47d0 2024-05-08T19:22:45.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fa7997fa700 1 --2- 172.21.15.47:0/2680506462 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa78406aef0 0x7fa78406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fa7997fa700 1 -- 172.21.15.47:0/2680506462 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa790089950 con 0x7fa79c0c47d0 2024-05-08T19:22:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.973+0000 7fa7997fa700 1 --2- 172.21.15.47:0/2680506462 >> [v2:172.21.15.47:6816/46998,v1:172.21.15.47:6817/46998] conn(0x7fa7840744b0 0x7fa7840768f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.973+0000 7fa7997fa700 1 -- 172.21.15.47:0/2680506462 --> [v2:172.21.15.47:6816/46998,v1:172.21.15.47:6817/46998] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa784076fc0 con 0x7fa7840744b0 2024-05-08T19:22:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.971+0000 7fe3f97fa700 1 -- 172.21.15.47:0/1564457112 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe3ec01a450 con 0x7fe3fc06c710 2024-05-08T19:22:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.971+0000 7fe3f97fa700 1 --2- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe3e806ace0 0x7fe3e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fe3f97fa700 1 -- 172.21.15.47:0/1564457112 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe3ec0897d0 con 0x7fe3fc06c710 2024-05-08T19:22:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fe3f97fa700 1 --2- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:6800/47188,v1:172.21.15.177:6801/47188] conn(0x7fe3e80742a0 0x7fe3e80766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fe3f97fa700 1 -- 172.21.15.47:0/1564457112 --> [v2:172.21.15.177:6800/47188,v1:172.21.15.177:6801/47188] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3e8076db0 con 0x7fe3e80742a0 2024-05-08T19:22:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fe401030700 1 --2- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:6800/47188,v1:172.21.15.177:6801/47188] conn(0x7fe3e80742a0 0x7fe3e80766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.973+0000 7fa7a0f6a700 1 --2- 172.21.15.47:0/2680506462 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa78406aef0 0x7fa78406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fa2c77fe700 1 --2- 172.21.15.47:0/456414477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2c806d940 0x7fa2c8148d00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00b480 tx=0x7fa2bc00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fa2affff700 1 -- 172.21.15.47:0/456414477 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc011830 con 0x7fa2c806d940 2024-05-08T19:22:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fa2affff700 1 -- 172.21.15.47:0/456414477 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc011990 con 0x7fa2c806d940 2024-05-08T19:22:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fa2affff700 1 -- 172.21.15.47:0/456414477 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc011d40 con 0x7fa2c806d940 2024-05-08T19:22:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.973+0000 7fa2ce228700 1 -- 172.21.15.47:0/456414477 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c806ce50 con 0x7fa2c806d940 2024-05-08T19:22:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fa296b0d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2900abb20 0x7fa290144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fa296b0d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2900abb20 0x7fa290144cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35842/0 (socket says 172.21.15.47:35842) 2024-05-08T19:22:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fa296b0d700 1 -- 172.21.15.47:0/1258325966 learned_addr learned my addr 172.21.15.47:0/1258325966 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fa296b0d700 1 -- 172.21.15.47:0/1258325966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa29006c710 msgr2=0x7fa290138e30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T19:22:45.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.973+0000 7fa2ce228700 1 -- 172.21.15.47:0/456414477 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c81492a0 con 0x7fa2c806d940 2024-05-08T19:22:45.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fa296b0d700 1 --2- 172.21.15.47:0/1258325966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa29006c710 0x7fa290138e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fa296b0d700 1 -- 172.21.15.47:0/1258325966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa29006dd80 msgr2=0x7fa290142e20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T19:22:45.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fa296b0d700 1 --2- 172.21.15.47:0/1258325966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa29006dd80 0x7fa290142e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.972+0000 7fa296b0d700 1 -- 172.21.15.47:0/1258325966 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c0094a0 con 0x7fa2900abb20 2024-05-08T19:22:45.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.973+0000 7fa7a176b700 1 --2- 172.21.15.47:0/2680506462 >> [v2:172.21.15.47:6816/46998,v1:172.21.15.47:6817/46998] conn(0x7fa7840744b0 0x7fa7840768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.973+0000 7fe3fbfff700 1 --2- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe3e806ace0 0x7fe3e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.971+0000 7f0174e57700 1 -- 172.21.15.47:0/1572021670 wait complete. 2024-05-08T19:22:45.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.973+0000 7f0174e57700 1 Processor -- start 2024-05-08T19:22:45.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.973+0000 7f0174e57700 1 -- start start 2024-05-08T19:22:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.974+0000 7fe401030700 1 --2- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:6800/47188,v1:172.21.15.177:6801/47188] conn(0x7fe3e80742a0 0x7fe3e80766e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.974+0000 7fa7a176b700 1 --2- 172.21.15.47:0/2680506462 >> [v2:172.21.15.47:6816/46998,v1:172.21.15.47:6817/46998] conn(0x7fa7840744b0 0x7fa7840768f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.973+0000 7fa296b0d700 1 --2- 172.21.15.47:0/1258325966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2900abb20 0x7fa290144cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0090b0 tx=0x7fa28c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.975+0000 7fa7a0f6a700 1 --2- 172.21.15.47:0/2680506462 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa78406aef0 0x7fa78406d3b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa78c014040 tx=0x7fa78c010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.975+0000 7f0174e57700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f017006e090 0x7f017015c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.975+0000 7f0174e57700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0170152ce0 0x7f01701549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.975+0000 7fe3fbfff700 1 --2- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe3e806ace0 0x7fe3e806d1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc152220 tx=0x7fe3f00090e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.975+0000 7f0174e57700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01700bb890 0x7f0170154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.975+0000 7f0174e57700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0170156470 con 0x7f01700bb890 2024-05-08T19:22:45.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.975+0000 7f0174e57700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0170156190 con 0x7f0170152ce0 2024-05-08T19:22:45.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.975+0000 7f0174e57700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0170153c70 con 0x7f017006e090 2024-05-08T19:22:45.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.975+0000 7f0535107700 1 -- 172.21.15.47:0/2303601372 --> [v2:172.21.15.177:6802/47187,v1:172.21.15.177:6804/47187] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0510002d40 con 0x7f051c074320 2024-05-08T19:22:45.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.975+0000 7f3e4be34700 1 Processor -- start 2024-05-08T19:22:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.975+0000 7fa2ce228700 1 -- 172.21.15.47:0/456414477 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa2a8000fc0 con 0x7fa2c806d940 2024-05-08T19:22:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.976+0000 7fe3f97fa700 1 -- 172.21.15.47:0/1564457112 <== osd.6 v2:172.21.15.177:6800/47188 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe3e8076db0 con 0x7fe3e80742a0 2024-05-08T19:22:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.976+0000 7fa7997fa700 1 -- 172.21.15.47:0/2680506462 <== osd.1 v2:172.21.15.47:6816/46998 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa784076fc0 con 0x7fa7840744b0 2024-05-08T19:22:45.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.976+0000 7f016ed9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01700bb890 0x7f0170154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f016ed9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01700bb890 0x7f0170154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35858/0 (socket says 172.21.15.47:35858) 2024-05-08T19:22:45.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f016ed9d700 1 -- 172.21.15.47:0/1888603828 learned_addr learned my addr 172.21.15.47:0/1888603828 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:45.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f05177fe700 1 -- 172.21.15.47:0/2303601372 <== osd.4 v2:172.21.15.177:6802/47187 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0510002d40 con 0x7f051c074320 2024-05-08T19:22:45.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f016ed9d700 1 -- 172.21.15.47:0/1888603828 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f017006e090 msgr2=0x7f017015c560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T19:22:45.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f016ed9d700 1 --2- 172.21.15.47:0/1888603828 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f017006e090 0x7f017015c560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f016ed9d700 1 -- 172.21.15.47:0/1888603828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0170152ce0 msgr2=0x7f01701549f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T19:22:45.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f016ed9d700 1 --2- 172.21.15.47:0/1888603828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0170152ce0 0x7f01701549f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f016ed9d700 1 -- 172.21.15.47:0/1888603828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01600094a0 con 0x7f01700bb890 2024-05-08T19:22:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.976+0000 7f3e4be34700 1 -- start start 2024-05-08T19:22:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.976+0000 7f3e4be34700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3e44152ce0 0x7f3e440726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.976+0000 7f3e4be34700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3e4406b4e0 0x7f3e440c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.976+0000 7f3e4be34700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4406dc00 con 0x7f3e4406e090 2024-05-08T19:22:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.976+0000 7f3e4be34700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4406d3a0 con 0x7f3e44152ce0 2024-05-08T19:22:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.976+0000 7f3e4be34700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e44159b20 con 0x7f3e4406b4e0 2024-05-08T19:22:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f3e49bd0700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3e44152ce0 0x7f3e440726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f3e49bd0700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3e44152ce0 0x7f3e440726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35868/0 (socket says 172.21.15.47:35868) 2024-05-08T19:22:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f3e49bd0700 1 -- 172.21.15.47:0/1682972333 learned_addr learned my addr 172.21.15.47:0/1682972333 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f3e49bd0700 1 -- 172.21.15.47:0/1682972333 >> v2:172.21.15.177:3300/0 conn(0x7f3e4406b4e0 msgr2=0x7f3e440c0aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T19:22:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f3e49bd0700 1 --2- 172.21.15.47:0/1682972333 >> v2:172.21.15.177:3300/0 conn(0x7f3e4406b4e0 0x7f3e440c0aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f3e49bd0700 1 -- 172.21.15.47:0/1682972333 >> v1:172.21.15.177:6789/0 conn(0x7f3e4406e090 legacy=0x7f3e44070670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T19:22:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f3e49bd0700 1 -- 172.21.15.47:0/1682972333 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4406d5b0 con 0x7f3e44152ce0 2024-05-08T19:22:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.977+0000 7f3e49bd0700 1 --2- 172.21.15.47:0/1682972333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e44152ce0 0x7f3e440726a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3e440c0760 tx=0x7f3e40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbba3efdb2154f3d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.978+0000 7f0535107700 1 -- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:6802/47187,v1:172.21.15.177:6804/47187] conn(0x7f051c074320 msgr2=0x7f051c076760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.978+0000 7f0535107700 1 --2- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:6802/47187,v1:172.21.15.177:6804/47187] conn(0x7f051c074320 0x7f051c076760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:45.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.978+0000 7fa286ffd700 1 -- 172.21.15.47:0/1258325966 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0044d0 con 0x7fa2900abb20 2024-05-08T19:22:45.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.978+0000 7f0535107700 1 -- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f051c06ace0 msgr2=0x7f051c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.978+0000 7f0535107700 1 --2- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f051c06ace0 0x7f051c06d1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0524000f60 tx=0x7f0524007a40 comp rx=0 tx=0).stop 2024-05-08T19:22:45.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.978+0000 7f0535107700 1 -- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05300c78c0 msgr2=0x7f05301eb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:45.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.978+0000 7f0535107700 1 --2- 172.21.15.47:0/2303601372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05300c78c0 0x7f05301eb870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f052800b680 tx=0x7f0528004ad0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.978+0000 7f052f59e700 1 -- 172.21.15.47:0/2303601372 reap_dead start 2024-05-08T19:22:46.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.978+0000 7fa286ffd700 1 -- 172.21.15.47:0/1258325966 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c01e070 con 0x7fa2900abb20 2024-05-08T19:22:46.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.978+0000 7fa298570700 1 -- 172.21.15.47:0/1258325966 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa290143360 con 0x7fa2900abb20 2024-05-08T19:22:46.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.978+0000 7fa298570700 1 -- 172.21.15.47:0/1258325966 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa290146f20 con 0x7fa2900abb20 2024-05-08T19:22:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.978+0000 7f3e48bce700 1 -- 172.21.15.47:0/1682972333 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40004230 con 0x7f3e44152ce0 2024-05-08T19:22:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.978+0000 7f3e48bce700 1 -- 172.21.15.47:0/1682972333 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e40004390 con 0x7f3e44152ce0 2024-05-08T19:22:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.978+0000 7f3e48bce700 1 -- 172.21.15.47:0/1682972333 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e400036a0 con 0x7f3e44152ce0 2024-05-08T19:22:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.979+0000 7f3e4be34700 1 -- 172.21.15.47:0/1682972333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e44152ce0 msgr2=0x7f3e440726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.979+0000 7f3e4be34700 1 --2- 172.21.15.47:0/1682972333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e44152ce0 0x7f3e440726a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3e440c0760 tx=0x7f3e40009bd0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.979+0000 7f3e4be34700 1 -- 172.21.15.47:0/1682972333 shutdown_connections 2024-05-08T19:22:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.979+0000 7f3e4be34700 1 --2- 172.21.15.47:0/1682972333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e44152ce0 0x7f3e440726a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.979+0000 7f3e4be34700 1 --2- 172.21.15.47:0/1682972333 >> v2:172.21.15.177:3300/0 conn(0x7f3e4406b4e0 0x7f3e440c0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.979+0000 7f3e4be34700 1 -- 172.21.15.47:0/1682972333 >> 172.21.15.47:0/1682972333 conn(0x7f3e4406a9c0 msgr2=0x7f3e4406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.979+0000 7f3e4be34700 1 -- 172.21.15.47:0/1682972333 shutdown_connections 2024-05-08T19:22:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.978+0000 7fa286ffd700 1 -- 172.21.15.47:0/1258325966 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0038a0 con 0x7fa2900abb20 2024-05-08T19:22:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.979+0000 7f0535107700 1 -- 172.21.15.47:0/2303601372 shutdown_connections 2024-05-08T19:22:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.979+0000 7f0535107700 1 -- 172.21.15.47:0/2303601372 >> 172.21.15.47:0/2303601372 conn(0x7f05300a9ea0 msgr2=0x7f0530073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.979+0000 7f3e4be34700 1 -- 172.21.15.47:0/1682972333 wait complete. 2024-05-08T19:22:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.979+0000 7fe3f97fa700 1 -- 172.21.15.47:0/1564457112 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3ec00a440 con 0x7fe3fc06c710 2024-05-08T19:22:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.979+0000 7fa7997fa700 1 -- 172.21.15.47:0/2680506462 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa790054820 con 0x7fa79c0c47d0 2024-05-08T19:22:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.980+0000 7fa298570700 1 -- 172.21.15.47:0/1258325966 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa278000fc0 con 0x7fa2900abb20 2024-05-08T19:22:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.980+0000 7fa286ffd700 1 -- 172.21.15.47:0/1258325966 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa28c003a00 con 0x7fa2900abb20 2024-05-08T19:22:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.980+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1621214274 --> [v2:172.21.15.47:6808/46997,v1:172.21.15.47:6809/46997] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd9ec070eb0 con 0x7fd9d8074250 2024-05-08T19:22:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.980+0000 7f3e4be34700 1 Processor -- start 2024-05-08T19:22:46.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.980+0000 7f016ed9d700 1 --2- 172.21.15.47:0/1888603828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01700bb890 0x7f0170154f30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f016800caa0 tx=0x7f016800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.981+0000 7fa286ffd700 1 --2- 172.21.15.47:0/1258325966 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa27406ace0 0x7fa27406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.981+0000 7f015effd700 1 -- 172.21.15.47:0/1888603828 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800aa80 con 0x7f01700bb890 2024-05-08T19:22:46.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.981+0000 7f0535107700 1 -- 172.21.15.47:0/2303601372 shutdown_connections 2024-05-08T19:22:46.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.981+0000 7f0174e57700 1 -- 172.21.15.47:0/1888603828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01640094a0 con 0x7f01700bb890 2024-05-08T19:22:46.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.981+0000 7f015effd700 1 -- 172.21.15.47:0/1888603828 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016800abe0 con 0x7f01700bb890 2024-05-08T19:22:46.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.981+0000 7f015effd700 1 -- 172.21.15.47:0/1888603828 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168012400 con 0x7f01700bb890 2024-05-08T19:22:46.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.981+0000 7f0174e57700 1 -- 172.21.15.47:0/1888603828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01701544d0 con 0x7f01700bb890 2024-05-08T19:22:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.981+0000 7f0535107700 1 -- 172.21.15.47:0/2303601372 wait complete. 2024-05-08T19:22:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.982+0000 7fa29630c700 1 --2- 172.21.15.47:0/1258325966 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa27406ace0 0x7fa27406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.982+0000 7fa286ffd700 1 -- 172.21.15.47:0/1258325966 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa28c08a2c0 con 0x7fa2900abb20 2024-05-08T19:22:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.982+0000 7fa286ffd700 1 --2- 172.21.15.47:0/1258325966 >> [v2:172.21.15.47:6800/46996,v1:172.21.15.47:6801/46996] conn(0x7fa2740742a0 0x7fa2740766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.982+0000 7fa286ffd700 1 -- 172.21.15.47:0/1258325966 --> [v2:172.21.15.47:6800/46996,v1:172.21.15.47:6801/46996] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa274076db0 con 0x7fa2740742a0 2024-05-08T19:22:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.983+0000 7fa295b0b700 1 --2- 172.21.15.47:0/1258325966 >> [v2:172.21.15.47:6800/46996,v1:172.21.15.47:6801/46996] conn(0x7fa2740742a0 0x7fa2740766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7fa295b0b700 1 --2- 172.21.15.47:0/1258325966 >> [v2:172.21.15.47:6800/46996,v1:172.21.15.47:6801/46996] conn(0x7fa2740742a0 0x7fa2740766e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.983+0000 7fd9d37fe700 1 -- 172.21.15.47:0/1621214274 <== osd.2 v2:172.21.15.47:6808/46997 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd9dc00c8f0 con 0x7fd9d8074250 2024-05-08T19:22:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1621214274 >> [v2:172.21.15.47:6808/46997,v1:172.21.15.47:6809/46997] conn(0x7fd9d8074250 msgr2=0x7fd9d8076690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7fd9f14e8700 1 --2- 172.21.15.47:0/1621214274 >> [v2:172.21.15.47:6808/46997,v1:172.21.15.47:6809/46997] conn(0x7fd9d8074250 0x7fd9d8076690 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1621214274 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd9d806ac90 msgr2=0x7fd9d806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7fd9f14e8700 1 --2- 172.21.15.47:0/1621214274 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd9d806ac90 0x7fd9d806d150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec14e790 tx=0x7fd9e00014a0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1621214274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9ec153450 msgr2=0x7fd9ec1f16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7fd9f14e8700 1 --2- 172.21.15.47:0/1621214274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9ec153450 0x7fd9ec1f16d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0c32e0 tx=0x7fd9e4009f50 comp rx=0 tx=0).stop 2024-05-08T19:22:46.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.982+0000 7f0174e57700 1 -- 172.21.15.47:0/1888603828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f017006ddb0 con 0x7f01700bb890 2024-05-08T19:22:46.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.983+0000 7f015effd700 1 -- 172.21.15.47:0/1888603828 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f016801b3b0 con 0x7f01700bb890 2024-05-08T19:22:46.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.983+0000 7f015effd700 1 --2- 172.21.15.47:0/1888603828 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f015006ad60 0x7f015006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7f015effd700 1 -- 172.21.15.47:0/1888603828 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f01680892f0 con 0x7f01700bb890 2024-05-08T19:22:46.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7f016e59c700 1 --2- 172.21.15.47:0/1888603828 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f015006ad60 0x7f015006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7f015effd700 1 --2- 172.21.15.47:0/1888603828 >> [v2:172.21.15.47:6824/47010,v1:172.21.15.47:6825/47010] conn(0x7f0150074320 0x7f0150076760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7f015effd700 1 -- 172.21.15.47:0/1888603828 --> [v2:172.21.15.47:6824/47010,v1:172.21.15.47:6825/47010] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0150076e30 con 0x7f0150074320 2024-05-08T19:22:46.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7f016e59c700 1 --2- 172.21.15.47:0/1888603828 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f015006ad60 0x7f015006d220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0160009b80 tx=0x7f0160009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.982+0000 7fa2affff700 1 -- 172.21.15.47:0/456414477 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa2bc01a400 con 0x7fa2c806d940 2024-05-08T19:22:46.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.982+0000 7fa2affff700 1 --2- 172.21.15.47:0/456414477 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa2b406ad90 0x7fa2b406d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.982+0000 7fa2affff700 1 -- 172.21.15.47:0/456414477 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa2bc089b10 con 0x7fa2c806d940 2024-05-08T19:22:46.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.983+0000 7fa2affff700 1 --2- 172.21.15.47:0/456414477 >> [v2:172.21.15.177:6820/47198,v1:172.21.15.177:6822/47198] conn(0x7fa2b40743d0 0x7fa2b4076810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.983+0000 7fa2affff700 1 -- 172.21.15.47:0/456414477 --> [v2:172.21.15.177:6820/47198,v1:172.21.15.177:6822/47198] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa2b4076ee0 con 0x7fa2b40743d0 2024-05-08T19:22:46.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.983+0000 7fa2affff700 1 -- 172.21.15.47:0/456414477 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2bc089ec0 con 0x7fa2c806d940 2024-05-08T19:22:46.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.983+0000 7fa2c6ffd700 1 --2- 172.21.15.47:0/456414477 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa2b406ad90 0x7fa2b406d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.983+0000 7fa2c7fff700 1 --2- 172.21.15.47:0/456414477 >> [v2:172.21.15.177:6820/47198,v1:172.21.15.177:6822/47198] conn(0x7fa2b40743d0 0x7fa2b4076810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7fa2c6ffd700 1 --2- 172.21.15.47:0/456414477 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa2b406ad90 0x7fa2b406d250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8001480 tx=0x7fa2b8001410 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7fa2c7fff700 1 --2- 172.21.15.47:0/456414477 >> [v2:172.21.15.177:6820/47198,v1:172.21.15.177:6822/47198] conn(0x7fa2b40743d0 0x7fa2b4076810 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.981+0000 7f3e4be34700 1 -- start start 2024-05-08T19:22:46.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.981+0000 7f3e4be34700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e4406e090 0x7f3e44144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.981+0000 7f3e4be34700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e44152ce0 0x7f3e4415c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.981+0000 7f3e4be34700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e44157b90 0x7f3e4413a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.981+0000 7f3e4be34700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e441530c0 con 0x7f3e4406e090 2024-05-08T19:22:46.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.981+0000 7f3e4be34700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e440bb0c0 con 0x7f3e44152ce0 2024-05-08T19:22:46.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.981+0000 7f3e4be34700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e440bb310 con 0x7f3e44157b90 2024-05-08T19:22:46.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.982+0000 7f3e4a3d1700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e44157b90 0x7f3e4413a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.982+0000 7f3e493cf700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e44152ce0 0x7f3e4415c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.982+0000 7f3e493cf700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e44152ce0 0x7f3e4415c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:38346/0 (socket says 172.21.15.47:38346) 2024-05-08T19:22:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.982+0000 7f3e493cf700 1 -- 172.21.15.47:0/1358400450 learned_addr learned my addr 172.21.15.47:0/1358400450 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.983+0000 7f3e493cf700 1 -- 172.21.15.47:0/1358400450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e44157b90 msgr2=0x7f3e4413a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.983+0000 7f3e493cf700 1 --2- 172.21.15.47:0/1358400450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e44157b90 0x7f3e4413a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.983+0000 7f3e493cf700 1 -- 172.21.15.47:0/1358400450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e4406e090 msgr2=0x7f3e44144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.983+0000 7f3e493cf700 1 --2- 172.21.15.47:0/1358400450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e4406e090 0x7f3e44144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.983+0000 7f3e493cf700 1 -- 172.21.15.47:0/1358400450 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e40009550 con 0x7f3e44152ce0 2024-05-08T19:22:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7f3e493cf700 1 --2- 172.21.15.47:0/1358400450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e44152ce0 0x7f3e4415c890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400b550 tx=0x7f3e3400b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7f3e3a7fc700 1 -- 172.21.15.47:0/1358400450 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34011830 con 0x7f3e44152ce0 2024-05-08T19:22:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7f3e3a7fc700 1 -- 172.21.15.47:0/1358400450 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e34011990 con 0x7f3e44152ce0 2024-05-08T19:22:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7f3e3a7fc700 1 -- 172.21.15.47:0/1358400450 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34011d20 con 0x7f3e44152ce0 2024-05-08T19:22:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7f3e4be34700 1 -- 172.21.15.47:0/1358400450 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e44155350 con 0x7f3e44152ce0 2024-05-08T19:22:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.984+0000 7f3e4be34700 1 -- 172.21.15.47:0/1358400450 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e440c08d0 con 0x7f3e44152ce0 2024-05-08T19:22:46.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.985+0000 7fa29630c700 1 --2- 172.21.15.47:0/1258325966 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa27406ace0 0x7fa27406d1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa288001f80 tx=0x7fa2880015b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.985+0000 7f015effd700 1 -- 172.21.15.47:0/1888603828 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0168001b70 con 0x7f01700bb890 2024-05-08T19:22:46.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.985+0000 7fa2affff700 1 -- 172.21.15.47:0/456414477 <== osd.5 v2:172.21.15.177:6820/47198 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa2b4076ee0 con 0x7fa2b40743d0 2024-05-08T19:22:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.985+0000 7f3e4be34700 1 -- 172.21.15.47:0/1358400450 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e441597b0 con 0x7f3e44152ce0 2024-05-08T19:22:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.986+0000 7fa286ffd700 1 -- 172.21.15.47:0/1258325966 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa28c055320 con 0x7fa2900abb20 2024-05-08T19:22:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.986+0000 7fa286ffd700 1 -- 172.21.15.47:0/1258325966 <== osd.0 v2:172.21.15.47:6800/46996 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa274076db0 con 0x7fa2740742a0 2024-05-08T19:22:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.986+0000 7f016dd9b700 1 --2- 172.21.15.47:0/1888603828 >> [v2:172.21.15.47:6824/47010,v1:172.21.15.47:6825/47010] conn(0x7f0150074320 0x7f0150076760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.986+0000 7f016dd9b700 1 --2- 172.21.15.47:0/1888603828 >> [v2:172.21.15.47:6824/47010,v1:172.21.15.47:6825/47010] conn(0x7f0150074320 0x7f0150076760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.987+0000 7fd9eb7fe700 1 -- 172.21.15.47:0/1621214274 reap_dead start 2024-05-08T19:22:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.987+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1621214274 shutdown_connections 2024-05-08T19:22:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.987+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1621214274 >> 172.21.15.47:0/1621214274 conn(0x7fd9ec0c33d0 msgr2=0x7fd9ec0c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.987+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1621214274 shutdown_connections 2024-05-08T19:22:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.986+0000 7f3e3a7fc700 1 -- 172.21.15.47:0/1358400450 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3e3401a400 con 0x7f3e44152ce0 2024-05-08T19:22:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.987+0000 7f3e3a7fc700 1 --2- 172.21.15.47:0/1358400450 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3e2806ad60 0x7f3e2806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.987+0000 7f3e3a7fc700 1 -- 172.21.15.47:0/1358400450 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e340895d0 con 0x7f3e44152ce0 2024-05-08T19:22:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.987+0000 7f3e3a7fc700 1 --2- 172.21.15.47:0/1358400450 >> [v2:172.21.15.177:6816/47211,v1:172.21.15.177:6817/47211] conn(0x7f3e28074320 0x7f3e28076760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.987+0000 7f3e3a7fc700 1 -- 172.21.15.47:0/1358400450 --> [v2:172.21.15.177:6816/47211,v1:172.21.15.177:6817/47211] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e28076e30 con 0x7f3e28074320 2024-05-08T19:22:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.989+0000 7fd9f14e8700 1 -- 172.21.15.47:0/1621214274 wait complete. 2024-05-08T19:22:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.989+0000 7f015effd700 1 -- 172.21.15.47:0/1888603828 <== osd.3 v2:172.21.15.47:6824/47010 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0150076e30 con 0x7f0150074320 2024-05-08T19:22:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.989+0000 7f3e3a7fc700 1 -- 172.21.15.47:0/1358400450 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e34011e80 con 0x7f3e44152ce0 2024-05-08T19:22:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.989+0000 7f3e49bd0700 1 --2- 172.21.15.47:0/1358400450 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3e2806ad60 0x7f3e2806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:45.996+0000 7f3e4a3d1700 1 --2- 172.21.15.47:0/1358400450 >> [v2:172.21.15.177:6816/47211,v1:172.21.15.177:6817/47211] conn(0x7f3e28074320 0x7f3e28076760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.000+0000 7f3e49bd0700 1 --2- 172.21.15.47:0/1358400450 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3e2806ad60 0x7f3e2806d220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009c10 tx=0x7f3e40010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.018 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-05-08T19:22:46.019 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T19:22:46.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.005+0000 7f3e4a3d1700 1 --2- 172.21.15.47:0/1358400450 >> [v2:172.21.15.177:6816/47211,v1:172.21.15.177:6817/47211] conn(0x7f3e28074320 0x7f3e28076760 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.006+0000 7fa2ce228700 1 -- 172.21.15.47:0/456414477 --> [v2:172.21.15.177:6820/47198,v1:172.21.15.177:6822/47198] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa2a8002d40 con 0x7fa2b40743d0 2024-05-08T19:22:46.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.006+0000 7f3e3a7fc700 1 -- 172.21.15.47:0/1358400450 <== osd.7 v2:172.21.15.177:6816/47211 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3e28076e30 con 0x7f3e28074320 2024-05-08T19:22:46.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.006+0000 7fe402a93700 1 -- 172.21.15.47:0/1564457112 --> [v2:172.21.15.177:6800/47188,v1:172.21.15.177:6801/47188] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe3dc002d00 con 0x7fe3e80742a0 2024-05-08T19:22:46.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.006+0000 7fe3f97fa700 1 -- 172.21.15.47:0/1564457112 <== osd.6 v2:172.21.15.177:6800/47188 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe3dc002d00 con 0x7fe3e80742a0 2024-05-08T19:22:46.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.006+0000 7fa2affff700 1 -- 172.21.15.47:0/456414477 <== osd.5 v2:172.21.15.177:6820/47198 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa2a8002d40 con 0x7fa2b40743d0 2024-05-08T19:22:46.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.007+0000 7fe402a93700 1 -- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:6800/47188,v1:172.21.15.177:6801/47188] conn(0x7fe3e80742a0 msgr2=0x7fe3e80766e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.007+0000 7fe402a93700 1 --2- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:6800/47188,v1:172.21.15.177:6801/47188] conn(0x7fe3e80742a0 0x7fe3e80766e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.007+0000 7fe402a93700 1 -- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe3e806ace0 msgr2=0x7fe3e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.007+0000 7fe402a93700 1 --2- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe3e806ace0 0x7fe3e806d1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc152220 tx=0x7fe3f00090e0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.007+0000 7fe402a93700 1 -- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3fc06c710 msgr2=0x7fe3fc1e2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.007+0000 7fe402a93700 1 --2- 172.21.15.47:0/1564457112 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3fc06c710 0x7fe3fc1e2820 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00c7f0 tx=0x7fe3ec00cb00 comp rx=0 tx=0).stop 2024-05-08T19:22:46.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.007+0000 7fe401030700 1 -- 172.21.15.47:0/1564457112 reap_dead start 2024-05-08T19:22:46.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.007+0000 7fe402a93700 1 -- 172.21.15.47:0/1564457112 shutdown_connections 2024-05-08T19:22:46.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.007+0000 7fe402a93700 1 -- 172.21.15.47:0/1564457112 >> 172.21.15.47:0/1564457112 conn(0x7fe3fc06a9c0 msgr2=0x7fe3fc0c4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.007+0000 7fe402a93700 1 -- 172.21.15.47:0/1564457112 shutdown_connections 2024-05-08T19:22:46.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.007+0000 7fe402a93700 1 -- 172.21.15.47:0/1564457112 wait complete. 2024-05-08T19:22:46.023 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-05-08T19:22:46.024 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T19:22:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.012+0000 7fa7a31ce700 1 -- 172.21.15.47:0/2680506462 --> [v2:172.21.15.47:6816/46998,v1:172.21.15.47:6817/46998] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa79c0c65f0 con 0x7fa7840744b0 2024-05-08T19:22:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.011+0000 7fa2ce228700 1 -- 172.21.15.47:0/456414477 >> [v2:172.21.15.177:6820/47198,v1:172.21.15.177:6822/47198] conn(0x7fa2b40743d0 msgr2=0x7fa2b4076810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.012+0000 7fa2ce228700 1 --2- 172.21.15.47:0/456414477 >> [v2:172.21.15.177:6820/47198,v1:172.21.15.177:6822/47198] conn(0x7fa2b40743d0 0x7fa2b4076810 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.012+0000 7fa2ce228700 1 -- 172.21.15.47:0/456414477 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa2b406ad90 msgr2=0x7fa2b406d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.012+0000 7fa2ce228700 1 --2- 172.21.15.47:0/456414477 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa2b406ad90 0x7fa2b406d250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8001480 tx=0x7fa2b8001410 comp rx=0 tx=0).stop 2024-05-08T19:22:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.012+0000 7fa2ce228700 1 -- 172.21.15.47:0/456414477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2c806d940 msgr2=0x7fa2c8148d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.012+0000 7fa2ce228700 1 --2- 172.21.15.47:0/456414477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2c806d940 0x7fa2c8148d00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00b480 tx=0x7fa2bc00b790 comp rx=0 tx=0).stop 2024-05-08T19:22:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.012+0000 7fa2c7fff700 1 -- 172.21.15.47:0/456414477 reap_dead start 2024-05-08T19:22:46.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.012+0000 7fa7997fa700 1 -- 172.21.15.47:0/2680506462 <== osd.1 v2:172.21.15.47:6816/46998 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa794007930 con 0x7fa7840744b0 2024-05-08T19:22:46.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.013+0000 7fa2ce228700 1 -- 172.21.15.47:0/456414477 shutdown_connections 2024-05-08T19:22:46.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.013+0000 7fa2ce228700 1 -- 172.21.15.47:0/456414477 >> 172.21.15.47:0/456414477 conn(0x7fa2c806a9c0 msgr2=0x7fa2c81429a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.013+0000 7fa2ce228700 1 -- 172.21.15.47:0/456414477 shutdown_connections 2024-05-08T19:22:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.013+0000 7fa2ce228700 1 -- 172.21.15.47:0/456414477 wait complete. 2024-05-08T19:22:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.014+0000 7fa7a31ce700 1 -- 172.21.15.47:0/2680506462 >> [v2:172.21.15.47:6816/46998,v1:172.21.15.47:6817/46998] conn(0x7fa7840744b0 msgr2=0x7fa7840768f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.014+0000 7fa7a31ce700 1 --2- 172.21.15.47:0/2680506462 >> [v2:172.21.15.47:6816/46998,v1:172.21.15.47:6817/46998] conn(0x7fa7840744b0 0x7fa7840768f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.016+0000 7fa298570700 1 -- 172.21.15.47:0/1258325966 --> [v2:172.21.15.47:6800/46996,v1:172.21.15.47:6801/46996] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa278002d40 con 0x7fa2740742a0 2024-05-08T19:22:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.017+0000 7fa7a31ce700 1 -- 172.21.15.47:0/2680506462 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa78406aef0 msgr2=0x7fa78406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.017+0000 7fa7a31ce700 1 --2- 172.21.15.47:0/2680506462 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa78406aef0 0x7fa78406d3b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa78c014040 tx=0x7fa78c010000 comp rx=0 tx=0).stop 2024-05-08T19:22:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.017+0000 7fa7a31ce700 1 -- 172.21.15.47:0/2680506462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa79c0c47d0 msgr2=0x7fa79c1543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.017+0000 7fa7a31ce700 1 --2- 172.21.15.47:0/2680506462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa79c0c47d0 0x7fa79c1543c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa79000e840 tx=0x7fa79000ec00 comp rx=0 tx=0).stop 2024-05-08T19:22:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.017+0000 7fa7a176b700 1 -- 172.21.15.47:0/2680506462 reap_dead start 2024-05-08T19:22:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.017+0000 7fa286ffd700 1 -- 172.21.15.47:0/1258325966 <== osd.0 v2:172.21.15.47:6800/46996 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa278002d40 con 0x7fa2740742a0 2024-05-08T19:22:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.017+0000 7fa298570700 1 -- 172.21.15.47:0/1258325966 >> [v2:172.21.15.47:6800/46996,v1:172.21.15.47:6801/46996] conn(0x7fa2740742a0 msgr2=0x7fa2740766e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.017+0000 7fa298570700 1 --2- 172.21.15.47:0/1258325966 >> [v2:172.21.15.47:6800/46996,v1:172.21.15.47:6801/46996] conn(0x7fa2740742a0 0x7fa2740766e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.017+0000 7fa298570700 1 -- 172.21.15.47:0/1258325966 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa27406ace0 msgr2=0x7fa27406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.017+0000 7fa298570700 1 --2- 172.21.15.47:0/1258325966 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa27406ace0 0x7fa27406d1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa288001f80 tx=0x7fa2880015b0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.017+0000 7fa298570700 1 -- 172.21.15.47:0/1258325966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2900abb20 msgr2=0x7fa290144cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.017+0000 7fa298570700 1 --2- 172.21.15.47:0/1258325966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2900abb20 0x7fa290144cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0090b0 tx=0x7fa28c004750 comp rx=0 tx=0).stop 2024-05-08T19:22:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.017+0000 7fa296b0d700 1 -- 172.21.15.47:0/1258325966 reap_dead start 2024-05-08T19:22:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.015+0000 7f0174e57700 1 -- 172.21.15.47:0/1888603828 --> [v2:172.21.15.47:6824/47010,v1:172.21.15.47:6825/47010] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f01701597b0 con 0x7f0150074320 2024-05-08T19:22:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.018+0000 7fa298570700 1 -- 172.21.15.47:0/1258325966 shutdown_connections 2024-05-08T19:22:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.018+0000 7fa298570700 1 -- 172.21.15.47:0/1258325966 >> 172.21.15.47:0/1258325966 conn(0x7fa29006a9c0 msgr2=0x7fa2900c4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.018+0000 7f015effd700 1 -- 172.21.15.47:0/1888603828 <== osd.3 v2:172.21.15.47:6824/47010 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0164011630 con 0x7f0150074320 2024-05-08T19:22:46.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.018+0000 7fa298570700 1 -- 172.21.15.47:0/1258325966 shutdown_connections 2024-05-08T19:22:46.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.018+0000 7fa298570700 1 -- 172.21.15.47:0/1258325966 wait complete. 2024-05-08T19:22:46.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.019+0000 7fa7a31ce700 1 -- 172.21.15.47:0/2680506462 shutdown_connections 2024-05-08T19:22:46.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.019+0000 7fa7a31ce700 1 -- 172.21.15.47:0/2680506462 >> 172.21.15.47:0/2680506462 conn(0x7fa79c0c33d0 msgr2=0x7fa79c152c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.019+0000 7fa7a31ce700 1 -- 172.21.15.47:0/2680506462 shutdown_connections 2024-05-08T19:22:46.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.019+0000 7fa7a31ce700 1 -- 172.21.15.47:0/2680506462 wait complete. 2024-05-08T19:22:46.036 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-05-08T19:22:46.036 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T19:22:46.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.028+0000 7f0174e57700 1 -- 172.21.15.47:0/1888603828 >> [v2:172.21.15.47:6824/47010,v1:172.21.15.47:6825/47010] conn(0x7f0150074320 msgr2=0x7f0150076760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.028+0000 7f0174e57700 1 --2- 172.21.15.47:0/1888603828 >> [v2:172.21.15.47:6824/47010,v1:172.21.15.47:6825/47010] conn(0x7f0150074320 0x7f0150076760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.028+0000 7f0174e57700 1 -- 172.21.15.47:0/1888603828 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f015006ad60 msgr2=0x7f015006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.028+0000 7f0174e57700 1 --2- 172.21.15.47:0/1888603828 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f015006ad60 0x7f015006d220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0160009b80 tx=0x7f0160009210 comp rx=0 tx=0).stop 2024-05-08T19:22:46.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.028+0000 7f0174e57700 1 -- 172.21.15.47:0/1888603828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01700bb890 msgr2=0x7f0170154f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.028+0000 7f0174e57700 1 --2- 172.21.15.47:0/1888603828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01700bb890 0x7f0170154f30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f016800caa0 tx=0x7f016800ce60 comp rx=0 tx=0).stop 2024-05-08T19:22:46.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.028+0000 7f016ed9d700 1 -- 172.21.15.47:0/1888603828 reap_dead start 2024-05-08T19:22:46.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.028+0000 7f0174e57700 1 -- 172.21.15.47:0/1888603828 shutdown_connections 2024-05-08T19:22:46.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.028+0000 7f0174e57700 1 -- 172.21.15.47:0/1888603828 >> 172.21.15.47:0/1888603828 conn(0x7f017006a9c0 msgr2=0x7f0170157d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.028+0000 7f0174e57700 1 -- 172.21.15.47:0/1888603828 shutdown_connections 2024-05-08T19:22:46.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.028+0000 7f0174e57700 1 -- 172.21.15.47:0/1888603828 wait complete. 2024-05-08T19:22:46.039 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-05-08T19:22:46.040 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T19:22:46.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.033+0000 7f3e4be34700 1 -- 172.21.15.47:0/1358400450 --> [v2:172.21.15.177:6816/47211,v1:172.21.15.177:6817/47211] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3e44155870 con 0x7f3e28074320 2024-05-08T19:22:46.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.034+0000 7f3e3a7fc700 1 -- 172.21.15.47:0/1358400450 <== osd.7 v2:172.21.15.177:6816/47211 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3e44155870 con 0x7f3e28074320 2024-05-08T19:22:46.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.035+0000 7f3e4be34700 1 -- 172.21.15.47:0/1358400450 >> [v2:172.21.15.177:6816/47211,v1:172.21.15.177:6817/47211] conn(0x7f3e28074320 msgr2=0x7f3e28076760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.035+0000 7f3e4be34700 1 --2- 172.21.15.47:0/1358400450 >> [v2:172.21.15.177:6816/47211,v1:172.21.15.177:6817/47211] conn(0x7f3e28074320 0x7f3e28076760 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.035+0000 7f3e4be34700 1 -- 172.21.15.47:0/1358400450 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3e2806ad60 msgr2=0x7f3e2806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.035+0000 7f3e4be34700 1 --2- 172.21.15.47:0/1358400450 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3e2806ad60 0x7f3e2806d220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009c10 tx=0x7f3e40010000 comp rx=0 tx=0).stop 2024-05-08T19:22:46.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.035+0000 7f3e4be34700 1 -- 172.21.15.47:0/1358400450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e44152ce0 msgr2=0x7f3e4415c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.035+0000 7f3e4be34700 1 --2- 172.21.15.47:0/1358400450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e44152ce0 0x7f3e4415c890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400b550 tx=0x7f3e3400b860 comp rx=0 tx=0).stop 2024-05-08T19:22:46.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.035+0000 7f3e4a3d1700 1 -- 172.21.15.47:0/1358400450 reap_dead start 2024-05-08T19:22:46.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.036+0000 7f3e4be34700 1 -- 172.21.15.47:0/1358400450 shutdown_connections 2024-05-08T19:22:46.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.036+0000 7f3e4be34700 1 -- 172.21.15.47:0/1358400450 >> 172.21.15.47:0/1358400450 conn(0x7f3e4406a9c0 msgr2=0x7f3e44158da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.043 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-05-08T19:22:46.044 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T19:22:46.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.037+0000 7f3e4be34700 1 -- 172.21.15.47:0/1358400450 shutdown_connections 2024-05-08T19:22:46.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.037+0000 7f3e4be34700 1 -- 172.21.15.47:0/1358400450 wait complete. 2024-05-08T19:22:46.045 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-05-08T19:22:46.045 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T19:22:46.046 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-05-08T19:22:46.046 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T19:22:46.047 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-05-08T19:22:46.048 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T19:22:46.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.238+0000 7f0fb1d81700 1 Processor -- start 2024-05-08T19:22:46.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.238+0000 7f0fb1d81700 1 -- start start 2024-05-08T19:22:46.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.239+0000 7f0fb1d81700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0fac070670 0x7f0fac14a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.239+0000 7f0fb1d81700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac06e430 con 0x7f0fac14ab90 2024-05-08T19:22:46.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.239+0000 7f0fb1d81700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac151490 con 0x7f0fac06d940 2024-05-08T19:22:46.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.239+0000 7f0fb1d81700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac071cc0 con 0x7f0fac070670 2024-05-08T19:22:46.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.240+0000 7f0fab7fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f0fac06d940 0x7f0fac06dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:57870/0 (socket says 172.21.15.47:57870) 2024-05-08T19:22:46.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.240+0000 7f0fab7fe700 1 -- 172.21.15.47:0/2834086991 learned_addr learned my addr 172.21.15.47:0/2834086991 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faa7fc700 1 -- 172.21.15.47:0/2834086991 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150689669 0 0) 0x7f0fac151490 con 0x7f0fac06d940 2024-05-08T19:22:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faa7fc700 1 -- 172.21.15.47:0/2834086991 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f940035b0 con 0x7f0fac06d940 2024-05-08T19:22:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faaffd700 1 --2- 172.21.15.47:0/2834086991 >> v2:172.21.15.47:3300/0 conn(0x7f0fac070670 0x7f0fac14a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faa7fc700 1 -- 172.21.15.47:0/2834086991 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3085972351 0 0) 0x7f0f940035b0 con 0x7f0fac06d940 2024-05-08T19:22:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faa7fc700 1 -- 172.21.15.47:0/2834086991 >> v2:172.21.15.47:3300/0 conn(0x7f0fac070670 msgr2=0x7f0fac14a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:46.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faa7fc700 1 --2- 172.21.15.47:0/2834086991 >> v2:172.21.15.47:3300/0 conn(0x7f0fac070670 0x7f0fac14a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faa7fc700 1 -- 172.21.15.47:0/2834086991 >> v1:172.21.15.47:6789/0 conn(0x7f0fac14ab90 legacy=0x7f0fac0c0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:46.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faa7fc700 1 -- 172.21.15.47:0/2834086991 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac151770 con 0x7f0fac06d940 2024-05-08T19:22:46.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faa7fc700 1 -- 172.21.15.47:0/2834086991 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f0fa40050e0 con 0x7f0fac06d940 2024-05-08T19:22:46.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faa7fc700 1 -- 172.21.15.47:0/2834086991 >> v1:172.21.15.177:6789/0 conn(0x7f0fac06d940 legacy=0x7f0fac06dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faa7fc700 1 --2- 172.21.15.47:0/2834086991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f94003a00 0x7f0f94003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faa7fc700 1 --2- 172.21.15.47:0/2834086991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f94004850 0x7f0f94004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faa7fc700 1 --2- 172.21.15.47:0/2834086991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f94005280 0x7f0f9400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faa7fc700 1 -- 172.21.15.47:0/2834086991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac071cc0 con 0x7f0f94005280 2024-05-08T19:22:46.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faa7fc700 1 -- 172.21.15.47:0/2834086991 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9400c1e0 con 0x7f0f94004850 2024-05-08T19:22:46.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faa7fc700 1 -- 172.21.15.47:0/2834086991 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9400c3a0 con 0x7f0f94003a00 2024-05-08T19:22:46.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.241+0000 7f0faaffd700 1 --2- 172.21.15.47:0/2834086991 >> v2:172.21.15.47:3300/0 conn(0x7f0fac070670 0x7f0fac14a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:46.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.242+0000 7f0fabfff700 1 --2- 172.21.15.47:0/2834086991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f94005280 0x7f0f9400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.242+0000 7f0fabfff700 1 -- 172.21.15.47:0/2834086991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f94003a00 msgr2=0x7f0f94003e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T19:22:46.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.242+0000 7f0fabfff700 1 --2- 172.21.15.47:0/2834086991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f94003a00 0x7f0f94003e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.242+0000 7f0fabfff700 1 -- 172.21.15.47:0/2834086991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f94004850 msgr2=0x7f0f94004cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T19:22:46.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.242+0000 7f0fabfff700 1 --2- 172.21.15.47:0/2834086991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f94004850 0x7f0f94004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.242+0000 7f0fabfff700 1 -- 172.21.15.47:0/2834086991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac151770 con 0x7f0f94005280 2024-05-08T19:22:46.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.242+0000 7f0fabfff700 1 -- 172.21.15.47:0/2834086991 reap_dead start 2024-05-08T19:22:46.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.242+0000 7f0fabfff700 1 --2- 172.21.15.47:0/2834086991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f94005280 0x7f0f9400ba10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0016e0 tx=0x7f0f94005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a8410d7bed6054 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.243+0000 7f0faa7fc700 1 -- 172.21.15.47:0/2834086991 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0052d0 con 0x7f0f94005280 2024-05-08T19:22:46.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.243+0000 7f0faa7fc700 1 -- 172.21.15.47:0/2834086991 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c005430 con 0x7f0f94005280 2024-05-08T19:22:46.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.243+0000 7f0faa7fc700 1 -- 172.21.15.47:0/2834086991 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0038c0 con 0x7f0f94005280 2024-05-08T19:22:46.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.244+0000 7f0fb1d81700 1 -- 172.21.15.47:0/2834086991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f94005280 msgr2=0x7f0f9400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.244+0000 7f0fb1d81700 1 --2- 172.21.15.47:0/2834086991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f94005280 0x7f0f9400ba10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0016e0 tx=0x7f0f94005880 comp rx=0 tx=0).stop 2024-05-08T19:22:46.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.246+0000 7f0fb1d81700 1 -- 172.21.15.47:0/2834086991 shutdown_connections 2024-05-08T19:22:46.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.246+0000 7f0fb1d81700 1 --2- 172.21.15.47:0/2834086991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f94005280 0x7f0f9400ba10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.246+0000 7f0fb1d81700 1 -- 172.21.15.47:0/2834086991 >> 172.21.15.47:0/2834086991 conn(0x7f0fac06a9c0 msgr2=0x7f0fac06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.247+0000 7f0fb1d81700 1 -- 172.21.15.47:0/2834086991 shutdown_connections 2024-05-08T19:22:46.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.247+0000 7f0fb1d81700 1 -- 172.21.15.47:0/2834086991 wait complete. 2024-05-08T19:22:46.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.249+0000 7f0fb1d81700 1 Processor -- start 2024-05-08T19:22:46.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.249+0000 7f0fb1d81700 1 -- start start 2024-05-08T19:22:46.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.250+0000 7f0fb1d81700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f94005280 0x7f0fac0abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.250+0000 7f0fb1d81700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fac1434f0 0x7f0fac142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.250+0000 7f0fb1d81700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fac0c5490 0x7f0fac0c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.250+0000 7f0fb1d81700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac1ef6b0 con 0x7f0fac1434f0 2024-05-08T19:22:46.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.250+0000 7f0fb1d81700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac1475e0 con 0x7f0fac0c5490 2024-05-08T19:22:46.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.250+0000 7f0fb1d81700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac147ca0 con 0x7f0f94005280 2024-05-08T19:22:46.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.251+0000 7f0fab7fe700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f94005280 0x7f0fac0abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.251+0000 7f0fab7fe700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f94005280 0x7f0fac0abe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:48964/0 (socket says 172.21.15.47:48964) 2024-05-08T19:22:46.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.251+0000 7f0fab7fe700 1 -- 172.21.15.47:0/1972387832 learned_addr learned my addr 172.21.15.47:0/1972387832 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:46.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.251+0000 7f0fab7fe700 1 -- 172.21.15.47:0/1972387832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fac0c5490 msgr2=0x7f0fac0c5910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T19:22:46.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.251+0000 7f0fab7fe700 1 --2- 172.21.15.47:0/1972387832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fac0c5490 0x7f0fac0c5910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.251+0000 7f0fab7fe700 1 -- 172.21.15.47:0/1972387832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fac1434f0 msgr2=0x7f0fac142be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T19:22:46.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.251+0000 7f0fab7fe700 1 --2- 172.21.15.47:0/1972387832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fac1434f0 0x7f0fac142be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.251+0000 7f0fab7fe700 1 -- 172.21.15.47:0/1972387832 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac1f2ca0 con 0x7f0f94005280 2024-05-08T19:22:46.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.251+0000 7f0fab7fe700 1 --2- 172.21.15.47:0/1972387832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f94005280 0x7f0fac0abe10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4008ab0 tx=0x7f0fa4008e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.252+0000 7f0f9bfff700 1 -- 172.21.15.47:0/1972387832 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4010070 con 0x7f0f94005280 2024-05-08T19:22:46.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.252+0000 7f0f9bfff700 1 -- 172.21.15.47:0/1972387832 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa400b2e0 con 0x7f0f94005280 2024-05-08T19:22:46.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.252+0000 7f0f9bfff700 1 -- 172.21.15.47:0/1972387832 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4001da0 con 0x7f0f94005280 2024-05-08T19:22:46.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.253+0000 7f0fb1d81700 1 -- 172.21.15.47:0/1972387832 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fac1eea30 con 0x7f0f94005280 2024-05-08T19:22:46.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.253+0000 7f0fb1d81700 1 -- 172.21.15.47:0/1972387832 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac1eeff0 con 0x7f0f94005280 2024-05-08T19:22:46.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.255+0000 7f0f9bfff700 1 -- 172.21.15.47:0/1972387832 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0fa4008080 con 0x7f0f94005280 2024-05-08T19:22:46.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.256+0000 7f0fb1d81700 1 -- 172.21.15.47:0/1972387832 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac04ec60 con 0x7f0f94005280 2024-05-08T19:22:46.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.256+0000 7f0f9bfff700 1 --2- 172.21.15.47:0/1972387832 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0f9008ccf0 0x7f0f9008f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.256+0000 7f0f9bfff700 1 -- 172.21.15.47:0/1972387832 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0fa4089a40 con 0x7f0f94005280 2024-05-08T19:22:46.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.256+0000 7f0faaffd700 1 --2- 172.21.15.47:0/1972387832 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0f9008ccf0 0x7f0f9008f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.257+0000 7f0faaffd700 1 --2- 172.21.15.47:0/1972387832 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0f9008ccf0 0x7f0f9008f1b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0ab680 tx=0x7f0fa000a320 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.262+0000 7f0f9bfff700 1 -- 172.21.15.47:0/1972387832 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0fa4054910 con 0x7f0f94005280 2024-05-08T19:22:46.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.262+0000 7ffbc8f56700 1 Processor -- start 2024-05-08T19:22:46.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.262+0000 7ffbc8f56700 1 -- start start 2024-05-08T19:22:46.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.263+0000 7ffbc8f56700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbc406d940 0x7ffbc406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.264+0000 7ffbc8f56700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc4151490 con 0x7ffbc406e260 2024-05-08T19:22:46.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.264+0000 7ffbc8f56700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc4151770 con 0x7ffbc4070670 2024-05-08T19:22:46.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.264+0000 7ffbc8f56700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc4071cc0 con 0x7ffbc406d940 2024-05-08T19:22:46.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.264+0000 7ffbc1d9b700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ffbc406e260 0x7ffbc414a650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48622/0 (socket says 172.21.15.47:48622) 2024-05-08T19:22:46.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.264+0000 7ffbc1d9b700 1 -- 172.21.15.47:0/3300559718 learned_addr learned my addr 172.21.15.47:0/3300559718 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:46.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.265+0000 7ffbc259c700 1 --2- 172.21.15.47:0/3300559718 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbc406d940 0x7ffbc406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947167600 0 0) 0x7ffbc4151490 con 0x7ffbc406e260 2024-05-08T19:22:46.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbac0035b0 con 0x7ffbc406e260 2024-05-08T19:22:46.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090819462 0 0) 0x7ffbc4151770 con 0x7ffbc4070670 2024-05-08T19:22:46.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbc4151490 con 0x7ffbc4070670 2024-05-08T19:22:46.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 112627025 0 0) 0x7ffbac0035b0 con 0x7ffbc406e260 2024-05-08T19:22:46.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbc406d940 msgr2=0x7ffbc406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 --2- 172.21.15.47:0/3300559718 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbc406d940 0x7ffbc406dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 >> v1:172.21.15.177:6789/0 conn(0x7ffbc4070670 legacy=0x7ffbc40c0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc40711b0 con 0x7ffbc406e260 2024-05-08T19:22:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7ffbb4001670 con 0x7ffbc406e260 2024-05-08T19:22:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 >> v1:172.21.15.47:6789/0 conn(0x7ffbc406e260 legacy=0x7ffbc414a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 --2- 172.21.15.47:0/3300559718 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbac004c20 0x7ffbac005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 --2- 172.21.15.47:0/3300559718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbac0037f0 0x7ffbac003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 --2- 172.21.15.47:0/3300559718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbac004200 0x7ffbac00ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc4071cc0 con 0x7ffbac004200 2024-05-08T19:22:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac014a20 con 0x7ffbac0037f0 2024-05-08T19:22:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.266+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac014be0 con 0x7ffbac004c20 2024-05-08T19:22:46.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.267+0000 7ffbc2d9d700 1 --2- 172.21.15.47:0/3300559718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbac004200 0x7ffbac00ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.268+0000 7ffbc2d9d700 1 -- 172.21.15.47:0/3300559718 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbac004c20 msgr2=0x7ffbac005020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T19:22:46.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.268+0000 7ffbc2d9d700 1 --2- 172.21.15.47:0/3300559718 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbac004c20 0x7ffbac005020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.268+0000 7ffbc2d9d700 1 -- 172.21.15.47:0/3300559718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbac0037f0 msgr2=0x7ffbac003c70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T19:22:46.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.268+0000 7ffbc2d9d700 1 --2- 172.21.15.47:0/3300559718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbac0037f0 0x7ffbac003c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.268+0000 7ffbc2d9d700 1 -- 172.21.15.47:0/3300559718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc40711b0 con 0x7ffbac004200 2024-05-08T19:22:46.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.268+0000 7ffbc2d9d700 1 --2- 172.21.15.47:0/3300559718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbac004200 0x7ffbac00ba90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00c190 tx=0x7ffbac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abaa229c2ee6925e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.269+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc00cc70 con 0x7ffbac004200 2024-05-08T19:22:46.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.269+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbbc00cdd0 con 0x7ffbac004200 2024-05-08T19:22:46.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.269+0000 7ffbc159a700 1 -- 172.21.15.47:0/3300559718 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc003c40 con 0x7ffbac004200 2024-05-08T19:22:46.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.270+0000 7ffbc8f56700 1 -- 172.21.15.47:0/3300559718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbac004200 msgr2=0x7ffbac00ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.270+0000 7ffbc8f56700 1 --2- 172.21.15.47:0/3300559718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbac004200 0x7ffbac00ba90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00c190 tx=0x7ffbac005880 comp rx=0 tx=0).stop 2024-05-08T19:22:46.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.270+0000 7ffbc2d9d700 1 -- 172.21.15.47:0/3300559718 reap_dead start 2024-05-08T19:22:46.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.274+0000 7ffbc8f56700 1 -- 172.21.15.47:0/3300559718 shutdown_connections 2024-05-08T19:22:46.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.274+0000 7ffbc8f56700 1 -- 172.21.15.47:0/3300559718 >> 172.21.15.47:0/3300559718 conn(0x7ffbc406a9c0 msgr2=0x7ffbc406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.274+0000 7ffbc8f56700 1 -- 172.21.15.47:0/3300559718 shutdown_connections 2024-05-08T19:22:46.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.275+0000 7ffbc8f56700 1 -- 172.21.15.47:0/3300559718 wait complete. 2024-05-08T19:22:46.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.277+0000 7ffbc8f56700 1 Processor -- start 2024-05-08T19:22:46.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.277+0000 7ffbc8f56700 1 -- start start 2024-05-08T19:22:46.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.278+0000 7ffbc8f56700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbac004200 0x7ffbc41e9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.278+0000 7ffbc8f56700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbc413f240 0x7ffbc4154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.278+0000 7ffbc8f56700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbc40c4ef0 0x7ffbc40c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.278+0000 7ffbc8f56700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc41e74d0 con 0x7ffbc40c4ef0 2024-05-08T19:22:46.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.278+0000 7ffbc8f56700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc40c5c30 con 0x7ffbac004200 2024-05-08T19:22:46.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.278+0000 7ffbc8f56700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc413d7c0 con 0x7ffbc413f240 2024-05-08T19:22:46.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.279+0000 7ffbc1d9b700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbc413f240 0x7ffbc4154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.279+0000 7ffbc1d9b700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbc413f240 0x7ffbc4154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:48980/0 (socket says 172.21.15.47:48980) 2024-05-08T19:22:46.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.279+0000 7ffbc1d9b700 1 -- 172.21.15.47:0/1170541631 learned_addr learned my addr 172.21.15.47:0/1170541631 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:46.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.279+0000 7ffbc259c700 1 --2- 172.21.15.47:0/1170541631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbac004200 0x7ffbc41e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.279+0000 7ffbc1d9b700 1 -- 172.21.15.47:0/1170541631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbac004200 msgr2=0x7ffbc41e9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.279+0000 7ffbc1d9b700 1 --2- 172.21.15.47:0/1170541631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbac004200 0x7ffbc41e9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.279+0000 7ffbc1d9b700 1 -- 172.21.15.47:0/1170541631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbc40c4ef0 msgr2=0x7ffbc40c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.279+0000 7ffbc1d9b700 1 --2- 172.21.15.47:0/1170541631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbc40c4ef0 0x7ffbc40c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.279+0000 7ffbc1d9b700 1 -- 172.21.15.47:0/1170541631 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc406ce50 con 0x7ffbc413f240 2024-05-08T19:22:46.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.279+0000 7ffbc1d9b700 1 --2- 172.21.15.47:0/1170541631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbc413f240 0x7ffbc4154980 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400caa0 tx=0x7ffbb400cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.280+0000 7ffbb2ffd700 1 -- 172.21.15.47:0/1170541631 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4004a70 con 0x7ffbc413f240 2024-05-08T19:22:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.280+0000 7ffbb2ffd700 1 -- 172.21.15.47:0/1170541631 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb4004bf0 con 0x7ffbc413f240 2024-05-08T19:22:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.280+0000 7ffbb2ffd700 1 -- 172.21.15.47:0/1170541631 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40070d0 con 0x7ffbc413f240 2024-05-08T19:22:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.280+0000 7ffbc8f56700 1 -- 172.21.15.47:0/1170541631 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc41e9dc0 con 0x7ffbc413f240 2024-05-08T19:22:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.280+0000 7ffbc8f56700 1 -- 172.21.15.47:0/1170541631 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc4154ec0 con 0x7ffbc413f240 2024-05-08T19:22:46.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.286+0000 7ffbc8f56700 1 -- 172.21.15.47:0/1170541631 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc404ec60 con 0x7ffbc413f240 2024-05-08T19:22:46.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.286+0000 7ffbb2ffd700 1 -- 172.21.15.47:0/1170541631 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffbb4007230 con 0x7ffbc413f240 2024-05-08T19:22:46.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.287+0000 7ffbb2ffd700 1 --2- 172.21.15.47:0/1170541631 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ffba406ad60 0x7ffba406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.287+0000 7ffbb2ffd700 1 -- 172.21.15.47:0/1170541631 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffbb4088a20 con 0x7ffbc413f240 2024-05-08T19:22:46.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.288+0000 7ffbc259c700 1 --2- 172.21.15.47:0/1170541631 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ffba406ad60 0x7ffba406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.289+0000 7ffbc259c700 1 --2- 172.21.15.47:0/1170541631 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ffba406ad60 0x7ffba406d220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40c2b70 tx=0x7ffbb8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.291+0000 7ffbb2ffd700 1 -- 172.21.15.47:0/1170541631 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ffbb4053900 con 0x7ffbc413f240 2024-05-08T19:22:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.317+0000 7f1fd4b33700 1 Processor -- start 2024-05-08T19:22:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.317+0000 7f1fd4b33700 1 -- start start 2024-05-08T19:22:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.318+0000 7f3fb9a3c700 1 Processor -- start 2024-05-08T19:22:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7fdb12dfe700 1 Processor -- start 2024-05-08T19:22:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7fdb12dfe700 1 -- start start 2024-05-08T19:22:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7fdb12dfe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdb0c06d940 0x7fdb0c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7fdb12dfe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdb0c070670 0x7fdb0c0c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7fdb12dfe700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c151490 con 0x7fdb0c06e260 2024-05-08T19:22:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7fdb12dfe700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c071cc0 con 0x7fdb0c070670 2024-05-08T19:22:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7fdb12dfe700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c151770 con 0x7fdb0c06d940 2024-05-08T19:22:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.318+0000 7f355e962700 1 Processor -- start 2024-05-08T19:22:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.318+0000 7f355e962700 1 -- start start 2024-05-08T19:22:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f355e962700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3558156520 0x7f35580c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f355e962700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35580c52a0 0x7f355815c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f355e962700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f35580c7150 0x7f355815c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f355e962700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3558158e30 con 0x7f3558156520 2024-05-08T19:22:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f355e962700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3558156900 con 0x7f35580c7150 2024-05-08T19:22:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f355e962700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3558159e00 con 0x7f35580c52a0 2024-05-08T19:22:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f35577fe700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35580c52a0 0x7f355815c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f35577fe700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35580c52a0 0x7f355815c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:48998/0 (socket says 172.21.15.47:48998) 2024-05-08T19:22:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f35577fe700 1 -- 172.21.15.47:0/445475086 learned_addr learned my addr 172.21.15.47:0/445475086 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.318+0000 7f65ec78e700 1 Processor -- start 2024-05-08T19:22:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.318+0000 7f65ec78e700 1 -- start start 2024-05-08T19:22:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f65ec78e700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f65e406edd0 0x7f65e406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f65ec78e700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e40c1020 con 0x7f65e406bf10 2024-05-08T19:22:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f65ec78e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e414eb00 con 0x7f65e406e370 2024-05-08T19:22:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f65ec78e700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e4071a50 con 0x7f65e406edd0 2024-05-08T19:22:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f65e9d29700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f65e406edd0 0x7f65e406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f65ead2b700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f65e406bf10 0x7f65e40c47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48634/0 (socket says 172.21.15.47:48634) 2024-05-08T19:22:46.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f65ead2b700 1 -- 172.21.15.47:0/777883502 learned_addr learned my addr 172.21.15.47:0/777883502 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:46.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.318+0000 7f1fd4b33700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fd0156700 0x7f1fd00c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.318+0000 7f1fd4b33700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1fd00728c0 0x7f1fd00c2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.318+0000 7f1fd4b33700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1fd00c2cb0 0x7f1fd0159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.318+0000 7f1fd4b33700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd00ac280 con 0x7f1fd00728c0 2024-05-08T19:22:46.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.318+0000 7f1fd4b33700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd00aa200 con 0x7f1fd00c2cb0 2024-05-08T19:22:46.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.318+0000 7f1fd4b33700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00a9c90 con 0x7f1fd0156700 2024-05-08T19:22:46.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f1fce59c700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fd0156700 0x7f1fd00c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f1fce59c700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fd0156700 0x7f1fd00c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:48986/0 (socket says 172.21.15.47:48986) 2024-05-08T19:22:46.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f1fce59c700 1 -- 172.21.15.47:0/216079037 learned_addr learned my addr 172.21.15.47:0/216079037 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:46.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f1fc7fff700 1 --2- 172.21.15.47:0/216079037 >> v2:172.21.15.47:3300/0 conn(0x7f1fd00728c0 0x7f1fd00c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f1fce59c700 1 -- 172.21.15.47:0/216079037 >> v2:172.21.15.177:3300/0 conn(0x7f1fd00c2cb0 msgr2=0x7f1fd0159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:46.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f1fce59c700 1 --2- 172.21.15.47:0/216079037 >> v2:172.21.15.177:3300/0 conn(0x7f1fd00c2cb0 0x7f1fd0159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f1fce59c700 1 -- 172.21.15.47:0/216079037 >> v2:172.21.15.47:3300/0 conn(0x7f1fd00728c0 msgr2=0x7f1fd00c2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:46.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f1fce59c700 1 --2- 172.21.15.47:0/216079037 >> v2:172.21.15.47:3300/0 conn(0x7f1fd00728c0 0x7f1fd00c2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f1fce59c700 1 -- 172.21.15.47:0/216079037 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd00abce0 con 0x7f1fd0156700 2024-05-08T19:22:46.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f1fce59c700 1 --2- 172.21.15.47:0/216079037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fd0156700 0x7f1fd00c1cb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1fd015d4c0 tx=0x7f1fb8009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=527d2d38e65498b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f1fcdd9b700 1 -- 172.21.15.47:0/216079037 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800b870 con 0x7f1fd0156700 2024-05-08T19:22:46.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f1fcdd9b700 1 -- 172.21.15.47:0/216079037 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb800b9d0 con 0x7f1fd0156700 2024-05-08T19:22:46.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f1fcdd9b700 1 -- 172.21.15.47:0/216079037 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800bd40 con 0x7f1fd0156700 2024-05-08T19:22:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.318+0000 7f3fb9a3c700 1 -- start start 2024-05-08T19:22:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f3fb9a3c700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3fb40aab40 0x7f3fb40ac250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f3fb9a3c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3fb40a84b0 0x7f3fb40c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f3fb9a3c700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb40c2880 con 0x7f3fb414eee0 2024-05-08T19:22:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f3fb9a3c700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb40ab450 con 0x7f3fb40aab40 2024-05-08T19:22:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f3fb9a3c700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb40c2b60 con 0x7f3fb40a84b0 2024-05-08T19:22:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f3fb37fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3fb40a84b0 0x7f3fb40c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f3fb37fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3fb40a84b0 0x7f3fb40c2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:38382/0 (socket says 172.21.15.47:38382) 2024-05-08T19:22:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f3fb37fe700 1 -- 172.21.15.47:0/3032163110 learned_addr learned my addr 172.21.15.47:0/3032163110 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.319+0000 7f3fb27fc700 1 --2- 172.21.15.47:0/3032163110 >> v2:172.21.15.47:3300/0 conn(0x7f3fb40aab40 0x7f3fb40ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f3fb37fe700 1 -- 172.21.15.47:0/3032163110 >> v2:172.21.15.47:3300/0 conn(0x7f3fb40aab40 msgr2=0x7f3fb40ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f3fb37fe700 1 --2- 172.21.15.47:0/3032163110 >> v2:172.21.15.47:3300/0 conn(0x7f3fb40aab40 0x7f3fb40ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f3fb37fe700 1 -- 172.21.15.47:0/3032163110 >> v1:172.21.15.47:6789/0 conn(0x7f3fb414eee0 legacy=0x7f3fb40a9ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T19:22:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f3fb37fe700 1 -- 172.21.15.47:0/3032163110 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb41526e0 con 0x7f3fb40a84b0 2024-05-08T19:22:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f3fb37fe700 1 --2- 172.21.15.47:0/3032163110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fb40a84b0 0x7f3fb40c2ff0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3fb406ca10 tx=0x7f3fac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9847f5dad7feb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f3fb1ffb700 1 -- 172.21.15.47:0/3032163110 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac00e070 con 0x7f3fb40a84b0 2024-05-08T19:22:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f3fb1ffb700 1 -- 172.21.15.47:0/3032163110 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac003a20 con 0x7f3fb40a84b0 2024-05-08T19:22:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.320+0000 7f3fb1ffb700 1 -- 172.21.15.47:0/3032163110 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac003dd0 con 0x7f3fb40a84b0 2024-05-08T19:22:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7f35577fe700 1 -- 172.21.15.47:0/445475086 >> v2:172.21.15.177:3300/0 conn(0x7f35580c7150 msgr2=0x7f355815c8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T19:22:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7f35577fe700 1 --2- 172.21.15.47:0/445475086 >> v2:172.21.15.177:3300/0 conn(0x7f35580c7150 0x7f355815c8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7f35577fe700 1 -- 172.21.15.47:0/445475086 >> v2:172.21.15.47:3300/0 conn(0x7f3558156520 msgr2=0x7f35580c6c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T19:22:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7f65e9528700 1 -- 172.21.15.47:0/777883502 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300915274 0 0) 0x7f65e414eb00 con 0x7f65e406e370 2024-05-08T19:22:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7fdb0bfff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fdb0c06e260 0x7fdb0c14a650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:57888/0 (socket says 172.21.15.47:57888) 2024-05-08T19:22:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7fdb0bfff700 1 -- 172.21.15.47:0/731789250 learned_addr learned my addr 172.21.15.47:0/731789250 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7f35577fe700 1 --2- 172.21.15.47:0/445475086 >> v2:172.21.15.47:3300/0 conn(0x7f3558156520 0x7f35580c6c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7f35577fe700 1 -- 172.21.15.47:0/445475086 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558159970 con 0x7f35580c52a0 2024-05-08T19:22:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7fdb10b9a700 1 --2- 172.21.15.47:0/731789250 >> v2:172.21.15.177:3300/0 conn(0x7fdb0c06d940 0x7fdb0c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7f35577fe700 1 --2- 172.21.15.47:0/445475086 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35580c52a0 0x7f355815c3a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f35580c78f0 tx=0x7f3548009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1a3eec2bc9390c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7f3556ffd700 1 -- 172.21.15.47:0/445475086 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354800b870 con 0x7f35580c52a0 2024-05-08T19:22:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7f3556ffd700 1 -- 172.21.15.47:0/445475086 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354800b9d0 con 0x7f35580c52a0 2024-05-08T19:22:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7f3556ffd700 1 -- 172.21.15.47:0/445475086 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354800bd60 con 0x7f35580c52a0 2024-05-08T19:22:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7fdb1139b700 1 --2- 172.21.15.47:0/731789250 >> v2:172.21.15.47:3300/0 conn(0x7fdb0c070670 0x7fdb0c0c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7f1fd4b33700 1 -- 172.21.15.47:0/216079037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fd0156700 msgr2=0x7f1fd00c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7f1fd4b33700 1 --2- 172.21.15.47:0/216079037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fd0156700 0x7f1fd00c1cb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1fd015d4c0 tx=0x7f1fb8009bd0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7fdb1139b700 1 -- 172.21.15.47:0/731789250 >> v2:172.21.15.177:3300/0 conn(0x7fdb0c06d940 msgr2=0x7fdb0c06dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:46.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7fdb1139b700 1 --2- 172.21.15.47:0/731789250 >> v2:172.21.15.177:3300/0 conn(0x7fdb0c06d940 0x7fdb0c06dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7fdb1139b700 1 -- 172.21.15.47:0/731789250 >> v1:172.21.15.177:6789/0 conn(0x7fdb0c06e260 legacy=0x7fdb0c14a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7fdb1139b700 1 -- 172.21.15.47:0/731789250 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c0711b0 con 0x7fdb0c070670 2024-05-08T19:22:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7f3fb9a3c700 1 -- 172.21.15.47:0/3032163110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fb40a84b0 msgr2=0x7f3fb40c2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7f3fb9a3c700 1 --2- 172.21.15.47:0/3032163110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fb40a84b0 0x7f3fb40c2ff0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3fb406ca10 tx=0x7f3fac00b330 comp rx=0 tx=0).stop 2024-05-08T19:22:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.321+0000 7f3fb9a3c700 1 -- 172.21.15.47:0/3032163110 shutdown_connections 2024-05-08T19:22:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7f3fb9a3c700 1 --2- 172.21.15.47:0/3032163110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fb40a84b0 0x7f3fb40c2ff0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7f3fb9a3c700 1 --2- 172.21.15.47:0/3032163110 >> v2:172.21.15.47:3300/0 conn(0x7f3fb40aab40 0x7f3fb40ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7f3fb9a3c700 1 -- 172.21.15.47:0/3032163110 >> 172.21.15.47:0/3032163110 conn(0x7f3fb40c3c20 msgr2=0x7f3fb40c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7f3fb9a3c700 1 -- 172.21.15.47:0/3032163110 shutdown_connections 2024-05-08T19:22:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7f3fb9a3c700 1 -- 172.21.15.47:0/3032163110 wait complete. 2024-05-08T19:22:46.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7fdb1139b700 1 --2- 172.21.15.47:0/731789250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb0c070670 0x7fdb0c0c0aa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c14e850 tx=0x7fdb0400d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f86a00560e4781 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.322+0000 7f65e9528700 1 -- 172.21.15.47:0/777883502 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65d00035b0 con 0x7f65e406e370 2024-05-08T19:22:46.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7f65e9528700 1 -- 172.21.15.47:0/777883502 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302420143 0 0) 0x7f65e40c1020 con 0x7f65e406bf10 2024-05-08T19:22:46.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7f65e9528700 1 -- 172.21.15.47:0/777883502 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65e414eb00 con 0x7f65e406bf10 2024-05-08T19:22:46.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7f65e9d29700 1 -- 172.21.15.47:0/777883502 >> v1:172.21.15.177:6789/0 conn(0x7f65e406e370 legacy=0x7f65e4072860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7f65e9d29700 1 -- 172.21.15.47:0/777883502 >> v1:172.21.15.47:6789/0 conn(0x7f65e406bf10 legacy=0x7f65e40c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7f65e9d29700 1 -- 172.21.15.47:0/777883502 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40c6190 con 0x7f65e406edd0 2024-05-08T19:22:46.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7f65e9d29700 1 --2- 172.21.15.47:0/777883502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65e406edd0 0x7f65e406b9d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009840 tx=0x7f65d4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5ab678d798cc310 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7fdb0b7fe700 1 -- 172.21.15.47:0/731789250 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04003a20 con 0x7fdb0c070670 2024-05-08T19:22:46.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7fdb0b7fe700 1 -- 172.21.15.47:0/731789250 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb04003b80 con 0x7fdb0c070670 2024-05-08T19:22:46.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7fdb0b7fe700 1 -- 172.21.15.47:0/731789250 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400d9a0 con 0x7fdb0c070670 2024-05-08T19:22:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7f355e962700 1 -- 172.21.15.47:0/445475086 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35580c52a0 msgr2=0x7f355815c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7f355e962700 1 --2- 172.21.15.47:0/445475086 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35580c52a0 0x7f355815c3a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f35580c78f0 tx=0x7f3548009bd0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7f3fb9a3c700 1 Processor -- start 2024-05-08T19:22:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7f355e962700 1 -- 172.21.15.47:0/445475086 shutdown_connections 2024-05-08T19:22:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.324+0000 7f355e962700 1 --2- 172.21.15.47:0/445475086 >> v2:172.21.15.177:3300/0 conn(0x7f35580c7150 0x7f355815c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.324+0000 7f355e962700 1 --2- 172.21.15.47:0/445475086 >> v2:172.21.15.47:3300/0 conn(0x7f3558156520 0x7f35580c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.324+0000 7f355e962700 1 --2- 172.21.15.47:0/445475086 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35580c52a0 0x7f355815c3a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.324+0000 7f355e962700 1 -- 172.21.15.47:0/445475086 >> 172.21.15.47:0/445475086 conn(0x7f35580abef0 msgr2=0x7f35580ac300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.324+0000 7f355e962700 1 -- 172.21.15.47:0/445475086 shutdown_connections 2024-05-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.324+0000 7fdb12dfe700 1 -- 172.21.15.47:0/731789250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb0c070670 msgr2=0x7fdb0c0c0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.324+0000 7fdb12dfe700 1 --2- 172.21.15.47:0/731789250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb0c070670 0x7fdb0c0c0aa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c14e850 tx=0x7fdb0400d330 comp rx=0 tx=0).stop 2024-05-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7fdb12dfe700 1 -- 172.21.15.47:0/731789250 shutdown_connections 2024-05-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7fdb12dfe700 1 --2- 172.21.15.47:0/731789250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb0c070670 0x7fdb0c0c0aa0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7fdb12dfe700 1 --2- 172.21.15.47:0/731789250 >> v2:172.21.15.177:3300/0 conn(0x7fdb0c06d940 0x7fdb0c06dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7fdb12dfe700 1 -- 172.21.15.47:0/731789250 >> 172.21.15.47:0/731789250 conn(0x7fdb0c06a9c0 msgr2=0x7fdb0c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7fdb12dfe700 1 -- 172.21.15.47:0/731789250 shutdown_connections 2024-05-08T19:22:46.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7fdb12dfe700 1 -- 172.21.15.47:0/731789250 wait complete. 2024-05-08T19:22:46.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.327+0000 7fdb12dfe700 1 Processor -- start 2024-05-08T19:22:46.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.324+0000 7f355e962700 1 -- 172.21.15.47:0/445475086 wait complete. 2024-05-08T19:22:46.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7f355e962700 1 Processor -- start 2024-05-08T19:22:46.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7f65e9528700 1 -- 172.21.15.47:0/777883502 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d4011830 con 0x7f65e406edd0 2024-05-08T19:22:46.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7f65e9528700 1 -- 172.21.15.47:0/777883502 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d4011990 con 0x7f65e406edd0 2024-05-08T19:22:46.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.323+0000 7f65e9528700 1 -- 172.21.15.47:0/777883502 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d4011d20 con 0x7f65e406edd0 2024-05-08T19:22:46.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.324+0000 7f65ec78e700 1 -- 172.21.15.47:0/777883502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65e406edd0 msgr2=0x7f65e406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.324+0000 7f65ec78e700 1 --2- 172.21.15.47:0/777883502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65e406edd0 0x7f65e406b9d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009840 tx=0x7f65d4009b50 comp rx=0 tx=0).stop 2024-05-08T19:22:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f65ec78e700 1 -- 172.21.15.47:0/777883502 shutdown_connections 2024-05-08T19:22:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f65ec78e700 1 --2- 172.21.15.47:0/777883502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65e406edd0 0x7f65e406b9d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f65ec78e700 1 -- 172.21.15.47:0/777883502 >> 172.21.15.47:0/777883502 conn(0x7f65e40c33d0 msgr2=0x7f65e40c37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f65ec78e700 1 -- 172.21.15.47:0/777883502 shutdown_connections 2024-05-08T19:22:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f65ec78e700 1 -- 172.21.15.47:0/777883502 wait complete. 2024-05-08T19:22:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.327+0000 7f65ec78e700 1 Processor -- start 2024-05-08T19:22:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7fb3509af700 1 Processor -- start 2024-05-08T19:22:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7fb3509af700 1 -- start start 2024-05-08T19:22:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7fb3509af700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb34c0af8f0 0x7fb34c0c7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7fb3509af700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb34c06d490 0x7fb34c154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7fb3509af700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c158a80 con 0x7fb34c0bd930 2024-05-08T19:22:46.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7fb3509af700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c0b0300 con 0x7fb34c06d490 2024-05-08T19:22:46.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7fb3509af700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c0c8560 con 0x7fb34c0af8f0 2024-05-08T19:22:46.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7fb34a59c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb34c0af8f0 0x7fb34c0c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7fb34a59c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb34c0af8f0 0x7fb34c0c7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:38430/0 (socket says 172.21.15.47:38430) 2024-05-08T19:22:46.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7fb34a59c700 1 -- 172.21.15.47:0/2389910869 learned_addr learned my addr 172.21.15.47:0/2389910869 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:46.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.327+0000 7fb34a59c700 1 -- 172.21.15.47:0/2389910869 >> v2:172.21.15.47:3300/0 conn(0x7fb34c06d490 msgr2=0x7fb34c154ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T19:22:46.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.327+0000 7fb34a59c700 1 --2- 172.21.15.47:0/2389910869 >> v2:172.21.15.47:3300/0 conn(0x7fb34c06d490 0x7fb34c154ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.327+0000 7fb34a59c700 1 -- 172.21.15.47:0/2389910869 >> v1:172.21.15.177:6789/0 conn(0x7fb34c0bd930 legacy=0x7fb34c1548e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T19:22:46.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.327+0000 7fb34a59c700 1 -- 172.21.15.47:0/2389910869 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c0c4cc0 con 0x7fb34c0af8f0 2024-05-08T19:22:46.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f1fd4b33700 1 -- 172.21.15.47:0/216079037 shutdown_connections 2024-05-08T19:22:46.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f1fd4b33700 1 --2- 172.21.15.47:0/216079037 >> v2:172.21.15.177:3300/0 conn(0x7f1fd00c2cb0 0x7f1fd0159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f1fd4b33700 1 --2- 172.21.15.47:0/216079037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fd0156700 0x7f1fd00c1cb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f1fd4b33700 1 --2- 172.21.15.47:0/216079037 >> v2:172.21.15.47:3300/0 conn(0x7f1fd00728c0 0x7f1fd00c2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f1fd4b33700 1 -- 172.21.15.47:0/216079037 >> 172.21.15.47:0/216079037 conn(0x7f1fd00c3c20 msgr2=0x7f1fd00c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.324+0000 7f3fb9a3c700 1 -- start start 2024-05-08T19:22:46.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.324+0000 7f3fb9a3c700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fb40a84b0 0x7f3fb4150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.324+0000 7f3fb9a3c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fb40aab40 0x7f3fb40c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f3fb9a3c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fb414eee0 0x7f3fb4138970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f3fb9a3c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb406ecf0 con 0x7f3fb414eee0 2024-05-08T19:22:46.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f3fb9a3c700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb41502f0 con 0x7f3fb40aab40 2024-05-08T19:22:46.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f3fb9a3c700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb406e070 con 0x7f3fb40a84b0 2024-05-08T19:22:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f3fb2ffd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fb40a84b0 0x7f3fb4150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f3fb2ffd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fb40a84b0 0x7f3fb4150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:49000/0 (socket says 172.21.15.47:49000) 2024-05-08T19:22:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f3fb27fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fb40aab40 0x7f3fb40c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f3fb2ffd700 1 -- 172.21.15.47:0/1931639353 learned_addr learned my addr 172.21.15.47:0/1931639353 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f3fb37fe700 1 --2- 172.21.15.47:0/1931639353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fb414eee0 0x7f3fb4138970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f3fb27fc700 1 -- 172.21.15.47:0/1931639353 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fb40a84b0 msgr2=0x7f3fb4150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f3fb27fc700 1 --2- 172.21.15.47:0/1931639353 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fb40a84b0 0x7f3fb4150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f3fb27fc700 1 -- 172.21.15.47:0/1931639353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fb414eee0 msgr2=0x7f3fb4138970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f3fb27fc700 1 --2- 172.21.15.47:0/1931639353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fb414eee0 0x7f3fb4138970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.325+0000 7f3fb27fc700 1 -- 172.21.15.47:0/1931639353 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac009b30 con 0x7f3fb40aab40 2024-05-08T19:22:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7f3fb27fc700 1 --2- 172.21.15.47:0/1931639353 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fb40aab40 0x7f3fb40c51c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400e8d0 tx=0x7f3fa400ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7f3f9bfff700 1 -- 172.21.15.47:0/1931639353 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4013680 con 0x7f3fb40aab40 2024-05-08T19:22:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7f3f9bfff700 1 -- 172.21.15.47:0/1931639353 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa40137e0 con 0x7f3fb40aab40 2024-05-08T19:22:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7f3f9bfff700 1 -- 172.21.15.47:0/1931639353 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4013b70 con 0x7f3fb40aab40 2024-05-08T19:22:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7f3fb9a3c700 1 -- 172.21.15.47:0/1931639353 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb406e350 con 0x7f3fb40aab40 2024-05-08T19:22:46.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.326+0000 7f3fb9a3c700 1 -- 172.21.15.47:0/1931639353 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb406e910 con 0x7f3fb40aab40 2024-05-08T19:22:46.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.327+0000 7f65ec78e700 1 -- start start 2024-05-08T19:22:46.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.327+0000 7f1fd4b33700 1 -- 172.21.15.47:0/216079037 shutdown_connections 2024-05-08T19:22:46.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.328+0000 7f65ec78e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65e406bf10 0x7f65e41f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.328+0000 7f65ec78e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65e406e370 0x7f65e41f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.328+0000 7f65ec78e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65e406edd0 0x7f65e41db4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.328+0000 7f65ec78e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e41dfb90 con 0x7f65e406e370 2024-05-08T19:22:46.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.328+0000 7f65ec78e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e41fb740 con 0x7f65e406edd0 2024-05-08T19:22:46.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.328+0000 7f65ec78e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e41da700 con 0x7f65e406bf10 2024-05-08T19:22:46.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.328+0000 7f3f9bfff700 1 -- 172.21.15.47:0/1931639353 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3fa4013cd0 con 0x7f3fb40aab40 2024-05-08T19:22:46.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.328+0000 7f3fb9a3c700 1 -- 172.21.15.47:0/1931639353 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f940052f0 con 0x7f3fb40aab40 2024-05-08T19:22:46.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7fb34a59c700 1 --2- 172.21.15.47:0/2389910869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb34c0af8f0 0x7fb34c0c7230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0ace70 tx=0x7fb340009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab0c7b9e54e093f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7f65e9d29700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65e406e370 0x7f65e41f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7f65e9d29700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65e406e370 0x7f65e41f4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35950/0 (socket says 172.21.15.47:35950) 2024-05-08T19:22:46.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7f65e9d29700 1 -- 172.21.15.47:0/3687403852 learned_addr learned my addr 172.21.15.47:0/3687403852 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:46.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7f1fd4b33700 1 -- 172.21.15.47:0/216079037 wait complete. 2024-05-08T19:22:46.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7f65ea52a700 1 --2- 172.21.15.47:0/3687403852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65e406bf10 0x7f65e41f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.328+0000 7fdb12dfe700 1 -- start start 2024-05-08T19:22:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7fdb12dfe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb0c06d940 0x7fdb0c0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7fdb12dfe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb0c070670 0x7fdb0c0a9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7fdb12dfe700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb0c0abd70 0x7fdb0c0c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7fdb12dfe700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c146540 con 0x7fdb0c070670 2024-05-08T19:22:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7fdb12dfe700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c0c53a0 con 0x7fdb0c06d940 2024-05-08T19:22:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7fdb12dfe700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c0c5d50 con 0x7fdb0c0abd70 2024-05-08T19:22:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7fdb1139b700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb0c0abd70 0x7fdb0c0c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7fdb10b9a700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb0c06d940 0x7fdb0c0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7fdb1139b700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb0c0abd70 0x7fdb0c0c3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:49024/0 (socket says 172.21.15.47:49024) 2024-05-08T19:22:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7fdb0bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb0c070670 0x7fdb0c0a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7fdb1139b700 1 -- 172.21.15.47:0/1007295458 learned_addr learned my addr 172.21.15.47:0/1007295458 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:46.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7f65ead2b700 1 --2- 172.21.15.47:0/3687403852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65e406edd0 0x7f65e41db4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7fb34959a700 1 -- 172.21.15.47:0/2389910869 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340004230 con 0x7fb34c0af8f0 2024-05-08T19:22:46.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7fb34959a700 1 -- 172.21.15.47:0/2389910869 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb340004390 con 0x7fb34c0af8f0 2024-05-08T19:22:46.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7fb34959a700 1 -- 172.21.15.47:0/2389910869 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400036a0 con 0x7fb34c0af8f0 2024-05-08T19:22:46.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7f3f9bfff700 1 --2- 172.21.15.47:0/1931639353 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3fa006ad60 0x7f3fa006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7f3f9bfff700 1 -- 172.21.15.47:0/1931639353 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3fa4089430 con 0x7f3fb40aab40 2024-05-08T19:22:46.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.329+0000 7f3fb2ffd700 1 --2- 172.21.15.47:0/1931639353 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3fa006ad60 0x7f3fa006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7fb3509af700 1 -- 172.21.15.47:0/2389910869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb34c0af8f0 msgr2=0x7fb34c0c7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7fb3509af700 1 --2- 172.21.15.47:0/2389910869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb34c0af8f0 0x7fb34c0c7230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0ace70 tx=0x7fb340009bd0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7f3fb2ffd700 1 --2- 172.21.15.47:0/1931639353 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3fa006ad60 0x7f3fa006d220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009a80 tx=0x7f3fa8009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7f65ea52a700 1 -- 172.21.15.47:0/3687403852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65e406edd0 msgr2=0x7f65e41db4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7f65ea52a700 1 --2- 172.21.15.47:0/3687403852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65e406edd0 0x7f65e41db4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7f65ea52a700 1 -- 172.21.15.47:0/3687403852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65e406e370 msgr2=0x7f65e41f4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7f65ea52a700 1 --2- 172.21.15.47:0/3687403852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65e406e370 0x7f65e41f4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7f65ea52a700 1 -- 172.21.15.47:0/3687403852 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d40094a0 con 0x7f65e406bf10 2024-05-08T19:22:46.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7fb3509af700 1 -- 172.21.15.47:0/2389910869 shutdown_connections 2024-05-08T19:22:46.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7fb3509af700 1 --2- 172.21.15.47:0/2389910869 >> v2:172.21.15.47:3300/0 conn(0x7fb34c06d490 0x7fb34c154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7fb3509af700 1 --2- 172.21.15.47:0/2389910869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb34c0af8f0 0x7fb34c0c7230 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7fb3509af700 1 -- 172.21.15.47:0/2389910869 >> 172.21.15.47:0/2389910869 conn(0x7fb34c072510 msgr2=0x7fb34c072920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7fb3509af700 1 -- 172.21.15.47:0/2389910869 shutdown_connections 2024-05-08T19:22:46.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.331+0000 7f1fd4b33700 1 Processor -- start 2024-05-08T19:22:46.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.331+0000 7f65ea52a700 1 --2- 172.21.15.47:0/3687403852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65e406bf10 0x7f65e41f4610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f65e000c4d0 tx=0x7f65e000c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7f355e962700 1 -- start start 2024-05-08T19:22:46.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.331+0000 7f355e962700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35580c7150 0x7f35581fa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.331+0000 7f355e962700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3558156520 0x7f355815c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.331+0000 7f355e962700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3558155430 0x7f355815cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.331+0000 7f355e962700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355815ac40 con 0x7f35580c7150 2024-05-08T19:22:46.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.331+0000 7f355e962700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355815d2a0 con 0x7f3558155430 2024-05-08T19:22:46.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.331+0000 7f355e962700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35581fb140 con 0x7f3558156520 2024-05-08T19:22:46.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f355ceff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3558155430 0x7f355815cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f355ceff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3558155430 0x7f355815cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:38458/0 (socket says 172.21.15.47:38458) 2024-05-08T19:22:46.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f355ceff700 1 -- 172.21.15.47:0/1800952859 learned_addr learned my addr 172.21.15.47:0/1800952859 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:46.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7fdb0bfff700 1 -- 172.21.15.47:0/1007295458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb0c0abd70 msgr2=0x7fdb0c0c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7fdb0bfff700 1 --2- 172.21.15.47:0/1007295458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb0c0abd70 0x7fdb0c0c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7fdb0bfff700 1 -- 172.21.15.47:0/1007295458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb0c06d940 msgr2=0x7fdb0c0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7fdb0bfff700 1 --2- 172.21.15.47:0/1007295458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb0c06d940 0x7fdb0c0c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7fdb0bfff700 1 -- 172.21.15.47:0/1007295458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0400bc80 con 0x7fdb0c070670 2024-05-08T19:22:46.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.331+0000 7fdb0bfff700 1 --2- 172.21.15.47:0/1007295458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb0c070670 0x7fdb0c0a9510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800c8e0 tx=0x7fdaf800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f3557fff700 1 --2- 172.21.15.47:0/1800952859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35580c7150 0x7f35581fa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f355ceff700 1 -- 172.21.15.47:0/1800952859 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3558156520 msgr2=0x7f355815c820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T19:22:46.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f355ceff700 1 --2- 172.21.15.47:0/1800952859 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3558156520 0x7f355815c820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f355ceff700 1 -- 172.21.15.47:0/1800952859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35580c7150 msgr2=0x7f35581fa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f355ceff700 1 --2- 172.21.15.47:0/1800952859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35580c7150 0x7f35581fa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f355ceff700 1 -- 172.21.15.47:0/1800952859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3548009550 con 0x7f3558155430 2024-05-08T19:22:46.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.330+0000 7fb3509af700 1 -- 172.21.15.47:0/2389910869 wait complete. 2024-05-08T19:22:46.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.331+0000 7f1fd4b33700 1 -- start start 2024-05-08T19:22:46.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f1fd4b33700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fd00728c0 0x7f1fd00c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f1fd4b33700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fd00c2cb0 0x7f1fd014e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f1fd4b33700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fd0156700 0x7f1fd00c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f1fd4b33700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00c6e90 con 0x7f1fd00728c0 2024-05-08T19:22:46.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7fb3509af700 1 Processor -- start 2024-05-08T19:22:46.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f1fd4b33700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd01ee450 con 0x7f1fd00c2cb0 2024-05-08T19:22:46.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f1fd4b33700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd0072020 con 0x7f1fd0156700 2024-05-08T19:22:46.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.333+0000 7f355ceff700 1 --2- 172.21.15.47:0/1800952859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3558155430 0x7f355815cd60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f355000b780 tx=0x7f355000bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.333+0000 7fb3509af700 1 -- start start 2024-05-08T19:22:46.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.333+0000 7f1fce59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fd00728c0 0x7f1fd00c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.333+0000 7f1fce59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fd00728c0 0x7f1fd00c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35974/0 (socket says 172.21.15.47:35974) 2024-05-08T19:22:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.333+0000 7f1fce59c700 1 -- 172.21.15.47:0/3851518365 learned_addr learned my addr 172.21.15.47:0/3851518365 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.331+0000 7f65daffd700 1 -- 172.21.15.47:0/3687403852 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00052d0 con 0x7f65e406bf10 2024-05-08T19:22:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f65daffd700 1 -- 172.21.15.47:0/3687403852 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e0005430 con 0x7f65e406bf10 2024-05-08T19:22:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.332+0000 7f65daffd700 1 -- 172.21.15.47:0/3687403852 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00038c0 con 0x7f65e406bf10 2024-05-08T19:22:46.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.333+0000 7f1fced9d700 1 --2- 172.21.15.47:0/3851518365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fd0156700 0x7f1fd00c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.333+0000 7f1fc7fff700 1 --2- 172.21.15.47:0/3851518365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fd00c2cb0 0x7f1fd014e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.333+0000 7f65ec78e700 1 -- 172.21.15.47:0/3687403852 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e41da9e0 con 0x7f65e406bf10 2024-05-08T19:22:46.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.333+0000 7f65ec78e700 1 -- 172.21.15.47:0/3687403852 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e41dafa0 con 0x7f65e406bf10 2024-05-08T19:22:46.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.333+0000 7f1fce59c700 1 -- 172.21.15.47:0/3851518365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fd0156700 msgr2=0x7f1fd00c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.333+0000 7f1fce59c700 1 --2- 172.21.15.47:0/3851518365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fd0156700 0x7f1fd00c4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.333+0000 7f1fce59c700 1 -- 172.21.15.47:0/3851518365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fd00c2cb0 msgr2=0x7f1fd014e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.333+0000 7f1fce59c700 1 --2- 172.21.15.47:0/3851518365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fd00c2cb0 0x7f1fd014e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.333+0000 7f1fce59c700 1 -- 172.21.15.47:0/3851518365 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb8009550 con 0x7f1fd00728c0 2024-05-08T19:22:46.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.334+0000 7fdb097fa700 1 -- 172.21.15.47:0/1007295458 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf800e8c0 con 0x7fdb0c070670 2024-05-08T19:22:46.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.334+0000 7fdb097fa700 1 -- 172.21.15.47:0/1007295458 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf800ea20 con 0x7fdb0c070670 2024-05-08T19:22:46.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.334+0000 7fdb097fa700 1 -- 172.21.15.47:0/1007295458 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf800ed90 con 0x7fdb0c070670 2024-05-08T19:22:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.334+0000 7fb3509af700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb34c06d490 0x7fb34c0c3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.334+0000 7fb3509af700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34c0af8f0 0x7fb34c1541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.334+0000 7fb3509af700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb34c0bd930 0x7fb34c1546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.334+0000 7fb3509af700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c153d50 con 0x7fb34c0af8f0 2024-05-08T19:22:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.334+0000 7fb3509af700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0a9d20 con 0x7fb34c0bd930 2024-05-08T19:22:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.334+0000 7fb3509af700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0a9f90 con 0x7fb34c06d490 2024-05-08T19:22:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.334+0000 7fb34ad9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb34c0bd930 0x7fb34c1546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.334+0000 7fb34ad9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb34c0bd930 0x7fb34c1546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:38478/0 (socket says 172.21.15.47:38478) 2024-05-08T19:22:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.334+0000 7fb34ad9d700 1 -- 172.21.15.47:0/4029749428 learned_addr learned my addr 172.21.15.47:0/4029749428 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7fb34a59c700 1 --2- 172.21.15.47:0/4029749428 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb34c06d490 0x7fb34c0c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.334+0000 7fdb12dfe700 1 -- 172.21.15.47:0/1007295458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c06ce50 con 0x7fdb0c070670 2024-05-08T19:22:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.334+0000 7fdb12dfe700 1 -- 172.21.15.47:0/1007295458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c148c00 con 0x7fdb0c070670 2024-05-08T19:22:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.333+0000 7f1fce59c700 1 --2- 172.21.15.47:0/3851518365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fd00728c0 0x7f1fd00c64b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8000c00 tx=0x7f1fb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7fb34ad9d700 1 -- 172.21.15.47:0/4029749428 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb34c06d490 msgr2=0x7fb34c0c3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7fb34ad9d700 1 --2- 172.21.15.47:0/4029749428 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb34c06d490 0x7fb34c0c3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7fb34ad9d700 1 -- 172.21.15.47:0/4029749428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34c0af8f0 msgr2=0x7fb34c1541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7fb34ad9d700 1 --2- 172.21.15.47:0/4029749428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34c0af8f0 0x7fb34c1541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7fb34ad9d700 1 -- 172.21.15.47:0/4029749428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb340009550 con 0x7fb34c0bd930 2024-05-08T19:22:46.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7f3f9bfff700 1 -- 172.21.15.47:0/1931639353 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3fa4054390 con 0x7f3fb40aab40 2024-05-08T19:22:46.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7fdb12dfe700 1 -- 172.21.15.47:0/1007295458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaec0052f0 con 0x7fdb0c070670 2024-05-08T19:22:46.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7f3554ff9700 1 -- 172.21.15.47:0/1800952859 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000f840 con 0x7f3558155430 2024-05-08T19:22:46.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7f3554ff9700 1 -- 172.21.15.47:0/1800952859 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355000f9a0 con 0x7f3558155430 2024-05-08T19:22:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7f355e962700 1 -- 172.21.15.47:0/1800952859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f355815a860 con 0x7f3558155430 2024-05-08T19:22:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.336+0000 7f355e962700 1 -- 172.21.15.47:0/1800952859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35580c14b0 con 0x7f3558155430 2024-05-08T19:22:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.336+0000 7f3554ff9700 1 -- 172.21.15.47:0/1800952859 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000fd50 con 0x7f3558155430 2024-05-08T19:22:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.338+0000 7f355e962700 1 -- 172.21.15.47:0/1800952859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355815ad80 con 0x7f3558155430 2024-05-08T19:22:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.334+0000 7f65ec78e700 1 -- 172.21.15.47:0/3687403852 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e4070e90 con 0x7f65e406bf10 2024-05-08T19:22:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.336+0000 7f65daffd700 1 -- 172.21.15.47:0/3687403852 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f65e0003a20 con 0x7f65e406bf10 2024-05-08T19:22:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.337+0000 7f65daffd700 1 --2- 172.21.15.47:0/3687403852 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f65c806ad60 0x7f65c806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.337+0000 7f65daffd700 1 -- 172.21.15.47:0/3687403852 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f65e0088b40 con 0x7f65e406bf10 2024-05-08T19:22:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.339+0000 7f65e9d29700 1 --2- 172.21.15.47:0/3687403852 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f65c806ad60 0x7f65c806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7fb34ad9d700 1 --2- 172.21.15.47:0/4029749428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb34c0bd930 0x7fb34c1546e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb34400b970 tx=0x7fb34400bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7fb33affd700 1 -- 172.21.15.47:0/4029749428 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34400c9b0 con 0x7fb34c0bd930 2024-05-08T19:22:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7fb33affd700 1 -- 172.21.15.47:0/4029749428 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34400cb30 con 0x7fb34c0bd930 2024-05-08T19:22:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7fb33affd700 1 -- 172.21.15.47:0/4029749428 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344014440 con 0x7fb34c0bd930 2024-05-08T19:22:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.337+0000 7fb3509af700 1 -- 172.21.15.47:0/4029749428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c0aa270 con 0x7fb34c0bd930 2024-05-08T19:22:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.337+0000 7fb3509af700 1 -- 172.21.15.47:0/4029749428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c0acbc0 con 0x7fb34c0bd930 2024-05-08T19:22:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.338+0000 7fb3509af700 1 -- 172.21.15.47:0/4029749428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34c153ec0 con 0x7fb34c0bd930 2024-05-08T19:22:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7f1fc6ffd700 1 -- 172.21.15.47:0/3851518365 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb801a900 con 0x7f1fd00728c0 2024-05-08T19:22:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7f1fc6ffd700 1 -- 172.21.15.47:0/3851518365 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb801f070 con 0x7f1fd00728c0 2024-05-08T19:22:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7f1fc6ffd700 1 -- 172.21.15.47:0/3851518365 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb801aca0 con 0x7f1fd00728c0 2024-05-08T19:22:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.335+0000 7f1fd4b33700 1 -- 172.21.15.47:0/3851518365 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd00c6bb0 con 0x7f1fd00728c0 2024-05-08T19:22:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.336+0000 7f1fd4b33700 1 -- 172.21.15.47:0/3851518365 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd01ee940 con 0x7f1fd00728c0 2024-05-08T19:22:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.337+0000 7f1fd4b33700 1 -- 172.21.15.47:0/3851518365 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd004ec60 con 0x7f1fd00728c0 2024-05-08T19:22:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.338+0000 7f1fc6ffd700 1 -- 172.21.15.47:0/3851518365 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1fb8026480 con 0x7f1fd00728c0 2024-05-08T19:22:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.340+0000 7fb33affd700 1 -- 172.21.15.47:0/4029749428 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb34401d3b0 con 0x7fb34c0bd930 2024-05-08T19:22:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.341+0000 7fb33affd700 1 --2- 172.21.15.47:0/4029749428 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb32c06ad60 0x7fb32c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.341+0000 7fb33affd700 1 -- 172.21.15.47:0/4029749428 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb3440898b0 con 0x7fb34c0bd930 2024-05-08T19:22:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.341+0000 7fb34a59c700 1 --2- 172.21.15.47:0/4029749428 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb32c06ad60 0x7fb32c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.342+0000 7f65daffd700 1 -- 172.21.15.47:0/3687403852 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f65e4070e90 con 0x7f65e406bf10 2024-05-08T19:22:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.342+0000 7f65e9d29700 1 --2- 172.21.15.47:0/3687403852 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f65c806ad60 0x7f65c806d220 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f65e406b160 tx=0x7f65d401c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.342+0000 7fb34a59c700 1 --2- 172.21.15.47:0/4029749428 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb32c06ad60 0x7fb32c06d220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb340000c00 tx=0x7fb340008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.339+0000 7fdb097fa700 1 -- 172.21.15.47:0/1007295458 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdaf8016420 con 0x7fdb0c070670 2024-05-08T19:22:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.340+0000 7fdb097fa700 1 --2- 172.21.15.47:0/1007295458 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fdaf006ace0 0x7fdaf006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.338+0000 7f1fc6ffd700 1 --2- 172.21.15.47:0/3851518365 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1fb006ac90 0x7f1fb006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.339+0000 7f1fc6ffd700 1 -- 172.21.15.47:0/3851518365 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1fb8021070 con 0x7f1fd00728c0 2024-05-08T19:22:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.339+0000 7f1fc7fff700 1 --2- 172.21.15.47:0/3851518365 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1fb006ac90 0x7f1fb006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.339+0000 7f1fc7fff700 1 --2- 172.21.15.47:0/3851518365 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1fb006ac90 0x7f1fb006d150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1fd014f020 tx=0x7f1fc0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.343+0000 7f3554ff9700 1 -- 172.21.15.47:0/1800952859 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3550017400 con 0x7f3558155430 2024-05-08T19:22:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.343+0000 7f3554ff9700 1 --2- 172.21.15.47:0/1800952859 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f354406ace0 0x7f354406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.343+0000 7f3554ff9700 1 -- 172.21.15.47:0/1800952859 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3550089a20 con 0x7f3558155430 2024-05-08T19:22:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.344+0000 7fb33affd700 1 -- 172.21.15.47:0/4029749428 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb344054780 con 0x7fb34c0bd930 2024-05-08T19:22:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.345+0000 7f3557fff700 1 --2- 172.21.15.47:0/1800952859 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f354406ace0 0x7f354406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.345+0000 7f3557fff700 1 --2- 172.21.15.47:0/1800952859 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f354406ace0 0x7f354406d1a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f354c009870 tx=0x7f354c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.348+0000 7f3554ff9700 1 -- 172.21.15.47:0/1800952859 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f355815ad80 con 0x7f3558155430 2024-05-08T19:22:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.352+0000 7fdb10b9a700 1 --2- 172.21.15.47:0/1007295458 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fdaf006ace0 0x7fdaf006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:46.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.353+0000 7f1fc6ffd700 1 -- 172.21.15.47:0/3851518365 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1fb8055d20 con 0x7f1fd00728c0 2024-05-08T19:22:46.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.353+0000 7fdb097fa700 1 -- 172.21.15.47:0/1007295458 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdaf8012070 con 0x7fdb0c070670 2024-05-08T19:22:46.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.353+0000 7fdb097fa700 1 -- 172.21.15.47:0/1007295458 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdaf808e060 con 0x7fdb0c070670 2024-05-08T19:22:46.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.387+0000 7fdb10b9a700 1 --2- 172.21.15.47:0/1007295458 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fdaf006ace0 0x7fdaf006d1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdb00007fd0 tx=0x7fdb00009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:46.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.687+0000 7f0fb1d81700 1 -- 172.21.15.47:0/1972387832 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0fac143a40 con 0x7f0f94005280 2024-05-08T19:22:46.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.688+0000 7f0f9bfff700 1 -- 172.21.15.47:0/1972387832 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0fa4057f30 con 0x7f0f94005280 2024-05-08T19:22:46.680 INFO:teuthology.orchestra.run.smithi047.stdout:55834574855 2024-05-08T19:22:46.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.691+0000 7f0fb1d81700 1 -- 172.21.15.47:0/1972387832 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0f9008ccf0 msgr2=0x7f0f9008f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.692+0000 7f0fb1d81700 1 --2- 172.21.15.47:0/1972387832 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0f9008ccf0 0x7f0f9008f1b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0ab680 tx=0x7f0fa000a320 comp rx=0 tx=0).stop 2024-05-08T19:22:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.692+0000 7f0fb1d81700 1 -- 172.21.15.47:0/1972387832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f94005280 msgr2=0x7f0fac0abe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.692+0000 7f0fb1d81700 1 --2- 172.21.15.47:0/1972387832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f94005280 0x7f0fac0abe10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4008ab0 tx=0x7f0fa4008e70 comp rx=0 tx=0).stop 2024-05-08T19:22:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.692+0000 7f0fb1d81700 1 -- 172.21.15.47:0/1972387832 shutdown_connections 2024-05-08T19:22:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.692+0000 7f0fb1d81700 1 --2- 172.21.15.47:0/1972387832 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0f9008ccf0 0x7f0f9008f1b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.692+0000 7f0fb1d81700 1 --2- 172.21.15.47:0/1972387832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fac0c5490 0x7f0fac0c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.692+0000 7f0fb1d81700 1 --2- 172.21.15.47:0/1972387832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f94005280 0x7f0fac0abe10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.692+0000 7f0fb1d81700 1 --2- 172.21.15.47:0/1972387832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fac1434f0 0x7f0fac142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.692+0000 7f0fb1d81700 1 -- 172.21.15.47:0/1972387832 >> 172.21.15.47:0/1972387832 conn(0x7f0fac06a9c0 msgr2=0x7f0fac0c1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.692+0000 7f0fb1d81700 1 -- 172.21.15.47:0/1972387832 shutdown_connections 2024-05-08T19:22:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.692+0000 7f0fb1d81700 1 -- 172.21.15.47:0/1972387832 wait complete. 2024-05-08T19:22:46.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2024-05-08T19:22:46.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.716+0000 7ffbc8f56700 1 -- 172.21.15.47:0/1170541631 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ffbc413f7b0 con 0x7ffbc413f240 2024-05-08T19:22:46.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.717+0000 7ffbb2ffd700 1 -- 172.21.15.47:0/1170541631 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffbb4018070 con 0x7ffbc413f240 2024-05-08T19:22:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-05-08T19:22:46.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.722+0000 7ffbc8f56700 1 -- 172.21.15.47:0/1170541631 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ffba406ad60 msgr2=0x7ffba406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.722+0000 7ffbc8f56700 1 --2- 172.21.15.47:0/1170541631 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ffba406ad60 0x7ffba406d220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40c2b70 tx=0x7ffbb8008040 comp rx=0 tx=0).stop 2024-05-08T19:22:46.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.722+0000 7ffbc8f56700 1 -- 172.21.15.47:0/1170541631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbc413f240 msgr2=0x7ffbc4154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.722+0000 7ffbc8f56700 1 --2- 172.21.15.47:0/1170541631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbc413f240 0x7ffbc4154980 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400caa0 tx=0x7ffbb400cdb0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.722+0000 7ffbc8f56700 1 -- 172.21.15.47:0/1170541631 shutdown_connections 2024-05-08T19:22:46.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.722+0000 7ffbc8f56700 1 --2- 172.21.15.47:0/1170541631 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ffba406ad60 0x7ffba406d220 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.722+0000 7ffbc8f56700 1 --2- 172.21.15.47:0/1170541631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbc40c4ef0 0x7ffbc40c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.722+0000 7ffbc8f56700 1 --2- 172.21.15.47:0/1170541631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbac004200 0x7ffbc41e9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.722+0000 7ffbc8f56700 1 --2- 172.21.15.47:0/1170541631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffbc413f240 0x7ffbc4154980 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.722+0000 7ffbc8f56700 1 -- 172.21.15.47:0/1170541631 >> 172.21.15.47:0/1170541631 conn(0x7ffbc406a9c0 msgr2=0x7ffbc41443a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.723+0000 7ffbc8f56700 1 -- 172.21.15.47:0/1170541631 shutdown_connections 2024-05-08T19:22:46.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.723+0000 7ffbc8f56700 1 -- 172.21.15.47:0/1170541631 wait complete. 2024-05-08T19:22:46.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-05-08T19:22:46.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.750+0000 7fb3509af700 1 -- 172.21.15.47:0/4029749428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb34c0aa400 con 0x7fb34c0bd930 2024-05-08T19:22:46.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.750+0000 7fb33affd700 1 -- 172.21.15.47:0/4029749428 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb344019020 con 0x7fb34c0bd930 2024-05-08T19:22:46.742 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-05-08T19:22:46.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.752+0000 7fb3509af700 1 -- 172.21.15.47:0/4029749428 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb32c06ad60 msgr2=0x7fb32c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.752+0000 7fb3509af700 1 --2- 172.21.15.47:0/4029749428 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb32c06ad60 0x7fb32c06d220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb340000c00 tx=0x7fb340008030 comp rx=0 tx=0).stop 2024-05-08T19:22:46.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.752+0000 7fb3509af700 1 -- 172.21.15.47:0/4029749428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb34c0bd930 msgr2=0x7fb34c1546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.752+0000 7fb3509af700 1 --2- 172.21.15.47:0/4029749428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb34c0bd930 0x7fb34c1546e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb34400b970 tx=0x7fb34400bd30 comp rx=0 tx=0).stop 2024-05-08T19:22:46.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.753+0000 7fb3509af700 1 -- 172.21.15.47:0/4029749428 shutdown_connections 2024-05-08T19:22:46.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.753+0000 7fb3509af700 1 --2- 172.21.15.47:0/4029749428 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb32c06ad60 0x7fb32c06d220 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.753+0000 7fb3509af700 1 --2- 172.21.15.47:0/4029749428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb34c0bd930 0x7fb34c1546e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.753+0000 7fb3509af700 1 --2- 172.21.15.47:0/4029749428 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb34c06d490 0x7fb34c0c3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.753+0000 7fb3509af700 1 --2- 172.21.15.47:0/4029749428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34c0af8f0 0x7fb34c1541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.753+0000 7fb3509af700 1 -- 172.21.15.47:0/4029749428 >> 172.21.15.47:0/4029749428 conn(0x7fb34c072510 msgr2=0x7fb34c0728f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.753+0000 7fb3509af700 1 -- 172.21.15.47:0/4029749428 shutdown_connections 2024-05-08T19:22:46.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.753+0000 7fb3509af700 1 -- 172.21.15.47:0/4029749428 wait complete. 2024-05-08T19:22:46.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.757+0000 7f3fb9a3c700 1 -- 172.21.15.47:0/1931639353 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3f940055a0 con 0x7f3fb40aab40 2024-05-08T19:22:46.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.761+0000 7f3f9bfff700 1 -- 172.21.15.47:0/1931639353 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3fa40579b0 con 0x7f3fb40aab40 2024-05-08T19:22:46.753 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-05-08T19:22:46.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.763+0000 7f65ec78e700 1 -- 172.21.15.47:0/3687403852 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f65e4070e90 con 0x7f65e406bf10 2024-05-08T19:22:46.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.763+0000 7f3fb9a3c700 1 -- 172.21.15.47:0/1931639353 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3fa006ad60 msgr2=0x7f3fa006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.763+0000 7f3fb9a3c700 1 --2- 172.21.15.47:0/1931639353 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3fa006ad60 0x7f3fa006d220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009a80 tx=0x7f3fa8009190 comp rx=0 tx=0).stop 2024-05-08T19:22:46.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.763+0000 7f3fb9a3c700 1 -- 172.21.15.47:0/1931639353 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fb40aab40 msgr2=0x7f3fb40c51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.763+0000 7f3fb9a3c700 1 --2- 172.21.15.47:0/1931639353 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fb40aab40 0x7f3fb40c51c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400e8d0 tx=0x7f3fa400ebe0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.763+0000 7f3fb9a3c700 1 -- 172.21.15.47:0/1931639353 shutdown_connections 2024-05-08T19:22:46.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.763+0000 7f3fb9a3c700 1 --2- 172.21.15.47:0/1931639353 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f3fa006ad60 0x7f3fa006d220 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.763+0000 7f3fb9a3c700 1 --2- 172.21.15.47:0/1931639353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fb414eee0 0x7f3fb4138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.763+0000 7f3fb9a3c700 1 --2- 172.21.15.47:0/1931639353 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3fb40a84b0 0x7f3fb4150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.763+0000 7f3fb9a3c700 1 --2- 172.21.15.47:0/1931639353 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fb40aab40 0x7f3fb40c51c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.763+0000 7f3fb9a3c700 1 -- 172.21.15.47:0/1931639353 >> 172.21.15.47:0/1931639353 conn(0x7f3fb40c3c20 msgr2=0x7f3fb4071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.763+0000 7f3fb9a3c700 1 -- 172.21.15.47:0/1931639353 shutdown_connections 2024-05-08T19:22:46.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.763+0000 7f3fb9a3c700 1 -- 172.21.15.47:0/1931639353 wait complete. 2024-05-08T19:22:46.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.764+0000 7f65daffd700 1 -- 172.21.15.47:0/3687403852 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f65e4070e90 con 0x7f65e406bf10 2024-05-08T19:22:46.757 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-05-08T19:22:46.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.768+0000 7f65ec78e700 1 -- 172.21.15.47:0/3687403852 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f65c806ad60 msgr2=0x7f65c806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.768+0000 7f65ec78e700 1 --2- 172.21.15.47:0/3687403852 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f65c806ad60 0x7f65c806d220 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f65e406b160 tx=0x7f65d401c040 comp rx=0 tx=0).stop 2024-05-08T19:22:46.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.768+0000 7f65ec78e700 1 -- 172.21.15.47:0/3687403852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65e406bf10 msgr2=0x7f65e41f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.768+0000 7f65ec78e700 1 --2- 172.21.15.47:0/3687403852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65e406bf10 0x7f65e41f4610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f65e000c4d0 tx=0x7f65e000c890 comp rx=0 tx=0).stop 2024-05-08T19:22:46.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.769+0000 7f65ec78e700 1 -- 172.21.15.47:0/3687403852 shutdown_connections 2024-05-08T19:22:46.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.769+0000 7f65ec78e700 1 --2- 172.21.15.47:0/3687403852 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f65c806ad60 0x7f65c806d220 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.769+0000 7f65ec78e700 1 --2- 172.21.15.47:0/3687403852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65e406edd0 0x7f65e41db4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.769+0000 7f65ec78e700 1 --2- 172.21.15.47:0/3687403852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65e406bf10 0x7f65e41f4610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.769+0000 7f65ec78e700 1 --2- 172.21.15.47:0/3687403852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65e406e370 0x7f65e41f4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.769+0000 7f65ec78e700 1 -- 172.21.15.47:0/3687403852 >> 172.21.15.47:0/3687403852 conn(0x7f65e40c33d0 msgr2=0x7f65e406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-05-08T19:22:46.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.773+0000 7f65ec78e700 1 -- 172.21.15.47:0/3687403852 shutdown_connections 2024-05-08T19:22:46.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.773+0000 7f65ec78e700 1 -- 172.21.15.47:0/3687403852 wait complete. 2024-05-08T19:22:46.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-05-08T19:22:46.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.778+0000 7fdb12dfe700 1 -- 172.21.15.47:0/1007295458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fdaec005870 con 0x7fdb0c070670 2024-05-08T19:22:46.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.778+0000 7f355e962700 1 -- 172.21.15.47:0/1800952859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f355815ad80 con 0x7f3558155430 2024-05-08T19:22:46.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.779+0000 7fdb097fa700 1 -- 172.21.15.47:0/1007295458 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdaf808e070 con 0x7fdb0c070670 2024-05-08T19:22:46.772 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-05-08T19:22:46.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.779+0000 7f3554ff9700 1 -- 172.21.15.47:0/1800952859 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f355815ad80 con 0x7f3558155430 2024-05-08T19:22:46.773 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-05-08T19:22:46.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.781+0000 7f355e962700 1 -- 172.21.15.47:0/1800952859 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f354406ace0 msgr2=0x7f354406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.781+0000 7f355e962700 1 --2- 172.21.15.47:0/1800952859 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f354406ace0 0x7f354406d1a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f354c009870 tx=0x7f354c008040 comp rx=0 tx=0).stop 2024-05-08T19:22:46.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.781+0000 7f355e962700 1 -- 172.21.15.47:0/1800952859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3558155430 msgr2=0x7f355815cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.781+0000 7f355e962700 1 --2- 172.21.15.47:0/1800952859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3558155430 0x7f355815cd60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f355000b780 tx=0x7f355000bb40 comp rx=0 tx=0).stop 2024-05-08T19:22:46.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.781+0000 7f355e962700 1 -- 172.21.15.47:0/1800952859 shutdown_connections 2024-05-08T19:22:46.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.781+0000 7f355e962700 1 --2- 172.21.15.47:0/1800952859 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f354406ace0 0x7f354406d1a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.781+0000 7f355e962700 1 --2- 172.21.15.47:0/1800952859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35580c7150 0x7f35581fa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.781+0000 7f355e962700 1 --2- 172.21.15.47:0/1800952859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3558155430 0x7f355815cd60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.781+0000 7f355e962700 1 --2- 172.21.15.47:0/1800952859 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3558156520 0x7f355815c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.781+0000 7f355e962700 1 -- 172.21.15.47:0/1800952859 >> 172.21.15.47:0/1800952859 conn(0x7f35580abef0 msgr2=0x7f3558158590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.782+0000 7f355e962700 1 -- 172.21.15.47:0/1800952859 shutdown_connections 2024-05-08T19:22:46.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.782+0000 7f355e962700 1 -- 172.21.15.47:0/1800952859 wait complete. 2024-05-08T19:22:46.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.782+0000 7fdb12dfe700 1 -- 172.21.15.47:0/1007295458 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fdaf006ace0 msgr2=0x7fdaf006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.782+0000 7fdb12dfe700 1 --2- 172.21.15.47:0/1007295458 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fdaf006ace0 0x7fdaf006d1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdb00007fd0 tx=0x7fdb00009040 comp rx=0 tx=0).stop 2024-05-08T19:22:46.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.782+0000 7fdb12dfe700 1 -- 172.21.15.47:0/1007295458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb0c070670 msgr2=0x7fdb0c0a9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.782+0000 7fdb12dfe700 1 --2- 172.21.15.47:0/1007295458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb0c070670 0x7fdb0c0a9510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800c8e0 tx=0x7fdaf800cbf0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.783+0000 7fdb12dfe700 1 -- 172.21.15.47:0/1007295458 shutdown_connections 2024-05-08T19:22:46.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.783+0000 7fdb12dfe700 1 --2- 172.21.15.47:0/1007295458 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fdaf006ace0 0x7fdaf006d1a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.783+0000 7fdb12dfe700 1 --2- 172.21.15.47:0/1007295458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb0c0abd70 0x7fdb0c0c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.783+0000 7fdb12dfe700 1 --2- 172.21.15.47:0/1007295458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb0c06d940 0x7fdb0c0c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.783+0000 7fdb12dfe700 1 --2- 172.21.15.47:0/1007295458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb0c070670 0x7fdb0c0a9510 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.783+0000 7fdb12dfe700 1 -- 172.21.15.47:0/1007295458 >> 172.21.15.47:0/1007295458 conn(0x7fdb0c06a9c0 msgr2=0x7fdb0c0c0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.783+0000 7fdb12dfe700 1 -- 172.21.15.47:0/1007295458 shutdown_connections 2024-05-08T19:22:46.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.783+0000 7fdb12dfe700 1 -- 172.21.15.47:0/1007295458 wait complete. 2024-05-08T19:22:46.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.786+0000 7f1fd4b33700 1 -- 172.21.15.47:0/3851518365 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1fd0072630 con 0x7f1fd00728c0 2024-05-08T19:22:46.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.786+0000 7f1fc6ffd700 1 -- 172.21.15.47:0/3851518365 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1fb8015090 con 0x7f1fd00728c0 2024-05-08T19:22:46.783 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-05-08T19:22:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.789+0000 7f1fd4b33700 1 -- 172.21.15.47:0/3851518365 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1fb006ac90 msgr2=0x7f1fb006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.789+0000 7f1fd4b33700 1 --2- 172.21.15.47:0/3851518365 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1fb006ac90 0x7f1fb006d150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1fd014f020 tx=0x7f1fc0008040 comp rx=0 tx=0).stop 2024-05-08T19:22:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.789+0000 7f1fd4b33700 1 -- 172.21.15.47:0/3851518365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fd00728c0 msgr2=0x7f1fd00c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:46.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.789+0000 7f1fd4b33700 1 --2- 172.21.15.47:0/3851518365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fd00728c0 0x7f1fd00c64b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8000c00 tx=0x7f1fb8004750 comp rx=0 tx=0).stop 2024-05-08T19:22:46.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.790+0000 7f1fd4b33700 1 -- 172.21.15.47:0/3851518365 shutdown_connections 2024-05-08T19:22:46.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.790+0000 7f1fd4b33700 1 --2- 172.21.15.47:0/3851518365 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1fb006ac90 0x7f1fb006d150 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.790+0000 7f1fd4b33700 1 --2- 172.21.15.47:0/3851518365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fd00728c0 0x7f1fd00c64b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.790+0000 7f1fd4b33700 1 --2- 172.21.15.47:0/3851518365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1fd0156700 0x7f1fd00c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.790+0000 7f1fd4b33700 1 --2- 172.21.15.47:0/3851518365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1fd00c2cb0 0x7f1fd014e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:46.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.790+0000 7f1fd4b33700 1 -- 172.21.15.47:0/3851518365 >> 172.21.15.47:0/3851518365 conn(0x7f1fd00c3c20 msgr2=0x7f1fd0155630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:46.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.790+0000 7f1fd4b33700 1 -- 172.21.15.47:0/3851518365 shutdown_connections 2024-05-08T19:22:46.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:46.790+0000 7f1fd4b33700 1 -- 172.21.15.47:0/3851518365 wait complete. 2024-05-08T19:22:46.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-05-08T19:22:46.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-05-08T19:22:46.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-05-08T19:22:46.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-05-08T19:22:47.704 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T19:22:47.737 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T19:22:47.763 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T19:22:47.771 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T19:22:47.787 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T19:22:47.793 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T19:22:47.796 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T19:22:47.801 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T19:22:47.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.886+0000 7fc2bfc2b700 1 Processor -- start 2024-05-08T19:22:47.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.888+0000 7fc2bfc2b700 1 -- start start 2024-05-08T19:22:47.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.889+0000 7fc2bfc2b700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc2b806e880 0x7fc2b806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.889+0000 7fc2bfc2b700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b80c1020 con 0x7fc2b806edd0 2024-05-08T19:22:47.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.889+0000 7fc2bfc2b700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b814eb00 con 0x7fc2b806e370 2024-05-08T19:22:47.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.889+0000 7fc2bfc2b700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b8071a50 con 0x7fc2b806e880 2024-05-08T19:22:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.889+0000 7fc2be1c8700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc2b806e880 0x7fc2b806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.889+0000 7fc2bd9c7700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc2b806edd0 0x7fc2b8066780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59922/0 (socket says 172.21.15.47:59922) 2024-05-08T19:22:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.889+0000 7fc2bd9c7700 1 -- 172.21.15.47:0/877783007 learned_addr learned my addr 172.21.15.47:0/877783007 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.889+0000 7fc2be1c8700 1 -- 172.21.15.47:0/877783007 >> v1:172.21.15.177:6789/0 conn(0x7fc2b806e370 legacy=0x7fc2b8072860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.889+0000 7fc2be1c8700 1 -- 172.21.15.47:0/877783007 >> v1:172.21.15.47:6789/0 conn(0x7fc2b806edd0 legacy=0x7fc2b8066780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.889+0000 7fc2be1c8700 1 -- 172.21.15.47:0/877783007 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b80c6190 con 0x7fc2b806e880 2024-05-08T19:22:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.890+0000 7fc2be1c8700 1 --2- 172.21.15.47:0/877783007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b806e880 0x7fc2b806b9d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0009d90 tx=0x7fc2b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e069e0210c554ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.890+0000 7fc2bc9c5700 1 -- 172.21.15.47:0/877783007 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b000e070 con 0x7fc2b806e880 2024-05-08T19:22:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.890+0000 7fc2bc9c5700 1 -- 172.21.15.47:0/877783007 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b000bbd0 con 0x7fc2b806e880 2024-05-08T19:22:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.890+0000 7fc2bc9c5700 1 -- 172.21.15.47:0/877783007 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0012430 con 0x7fc2b806e880 2024-05-08T19:22:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.890+0000 7fc2bfc2b700 1 -- 172.21.15.47:0/877783007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b806e880 msgr2=0x7fc2b806b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.890+0000 7fc2bfc2b700 1 --2- 172.21.15.47:0/877783007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b806e880 0x7fc2b806b9d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0009d90 tx=0x7fc2b000b330 comp rx=0 tx=0).stop 2024-05-08T19:22:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.891+0000 7fc2bfc2b700 1 -- 172.21.15.47:0/877783007 shutdown_connections 2024-05-08T19:22:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.891+0000 7fc2bfc2b700 1 --2- 172.21.15.47:0/877783007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b806e880 0x7fc2b806b9d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.891+0000 7fc2bfc2b700 1 -- 172.21.15.47:0/877783007 >> 172.21.15.47:0/877783007 conn(0x7fc2b80c33d0 msgr2=0x7fc2b80c37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.891+0000 7fc2bfc2b700 1 -- 172.21.15.47:0/877783007 shutdown_connections 2024-05-08T19:22:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.891+0000 7fc2bfc2b700 1 -- 172.21.15.47:0/877783007 wait complete. 2024-05-08T19:22:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.892+0000 7fc2bfc2b700 1 Processor -- start 2024-05-08T19:22:47.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.892+0000 7fc2bfc2b700 1 -- start start 2024-05-08T19:22:47.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.893+0000 7fc2bfc2b700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2b806e370 0x7fc2b8160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.893+0000 7fc2bfc2b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b806e880 0x7fc2b81ef120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.893+0000 7fc2bfc2b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b806edd0 0x7fc2b81f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.893+0000 7fc2bfc2b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b8160ae0 con 0x7fc2b806e880 2024-05-08T19:22:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.893+0000 7fc2bfc2b700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b81ee9f0 con 0x7fc2b806edd0 2024-05-08T19:22:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.893+0000 7fc2bfc2b700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b81605b0 con 0x7fc2b806e370 2024-05-08T19:22:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.894+0000 7fc2bd9c7700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2b806e370 0x7fc2b8160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.894+0000 7fc2bd9c7700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2b806e370 0x7fc2b8160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:41156/0 (socket says 172.21.15.47:41156) 2024-05-08T19:22:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.894+0000 7fc2bd9c7700 1 -- 172.21.15.47:0/3200037052 learned_addr learned my addr 172.21.15.47:0/3200037052 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.894+0000 7fc2be1c8700 1 --2- 172.21.15.47:0/3200037052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b806edd0 0x7fc2b81f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.894+0000 7fc2bd1c6700 1 --2- 172.21.15.47:0/3200037052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b806e880 0x7fc2b81ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.894+0000 7fc2bd9c7700 1 -- 172.21.15.47:0/3200037052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b806edd0 msgr2=0x7fc2b81f1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.894+0000 7fc2bd9c7700 1 --2- 172.21.15.47:0/3200037052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b806edd0 0x7fc2b81f1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.894+0000 7fc2bd9c7700 1 -- 172.21.15.47:0/3200037052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b806e880 msgr2=0x7fc2b81ef120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.894+0000 7fc2bd9c7700 1 --2- 172.21.15.47:0/3200037052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b806e880 0x7fc2b81ef120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.894+0000 7fc2bd9c7700 1 -- 172.21.15.47:0/3200037052 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b0009a70 con 0x7fc2b806e370 2024-05-08T19:22:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.894+0000 7fc2be1c8700 1 --2- 172.21.15.47:0/3200037052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b806edd0 0x7fc2b81f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:47.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.894+0000 7fc2bd9c7700 1 --2- 172.21.15.47:0/3200037052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2b806e370 0x7fc2b8160eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800c4b0 tx=0x7fc2a800c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:47.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.895+0000 7fc2ae7fc700 1 -- 172.21.15.47:0/3200037052 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8005d70 con 0x7fc2b806e370 2024-05-08T19:22:47.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.895+0000 7fc2ae7fc700 1 -- 172.21.15.47:0/3200037052 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a80070d0 con 0x7fc2b806e370 2024-05-08T19:22:47.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.895+0000 7fc2ae7fc700 1 -- 172.21.15.47:0/3200037052 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8007440 con 0x7fc2b806e370 2024-05-08T19:22:47.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.895+0000 7fc2bfc2b700 1 -- 172.21.15.47:0/3200037052 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b81eec90 con 0x7fc2b806e370 2024-05-08T19:22:47.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.895+0000 7fc2bfc2b700 1 -- 172.21.15.47:0/3200037052 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b814e340 con 0x7fc2b806e370 2024-05-08T19:22:47.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.898+0000 7fc2ae7fc700 1 -- 172.21.15.47:0/3200037052 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc2a80075a0 con 0x7fc2b806e370 2024-05-08T19:22:47.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.898+0000 7fc2ae7fc700 1 --2- 172.21.15.47:0/3200037052 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc29c06ac90 0x7fc29c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.898+0000 7fc2ae7fc700 1 -- 172.21.15.47:0/3200037052 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc2a8088950 con 0x7fc2b806e370 2024-05-08T19:22:47.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.907+0000 7fc2bfc2b700 1 -- 172.21.15.47:0/3200037052 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a00052f0 con 0x7fc2b806e370 2024-05-08T19:22:47.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.910+0000 7fc2bd1c6700 1 --2- 172.21.15.47:0/3200037052 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc29c06ac90 0x7fc29c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.913+0000 7fc2bd1c6700 1 --2- 172.21.15.47:0/3200037052 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc29c06ac90 0x7fc29c06d150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc2b815fa00 tx=0x7fc2b4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:47.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.914+0000 7fc2ae7fc700 1 -- 172.21.15.47:0/3200037052 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc2a8053920 con 0x7fc2b806e370 2024-05-08T19:22:47.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.964+0000 7f642fa95700 1 Processor -- start 2024-05-08T19:22:47.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.964+0000 7f642fa95700 1 -- start start 2024-05-08T19:22:47.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.965+0000 7f642fa95700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f642815ea30 0x7f64280726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.965+0000 7f642fa95700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f642806b4e0 0x7f6428070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.965+0000 7f642fa95700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6428070bb0 0x7f64280ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.965+0000 7f642fa95700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6428071b80 con 0x7f6428070bb0 2024-05-08T19:22:47.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.965+0000 7f642fa95700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6428162490 con 0x7f642806b4e0 2024-05-08T19:22:47.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.965+0000 7f642fa95700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6428161550 con 0x7f642815ea30 2024-05-08T19:22:47.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.966+0000 7f642d831700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f642815ea30 0x7f64280726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.966+0000 7f642d030700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f642806b4e0 0x7f6428070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.966+0000 7f642d831700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f642815ea30 0x7f64280726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:41172/0 (socket says 172.21.15.47:41172) 2024-05-08T19:22:47.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.968+0000 7f642d831700 1 -- 172.21.15.47:0/3728647461 learned_addr learned my addr 172.21.15.47:0/3728647461 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:47.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.967+0000 7f642d030700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f642806b4e0 0x7f6428070670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:42108/0 (socket says 172.21.15.47:42108) 2024-05-08T19:22:47.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.967+0000 7f642e032700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6428070bb0 0x7f64280ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.969+0000 7f642e032700 1 -- 172.21.15.47:0/3728647461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f642815ea30 msgr2=0x7f64280726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:47.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.969+0000 7f642e032700 1 --2- 172.21.15.47:0/3728647461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f642815ea30 0x7f64280726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:47.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.969+0000 7f642e032700 1 -- 172.21.15.47:0/3728647461 >> v2:172.21.15.177:3300/0 conn(0x7f642806b4e0 msgr2=0x7f6428070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:47.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.969+0000 7f642e032700 1 --2- 172.21.15.47:0/3728647461 >> v2:172.21.15.177:3300/0 conn(0x7f642806b4e0 0x7f6428070670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:47.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.969+0000 7f642e032700 1 -- 172.21.15.47:0/3728647461 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6428161810 con 0x7f6428070bb0 2024-05-08T19:22:47.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.970+0000 7f642e032700 1 --2- 172.21.15.47:0/3728647461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6428070bb0 0x7f64280ab2e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f64280742b0 tx=0x7f642000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b1848712253127 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:47.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.970+0000 7f642c82f700 1 -- 172.21.15.47:0/3728647461 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642000e070 con 0x7f6428070bb0 2024-05-08T19:22:47.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.970+0000 7f642c82f700 1 -- 172.21.15.47:0/3728647461 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642000bb20 con 0x7f6428070bb0 2024-05-08T19:22:47.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.970+0000 7f642c82f700 1 -- 172.21.15.47:0/3728647461 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420012430 con 0x7f6428070bb0 2024-05-08T19:22:47.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.971+0000 7f642fa95700 1 -- 172.21.15.47:0/3728647461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6428070bb0 msgr2=0x7f64280ab2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:47.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.971+0000 7f642fa95700 1 --2- 172.21.15.47:0/3728647461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6428070bb0 0x7f64280ab2e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f64280742b0 tx=0x7f642000b330 comp rx=0 tx=0).stop 2024-05-08T19:22:47.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.972+0000 7f642fa95700 1 -- 172.21.15.47:0/3728647461 shutdown_connections 2024-05-08T19:22:47.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.972+0000 7f642fa95700 1 --2- 172.21.15.47:0/3728647461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6428070bb0 0x7f64280ab2e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:47.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.972+0000 7f642fa95700 1 --2- 172.21.15.47:0/3728647461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f642815ea30 0x7f64280726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:47.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.972+0000 7f642fa95700 1 --2- 172.21.15.47:0/3728647461 >> v2:172.21.15.177:3300/0 conn(0x7f642806b4e0 0x7f6428070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:47.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.972+0000 7f642fa95700 1 -- 172.21.15.47:0/3728647461 >> 172.21.15.47:0/3728647461 conn(0x7f642806a9c0 msgr2=0x7f642806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:47.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.972+0000 7f642fa95700 1 -- 172.21.15.47:0/3728647461 shutdown_connections 2024-05-08T19:22:47.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.972+0000 7f642fa95700 1 -- 172.21.15.47:0/3728647461 wait complete. 2024-05-08T19:22:47.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.974+0000 7f642fa95700 1 Processor -- start 2024-05-08T19:22:47.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.974+0000 7f642fa95700 1 -- start start 2024-05-08T19:22:47.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.975+0000 7f642fa95700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6428070bb0 0x7f64281ee5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.975+0000 7f642fa95700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64281fa750 0x7f64281fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.975+0000 7f642fa95700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6428162d70 0x7f64281f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.975+0000 7f642fa95700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64281fb6f0 con 0x7f6428070bb0 2024-05-08T19:22:47.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.975+0000 7f642fa95700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642815c3f0 con 0x7f6428162d70 2024-05-08T19:22:47.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.975+0000 7f642fa95700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64281fabb0 con 0x7f64281fa750 2024-05-08T19:22:47.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.976+0000 7f642e032700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6428162d70 0x7f64281f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.976+0000 7f642e032700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6428162d70 0x7f64281f7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:42122/0 (socket says 172.21.15.47:42122) 2024-05-08T19:22:47.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.976+0000 7f642e032700 1 -- 172.21.15.47:0/1689034023 learned_addr learned my addr 172.21.15.47:0/1689034023 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:47.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.976+0000 7f642d030700 1 --2- 172.21.15.47:0/1689034023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64281fa750 0x7f64281fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.976+0000 7f642d831700 1 --2- 172.21.15.47:0/1689034023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6428070bb0 0x7f64281ee5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.976+0000 7f642e032700 1 -- 172.21.15.47:0/1689034023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64281fa750 msgr2=0x7f64281fb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:47.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.976+0000 7f642e032700 1 --2- 172.21.15.47:0/1689034023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64281fa750 0x7f64281fb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:47.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.976+0000 7f642e032700 1 -- 172.21.15.47:0/1689034023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6428070bb0 msgr2=0x7f64281ee5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:47.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.976+0000 7f642e032700 1 --2- 172.21.15.47:0/1689034023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6428070bb0 0x7f64281ee5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:47.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.976+0000 7f642e032700 1 -- 172.21.15.47:0/1689034023 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6420009a70 con 0x7f6428162d70 2024-05-08T19:22:47.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.977+0000 7f642e032700 1 --2- 172.21.15.47:0/1689034023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6428162d70 0x7f64281f7af0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6428067640 tx=0x7f6420004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:47.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.979+0000 7f641e7fc700 1 -- 172.21.15.47:0/1689034023 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420004800 con 0x7f6428162d70 2024-05-08T19:22:47.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.980+0000 7f641e7fc700 1 -- 172.21.15.47:0/1689034023 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6420020070 con 0x7f6428162d70 2024-05-08T19:22:47.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.980+0000 7f641e7fc700 1 -- 172.21.15.47:0/1689034023 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64200276c0 con 0x7f6428162d70 2024-05-08T19:22:47.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.980+0000 7f642fa95700 1 -- 172.21.15.47:0/1689034023 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64281634e0 con 0x7f6428162d70 2024-05-08T19:22:47.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.980+0000 7f642fa95700 1 -- 172.21.15.47:0/1689034023 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6428163aa0 con 0x7f6428162d70 2024-05-08T19:22:47.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.984+0000 7f641e7fc700 1 -- 172.21.15.47:0/1689034023 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6420012430 con 0x7f6428162d70 2024-05-08T19:22:47.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.984+0000 7f641e7fc700 1 --2- 172.21.15.47:0/1689034023 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f6414073700 0x7f6414075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.984+0000 7f641e7fc700 1 -- 172.21.15.47:0/1689034023 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6420022070 con 0x7f6428162d70 2024-05-08T19:22:47.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.984+0000 7f642d831700 1 --2- 172.21.15.47:0/1689034023 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f6414073700 0x7f6414075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.984+0000 7f642fa95700 1 -- 172.21.15.47:0/1689034023 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640c0052f0 con 0x7f6428162d70 2024-05-08T19:22:47.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.985+0000 7f642d831700 1 --2- 172.21.15.47:0/1689034023 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f6414073700 0x7f6414075bc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6428159c70 tx=0x7f642400c230 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:47.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.991+0000 7f641e7fc700 1 -- 172.21.15.47:0/1689034023 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6420056480 con 0x7f6428162d70 2024-05-08T19:22:47.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.998+0000 7f1ce4bba700 1 Processor -- start 2024-05-08T19:22:47.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:47.998+0000 7f1ce4bba700 1 -- start start 2024-05-08T19:22:47.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.000+0000 7f1ce4bba700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1ce006b4e0 0x7f1ce014a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.000+0000 7f1ce4bba700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1ce00c11b0 0x7f1ce014ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.000+0000 7f1ce4bba700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce0151490 con 0x7f1ce0070670 2024-05-08T19:22:47.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.000+0000 7f1ce4bba700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce0071cc0 con 0x7f1ce00c11b0 2024-05-08T19:22:47.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.000+0000 7f1ce4bba700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce0151770 con 0x7f1ce006b4e0 2024-05-08T19:22:47.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.000+0000 7f1cddd9b700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f1ce0070670 0x7f1ce00c0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59926/0 (socket says 172.21.15.47:59926) 2024-05-08T19:22:47.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.000+0000 7f1cddd9b700 1 -- 172.21.15.47:0/1363461405 learned_addr learned my addr 172.21.15.47:0/1363461405 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:47.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.000+0000 7f1cde59c700 1 --2- 172.21.15.47:0/1363461405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1ce006b4e0 0x7f1ce014a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.000+0000 7f1cded9d700 1 --2- 172.21.15.47:0/1363461405 >> v2:172.21.15.177:3300/0 conn(0x7f1ce00c11b0 0x7f1ce014ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.001+0000 7f1cde59c700 1 -- 172.21.15.47:0/1363461405 >> v2:172.21.15.177:3300/0 conn(0x7f1ce00c11b0 msgr2=0x7f1ce014ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:47.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.001+0000 7f1cde59c700 1 --2- 172.21.15.47:0/1363461405 >> v2:172.21.15.177:3300/0 conn(0x7f1ce00c11b0 0x7f1ce014ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:47.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.001+0000 7f1cde59c700 1 -- 172.21.15.47:0/1363461405 >> v1:172.21.15.47:6789/0 conn(0x7f1ce0070670 legacy=0x7f1ce00c0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:47.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.001+0000 7f1cde59c700 1 -- 172.21.15.47:0/1363461405 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce00711b0 con 0x7f1ce006b4e0 2024-05-08T19:22:47.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.001+0000 7f1cde59c700 1 --2- 172.21.15.47:0/1363461405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1ce006b4e0 0x7f1ce014a650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009d90 tx=0x7f1cd800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77cb1c3f902f7fd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:47.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.001+0000 7f1cdd59a700 1 -- 172.21.15.47:0/1363461405 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd800e070 con 0x7f1ce006b4e0 2024-05-08T19:22:47.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.001+0000 7f1cdd59a700 1 -- 172.21.15.47:0/1363461405 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd800bad0 con 0x7f1ce006b4e0 2024-05-08T19:22:47.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.001+0000 7f1cdd59a700 1 -- 172.21.15.47:0/1363461405 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd800be80 con 0x7f1ce006b4e0 2024-05-08T19:22:47.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.002+0000 7f1ce4bba700 1 -- 172.21.15.47:0/1363461405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1ce006b4e0 msgr2=0x7f1ce014a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:47.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.002+0000 7f1ce4bba700 1 --2- 172.21.15.47:0/1363461405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1ce006b4e0 0x7f1ce014a650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009d90 tx=0x7f1cd800b330 comp rx=0 tx=0).stop 2024-05-08T19:22:47.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.003+0000 7f1ce4bba700 1 -- 172.21.15.47:0/1363461405 shutdown_connections 2024-05-08T19:22:47.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.003+0000 7f1ce4bba700 1 --2- 172.21.15.47:0/1363461405 >> v2:172.21.15.177:3300/0 conn(0x7f1ce00c11b0 0x7f1ce014ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:47.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.003+0000 7f1ce4bba700 1 --2- 172.21.15.47:0/1363461405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1ce006b4e0 0x7f1ce014a650 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:47.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.003+0000 7f1ce4bba700 1 -- 172.21.15.47:0/1363461405 >> 172.21.15.47:0/1363461405 conn(0x7f1ce006a9c0 msgr2=0x7f1ce006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:47.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.003+0000 7f1ce4bba700 1 -- 172.21.15.47:0/1363461405 shutdown_connections 2024-05-08T19:22:47.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.003+0000 7f1ce4bba700 1 -- 172.21.15.47:0/1363461405 wait complete. 2024-05-08T19:22:47.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.004+0000 7f1ce4bba700 1 Processor -- start 2024-05-08T19:22:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.005+0000 7f1ce4bba700 1 -- start start 2024-05-08T19:22:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.005+0000 7f1ce4bba700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ce006b4e0 0x7f1ce015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.005+0000 7f1ce4bba700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce0070670 0x7f1ce0139bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.006+0000 7f1ce4bba700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1ce00c11b0 0x7f1ce013a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.006+0000 7f1ce4bba700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce00c49f0 con 0x7f1ce0070670 2024-05-08T19:22:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.006+0000 7f1ce4bba700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce00c43b0 con 0x7f1ce006b4e0 2024-05-08T19:22:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.006+0000 7f1ce4bba700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce0144850 con 0x7f1ce00c11b0 2024-05-08T19:22:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.006+0000 7f1cde59c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ce006b4e0 0x7f1ce015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.006+0000 7f1cddd9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce0070670 0x7f1ce0139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.006+0000 7f1cde59c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ce006b4e0 0x7f1ce015dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:42126/0 (socket says 172.21.15.47:42126) 2024-05-08T19:22:47.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.006+0000 7f1cddd9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce0070670 0x7f1ce0139bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56008/0 (socket says 172.21.15.47:56008) 2024-05-08T19:22:47.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.006+0000 7f1cde59c700 1 -- 172.21.15.47:0/4109981226 learned_addr learned my addr 172.21.15.47:0/4109981226 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:47.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.006+0000 7f1cded9d700 1 --2- 172.21.15.47:0/4109981226 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1ce00c11b0 0x7f1ce013a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:47.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.007+0000 7f1cde59c700 1 -- 172.21.15.47:0/4109981226 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1ce00c11b0 msgr2=0x7f1ce013a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:47.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.007+0000 7f1cde59c700 1 --2- 172.21.15.47:0/4109981226 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1ce00c11b0 0x7f1ce013a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.007+0000 7f1cde59c700 1 -- 172.21.15.47:0/4109981226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce0070670 msgr2=0x7f1ce0139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.007+0000 7f1cde59c700 1 --2- 172.21.15.47:0/4109981226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce0070670 0x7f1ce0139bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.007+0000 7f1cde59c700 1 -- 172.21.15.47:0/4109981226 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd8009a70 con 0x7f1ce006b4e0 2024-05-08T19:22:48.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.007+0000 7f1cded9d700 1 --2- 172.21.15.47:0/4109981226 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1ce00c11b0 0x7f1ce013a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:48.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.007+0000 7f1cde59c700 1 --2- 172.21.15.47:0/4109981226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ce006b4e0 0x7f1ce015dbb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800b730 tx=0x7f1cd8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.007+0000 7f46b0daf700 1 Processor -- start 2024-05-08T19:22:48.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.007+0000 7f1cceffd700 1 -- 172.21.15.47:0/4109981226 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8012630 con 0x7f1ce006b4e0 2024-05-08T19:22:48.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.007+0000 7f1cceffd700 1 -- 172.21.15.47:0/4109981226 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd80127b0 con 0x7f1ce006b4e0 2024-05-08T19:22:48.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.007+0000 7f1cceffd700 1 -- 172.21.15.47:0/4109981226 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8012b60 con 0x7f1ce006b4e0 2024-05-08T19:22:48.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.008+0000 7f1ce4bba700 1 -- 172.21.15.47:0/4109981226 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce006ce50 con 0x7f1ce006b4e0 2024-05-08T19:22:48.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.008+0000 7f1ce4bba700 1 -- 172.21.15.47:0/4109981226 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce014f260 con 0x7f1ce006b4e0 2024-05-08T19:22:48.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.007+0000 7f46b0daf700 1 -- start start 2024-05-08T19:22:48.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.009+0000 7f46b0daf700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46ac070670 0x7f46ac14a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.009+0000 7f46b0daf700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f46ac14ab90 0x7f46ac0c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.009+0000 7f46b0daf700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ac06e430 con 0x7f46ac06d940 2024-05-08T19:22:48.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.009+0000 7f46b0daf700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ac071cc0 con 0x7f46ac14ab90 2024-05-08T19:22:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.009+0000 7f46b0daf700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac151490 con 0x7f46ac070670 2024-05-08T19:22:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.009+0000 7f46aa59c700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f46ac06d940 0x7f46ac06dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:36320/0 (socket says 172.21.15.47:36320) 2024-05-08T19:22:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.009+0000 7f46aa59c700 1 -- 172.21.15.47:0/3635675975 learned_addr learned my addr 172.21.15.47:0/3635675975 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.009+0000 7f46a959a700 1 -- 172.21.15.47:0/3635675975 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796067125 0 0) 0x7f46ac06e430 con 0x7f46ac06d940 2024-05-08T19:22:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.009+0000 7f46a959a700 1 -- 172.21.15.47:0/3635675975 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46940035b0 con 0x7f46ac06d940 2024-05-08T19:22:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46a959a700 1 -- 172.21.15.47:0/3635675975 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1682416404 0 0) 0x7f46940035b0 con 0x7f46ac06d940 2024-05-08T19:22:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46a959a700 1 -- 172.21.15.47:0/3635675975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46ac070670 msgr2=0x7f46ac14a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46a959a700 1 --2- 172.21.15.47:0/3635675975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46ac070670 0x7f46ac14a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46a959a700 1 -- 172.21.15.47:0/3635675975 >> v2:172.21.15.177:3300/0 conn(0x7f46ac14ab90 msgr2=0x7f46ac0c0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46aad9d700 1 --2- 172.21.15.47:0/3635675975 >> v2:172.21.15.177:3300/0 conn(0x7f46ac14ab90 0x7f46ac0c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46a959a700 1 --2- 172.21.15.47:0/3635675975 >> v2:172.21.15.177:3300/0 conn(0x7f46ac14ab90 0x7f46ac0c0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46a959a700 1 -- 172.21.15.47:0/3635675975 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac151770 con 0x7f46ac06d940 2024-05-08T19:22:48.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46a959a700 1 -- 172.21.15.47:0/3635675975 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f46a0001670 con 0x7f46ac06d940 2024-05-08T19:22:48.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46aad9d700 1 --2- 172.21.15.47:0/3635675975 >> v2:172.21.15.177:3300/0 conn(0x7f46ac14ab90 0x7f46ac0c0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:48.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f1ce4bba700 1 -- 172.21.15.47:0/4109981226 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc40052f0 con 0x7f1ce006b4e0 2024-05-08T19:22:48.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46a959a700 1 -- 172.21.15.47:0/3635675975 >> v1:172.21.15.177:6789/0 conn(0x7f46ac06d940 legacy=0x7f46ac06dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46a959a700 1 --2- 172.21.15.47:0/3635675975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46940037f0 0x7f4694003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46a959a700 1 --2- 172.21.15.47:0/3635675975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46ac070670 0x7f4694004290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46a959a700 1 --2- 172.21.15.47:0/3635675975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f469400b230 0x7f469400d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46a959a700 1 -- 172.21.15.47:0/3635675975 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac071cc0 con 0x7f46940037f0 2024-05-08T19:22:48.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46a959a700 1 -- 172.21.15.47:0/3635675975 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac151490 con 0x7f469400b230 2024-05-08T19:22:48.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46a959a700 1 -- 172.21.15.47:0/3635675975 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469400dfa0 con 0x7f46ac070670 2024-05-08T19:22:48.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.010+0000 7f46aa59c700 1 --2- 172.21.15.47:0/3635675975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46940037f0 0x7f4694003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.011+0000 7f1cceffd700 1 -- 172.21.15.47:0/4109981226 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1cd8012cc0 con 0x7f1ce006b4e0 2024-05-08T19:22:48.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.011+0000 7f46aa59c700 1 -- 172.21.15.47:0/3635675975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46ac070670 msgr2=0x7f4694004290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T19:22:48.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.011+0000 7f46aa59c700 1 --2- 172.21.15.47:0/3635675975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46ac070670 0x7f4694004290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.011+0000 7f46aa59c700 1 -- 172.21.15.47:0/3635675975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f469400b230 msgr2=0x7f469400d6a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T19:22:48.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.011+0000 7f46aa59c700 1 --2- 172.21.15.47:0/3635675975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f469400b230 0x7f469400d6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.011+0000 7f46aa59c700 1 -- 172.21.15.47:0/3635675975 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46940035b0 con 0x7f46940037f0 2024-05-08T19:22:48.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.011+0000 7f46aa59c700 1 --2- 172.21.15.47:0/3635675975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46940037f0 0x7f4694003bd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f46a0005100 tx=0x7f4694004870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fd265d23d20c89 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.011+0000 7f1cceffd700 1 --2- 172.21.15.47:0/4109981226 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1cc006ad60 0x7f1cc006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.011+0000 7f1cceffd700 1 -- 172.21.15.47:0/4109981226 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1cd808ba30 con 0x7f1ce006b4e0 2024-05-08T19:22:48.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.011+0000 7f46a959a700 1 -- 172.21.15.47:0/3635675975 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0005b60 con 0x7f46940037f0 2024-05-08T19:22:48.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.012+0000 7f46a959a700 1 -- 172.21.15.47:0/3635675975 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a0005cc0 con 0x7f46940037f0 2024-05-08T19:22:48.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.012+0000 7f46a959a700 1 -- 172.21.15.47:0/3635675975 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a00082e0 con 0x7f46940037f0 2024-05-08T19:22:48.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.013+0000 7f46b0daf700 1 -- 172.21.15.47:0/3635675975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46940037f0 msgr2=0x7f4694003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.013+0000 7f46b0daf700 1 --2- 172.21.15.47:0/3635675975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46940037f0 0x7f4694003bd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f46a0005100 tx=0x7f4694004870 comp rx=0 tx=0).stop 2024-05-08T19:22:48.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.012+0000 7f1cddd9b700 1 --2- 172.21.15.47:0/4109981226 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1cc006ad60 0x7f1cc006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.012+0000 7f1cddd9b700 1 --2- 172.21.15.47:0/4109981226 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1cc006ad60 0x7f1cc006d220 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40013c0 tx=0x7f1cd4001350 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.016+0000 7f46aad9d700 1 -- 172.21.15.47:0/3635675975 reap_dead start 2024-05-08T19:22:48.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.016+0000 7f46b0daf700 1 -- 172.21.15.47:0/3635675975 shutdown_connections 2024-05-08T19:22:48.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.016+0000 7f46b0daf700 1 -- 172.21.15.47:0/3635675975 >> 172.21.15.47:0/3635675975 conn(0x7f46ac06a9c0 msgr2=0x7f46ac06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:48.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.016+0000 7f46b0daf700 1 -- 172.21.15.47:0/3635675975 shutdown_connections 2024-05-08T19:22:48.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.016+0000 7f46b0daf700 1 -- 172.21.15.47:0/3635675975 wait complete. 2024-05-08T19:22:48.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.018+0000 7f46b0daf700 1 Processor -- start 2024-05-08T19:22:48.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.019+0000 7f1cceffd700 1 -- 172.21.15.47:0/4109981226 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1cd8056a40 con 0x7f1ce006b4e0 2024-05-08T19:22:48.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.018+0000 7f46b0daf700 1 -- start start 2024-05-08T19:22:48.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.019+0000 7f46b0daf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46ac14f8d0 0x7f46ac14fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.019+0000 7f46b0daf700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46ac152720 0x7f46ac142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.019+0000 7f46b0daf700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46ac1f2230 0x7f46ac143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.019+0000 7f46b0daf700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac1ee300 con 0x7f46ac14f8d0 2024-05-08T19:22:48.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.019+0000 7f46b0daf700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac1f27f0 con 0x7f46ac152720 2024-05-08T19:22:48.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.019+0000 7f46b0daf700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac1ef2d0 con 0x7f46ac1f2230 2024-05-08T19:22:48.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.020+0000 7f46aa59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46ac14f8d0 0x7f46ac14fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.020+0000 7f46aa59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46ac14f8d0 0x7f46ac14fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56038/0 (socket says 172.21.15.47:56038) 2024-05-08T19:22:48.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.020+0000 7f46aa59c700 1 -- 172.21.15.47:0/2619501848 learned_addr learned my addr 172.21.15.47:0/2619501848 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:48.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.020+0000 7f46aa59c700 1 -- 172.21.15.47:0/2619501848 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46ac1f2230 msgr2=0x7f46ac143120 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T19:22:48.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.020+0000 7f46aa59c700 1 --2- 172.21.15.47:0/2619501848 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46ac1f2230 0x7f46ac143120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.020+0000 7f46aa59c700 1 -- 172.21.15.47:0/2619501848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46ac152720 msgr2=0x7f46ac142be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T19:22:48.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.020+0000 7f46aa59c700 1 --2- 172.21.15.47:0/2619501848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46ac152720 0x7f46ac142be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.020+0000 7f46aa59c700 1 -- 172.21.15.47:0/2619501848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac1eee40 con 0x7f46ac14f8d0 2024-05-08T19:22:48.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.021+0000 7f46aa59c700 1 --2- 172.21.15.47:0/2619501848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46ac14f8d0 0x7f46ac14fcb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f46a00056f0 tx=0x7f46a0004a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.021+0000 7f469affd700 1 -- 172.21.15.47:0/2619501848 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0025070 con 0x7f46ac14f8d0 2024-05-08T19:22:48.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.021+0000 7f469affd700 1 -- 172.21.15.47:0/2619501848 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a0001aa0 con 0x7f46ac14f8d0 2024-05-08T19:22:48.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.021+0000 7f469affd700 1 -- 172.21.15.47:0/2619501848 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0001c30 con 0x7f46ac14f8d0 2024-05-08T19:22:48.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.021+0000 7f46b0daf700 1 -- 172.21.15.47:0/2619501848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac1ee510 con 0x7f46ac14f8d0 2024-05-08T19:22:48.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.021+0000 7f46b0daf700 1 -- 172.21.15.47:0/2619501848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac1eead0 con 0x7f46ac14f8d0 2024-05-08T19:22:48.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.023+0000 7f46b0daf700 1 -- 172.21.15.47:0/2619501848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac04ec60 con 0x7f46ac14f8d0 2024-05-08T19:22:48.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.029+0000 7f469affd700 1 -- 172.21.15.47:0/2619501848 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f46a00080e0 con 0x7f46ac14f8d0 2024-05-08T19:22:48.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.030+0000 7f469affd700 1 --2- 172.21.15.47:0/2619501848 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f468c06ac90 0x7f468c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.030+0000 7f469affd700 1 -- 172.21.15.47:0/2619501848 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f46a008b5a0 con 0x7f46ac14f8d0 2024-05-08T19:22:48.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.030+0000 7f05345a5700 1 Processor -- start 2024-05-08T19:22:48.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.032+0000 7f46a9d9b700 1 --2- 172.21.15.47:0/2619501848 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f468c06ac90 0x7f468c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.034+0000 7f469affd700 1 -- 172.21.15.47:0/2619501848 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f46a0056500 con 0x7f46ac14f8d0 2024-05-08T19:22:48.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.030+0000 7f05345a5700 1 -- start start 2024-05-08T19:22:48.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.032+0000 7f05345a5700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052c06d940 0x7f052c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.032+0000 7f05345a5700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f052c06e260 0x7f052c14a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.032+0000 7f05345a5700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052c151490 con 0x7f052c070670 2024-05-08T19:22:48.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.032+0000 7f05345a5700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052c071cc0 con 0x7f052c06e260 2024-05-08T19:22:48.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.032+0000 7f05345a5700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052c151770 con 0x7f052c06d940 2024-05-08T19:22:48.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.032+0000 7f0532341700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052c06d940 0x7f052c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.033+0000 7f0532341700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052c06d940 0x7f052c06dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:41202/0 (socket says 172.21.15.47:41202) 2024-05-08T19:22:48.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.033+0000 7f0532341700 1 -- 172.21.15.47:0/4252427362 learned_addr learned my addr 172.21.15.47:0/4252427362 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:48.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.033+0000 7f0531b40700 1 --2- 172.21.15.47:0/4252427362 >> v2:172.21.15.47:3300/0 conn(0x7f052c06e260 0x7f052c14a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.033+0000 7f0531b40700 1 -- 172.21.15.47:0/4252427362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052c06d940 msgr2=0x7f052c06dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:48.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.033+0000 7f0531b40700 1 --2- 172.21.15.47:0/4252427362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052c06d940 0x7f052c06dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.033+0000 7f0531b40700 1 -- 172.21.15.47:0/4252427362 >> v1:172.21.15.47:6789/0 conn(0x7f052c070670 legacy=0x7f052c0c0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:48.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.033+0000 7f0531b40700 1 -- 172.21.15.47:0/4252427362 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c0711b0 con 0x7f052c06e260 2024-05-08T19:22:48.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.034+0000 7f0531b40700 1 --2- 172.21.15.47:0/4252427362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052c06e260 0x7f052c14a650 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f051c009840 tx=0x7f051c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec64018581e8595 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.035+0000 7f053133f700 1 -- 172.21.15.47:0/4252427362 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c004230 con 0x7f052c06e260 2024-05-08T19:22:48.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.035+0000 7f053133f700 1 -- 172.21.15.47:0/4252427362 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c004390 con 0x7f052c06e260 2024-05-08T19:22:48.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.035+0000 7f053133f700 1 -- 172.21.15.47:0/4252427362 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c0036a0 con 0x7f052c06e260 2024-05-08T19:22:48.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.036+0000 7f05345a5700 1 -- 172.21.15.47:0/4252427362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052c06e260 msgr2=0x7f052c14a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.036+0000 7f05345a5700 1 --2- 172.21.15.47:0/4252427362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052c06e260 0x7f052c14a650 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f051c009840 tx=0x7f051c009b50 comp rx=0 tx=0).stop 2024-05-08T19:22:48.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.037+0000 7f46a9d9b700 1 --2- 172.21.15.47:0/2619501848 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f468c06ac90 0x7f468c06d150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f46ac06b460 tx=0x7f469c006cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.037+0000 7f05345a5700 1 -- 172.21.15.47:0/4252427362 shutdown_connections 2024-05-08T19:22:48.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.037+0000 7f05345a5700 1 --2- 172.21.15.47:0/4252427362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052c06d940 0x7f052c06dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.037+0000 7f05345a5700 1 --2- 172.21.15.47:0/4252427362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052c06e260 0x7f052c14a650 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.037+0000 7f05345a5700 1 -- 172.21.15.47:0/4252427362 >> 172.21.15.47:0/4252427362 conn(0x7f052c06a9c0 msgr2=0x7f052c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:48.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.038+0000 7f05345a5700 1 -- 172.21.15.47:0/4252427362 shutdown_connections 2024-05-08T19:22:48.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.038+0000 7f05345a5700 1 -- 172.21.15.47:0/4252427362 wait complete. 2024-05-08T19:22:48.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.039+0000 7f05345a5700 1 Processor -- start 2024-05-08T19:22:48.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.039+0000 7f05345a5700 1 -- start start 2024-05-08T19:22:48.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.040+0000 7f05345a5700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052c06d940 0x7f052c14fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.040+0000 7f05345a5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052c070670 0x7f052c143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.040+0000 7f05345a5700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f052c144480 0x7f052c1437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.040+0000 7f05345a5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c150660 con 0x7f052c070670 2024-05-08T19:22:48.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.040+0000 7f05345a5700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c140db0 con 0x7f052c144480 2024-05-08T19:22:48.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.040+0000 7f05345a5700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052c13ed90 con 0x7f052c06d940 2024-05-08T19:22:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.041+0000 7f0531b40700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052c070670 0x7f052c143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.041+0000 7f0531b40700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052c070670 0x7f052c143290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56056/0 (socket says 172.21.15.47:56056) 2024-05-08T19:22:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.041+0000 7f0531b40700 1 -- 172.21.15.47:0/2055463773 learned_addr learned my addr 172.21.15.47:0/2055463773 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.041+0000 7f0532341700 1 --2- 172.21.15.47:0/2055463773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052c06d940 0x7f052c14fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.041+0000 7f0532b42700 1 --2- 172.21.15.47:0/2055463773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f052c144480 0x7f052c1437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.041+0000 7f0532341700 1 -- 172.21.15.47:0/2055463773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f052c144480 msgr2=0x7f052c1437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.041+0000 7f0532341700 1 --2- 172.21.15.47:0/2055463773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f052c144480 0x7f052c1437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.042+0000 7f0532341700 1 -- 172.21.15.47:0/2055463773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052c070670 msgr2=0x7f052c143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.042+0000 7f0532341700 1 --2- 172.21.15.47:0/2055463773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052c070670 0x7f052c143290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.042+0000 7f0532341700 1 -- 172.21.15.47:0/2055463773 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c0094a0 con 0x7f052c06d940 2024-05-08T19:22:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.042+0000 7f0532341700 1 --2- 172.21.15.47:0/2055463773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052c06d940 0x7f052c14fb40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f052800e910 tx=0x7f052800ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.042+0000 7f0522ffd700 1 -- 172.21.15.47:0/2055463773 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528013680 con 0x7f052c06d940 2024-05-08T19:22:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.042+0000 7f0522ffd700 1 -- 172.21.15.47:0/2055463773 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05280137e0 con 0x7f052c06d940 2024-05-08T19:22:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.042+0000 7f0522ffd700 1 -- 172.21.15.47:0/2055463773 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528013b50 con 0x7f052c06d940 2024-05-08T19:22:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.042+0000 7f05345a5700 1 -- 172.21.15.47:0/2055463773 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c06ce50 con 0x7f052c06d940 2024-05-08T19:22:48.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.042+0000 7f05345a5700 1 -- 172.21.15.47:0/2055463773 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052c150a00 con 0x7f052c06d940 2024-05-08T19:22:48.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.044+0000 7f0522ffd700 1 -- 172.21.15.47:0/2055463773 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0528013cb0 con 0x7f052c06d940 2024-05-08T19:22:48.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.045+0000 7f0522ffd700 1 --2- 172.21.15.47:0/2055463773 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f051806af00 0x7f051806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.045+0000 7f0522ffd700 1 -- 172.21.15.47:0/2055463773 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0528089430 con 0x7f052c06d940 2024-05-08T19:22:48.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.047+0000 7f0531b40700 1 --2- 172.21.15.47:0/2055463773 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f051806af00 0x7f051806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.047+0000 7f0531b40700 1 --2- 172.21.15.47:0/2055463773 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f051806af00 0x7f051806d3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f052c1404f0 tx=0x7f051c010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.060+0000 7f05345a5700 1 -- 172.21.15.47:0/2055463773 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05140052f0 con 0x7f052c06d940 2024-05-08T19:22:48.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.067+0000 7f0522ffd700 1 -- 172.21.15.47:0/2055463773 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0528054390 con 0x7f052c06d940 2024-05-08T19:22:48.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.086+0000 7f03fe6e8700 1 Processor -- start 2024-05-08T19:22:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.086+0000 7f03fe6e8700 1 -- start start 2024-05-08T19:22:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.085+0000 7fa0316c8700 1 Processor -- start 2024-05-08T19:22:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.085+0000 7fa0316c8700 1 -- start start 2024-05-08T19:22:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.086+0000 7fa0316c8700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa02c156700 0x7fa02c0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.086+0000 7fa0316c8700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02c0aa200 con 0x7fa02c0728c0 2024-05-08T19:22:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.086+0000 7fa0316c8700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02c0a9c90 con 0x7fa02c159000 2024-05-08T19:22:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.086+0000 7fa0316c8700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02c0ac280 con 0x7fa02c156700 2024-05-08T19:22:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.087+0000 7fa02b7fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fa02c159000 0x7fa02c159430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:36332/0 (socket says 172.21.15.47:36332) 2024-05-08T19:22:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.087+0000 7fa02b7fe700 1 -- 172.21.15.47:0/3994419989 learned_addr learned my addr 172.21.15.47:0/3994419989 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.087+0000 7f03fe6e8700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f03f806cc20 0x7f03f814def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.087+0000 7f03fe6e8700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03f806e9d0 0x7f03f806d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.087+0000 7f03fe6e8700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f8071550 con 0x7f03f8070670 2024-05-08T19:22:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.087+0000 7f03fe6e8700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f814e430 con 0x7f03f806cc20 2024-05-08T19:22:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.087+0000 7f03fe6e8700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f8071060 con 0x7f03f806e9d0 2024-05-08T19:22:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.088+0000 7f03f77fe700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03f806e9d0 0x7f03f806d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.088+0000 7f03f77fe700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03f806e9d0 0x7f03f806d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:41224/0 (socket says 172.21.15.47:41224) 2024-05-08T19:22:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.088+0000 7f03f77fe700 1 -- 172.21.15.47:0/1457378006 learned_addr learned my addr 172.21.15.47:0/1457378006 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:48.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.088+0000 7f03f7fff700 1 --2- 172.21.15.47:0/1457378006 >> v2:172.21.15.47:3300/0 conn(0x7f03f806cc20 0x7f03f814def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.088+0000 7f03f77fe700 1 -- 172.21.15.47:0/1457378006 >> v2:172.21.15.47:3300/0 conn(0x7f03f806cc20 msgr2=0x7f03f814def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:48.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.088+0000 7f03f77fe700 1 --2- 172.21.15.47:0/1457378006 >> v2:172.21.15.47:3300/0 conn(0x7f03f806cc20 0x7f03f814def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.088+0000 7f03f77fe700 1 -- 172.21.15.47:0/1457378006 >> v1:172.21.15.47:6789/0 conn(0x7f03f8070670 legacy=0x7f03f8153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:48.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.088+0000 7f03f77fe700 1 -- 172.21.15.47:0/1457378006 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f806db50 con 0x7f03f806e9d0 2024-05-08T19:22:48.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.088+0000 7fa02affd700 1 --2- 172.21.15.47:0/3994419989 >> v2:172.21.15.47:3300/0 conn(0x7fa02c156700 0x7fa02c0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.089+0000 7fa02affd700 1 -- 172.21.15.47:0/3994419989 >> v1:172.21.15.177:6789/0 conn(0x7fa02c159000 legacy=0x7fa02c159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.089+0000 7fa02affd700 1 -- 172.21.15.47:0/3994419989 >> v1:172.21.15.47:6789/0 conn(0x7fa02c0728c0 legacy=0x7fa02c0c2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.089+0000 7fa02affd700 1 -- 172.21.15.47:0/3994419989 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c0abce0 con 0x7fa02c156700 2024-05-08T19:22:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.089+0000 7fa02affd700 1 --2- 172.21.15.47:0/3994419989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa02c156700 0x7fa02c0c1cb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa024009d90 tx=0x7fa02400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d307c12df8b838 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.089+0000 7f03f77fe700 1 --2- 172.21.15.47:0/1457378006 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03f806e9d0 0x7f03f806d610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f03f0014500 tx=0x7f03f0014810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91154873543c6c40 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.089+0000 7fa029ffb700 1 -- 172.21.15.47:0/3994419989 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02400e070 con 0x7fa02c156700 2024-05-08T19:22:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.089+0000 7fa029ffb700 1 -- 172.21.15.47:0/3994419989 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02400bbd0 con 0x7fa02c156700 2024-05-08T19:22:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.089+0000 7fa029ffb700 1 -- 172.21.15.47:0/3994419989 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024012430 con 0x7fa02c156700 2024-05-08T19:22:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.089+0000 7f03f6ffd700 1 -- 172.21.15.47:0/1457378006 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0003c20 con 0x7f03f806e9d0 2024-05-08T19:22:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.089+0000 7f03f6ffd700 1 -- 172.21.15.47:0/1457378006 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f0003d80 con 0x7f03f806e9d0 2024-05-08T19:22:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.089+0000 7f03f6ffd700 1 -- 172.21.15.47:0/1457378006 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f00187d0 con 0x7f03f806e9d0 2024-05-08T19:22:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.090+0000 7fa0316c8700 1 -- 172.21.15.47:0/3994419989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa02c156700 msgr2=0x7fa02c0c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.090+0000 7fa0316c8700 1 --2- 172.21.15.47:0/3994419989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa02c156700 0x7fa02c0c1cb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa024009d90 tx=0x7fa02400b330 comp rx=0 tx=0).stop 2024-05-08T19:22:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.090+0000 7f03fe6e8700 1 -- 172.21.15.47:0/1457378006 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03f806e9d0 msgr2=0x7f03f806d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.090+0000 7f03fe6e8700 1 --2- 172.21.15.47:0/1457378006 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03f806e9d0 0x7f03f806d610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f03f0014500 tx=0x7f03f0014810 comp rx=0 tx=0).stop 2024-05-08T19:22:48.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.091+0000 7fa0316c8700 1 -- 172.21.15.47:0/3994419989 shutdown_connections 2024-05-08T19:22:48.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.091+0000 7fa0316c8700 1 --2- 172.21.15.47:0/3994419989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa02c156700 0x7fa02c0c1cb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.091+0000 7fa0316c8700 1 -- 172.21.15.47:0/3994419989 >> 172.21.15.47:0/3994419989 conn(0x7fa02c0c3c20 msgr2=0x7fa02c0c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:48.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.091+0000 7fa0316c8700 1 -- 172.21.15.47:0/3994419989 shutdown_connections 2024-05-08T19:22:48.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.091+0000 7fa0316c8700 1 -- 172.21.15.47:0/3994419989 wait complete. 2024-05-08T19:22:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.091+0000 7f03fe6e8700 1 -- 172.21.15.47:0/1457378006 shutdown_connections 2024-05-08T19:22:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.091+0000 7f03fe6e8700 1 --2- 172.21.15.47:0/1457378006 >> v2:172.21.15.47:3300/0 conn(0x7f03f806cc20 0x7f03f814def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.091+0000 7f03fe6e8700 1 --2- 172.21.15.47:0/1457378006 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03f806e9d0 0x7f03f806d610 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.091+0000 7f03fe6e8700 1 -- 172.21.15.47:0/1457378006 >> 172.21.15.47:0/1457378006 conn(0x7f03f806a9c0 msgr2=0x7f03f806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.091+0000 7f03fe6e8700 1 -- 172.21.15.47:0/1457378006 shutdown_connections 2024-05-08T19:22:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.092+0000 7fa0316c8700 1 Processor -- start 2024-05-08T19:22:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.092+0000 7fa0316c8700 1 -- start start 2024-05-08T19:22:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.093+0000 7fa0316c8700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa02c0728c0 0x7fa02c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.093+0000 7fa0316c8700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa02c156700 0x7fa02c158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.093+0000 7fa0316c8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa02c159000 0x7fa02c132c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.093+0000 7fa0316c8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c06f620 con 0x7fa02c159000 2024-05-08T19:22:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.093+0000 7fa0316c8700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c142320 con 0x7fa02c156700 2024-05-08T19:22:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.093+0000 7fa0316c8700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c06f0a0 con 0x7fa02c0728c0 2024-05-08T19:22:48.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.091+0000 7f03fe6e8700 1 -- 172.21.15.47:0/1457378006 wait complete. 2024-05-08T19:22:48.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.093+0000 7f03fe6e8700 1 Processor -- start 2024-05-08T19:22:48.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.095+0000 7f371a0d2700 1 Processor -- start 2024-05-08T19:22:48.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.094+0000 7fa02a7fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa02c156700 0x7fa02c158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.094+0000 7fa02a7fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa02c156700 0x7fa02c158180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:42166/0 (socket says 172.21.15.47:42166) 2024-05-08T19:22:48.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.094+0000 7fa02a7fc700 1 -- 172.21.15.47:0/3609793156 learned_addr learned my addr 172.21.15.47:0/3609793156 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:48.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.094+0000 7fa02b7fe700 1 --2- 172.21.15.47:0/3609793156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa02c159000 0x7fa02c132c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.094+0000 7fa02affd700 1 --2- 172.21.15.47:0/3609793156 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa02c0728c0 0x7fa02c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.094+0000 7fa02b7fe700 1 -- 172.21.15.47:0/3609793156 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa02c0728c0 msgr2=0x7fa02c06eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.094+0000 7fa02b7fe700 1 --2- 172.21.15.47:0/3609793156 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa02c0728c0 0x7fa02c06eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.094+0000 7fa02b7fe700 1 -- 172.21.15.47:0/3609793156 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa02c156700 msgr2=0x7fa02c158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.094+0000 7fa02b7fe700 1 --2- 172.21.15.47:0/3609793156 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa02c156700 0x7fa02c158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.094+0000 7fa02b7fe700 1 -- 172.21.15.47:0/3609793156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa024009a70 con 0x7fa02c159000 2024-05-08T19:22:48.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.094+0000 7fa02b7fe700 1 --2- 172.21.15.47:0/3609793156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa02c159000 0x7fa02c132c60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa02000c3c0 tx=0x7fa02000c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.094+0000 7f03fe6e8700 1 -- start start 2024-05-08T19:22:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.095+0000 7f03fe6e8700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03f806cc20 0x7f03f8153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.095+0000 7f03fe6e8700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03f806e9d0 0x7f03f80ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.095+0000 7f03fe6e8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03f8070670 0x7f03f80abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.095+0000 7f03fe6e8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f80a9ec0 con 0x7f03f8070670 2024-05-08T19:22:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.095+0000 7f03fe6e8700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f81f7800 con 0x7f03f806cc20 2024-05-08T19:22:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.095+0000 7f03fe6e8700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f80ac0f0 con 0x7f03f806e9d0 2024-05-08T19:22:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.096+0000 7f03fcc85700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03f8070670 0x7f03f80abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.096+0000 7f03fcc85700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03f8070670 0x7f03f80abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56094/0 (socket says 172.21.15.47:56094) 2024-05-08T19:22:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.096+0000 7f03fcc85700 1 -- 172.21.15.47:0/1013454506 learned_addr learned my addr 172.21.15.47:0/1013454506 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:48.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.095+0000 7f371a0d2700 1 -- start start 2024-05-08T19:22:48.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.096+0000 7f371a0d2700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f371406d940 0x7f371406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.096+0000 7f371a0d2700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f371406e260 0x7f371414a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.096+0000 7f371a0d2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3714151490 con 0x7f3714070670 2024-05-08T19:22:48.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.096+0000 7f371a0d2700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3714071cc0 con 0x7f371406e260 2024-05-08T19:22:48.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.096+0000 7f371a0d2700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3714151770 con 0x7f371406d940 2024-05-08T19:22:48.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.096+0000 7f3712ffd700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f371406e260 0x7f371414a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.096+0000 7f37137fe700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f371406d940 0x7f371406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.096+0000 7f3713fff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f3714070670 0x7f37140c0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:36342/0 (socket says 172.21.15.47:36342) 2024-05-08T19:22:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.096+0000 7f3713fff700 1 -- 172.21.15.47:0/903239390 learned_addr learned my addr 172.21.15.47:0/903239390 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.096+0000 7f3712ffd700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f371406e260 0x7f371414a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56110/0 (socket says 172.21.15.47:56110) 2024-05-08T19:22:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.097+0000 7f3712ffd700 1 -- 172.21.15.47:0/903239390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f371406d940 msgr2=0x7f371406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.097+0000 7f3712ffd700 1 --2- 172.21.15.47:0/903239390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f371406d940 0x7f371406dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.097+0000 7f3712ffd700 1 -- 172.21.15.47:0/903239390 >> v1:172.21.15.177:6789/0 conn(0x7f3714070670 legacy=0x7f37140c0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.097+0000 7f3712ffd700 1 -- 172.21.15.47:0/903239390 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37140711b0 con 0x7f371406e260 2024-05-08T19:22:48.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.097+0000 7f03fcc85700 1 -- 172.21.15.47:0/1013454506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03f806e9d0 msgr2=0x7f03f80ab670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T19:22:48.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.097+0000 7f03fcc85700 1 --2- 172.21.15.47:0/1013454506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03f806e9d0 0x7f03f80ab670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.097+0000 7f03fcc85700 1 -- 172.21.15.47:0/1013454506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03f806cc20 msgr2=0x7f03f8153e90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T19:22:48.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.097+0000 7f03fcc85700 1 --2- 172.21.15.47:0/1013454506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03f806cc20 0x7f03f8153e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.097+0000 7f03fcc85700 1 -- 172.21.15.47:0/1013454506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f0014160 con 0x7f03f8070670 2024-05-08T19:22:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.097+0000 7f3712ffd700 1 --2- 172.21.15.47:0/903239390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f371406e260 0x7f371414a650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f370800bae0 tx=0x7f370800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de103b087f02be2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.097+0000 7fa0137fe700 1 -- 172.21.15.47:0/3609793156 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa020005b70 con 0x7fa02c159000 2024-05-08T19:22:48.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.097+0000 7fa0137fe700 1 -- 172.21.15.47:0/3609793156 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa020005cd0 con 0x7fa02c159000 2024-05-08T19:22:48.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.097+0000 7fa0137fe700 1 -- 172.21.15.47:0/3609793156 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0200072f0 con 0x7fa02c159000 2024-05-08T19:22:48.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.097+0000 7fa0316c8700 1 -- 172.21.15.47:0/3609793156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02c06f340 con 0x7fa02c159000 2024-05-08T19:22:48.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.097+0000 7fa0316c8700 1 -- 172.21.15.47:0/3609793156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02c141fb0 con 0x7fa02c159000 2024-05-08T19:22:48.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.098+0000 7f03fcc85700 1 --2- 172.21.15.47:0/1013454506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03f8070670 0x7f03f80abbb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009fd0 tx=0x7f03ec00b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.098+0000 7f03f4ff9700 1 -- 172.21.15.47:0/1013454506 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec011830 con 0x7f03f8070670 2024-05-08T19:22:48.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.098+0000 7f03f4ff9700 1 -- 172.21.15.47:0/1013454506 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec011990 con 0x7f03f8070670 2024-05-08T19:22:48.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.098+0000 7f03f4ff9700 1 -- 172.21.15.47:0/1013454506 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec011d40 con 0x7f03f8070670 2024-05-08T19:22:48.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.098+0000 7f03fe6e8700 1 -- 172.21.15.47:0/1013454506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f81f7aa0 con 0x7f03f8070670 2024-05-08T19:22:48.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.098+0000 7f03fe6e8700 1 -- 172.21.15.47:0/1013454506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f80a9b50 con 0x7f03f8070670 2024-05-08T19:22:48.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.100+0000 7fa0316c8700 1 -- 172.21.15.47:0/3609793156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0180052f0 con 0x7fa02c159000 2024-05-08T19:22:48.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.101+0000 7f37127fc700 1 -- 172.21.15.47:0/903239390 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370800dc70 con 0x7f371406e260 2024-05-08T19:22:48.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.101+0000 7f37127fc700 1 -- 172.21.15.47:0/903239390 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370800ddd0 con 0x7f371406e260 2024-05-08T19:22:48.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.101+0000 7f37127fc700 1 -- 172.21.15.47:0/903239390 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708010670 con 0x7f371406e260 2024-05-08T19:22:48.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.101+0000 7f371a0d2700 1 -- 172.21.15.47:0/903239390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f371406e260 msgr2=0x7f371414a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.101+0000 7f371a0d2700 1 --2- 172.21.15.47:0/903239390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f371406e260 0x7f371414a650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f370800bae0 tx=0x7f370800bdf0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.102+0000 7f371a0d2700 1 -- 172.21.15.47:0/903239390 shutdown_connections 2024-05-08T19:22:48.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.102+0000 7f371a0d2700 1 --2- 172.21.15.47:0/903239390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f371406d940 0x7f371406dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.102+0000 7f371a0d2700 1 --2- 172.21.15.47:0/903239390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f371406e260 0x7f371414a650 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.102+0000 7f371a0d2700 1 -- 172.21.15.47:0/903239390 >> 172.21.15.47:0/903239390 conn(0x7f371406a9c0 msgr2=0x7f371406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:48.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.102+0000 7f03fe6e8700 1 -- 172.21.15.47:0/1013454506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d40052f0 con 0x7f03f8070670 2024-05-08T19:22:48.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.102+0000 7f03f4ff9700 1 -- 172.21.15.47:0/1013454506 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f03ec01a400 con 0x7f03f8070670 2024-05-08T19:22:48.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.103+0000 7f03f4ff9700 1 --2- 172.21.15.47:0/1013454506 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f03dc06ad60 0x7f03dc06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.103+0000 7f03f4ff9700 1 -- 172.21.15.47:0/1013454506 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f03ec0894f0 con 0x7f03f8070670 2024-05-08T19:22:48.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.108+0000 7f03f4ff9700 1 -- 172.21.15.47:0/1013454506 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f03ec054450 con 0x7f03f8070670 2024-05-08T19:22:48.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.110+0000 7f371a0d2700 1 -- 172.21.15.47:0/903239390 shutdown_connections 2024-05-08T19:22:48.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.110+0000 7f371a0d2700 1 -- 172.21.15.47:0/903239390 wait complete. 2024-05-08T19:22:48.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.112+0000 7f371a0d2700 1 Processor -- start 2024-05-08T19:22:48.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.112+0000 7f371a0d2700 1 -- start start 2024-05-08T19:22:48.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.111+0000 7fa0137fe700 1 -- 172.21.15.47:0/3609793156 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa020007450 con 0x7fa02c159000 2024-05-08T19:22:48.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.111+0000 7fa0137fe700 1 --2- 172.21.15.47:0/3609793156 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa01406aef0 0x7fa01406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.111+0000 7fa0137fe700 1 -- 172.21.15.47:0/3609793156 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa020088d50 con 0x7fa02c159000 2024-05-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.113+0000 7f371a0d2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f371406d940 0x7f371414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.113+0000 7f371a0d2700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3714070670 0x7f37141ebb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.113+0000 7f371a0d2700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3714150690 0x7f37141ec050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.113+0000 7f371a0d2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37140c5140 con 0x7f371406d940 2024-05-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.113+0000 7f371a0d2700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37140c5420 con 0x7f3714070670 2024-05-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.113+0000 7f371a0d2700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37140c5700 con 0x7f3714150690 2024-05-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.114+0000 7f37137fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f371406d940 0x7f371414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.114+0000 7f37137fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f371406d940 0x7f371414f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56122/0 (socket says 172.21.15.47:56122) 2024-05-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.114+0000 7f37137fe700 1 -- 172.21.15.47:0/2122866474 learned_addr learned my addr 172.21.15.47:0/2122866474 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.115+0000 7f3713fff700 1 --2- 172.21.15.47:0/2122866474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3714150690 0x7f37141ec050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.115+0000 7f3712ffd700 1 --2- 172.21.15.47:0/2122866474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3714070670 0x7f37141ebb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.115+0000 7f37137fe700 1 -- 172.21.15.47:0/2122866474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3714150690 msgr2=0x7f37141ec050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.115+0000 7f37137fe700 1 --2- 172.21.15.47:0/2122866474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3714150690 0x7f37141ec050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.115+0000 7f37137fe700 1 -- 172.21.15.47:0/2122866474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3714070670 msgr2=0x7f37141ebb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.115+0000 7f37137fe700 1 --2- 172.21.15.47:0/2122866474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3714070670 0x7f37141ebb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.115+0000 7f37137fe700 1 -- 172.21.15.47:0/2122866474 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370800b740 con 0x7f371406d940 2024-05-08T19:22:48.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.115+0000 7f37137fe700 1 --2- 172.21.15.47:0/2122866474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f371406d940 0x7f371414f740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f370400bb80 tx=0x7f370400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.114+0000 7f03f7fff700 1 --2- 172.21.15.47:0/1013454506 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f03dc06ad60 0x7f03dc06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.115+0000 7fa0137fe700 1 -- 172.21.15.47:0/3609793156 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa020053cb0 con 0x7fa02c159000 2024-05-08T19:22:48.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.117+0000 7fa02affd700 1 --2- 172.21.15.47:0/3609793156 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa01406aef0 0x7fa01406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.119+0000 7fa02affd700 1 --2- 172.21.15.47:0/3609793156 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa01406aef0 0x7fa01406d3b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa024014040 tx=0x7fa024011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.121+0000 7f3713fff700 1 --2- 172.21.15.47:0/2122866474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3714150690 0x7f37141ec050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:48.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.129+0000 7f36fbfff700 1 -- 172.21.15.47:0/2122866474 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704010040 con 0x7f371406d940 2024-05-08T19:22:48.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.129+0000 7f36fbfff700 1 -- 172.21.15.47:0/2122866474 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370400b2e0 con 0x7f371406d940 2024-05-08T19:22:48.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.129+0000 7f36fbfff700 1 -- 172.21.15.47:0/2122866474 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704006a50 con 0x7f371406d940 2024-05-08T19:22:48.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.130+0000 7f371a0d2700 1 -- 172.21.15.47:0/2122866474 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371406ce50 con 0x7f371406d940 2024-05-08T19:22:48.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.130+0000 7f371a0d2700 1 -- 172.21.15.47:0/2122866474 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37141ed570 con 0x7f371406d940 2024-05-08T19:22:48.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.132+0000 7f03f7fff700 1 --2- 172.21.15.47:0/1013454506 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f03dc06ad60 0x7f03dc06d220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009770 tx=0x7f03e8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.131+0000 7f371a0d2700 1 -- 172.21.15.47:0/2122866474 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371404ec60 con 0x7f371406d940 2024-05-08T19:22:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.147+0000 7f36fbfff700 1 -- 172.21.15.47:0/2122866474 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3704006bb0 con 0x7f371406d940 2024-05-08T19:22:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.148+0000 7f36fbfff700 1 --2- 172.21.15.47:0/2122866474 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f36fc06af10 0x7f36fc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.148+0000 7f36fbfff700 1 -- 172.21.15.47:0/2122866474 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f370408a250 con 0x7f371406d940 2024-05-08T19:22:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.148+0000 7f36fbfff700 1 -- 172.21.15.47:0/2122866474 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f370408a6d0 con 0x7f371406d940 2024-05-08T19:22:48.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.154+0000 7f3712ffd700 1 --2- 172.21.15.47:0/2122866474 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f36fc06af10 0x7f36fc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.187+0000 7f3712ffd700 1 --2- 172.21.15.47:0/2122866474 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f36fc06af10 0x7f36fc06d3d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3708000c00 tx=0x7f3708013000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.337+0000 7fc2bfc2b700 1 -- 172.21.15.47:0/3200037052 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc2a00055a0 con 0x7fc2b806e370 2024-05-08T19:22:48.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.338+0000 7fc2ae7fc700 1 -- 172.21.15.47:0/3200037052 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc2a8017070 con 0x7fc2b806e370 2024-05-08T19:22:48.333 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-05-08T19:22:48.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.341+0000 7fc2bfc2b700 1 -- 172.21.15.47:0/3200037052 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc29c06ac90 msgr2=0x7fc29c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.341+0000 7fc2bfc2b700 1 --2- 172.21.15.47:0/3200037052 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc29c06ac90 0x7fc29c06d150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc2b815fa00 tx=0x7fc2b4009040 comp rx=0 tx=0).stop 2024-05-08T19:22:48.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.341+0000 7fc2bfc2b700 1 -- 172.21.15.47:0/3200037052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2b806e370 msgr2=0x7fc2b8160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.341+0000 7fc2bfc2b700 1 --2- 172.21.15.47:0/3200037052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2b806e370 0x7fc2b8160eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800c4b0 tx=0x7fc2a800c7c0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.342+0000 7fc2bfc2b700 1 -- 172.21.15.47:0/3200037052 shutdown_connections 2024-05-08T19:22:48.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.342+0000 7fc2bfc2b700 1 --2- 172.21.15.47:0/3200037052 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc29c06ac90 0x7fc29c06d150 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.342+0000 7fc2bfc2b700 1 --2- 172.21.15.47:0/3200037052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b806edd0 0x7fc2b81f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.342+0000 7fc2bfc2b700 1 --2- 172.21.15.47:0/3200037052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2b806e370 0x7fc2b8160eb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.342+0000 7fc2bfc2b700 1 --2- 172.21.15.47:0/3200037052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b806e880 0x7fc2b81ef120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.342+0000 7fc2bfc2b700 1 -- 172.21.15.47:0/3200037052 >> 172.21.15.47:0/3200037052 conn(0x7fc2b80c33d0 msgr2=0x7fc2b815f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:48.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.342+0000 7fc2bfc2b700 1 -- 172.21.15.47:0/3200037052 shutdown_connections 2024-05-08T19:22:48.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.342+0000 7fc2bfc2b700 1 -- 172.21.15.47:0/3200037052 wait complete. 2024-05-08T19:22:48.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2024-05-08T19:22:48.354 DEBUG:teuthology.parallel:result is None 2024-05-08T19:22:48.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.406+0000 7f46b0daf700 1 -- 172.21.15.47:0/2619501848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f46ac04ec60 con 0x7f46ac14f8d0 2024-05-08T19:22:48.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.406+0000 7f469affd700 1 -- 172.21.15.47:0/2619501848 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f46a0059b20 con 0x7f46ac14f8d0 2024-05-08T19:22:48.399 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-05-08T19:22:48.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.410+0000 7f46b0daf700 1 -- 172.21.15.47:0/2619501848 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f468c06ac90 msgr2=0x7f468c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.410+0000 7f46b0daf700 1 --2- 172.21.15.47:0/2619501848 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f468c06ac90 0x7f468c06d150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f46ac06b460 tx=0x7f469c006cc0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.410+0000 7f46b0daf700 1 -- 172.21.15.47:0/2619501848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46ac14f8d0 msgr2=0x7f46ac14fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.410+0000 7f46b0daf700 1 --2- 172.21.15.47:0/2619501848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46ac14f8d0 0x7f46ac14fcb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f46a00056f0 tx=0x7f46a0004a10 comp rx=0 tx=0).stop 2024-05-08T19:22:48.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.410+0000 7f46b0daf700 1 -- 172.21.15.47:0/2619501848 shutdown_connections 2024-05-08T19:22:48.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.410+0000 7f46b0daf700 1 --2- 172.21.15.47:0/2619501848 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f468c06ac90 0x7f468c06d150 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.410+0000 7f46b0daf700 1 --2- 172.21.15.47:0/2619501848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46ac14f8d0 0x7f46ac14fcb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.410+0000 7f46b0daf700 1 --2- 172.21.15.47:0/2619501848 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46ac1f2230 0x7f46ac143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.410+0000 7f46b0daf700 1 --2- 172.21.15.47:0/2619501848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46ac152720 0x7f46ac142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.410+0000 7f46b0daf700 1 -- 172.21.15.47:0/2619501848 >> 172.21.15.47:0/2619501848 conn(0x7f46ac06a9c0 msgr2=0x7f46ac148620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:48.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.410+0000 7f46b0daf700 1 -- 172.21.15.47:0/2619501848 shutdown_connections 2024-05-08T19:22:48.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.410+0000 7f46b0daf700 1 -- 172.21.15.47:0/2619501848 wait complete. 2024-05-08T19:22:48.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-05-08T19:22:48.417 DEBUG:teuthology.parallel:result is None 2024-05-08T19:22:48.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.427+0000 7f642fa95700 1 -- 172.21.15.47:0/1689034023 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f640c0055a0 con 0x7f6428162d70 2024-05-08T19:22:48.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.428+0000 7f641e7fc700 1 -- 172.21.15.47:0/1689034023 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6420059aa0 con 0x7f6428162d70 2024-05-08T19:22:48.420 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-05-08T19:22:48.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.431+0000 7f642fa95700 1 -- 172.21.15.47:0/1689034023 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f6414073700 msgr2=0x7f6414075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.431+0000 7f642fa95700 1 --2- 172.21.15.47:0/1689034023 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f6414073700 0x7f6414075bc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6428159c70 tx=0x7f642400c230 comp rx=0 tx=0).stop 2024-05-08T19:22:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.431+0000 7f642fa95700 1 -- 172.21.15.47:0/1689034023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6428162d70 msgr2=0x7f64281f7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.431+0000 7f642fa95700 1 --2- 172.21.15.47:0/1689034023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6428162d70 0x7f64281f7af0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6428067640 tx=0x7f6420004ad0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.431+0000 7f642fa95700 1 -- 172.21.15.47:0/1689034023 shutdown_connections 2024-05-08T19:22:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.431+0000 7f642fa95700 1 --2- 172.21.15.47:0/1689034023 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f6414073700 0x7f6414075bc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.431+0000 7f642fa95700 1 --2- 172.21.15.47:0/1689034023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6428070bb0 0x7f64281ee5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.431+0000 7f642fa95700 1 --2- 172.21.15.47:0/1689034023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6428162d70 0x7f64281f7af0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.431+0000 7f642fa95700 1 --2- 172.21.15.47:0/1689034023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64281fa750 0x7f64281fb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.431+0000 7f642fa95700 1 -- 172.21.15.47:0/1689034023 >> 172.21.15.47:0/1689034023 conn(0x7f642806a9c0 msgr2=0x7f64280c2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.432+0000 7f642fa95700 1 -- 172.21.15.47:0/1689034023 shutdown_connections 2024-05-08T19:22:48.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.432+0000 7f642fa95700 1 -- 172.21.15.47:0/1689034023 wait complete. 2024-05-08T19:22:48.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-05-08T19:22:48.437 DEBUG:teuthology.parallel:result is None 2024-05-08T19:22:48.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.447+0000 7f1ce4bba700 1 -- 172.21.15.47:0/4109981226 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1cc40055a0 con 0x7f1ce006b4e0 2024-05-08T19:22:48.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.447+0000 7f1cceffd700 1 -- 172.21.15.47:0/4109981226 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1cd805a060 con 0x7f1ce006b4e0 2024-05-08T19:22:48.439 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-05-08T19:22:48.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.449+0000 7f1ce4bba700 1 -- 172.21.15.47:0/4109981226 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1cc006ad60 msgr2=0x7f1cc006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.449+0000 7f1ce4bba700 1 --2- 172.21.15.47:0/4109981226 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1cc006ad60 0x7f1cc006d220 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40013c0 tx=0x7f1cd4001350 comp rx=0 tx=0).stop 2024-05-08T19:22:48.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.449+0000 7f1ce4bba700 1 -- 172.21.15.47:0/4109981226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ce006b4e0 msgr2=0x7f1ce015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.449+0000 7f1ce4bba700 1 --2- 172.21.15.47:0/4109981226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ce006b4e0 0x7f1ce015dbb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800b730 tx=0x7f1cd8004ad0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.450+0000 7f1ce4bba700 1 -- 172.21.15.47:0/4109981226 shutdown_connections 2024-05-08T19:22:48.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.450+0000 7f1ce4bba700 1 --2- 172.21.15.47:0/4109981226 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1cc006ad60 0x7f1cc006d220 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.450+0000 7f1ce4bba700 1 --2- 172.21.15.47:0/4109981226 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1ce00c11b0 0x7f1ce013a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.450+0000 7f1ce4bba700 1 --2- 172.21.15.47:0/4109981226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ce006b4e0 0x7f1ce015dbb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.450+0000 7f1ce4bba700 1 --2- 172.21.15.47:0/4109981226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce0070670 0x7f1ce0139bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.450+0000 7f1ce4bba700 1 -- 172.21.15.47:0/4109981226 >> 172.21.15.47:0/4109981226 conn(0x7f1ce006a9c0 msgr2=0x7f1ce00c3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:48.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.450+0000 7f1ce4bba700 1 -- 172.21.15.47:0/4109981226 shutdown_connections 2024-05-08T19:22:48.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.450+0000 7f1ce4bba700 1 -- 172.21.15.47:0/4109981226 wait complete. 2024-05-08T19:22:48.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2024-05-08T19:22:48.455 DEBUG:teuthology.parallel:result is None 2024-05-08T19:22:48.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.506+0000 7f05345a5700 1 -- 172.21.15.47:0/2055463773 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f05140055a0 con 0x7f052c06d940 2024-05-08T19:22:48.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.507+0000 7f0522ffd700 1 -- 172.21.15.47:0/2055463773 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0528021020 con 0x7f052c06d940 2024-05-08T19:22:48.499 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-05-08T19:22:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.510+0000 7f05345a5700 1 -- 172.21.15.47:0/2055463773 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f051806af00 msgr2=0x7f051806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.510+0000 7f05345a5700 1 --2- 172.21.15.47:0/2055463773 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f051806af00 0x7f051806d3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f052c1404f0 tx=0x7f051c010000 comp rx=0 tx=0).stop 2024-05-08T19:22:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.510+0000 7f05345a5700 1 -- 172.21.15.47:0/2055463773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052c06d940 msgr2=0x7f052c14fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.510+0000 7f05345a5700 1 --2- 172.21.15.47:0/2055463773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052c06d940 0x7f052c14fb40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f052800e910 tx=0x7f052800ec20 comp rx=0 tx=0).stop 2024-05-08T19:22:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.510+0000 7f05345a5700 1 -- 172.21.15.47:0/2055463773 shutdown_connections 2024-05-08T19:22:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.510+0000 7f05345a5700 1 --2- 172.21.15.47:0/2055463773 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f051806af00 0x7f051806d3c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.510+0000 7f05345a5700 1 --2- 172.21.15.47:0/2055463773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f052c144480 0x7f052c1437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.510+0000 7f05345a5700 1 --2- 172.21.15.47:0/2055463773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f052c06d940 0x7f052c14fb40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.510+0000 7f05345a5700 1 --2- 172.21.15.47:0/2055463773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052c070670 0x7f052c143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.510+0000 7f05345a5700 1 -- 172.21.15.47:0/2055463773 >> 172.21.15.47:0/2055463773 conn(0x7f052c06a9c0 msgr2=0x7f052c13c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.510+0000 7f05345a5700 1 -- 172.21.15.47:0/2055463773 shutdown_connections 2024-05-08T19:22:48.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.510+0000 7f05345a5700 1 -- 172.21.15.47:0/2055463773 wait complete. 2024-05-08T19:22:48.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.517+0000 7f03fe6e8700 1 -- 172.21.15.47:0/1013454506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f03d4005160 con 0x7f03f8070670 2024-05-08T19:22:48.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.518+0000 7f03f4ff9700 1 -- 172.21.15.47:0/1013454506 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f03ec05ce60 con 0x7f03f8070670 2024-05-08T19:22:48.510 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-05-08T19:22:48.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.520+0000 7f03fe6e8700 1 -- 172.21.15.47:0/1013454506 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f03dc06ad60 msgr2=0x7f03dc06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.520+0000 7f03fe6e8700 1 --2- 172.21.15.47:0/1013454506 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f03dc06ad60 0x7f03dc06d220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009770 tx=0x7f03e8008040 comp rx=0 tx=0).stop 2024-05-08T19:22:48.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.520+0000 7f03fe6e8700 1 -- 172.21.15.47:0/1013454506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03f8070670 msgr2=0x7f03f80abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.520+0000 7f03fe6e8700 1 --2- 172.21.15.47:0/1013454506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03f8070670 0x7f03f80abbb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009fd0 tx=0x7f03ec00b770 comp rx=0 tx=0).stop 2024-05-08T19:22:48.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.520+0000 7f03fe6e8700 1 -- 172.21.15.47:0/1013454506 shutdown_connections 2024-05-08T19:22:48.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.520+0000 7f03fe6e8700 1 --2- 172.21.15.47:0/1013454506 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f03dc06ad60 0x7f03dc06d220 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.520+0000 7f03fe6e8700 1 --2- 172.21.15.47:0/1013454506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03f8070670 0x7f03f80abbb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.520+0000 7f03fe6e8700 1 --2- 172.21.15.47:0/1013454506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03f806cc20 0x7f03f8153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.520+0000 7f03fe6e8700 1 --2- 172.21.15.47:0/1013454506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f03f806e9d0 0x7f03f80ab670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.520+0000 7f03fe6e8700 1 -- 172.21.15.47:0/1013454506 >> 172.21.15.47:0/1013454506 conn(0x7f03f806a9c0 msgr2=0x7f03f806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:48.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.520+0000 7f03fe6e8700 1 -- 172.21.15.47:0/1013454506 shutdown_connections 2024-05-08T19:22:48.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.520+0000 7f03fe6e8700 1 -- 172.21.15.47:0/1013454506 wait complete. 2024-05-08T19:22:48.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-05-08T19:22:48.521 DEBUG:teuthology.parallel:result is None 2024-05-08T19:22:48.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2024-05-08T19:22:48.525 DEBUG:teuthology.parallel:result is None 2024-05-08T19:22:48.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.536+0000 7fa0316c8700 1 -- 172.21.15.47:0/3609793156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa018005870 con 0x7fa02c159000 2024-05-08T19:22:48.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.536+0000 7fa0137fe700 1 -- 172.21.15.47:0/3609793156 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa0200572d0 con 0x7fa02c159000 2024-05-08T19:22:48.528 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-05-08T19:22:48.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.538+0000 7fa0316c8700 1 -- 172.21.15.47:0/3609793156 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa01406aef0 msgr2=0x7fa01406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.538+0000 7fa0316c8700 1 --2- 172.21.15.47:0/3609793156 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa01406aef0 0x7fa01406d3b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa024014040 tx=0x7fa024011000 comp rx=0 tx=0).stop 2024-05-08T19:22:48.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.538+0000 7fa0316c8700 1 -- 172.21.15.47:0/3609793156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa02c159000 msgr2=0x7fa02c132c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.538+0000 7fa0316c8700 1 --2- 172.21.15.47:0/3609793156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa02c159000 0x7fa02c132c60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa02000c3c0 tx=0x7fa02000c6d0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.539+0000 7fa0316c8700 1 -- 172.21.15.47:0/3609793156 shutdown_connections 2024-05-08T19:22:48.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.539+0000 7fa0316c8700 1 --2- 172.21.15.47:0/3609793156 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa01406aef0 0x7fa01406d3b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.539+0000 7fa0316c8700 1 --2- 172.21.15.47:0/3609793156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa02c159000 0x7fa02c132c60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.539+0000 7fa0316c8700 1 --2- 172.21.15.47:0/3609793156 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa02c0728c0 0x7fa02c06eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.539+0000 7fa0316c8700 1 --2- 172.21.15.47:0/3609793156 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa02c156700 0x7fa02c158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.539+0000 7fa0316c8700 1 -- 172.21.15.47:0/3609793156 >> 172.21.15.47:0/3609793156 conn(0x7fa02c0c3c20 msgr2=0x7fa02c1598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:48.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.539+0000 7fa0316c8700 1 -- 172.21.15.47:0/3609793156 shutdown_connections 2024-05-08T19:22:48.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.539+0000 7fa0316c8700 1 -- 172.21.15.47:0/3609793156 wait complete. 2024-05-08T19:22:48.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.541+0000 7f371a0d2700 1 -- 172.21.15.47:0/2122866474 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f37140c5280 con 0x7f371406d940 2024-05-08T19:22:48.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.542+0000 7f36fbfff700 1 -- 172.21.15.47:0/2122866474 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37140c5280 con 0x7f371406d940 2024-05-08T19:22:48.534 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-05-08T19:22:48.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.544+0000 7f371a0d2700 1 -- 172.21.15.47:0/2122866474 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f36fc06af10 msgr2=0x7f36fc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.544+0000 7f371a0d2700 1 --2- 172.21.15.47:0/2122866474 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f36fc06af10 0x7f36fc06d3d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3708000c00 tx=0x7f3708013000 comp rx=0 tx=0).stop 2024-05-08T19:22:48.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.544+0000 7f371a0d2700 1 -- 172.21.15.47:0/2122866474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f371406d940 msgr2=0x7f371414f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.544+0000 7f371a0d2700 1 --2- 172.21.15.47:0/2122866474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f371406d940 0x7f371414f740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f370400bb80 tx=0x7f370400be90 comp rx=0 tx=0).stop 2024-05-08T19:22:48.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.544+0000 7f371a0d2700 1 -- 172.21.15.47:0/2122866474 shutdown_connections 2024-05-08T19:22:48.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.544+0000 7f371a0d2700 1 --2- 172.21.15.47:0/2122866474 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f36fc06af10 0x7f36fc06d3d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.544+0000 7f371a0d2700 1 --2- 172.21.15.47:0/2122866474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f371406d940 0x7f371414f740 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.544+0000 7f371a0d2700 1 --2- 172.21.15.47:0/2122866474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3714150690 0x7f37141ec050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.544+0000 7f371a0d2700 1 --2- 172.21.15.47:0/2122866474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3714070670 0x7f37141ebb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.544+0000 7f371a0d2700 1 -- 172.21.15.47:0/2122866474 >> 172.21.15.47:0/2122866474 conn(0x7f371406a9c0 msgr2=0x7f37141463e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:48.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.544+0000 7f371a0d2700 1 -- 172.21.15.47:0/2122866474 shutdown_connections 2024-05-08T19:22:48.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.544+0000 7f371a0d2700 1 -- 172.21.15.47:0/2122866474 wait complete. 2024-05-08T19:22:48.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-05-08T19:22:48.544 DEBUG:teuthology.parallel:result is None 2024-05-08T19:22:48.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-05-08T19:22:48.549 DEBUG:teuthology.parallel:result is None 2024-05-08T19:22:48.549 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T19:22:48.549 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T19:22:48.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.723+0000 7f7ef9ee7700 1 Processor -- start 2024-05-08T19:22:48.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.723+0000 7f7ef9ee7700 1 -- start start 2024-05-08T19:22:48.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.724+0000 7f7ef9ee7700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef414ff80 0x7f7ef406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.724+0000 7f7ef9ee7700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef40c1cc0 con 0x7f7ef4155e30 2024-05-08T19:22:48.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.724+0000 7f7ef9ee7700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef40c1fa0 con 0x7f7ef40c3040 2024-05-08T19:22:48.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.724+0000 7f7ef9ee7700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40c34d0 con 0x7f7ef414ff80 2024-05-08T19:22:48.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.724+0000 7f7ef3fff700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7ef4155e30 0x7f7ef415d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59966/0 (socket says 172.21.15.47:59966) 2024-05-08T19:22:48.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.724+0000 7f7ef3fff700 1 -- 172.21.15.47:0/3417533335 learned_addr learned my addr 172.21.15.47:0/3417533335 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:48.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.724+0000 7f7ef27fc700 1 -- 172.21.15.47:0/3417533335 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761396448 0 0) 0x7f7ef40c1cc0 con 0x7f7ef4155e30 2024-05-08T19:22:48.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef37fe700 1 --2- 172.21.15.47:0/3417533335 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef414ff80 0x7f7ef406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef27fc700 1 -- 172.21.15.47:0/3417533335 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ee00035b0 con 0x7f7ef4155e30 2024-05-08T19:22:48.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef27fc700 1 -- 172.21.15.47:0/3417533335 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1795810649 0 0) 0x7f7ee00035b0 con 0x7f7ef4155e30 2024-05-08T19:22:48.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef27fc700 1 -- 172.21.15.47:0/3417533335 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef414ff80 msgr2=0x7f7ef406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:48.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef27fc700 1 --2- 172.21.15.47:0/3417533335 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef414ff80 0x7f7ef406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef27fc700 1 -- 172.21.15.47:0/3417533335 >> v1:172.21.15.177:6789/0 conn(0x7f7ef40c3040 legacy=0x7f7ef4152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef27fc700 1 -- 172.21.15.47:0/3417533335 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4152a90 con 0x7f7ef4155e30 2024-05-08T19:22:48.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef27fc700 1 -- 172.21.15.47:0/3417533335 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f7eec0019f0 con 0x7f7ef4155e30 2024-05-08T19:22:48.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef27fc700 1 -- 172.21.15.47:0/3417533335 >> v1:172.21.15.47:6789/0 conn(0x7f7ef4155e30 legacy=0x7f7ef415d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef27fc700 1 --2- 172.21.15.47:0/3417533335 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef414ff80 0x7f7ee0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef27fc700 1 --2- 172.21.15.47:0/3417533335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ee0003fb0 0x7f7ee0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef27fc700 1 --2- 172.21.15.47:0/3417533335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ee0004d90 0x7f7ee0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef27fc700 1 -- 172.21.15.47:0/3417533335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40c34d0 con 0x7f7ee0004d90 2024-05-08T19:22:48.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef27fc700 1 -- 172.21.15.47:0/3417533335 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee000bba0 con 0x7f7ee0003fb0 2024-05-08T19:22:48.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef27fc700 1 -- 172.21.15.47:0/3417533335 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee000bd60 con 0x7f7ef414ff80 2024-05-08T19:22:48.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef3fff700 1 --2- 172.21.15.47:0/3417533335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ee0004d90 0x7f7ee0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef37fe700 1 --2- 172.21.15.47:0/3417533335 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef414ff80 0x7f7ee0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef2ffd700 1 --2- 172.21.15.47:0/3417533335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ee0003fb0 0x7f7ee0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef3fff700 1 -- 172.21.15.47:0/3417533335 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef414ff80 msgr2=0x7f7ee0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:48.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef3fff700 1 --2- 172.21.15.47:0/3417533335 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef414ff80 0x7f7ee0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef3fff700 1 -- 172.21.15.47:0/3417533335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ee0003fb0 msgr2=0x7f7ee0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:48.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef3fff700 1 --2- 172.21.15.47:0/3417533335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ee0003fb0 0x7f7ee0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.725+0000 7f7ef3fff700 1 -- 172.21.15.47:0/3417533335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee00035b0 con 0x7f7ee0004d90 2024-05-08T19:22:48.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.726+0000 7f7ef3fff700 1 --2- 172.21.15.47:0/3417533335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ee0004d90 0x7f7ee0005210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0013d0 tx=0x7f7ee0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21114e506a143857 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.726+0000 7f7ef27fc700 1 -- 172.21.15.47:0/3417533335 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec012600 con 0x7f7ee0004d90 2024-05-08T19:22:48.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.726+0000 7f7ef27fc700 1 -- 172.21.15.47:0/3417533335 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec0127a0 con 0x7f7ee0004d90 2024-05-08T19:22:48.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.726+0000 7f7ef27fc700 1 -- 172.21.15.47:0/3417533335 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec012b50 con 0x7f7ee0004d90 2024-05-08T19:22:48.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.726+0000 7f7ef9ee7700 1 -- 172.21.15.47:0/3417533335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ee0004d90 msgr2=0x7f7ee0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.726+0000 7f7ef9ee7700 1 --2- 172.21.15.47:0/3417533335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ee0004d90 0x7f7ee0005210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0013d0 tx=0x7f7ee0005880 comp rx=0 tx=0).stop 2024-05-08T19:22:48.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.726+0000 7f7ef3fff700 1 -- 172.21.15.47:0/3417533335 reap_dead start 2024-05-08T19:22:48.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.726+0000 7f7ef9ee7700 1 -- 172.21.15.47:0/3417533335 shutdown_connections 2024-05-08T19:22:48.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.726+0000 7f7ef9ee7700 1 -- 172.21.15.47:0/3417533335 >> 172.21.15.47:0/3417533335 conn(0x7f7ef40c3c20 msgr2=0x7f7ef40c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:48.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.726+0000 7f7ef9ee7700 1 -- 172.21.15.47:0/3417533335 shutdown_connections 2024-05-08T19:22:48.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.726+0000 7f7ef9ee7700 1 -- 172.21.15.47:0/3417533335 wait complete. 2024-05-08T19:22:48.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.728+0000 7f7ef9ee7700 1 Processor -- start 2024-05-08T19:22:48.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.728+0000 7f7ef9ee7700 1 -- start start 2024-05-08T19:22:48.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef9ee7700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ef4071840 0x7f7ef41ee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef9ee7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef40c0eb0 0x7f7ef413c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef9ee7700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef41ea6d0 0x7f7ef413cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef9ee7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40abf20 con 0x7f7ef40c0eb0 2024-05-08T19:22:48.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef9ee7700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef41eb6c0 con 0x7f7ef4071840 2024-05-08T19:22:48.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef9ee7700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef406d7d0 con 0x7f7ef41ea6d0 2024-05-08T19:22:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef40c0eb0 0x7f7ef413c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef40c0eb0 0x7f7ef413c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56138/0 (socket says 172.21.15.47:56138) 2024-05-08T19:22:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef2ffd700 1 -- 172.21.15.47:0/796419208 learned_addr learned my addr 172.21.15.47:0/796419208 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef37fe700 1 --2- 172.21.15.47:0/796419208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ef4071840 0x7f7ef41ee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef3fff700 1 --2- 172.21.15.47:0/796419208 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef41ea6d0 0x7f7ef413cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef2ffd700 1 -- 172.21.15.47:0/796419208 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef41ea6d0 msgr2=0x7f7ef413cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef2ffd700 1 --2- 172.21.15.47:0/796419208 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef41ea6d0 0x7f7ef413cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef2ffd700 1 -- 172.21.15.47:0/796419208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ef4071840 msgr2=0x7f7ef41ee2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef2ffd700 1 --2- 172.21.15.47:0/796419208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ef4071840 0x7f7ef41ee2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.729+0000 7f7ef2ffd700 1 -- 172.21.15.47:0/796419208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4148e90 con 0x7f7ef40c0eb0 2024-05-08T19:22:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.730+0000 7f7ef2ffd700 1 --2- 172.21.15.47:0/796419208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef40c0eb0 0x7f7ef413c690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00f850 tx=0x7f7edc00fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.730+0000 7f7eebfff700 1 -- 172.21.15.47:0/796419208 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0052e0 con 0x7f7ef40c0eb0 2024-05-08T19:22:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.730+0000 7f7eebfff700 1 -- 172.21.15.47:0/796419208 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc005440 con 0x7f7ef40c0eb0 2024-05-08T19:22:48.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.730+0000 7f7ef9ee7700 1 -- 172.21.15.47:0/796419208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef4148c20 con 0x7f7ef40c0eb0 2024-05-08T19:22:48.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.730+0000 7f7eebfff700 1 -- 172.21.15.47:0/796419208 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc003910 con 0x7f7ef40c0eb0 2024-05-08T19:22:48.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.730+0000 7f7ef9ee7700 1 -- 172.21.15.47:0/796419208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef406d4f0 con 0x7f7ef40c0eb0 2024-05-08T19:22:48.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.731+0000 7f7ef9ee7700 1 -- 172.21.15.47:0/796419208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef404ec60 con 0x7f7ef40c0eb0 2024-05-08T19:22:48.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.731+0000 7f7eebfff700 1 -- 172.21.15.47:0/796419208 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7edc003a70 con 0x7f7ef40c0eb0 2024-05-08T19:22:48.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.732+0000 7f7eebfff700 1 --2- 172.21.15.47:0/796419208 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f7ed406acc0 0x7f7ed406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:48.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.732+0000 7f7eebfff700 1 -- 172.21.15.47:0/796419208 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7edc0891a0 con 0x7f7ef40c0eb0 2024-05-08T19:22:48.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.732+0000 7f7ef37fe700 1 --2- 172.21.15.47:0/796419208 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f7ed406acc0 0x7f7ed406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:48.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.732+0000 7f7ef37fe700 1 --2- 172.21.15.47:0/796419208 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f7ed406acc0 0x7f7ed406d180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009c60 tx=0x7f7ee4009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:48.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.736+0000 7f7eebfff700 1 -- 172.21.15.47:0/796419208 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7edc0541d0 con 0x7f7ef40c0eb0 2024-05-08T19:22:48.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.938+0000 7f7ef9ee7700 1 -- 172.21.15.47:0/796419208 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ef4150360 con 0x7f7ed406acc0 2024-05-08T19:22:48.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.947+0000 7f7eebfff700 1 -- 172.21.15.47:0/796419208 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345317 (secure 0 0 0) 0x7f7ee4019070 con 0x7f7ed406acc0 2024-05-08T19:22:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:48.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.951+0000 7f7ef9ee7700 1 -- 172.21.15.47:0/796419208 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f7ed406acc0 msgr2=0x7f7ed406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.951+0000 7f7ef9ee7700 1 --2- 172.21.15.47:0/796419208 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f7ed406acc0 0x7f7ed406d180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009c60 tx=0x7f7ee4009210 comp rx=0 tx=0).stop 2024-05-08T19:22:48.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.951+0000 7f7ef9ee7700 1 -- 172.21.15.47:0/796419208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef40c0eb0 msgr2=0x7f7ef413c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:48.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.951+0000 7f7ef9ee7700 1 --2- 172.21.15.47:0/796419208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef40c0eb0 0x7f7ef413c690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00f850 tx=0x7f7edc00fb60 comp rx=0 tx=0).stop 2024-05-08T19:22:48.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.951+0000 7f7ef9ee7700 1 -- 172.21.15.47:0/796419208 shutdown_connections 2024-05-08T19:22:48.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.951+0000 7f7ef9ee7700 1 --2- 172.21.15.47:0/796419208 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f7ed406acc0 0x7f7ed406d180 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.951+0000 7f7ef9ee7700 1 --2- 172.21.15.47:0/796419208 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ef41ea6d0 0x7f7ef413cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.951+0000 7f7ef9ee7700 1 --2- 172.21.15.47:0/796419208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ef4071840 0x7f7ef41ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.951+0000 7f7ef9ee7700 1 --2- 172.21.15.47:0/796419208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ef40c0eb0 0x7f7ef413c690 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:48.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.951+0000 7f7ef9ee7700 1 -- 172.21.15.47:0/796419208 >> 172.21.15.47:0/796419208 conn(0x7f7ef40c3c20 msgr2=0x7f7ef4152eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:48.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.951+0000 7f7ef9ee7700 1 -- 172.21.15.47:0/796419208 shutdown_connections 2024-05-08T19:22:48.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:48.951+0000 7f7ef9ee7700 1 -- 172.21.15.47:0/796419208 wait complete. 2024-05-08T19:22:48.949 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-08T19:22:48.956 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-05-08T19:22:47.871911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218376,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756344,"statfs":{"total":773094113280,"available":772870496256,"internally_reserved":0,"allocated":2228224,"data_stored":1988164,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003617"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888597+0000","last_change":"2024-05-08T19:22:20.461758+0000","last_active":"2024-05-08T19:22:24.888597+0000","last_peered":"2024-05-08T19:22:24.888597+0000","last_clean":"2024-05-08T19:22:24.888597+0000","last_became_active":"2024-05-08T19:22:20.461515+0000","last_became_peered":"2024-05-08T19:22:20.461515+0000","last_unstale":"2024-05-08T19:22:24.888597+0000","last_undegraded":"2024-05-08T19:22:24.888597+0000","last_fullsized":"2024-05-08T19:22:24.888597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879290+0000","last_change":"2024-05-08T19:22:20.434929+0000","last_active":"2024-05-08T19:22:24.879290+0000","last_peered":"2024-05-08T19:22:24.879290+0000","last_clean":"2024-05-08T19:22:24.879290+0000","last_became_active":"2024-05-08T19:22:20.434629+0000","last_became_peered":"2024-05-08T19:22:20.434629+0000","last_unstale":"2024-05-08T19:22:24.879290+0000","last_undegraded":"2024-05-08T19:22:24.879290+0000","last_fullsized":"2024-05-08T19:22:24.879290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878900+0000","last_change":"2024-05-08T19:22:20.449450+0000","last_active":"2024-05-08T19:22:24.878900+0000","last_peered":"2024-05-08T19:22:24.878900+0000","last_clean":"2024-05-08T19:22:24.878900+0000","last_became_active":"2024-05-08T19:22:20.449184+0000","last_became_peered":"2024-05-08T19:22:20.449184+0000","last_unstale":"2024-05-08T19:22:24.878900+0000","last_undegraded":"2024-05-08T19:22:24.878900+0000","last_fullsized":"2024-05-08T19:22:24.878900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875678+0000","last_change":"2024-05-08T19:22:20.449919+0000","last_active":"2024-05-08T19:22:24.875678+0000","last_peered":"2024-05-08T19:22:24.875678+0000","last_clean":"2024-05-08T19:22:24.875678+0000","last_became_active":"2024-05-08T19:22:20.449637+0000","last_became_peered":"2024-05-08T19:22:20.449637+0000","last_unstale":"2024-05-08T19:22:24.875678+0000","last_undegraded":"2024-05-08T19:22:24.875678+0000","last_fullsized":"2024-05-08T19:22:24.875678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888369+0000","last_change":"2024-05-08T19:22:20.449676+0000","last_active":"2024-05-08T19:22:24.888369+0000","last_peered":"2024-05-08T19:22:24.888369+0000","last_clean":"2024-05-08T19:22:24.888369+0000","last_became_active":"2024-05-08T19:22:20.449347+0000","last_became_peered":"2024-05-08T19:22:20.449347+0000","last_unstale":"2024-05-08T19:22:24.888369+0000","last_undegraded":"2024-05-08T19:22:24.888369+0000","last_fullsized":"2024-05-08T19:22:24.888369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:29.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875620+0000","last_change":"2024-05-08T19:22:20.447174+0000","last_active":"2024-05-08T19:22:24.875620+0000","last_peered":"2024-05-08T19:22:24.875620+0000","last_clean":"2024-05-08T19:22:24.875620+0000","last_became_active":"2024-05-08T19:22:20.446893+0000","last_became_peered":"2024-05-08T19:22:20.446893+0000","last_unstale":"2024-05-08T19:22:24.875620+0000","last_undegraded":"2024-05-08T19:22:24.875620+0000","last_fullsized":"2024-05-08T19:22:24.875620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:25.101779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888313+0000","last_change":"2024-05-08T19:22:20.446830+0000","last_active":"2024-05-08T19:22:24.888313+0000","last_peered":"2024-05-08T19:22:24.888313+0000","last_clean":"2024-05-08T19:22:24.888313+0000","last_became_active":"2024-05-08T19:22:20.446520+0000","last_became_peered":"2024-05-08T19:22:20.446520+0000","last_unstale":"2024-05-08T19:22:24.888313+0000","last_undegraded":"2024-05-08T19:22:24.888313+0000","last_fullsized":"2024-05-08T19:22:24.888313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:25.101779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879197+0000","last_change":"2024-05-08T19:22:20.447313+0000","last_active":"2024-05-08T19:22:24.879197+0000","last_peered":"2024-05-08T19:22:24.879197+0000","last_clean":"2024-05-08T19:22:24.879197+0000","last_became_active":"2024-05-08T19:22:20.447031+0000","last_became_peered":"2024-05-08T19:22:20.447031+0000","last_unstale":"2024-05-08T19:22:24.879197+0000","last_undegraded":"2024-05-08T19:22:24.879197+0000","last_fullsized":"2024-05-08T19:22:24.879197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888578+0000","last_change":"2024-05-08T19:22:20.447186+0000","last_active":"2024-05-08T19:22:24.888578+0000","last_peered":"2024-05-08T19:22:24.888578+0000","last_clean":"2024-05-08T19:22:24.888578+0000","last_became_active":"2024-05-08T19:22:20.446803+0000","last_became_peered":"2024-05-08T19:22:20.446803+0000","last_unstale":"2024-05-08T19:22:24.888578+0000","last_undegraded":"2024-05-08T19:22:24.888578+0000","last_fullsized":"2024-05-08T19:22:24.888578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885037+0000","last_change":"2024-05-08T19:22:20.462899+0000","last_active":"2024-05-08T19:22:24.885037+0000","last_peered":"2024-05-08T19:22:24.885037+0000","last_clean":"2024-05-08T19:22:24.885037+0000","last_became_active":"2024-05-08T19:22:20.461395+0000","last_became_peered":"2024-05-08T19:22:20.461395+0000","last_unstale":"2024-05-08T19:22:24.885037+0000","last_undegraded":"2024-05-08T19:22:24.885037+0000","last_fullsized":"2024-05-08T19:22:24.885037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885018+0000","last_change":"2024-05-08T19:22:20.459545+0000","last_active":"2024-05-08T19:22:24.885018+0000","last_peered":"2024-05-08T19:22:24.885018+0000","last_clean":"2024-05-08T19:22:24.885018+0000","last_became_active":"2024-05-08T19:22:20.459253+0000","last_became_peered":"2024-05-08T19:22:20.459253+0000","last_unstale":"2024-05-08T19:22:24.885018+0000","last_undegraded":"2024-05-08T19:22:24.885018+0000","last_fullsized":"2024-05-08T19:22:24.885018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882661+0000","last_change":"2024-05-08T19:22:20.462193+0000","last_active":"2024-05-08T19:22:24.882661+0000","last_peered":"2024-05-08T19:22:24.882661+0000","last_clean":"2024-05-08T19:22:24.882661+0000","last_became_active":"2024-05-08T19:22:20.461852+0000","last_became_peered":"2024-05-08T19:22:20.461852+0000","last_unstale":"2024-05-08T19:22:24.882661+0000","last_undegraded":"2024-05-08T19:22:24.882661+0000","last_fullsized":"2024-05-08T19:22:24.882661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:51.431376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879318+0000","last_change":"2024-05-08T19:22:20.453169+0000","last_active":"2024-05-08T19:22:24.879318+0000","last_peered":"2024-05-08T19:22:24.879318+0000","last_clean":"2024-05-08T19:22:24.879318+0000","last_became_active":"2024-05-08T19:22:20.452884+0000","last_became_peered":"2024-05-08T19:22:20.452884+0000","last_unstale":"2024-05-08T19:22:24.879318+0000","last_undegraded":"2024-05-08T19:22:24.879318+0000","last_fullsized":"2024-05-08T19:22:24.879318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878772+0000","last_change":"2024-05-08T19:22:20.435745+0000","last_active":"2024-05-08T19:22:24.878772+0000","last_peered":"2024-05-08T19:22:24.878772+0000","last_clean":"2024-05-08T19:22:24.878772+0000","last_became_active":"2024-05-08T19:22:20.435456+0000","last_became_peered":"2024-05-08T19:22:20.435456+0000","last_unstale":"2024-05-08T19:22:24.878772+0000","last_undegraded":"2024-05-08T19:22:24.878772+0000","last_fullsized":"2024-05-08T19:22:24.878772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879116+0000","last_change":"2024-05-08T19:22:20.444615+0000","last_active":"2024-05-08T19:22:24.879116+0000","last_peered":"2024-05-08T19:22:24.879116+0000","last_clean":"2024-05-08T19:22:24.879116+0000","last_became_active":"2024-05-08T19:22:20.444369+0000","last_became_peered":"2024-05-08T19:22:20.444369+0000","last_unstale":"2024-05-08T19:22:24.879116+0000","last_undegraded":"2024-05-08T19:22:24.879116+0000","last_fullsized":"2024-05-08T19:22:24.879116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875527+0000","last_change":"2024-05-08T19:22:20.445391+0000","last_active":"2024-05-08T19:22:24.875527+0000","last_peered":"2024-05-08T19:22:24.875527+0000","last_clean":"2024-05-08T19:22:24.875527+0000","last_became_active":"2024-05-08T19:22:20.444996+0000","last_became_peered":"2024-05-08T19:22:20.444996+0000","last_unstale":"2024-05-08T19:22:24.875527+0000","last_undegraded":"2024-05-08T19:22:24.875527+0000","last_fullsized":"2024-05-08T19:22:24.875527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875748+0000","last_change":"2024-05-08T19:22:20.451170+0000","last_active":"2024-05-08T19:22:24.875748+0000","last_peered":"2024-05-08T19:22:24.875748+0000","last_clean":"2024-05-08T19:22:24.875748+0000","last_became_active":"2024-05-08T19:22:20.450843+0000","last_became_peered":"2024-05-08T19:22:20.450843+0000","last_unstale":"2024-05-08T19:22:24.875748+0000","last_undegraded":"2024-05-08T19:22:24.875748+0000","last_fullsized":"2024-05-08T19:22:24.875748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.886301+0000","last_change":"2024-05-08T19:22:20.462503+0000","last_active":"2024-05-08T19:22:24.886301+0000","last_peered":"2024-05-08T19:22:24.886301+0000","last_clean":"2024-05-08T19:22:24.886301+0000","last_became_active":"2024-05-08T19:22:20.462266+0000","last_became_peered":"2024-05-08T19:22:20.462266+0000","last_unstale":"2024-05-08T19:22:24.886301+0000","last_undegraded":"2024-05-08T19:22:24.886301+0000","last_fullsized":"2024-05-08T19:22:24.886301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:04.174914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888517+0000","last_change":"2024-05-08T19:22:20.454128+0000","last_active":"2024-05-08T19:22:24.888517+0000","last_peered":"2024-05-08T19:22:24.888517+0000","last_clean":"2024-05-08T19:22:24.888517+0000","last_became_active":"2024-05-08T19:22:20.453834+0000","last_became_peered":"2024-05-08T19:22:20.453834+0000","last_unstale":"2024-05-08T19:22:24.888517+0000","last_undegraded":"2024-05-08T19:22:24.888517+0000","last_fullsized":"2024-05-08T19:22:24.888517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:23.193366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879275+0000","last_change":"2024-05-08T19:22:24.616532+0000","last_active":"2024-05-08T19:22:24.879275+0000","last_peered":"2024-05-08T19:22:24.879275+0000","last_clean":"2024-05-08T19:22:24.879275+0000","last_became_active":"2024-05-08T19:22:24.616128+0000","last_became_peered":"2024-05-08T19:22:24.616128+0000","last_unstale":"2024-05-08T19:22:24.879275+0000","last_undegraded":"2024-05-08T19:22:24.879275+0000","last_fullsized":"2024-05-08T19:22:24.879275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:44.356550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.459339+0000","last_change":"2024-05-08T19:22:20.012743+0000","last_active":"2024-05-08T19:22:24.459339+0000","last_peered":"2024-05-08T19:22:24.459339+0000","last_clean":"2024-05-08T19:22:24.459339+0000","last_became_active":"2024-05-08T19:22:20.012453+0000","last_became_peered":"2024-05-08T19:22:20.012453+0000","last_unstale":"2024-05-08T19:22:24.459339+0000","last_undegraded":"2024-05-08T19:22:24.459339+0000","last_fullsized":"2024-05-08T19:22:24.459339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:52.547906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879448+0000","last_change":"2024-05-08T19:22:20.464578+0000","last_active":"2024-05-08T19:22:24.879448+0000","last_peered":"2024-05-08T19:22:24.879448+0000","last_clean":"2024-05-08T19:22:24.879448+0000","last_became_active":"2024-05-08T19:22:20.464396+0000","last_became_peered":"2024-05-08T19:22:20.464396+0000","last_unstale":"2024-05-08T19:22:24.879448+0000","last_undegraded":"2024-05-08T19:22:24.879448+0000","last_fullsized":"2024-05-08T19:22:24.879448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882432+0000","last_change":"2024-05-08T19:22:24.469561+0000","last_active":"2024-05-08T19:22:24.882432+0000","last_peered":"2024-05-08T19:22:24.882432+0000","last_clean":"2024-05-08T19:22:24.882432+0000","last_became_active":"2024-05-08T19:22:24.469161+0000","last_became_peered":"2024-05-08T19:22:24.469161+0000","last_unstale":"2024-05-08T19:22:24.882432+0000","last_undegraded":"2024-05-08T19:22:24.882432+0000","last_fullsized":"2024-05-08T19:22:24.882432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:50.011809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.449197+0000","last_change":"2024-05-08T19:22:20.006198+0000","last_active":"2024-05-08T19:22:24.449197+0000","last_peered":"2024-05-08T19:22:24.449197+0000","last_clean":"2024-05-08T19:22:24.449197+0000","last_became_active":"2024-05-08T19:22:20.005723+0000","last_became_peered":"2024-05-08T19:22:20.005723+0000","last_unstale":"2024-05-08T19:22:24.449197+0000","last_undegraded":"2024-05-08T19:22:24.449197+0000","last_fullsized":"2024-05-08T19:22:24.449197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878995+0000","last_change":"2024-05-08T19:22:20.451485+0000","last_active":"2024-05-08T19:22:24.878995+0000","last_peered":"2024-05-08T19:22:24.878995+0000","last_clean":"2024-05-08T19:22:24.878995+0000","last_became_active":"2024-05-08T19:22:20.446380+0000","last_became_peered":"2024-05-08T19:22:20.446380+0000","last_unstale":"2024-05-08T19:22:24.878995+0000","last_undegraded":"2024-05-08T19:22:24.878995+0000","last_fullsized":"2024-05-08T19:22:24.878995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:47.856077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882551+0000","last_change":"2024-05-08T19:22:24.465354+0000","last_active":"2024-05-08T19:22:24.882551+0000","last_peered":"2024-05-08T19:22:24.882551+0000","last_clean":"2024-05-08T19:22:24.882551+0000","last_became_active":"2024-05-08T19:22:24.464669+0000","last_became_peered":"2024-05-08T19:22:24.464669+0000","last_unstale":"2024-05-08T19:22:24.882551+0000","last_undegraded":"2024-05-08T19:22:24.882551+0000","last_fullsized":"2024-05-08T19:22:24.882551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:29.398413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612530+0000","last_change":"2024-05-08T19:22:20.014506+0000","last_active":"2024-05-08T19:22:24.612530+0000","last_peered":"2024-05-08T19:22:24.612530+0000","last_clean":"2024-05-08T19:22:24.612530+0000","last_became_active":"2024-05-08T19:22:20.014239+0000","last_became_peered":"2024-05-08T19:22:20.014239+0000","last_unstale":"2024-05-08T19:22:24.612530+0000","last_undegraded":"2024-05-08T19:22:24.612530+0000","last_fullsized":"2024-05-08T19:22:24.612530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:23.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875653+0000","last_change":"2024-05-08T19:22:20.460913+0000","last_active":"2024-05-08T19:22:24.875653+0000","last_peered":"2024-05-08T19:22:24.875653+0000","last_clean":"2024-05-08T19:22:24.875653+0000","last_became_active":"2024-05-08T19:22:20.460601+0000","last_became_peered":"2024-05-08T19:22:20.460601+0000","last_unstale":"2024-05-08T19:22:24.875653+0000","last_undegraded":"2024-05-08T19:22:24.875653+0000","last_fullsized":"2024-05-08T19:22:24.875653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882504+0000","last_change":"2024-05-08T19:22:24.479649+0000","last_active":"2024-05-08T19:22:24.882504+0000","last_peered":"2024-05-08T19:22:24.882504+0000","last_clean":"2024-05-08T19:22:24.882504+0000","last_became_active":"2024-05-08T19:22:24.479255+0000","last_became_peered":"2024-05-08T19:22:24.479255+0000","last_unstale":"2024-05-08T19:22:24.882504+0000","last_undegraded":"2024-05-08T19:22:24.882504+0000","last_fullsized":"2024-05-08T19:22:24.882504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612447+0000","last_change":"2024-05-08T19:22:20.014093+0000","last_active":"2024-05-08T19:22:24.612447+0000","last_peered":"2024-05-08T19:22:24.612447+0000","last_clean":"2024-05-08T19:22:24.612447+0000","last_became_active":"2024-05-08T19:22:20.013793+0000","last_became_peered":"2024-05-08T19:22:20.013793+0000","last_unstale":"2024-05-08T19:22:24.612447+0000","last_undegraded":"2024-05-08T19:22:24.612447+0000","last_fullsized":"2024-05-08T19:22:24.612447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875700+0000","last_change":"2024-05-08T19:22:20.455505+0000","last_active":"2024-05-08T19:22:24.875700+0000","last_peered":"2024-05-08T19:22:24.875700+0000","last_clean":"2024-05-08T19:22:24.875700+0000","last_became_active":"2024-05-08T19:22:20.455148+0000","last_became_peered":"2024-05-08T19:22:20.455148+0000","last_unstale":"2024-05-08T19:22:24.875700+0000","last_undegraded":"2024-05-08T19:22:24.875700+0000","last_fullsized":"2024-05-08T19:22:24.875700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879418+0000","last_change":"2024-05-08T19:22:24.465009+0000","last_active":"2024-05-08T19:22:24.879418+0000","last_peered":"2024-05-08T19:22:24.879418+0000","last_clean":"2024-05-08T19:22:24.879418+0000","last_became_active":"2024-05-08T19:22:24.464422+0000","last_became_peered":"2024-05-08T19:22:24.464422+0000","last_unstale":"2024-05-08T19:22:24.879418+0000","last_undegraded":"2024-05-08T19:22:24.879418+0000","last_fullsized":"2024-05-08T19:22:24.879418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:12.830755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.449208+0000","last_change":"2024-05-08T19:22:20.011515+0000","last_active":"2024-05-08T19:22:24.449208+0000","last_peered":"2024-05-08T19:22:24.449208+0000","last_clean":"2024-05-08T19:22:24.449208+0000","last_became_active":"2024-05-08T19:22:20.011183+0000","last_became_peered":"2024-05-08T19:22:20.011183+0000","last_unstale":"2024-05-08T19:22:24.449208+0000","last_undegraded":"2024-05-08T19:22:24.449208+0000","last_fullsized":"2024-05-08T19:22:24.449208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882529+0000","last_change":"2024-05-08T19:22:20.439371+0000","last_active":"2024-05-08T19:22:24.882529+0000","last_peered":"2024-05-08T19:22:24.882529+0000","last_clean":"2024-05-08T19:22:24.882529+0000","last_became_active":"2024-05-08T19:22:20.439096+0000","last_became_peered":"2024-05-08T19:22:20.439096+0000","last_unstale":"2024-05-08T19:22:24.882529+0000","last_undegraded":"2024-05-08T19:22:24.882529+0000","last_fullsized":"2024-05-08T19:22:24.882529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:56.795619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.886255+0000","last_change":"2024-05-08T19:22:24.476370+0000","last_active":"2024-05-08T19:22:24.886255+0000","last_peered":"2024-05-08T19:22:24.886255+0000","last_clean":"2024-05-08T19:22:24.886255+0000","last_became_active":"2024-05-08T19:22:24.475891+0000","last_became_peered":"2024-05-08T19:22:24.475891+0000","last_unstale":"2024-05-08T19:22:24.886255+0000","last_undegraded":"2024-05-08T19:22:24.886255+0000","last_fullsized":"2024-05-08T19:22:24.886255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:58.674524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458227+0000","last_change":"2024-05-08T19:22:20.004185+0000","last_active":"2024-05-08T19:22:24.458227+0000","last_peered":"2024-05-08T19:22:24.458227+0000","last_clean":"2024-05-08T19:22:24.458227+0000","last_became_active":"2024-05-08T19:22:20.003513+0000","last_became_peered":"2024-05-08T19:22:20.003513+0000","last_unstale":"2024-05-08T19:22:24.458227+0000","last_undegraded":"2024-05-08T19:22:24.458227+0000","last_fullsized":"2024-05-08T19:22:24.458227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878842+0000","last_change":"2024-05-08T19:22:20.446538+0000","last_active":"2024-05-08T19:22:24.878842+0000","last_peered":"2024-05-08T19:22:24.878842+0000","last_clean":"2024-05-08T19:22:24.878842+0000","last_became_active":"2024-05-08T19:22:20.445238+0000","last_became_peered":"2024-05-08T19:22:20.445238+0000","last_unstale":"2024-05-08T19:22:24.878842+0000","last_undegraded":"2024-05-08T19:22:24.878842+0000","last_fullsized":"2024-05-08T19:22:24.878842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885078+0000","last_change":"2024-05-08T19:22:24.479665+0000","last_active":"2024-05-08T19:22:24.885078+0000","last_peered":"2024-05-08T19:22:24.885078+0000","last_clean":"2024-05-08T19:22:24.885078+0000","last_became_active":"2024-05-08T19:22:24.478998+0000","last_became_peered":"2024-05-08T19:22:24.478998+0000","last_unstale":"2024-05-08T19:22:24.885078+0000","last_undegraded":"2024-05-08T19:22:24.885078+0000","last_fullsized":"2024-05-08T19:22:24.885078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:55.287155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.448886+0000","last_change":"2024-05-08T19:22:20.002850+0000","last_active":"2024-05-08T19:22:24.448886+0000","last_peered":"2024-05-08T19:22:24.448886+0000","last_clean":"2024-05-08T19:22:24.448886+0000","last_became_active":"2024-05-08T19:22:20.002534+0000","last_became_peered":"2024-05-08T19:22:20.002534+0000","last_unstale":"2024-05-08T19:22:24.448886+0000","last_undegraded":"2024-05-08T19:22:24.448886+0000","last_fullsized":"2024-05-08T19:22:24.448886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879154+0000","last_change":"2024-05-08T19:22:20.436698+0000","last_active":"2024-05-08T19:22:24.879154+0000","last_peered":"2024-05-08T19:22:24.879154+0000","last_clean":"2024-05-08T19:22:24.879154+0000","last_became_active":"2024-05-08T19:22:20.436431+0000","last_became_peered":"2024-05-08T19:22:20.436431+0000","last_unstale":"2024-05-08T19:22:24.879154+0000","last_undegraded":"2024-05-08T19:22:24.879154+0000","last_fullsized":"2024-05-08T19:22:24.879154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878964+0000","last_change":"2024-05-08T19:22:24.617420+0000","last_active":"2024-05-08T19:22:24.878964+0000","last_peered":"2024-05-08T19:22:24.878964+0000","last_clean":"2024-05-08T19:22:24.878964+0000","last_became_active":"2024-05-08T19:22:24.617030+0000","last_became_peered":"2024-05-08T19:22:24.617030+0000","last_unstale":"2024-05-08T19:22:24.878964+0000","last_undegraded":"2024-05-08T19:22:24.878964+0000","last_fullsized":"2024-05-08T19:22:24.878964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:29.274973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.451218+0000","last_change":"2024-05-08T19:22:20.003949+0000","last_active":"2024-05-08T19:22:24.451218+0000","last_peered":"2024-05-08T19:22:24.451218+0000","last_clean":"2024-05-08T19:22:24.451218+0000","last_became_active":"2024-05-08T19:22:20.003365+0000","last_became_peered":"2024-05-08T19:22:20.003365+0000","last_unstale":"2024-05-08T19:22:24.451218+0000","last_undegraded":"2024-05-08T19:22:24.451218+0000","last_fullsized":"2024-05-08T19:22:24.451218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879173+0000","last_change":"2024-05-08T19:22:20.437480+0000","last_active":"2024-05-08T19:22:24.879173+0000","last_peered":"2024-05-08T19:22:24.879173+0000","last_clean":"2024-05-08T19:22:24.879173+0000","last_became_active":"2024-05-08T19:22:20.437214+0000","last_became_peered":"2024-05-08T19:22:20.437214+0000","last_unstale":"2024-05-08T19:22:24.879173+0000","last_undegraded":"2024-05-08T19:22:24.879173+0000","last_fullsized":"2024-05-08T19:22:24.879173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879220+0000","last_change":"2024-05-08T19:22:24.615730+0000","last_active":"2024-05-08T19:22:24.879220+0000","last_peered":"2024-05-08T19:22:24.879220+0000","last_clean":"2024-05-08T19:22:24.879220+0000","last_became_active":"2024-05-08T19:22:24.615351+0000","last_became_peered":"2024-05-08T19:22:24.615351+0000","last_unstale":"2024-05-08T19:22:24.879220+0000","last_undegraded":"2024-05-08T19:22:24.879220+0000","last_fullsized":"2024-05-08T19:22:24.879220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458351+0000","last_change":"2024-05-08T19:22:20.002400+0000","last_active":"2024-05-08T19:22:24.458351+0000","last_peered":"2024-05-08T19:22:24.458351+0000","last_clean":"2024-05-08T19:22:24.458351+0000","last_became_active":"2024-05-08T19:22:20.001990+0000","last_became_peered":"2024-05-08T19:22:20.001990+0000","last_unstale":"2024-05-08T19:22:24.458351+0000","last_undegraded":"2024-05-08T19:22:24.458351+0000","last_fullsized":"2024-05-08T19:22:24.458351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875730+0000","last_change":"2024-05-08T19:22:20.447742+0000","last_active":"2024-05-08T19:22:24.875730+0000","last_peered":"2024-05-08T19:22:24.875730+0000","last_clean":"2024-05-08T19:22:24.875730+0000","last_became_active":"2024-05-08T19:22:20.447475+0000","last_became_peered":"2024-05-08T19:22:20.447475+0000","last_unstale":"2024-05-08T19:22:24.875730+0000","last_undegraded":"2024-05-08T19:22:24.875730+0000","last_fullsized":"2024-05-08T19:22:24.875730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879120+0000","last_change":"2024-05-08T19:22:24.469872+0000","last_active":"2024-05-08T19:22:24.879120+0000","last_peered":"2024-05-08T19:22:24.879120+0000","last_clean":"2024-05-08T19:22:24.879120+0000","last_became_active":"2024-05-08T19:22:24.469176+0000","last_became_peered":"2024-05-08T19:22:24.469176+0000","last_unstale":"2024-05-08T19:22:24.879120+0000","last_undegraded":"2024-05-08T19:22:24.879120+0000","last_fullsized":"2024-05-08T19:22:24.879120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:04.818467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.451462+0000","last_change":"2024-05-08T19:22:20.001272+0000","last_active":"2024-05-08T19:22:24.451462+0000","last_peered":"2024-05-08T19:22:24.451462+0000","last_clean":"2024-05-08T19:22:24.451462+0000","last_became_active":"2024-05-08T19:22:20.000981+0000","last_became_peered":"2024-05-08T19:22:20.000981+0000","last_unstale":"2024-05-08T19:22:24.451462+0000","last_undegraded":"2024-05-08T19:22:24.451462+0000","last_fullsized":"2024-05-08T19:22:24.451462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879018+0000","last_change":"2024-05-08T19:22:20.446938+0000","last_active":"2024-05-08T19:22:24.879018+0000","last_peered":"2024-05-08T19:22:24.879018+0000","last_clean":"2024-05-08T19:22:24.879018+0000","last_became_active":"2024-05-08T19:22:20.446644+0000","last_became_peered":"2024-05-08T19:22:20.446644+0000","last_unstale":"2024-05-08T19:22:24.879018+0000","last_undegraded":"2024-05-08T19:22:24.879018+0000","last_fullsized":"2024-05-08T19:22:24.879018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:39:35.443674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882595+0000","last_change":"2024-05-08T19:22:24.465089+0000","last_active":"2024-05-08T19:22:24.882595+0000","last_peered":"2024-05-08T19:22:24.882595+0000","last_clean":"2024-05-08T19:22:24.882595+0000","last_became_active":"2024-05-08T19:22:24.464178+0000","last_became_peered":"2024-05-08T19:22:24.464178+0000","last_unstale":"2024-05-08T19:22:24.882595+0000","last_undegraded":"2024-05-08T19:22:24.882595+0000","last_fullsized":"2024-05-08T19:22:24.882595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466970+0000","last_change":"2024-05-08T19:22:20.001300+0000","last_active":"2024-05-08T19:22:24.466970+0000","last_peered":"2024-05-08T19:22:24.466970+0000","last_clean":"2024-05-08T19:22:24.466970+0000","last_became_active":"2024-05-08T19:22:20.000985+0000","last_became_peered":"2024-05-08T19:22:20.000985+0000","last_unstale":"2024-05-08T19:22:24.466970+0000","last_undegraded":"2024-05-08T19:22:24.466970+0000","last_fullsized":"2024-05-08T19:22:24.466970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:50.426177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882648+0000","last_change":"2024-05-08T19:22:20.447801+0000","last_active":"2024-05-08T19:22:24.882648+0000","last_peered":"2024-05-08T19:22:24.882648+0000","last_clean":"2024-05-08T19:22:24.882648+0000","last_became_active":"2024-05-08T19:22:20.447538+0000","last_became_peered":"2024-05-08T19:22:20.447538+0000","last_unstale":"2024-05-08T19:22:24.882648+0000","last_undegraded":"2024-05-08T19:22:24.882648+0000","last_fullsized":"2024-05-08T19:22:24.882648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:14.706653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879217+0000","last_change":"2024-05-08T19:22:24.479544+0000","last_active":"2024-05-08T19:22:24.879217+0000","last_peered":"2024-05-08T19:22:24.879217+0000","last_clean":"2024-05-08T19:22:24.879217+0000","last_became_active":"2024-05-08T19:22:24.479071+0000","last_became_peered":"2024-05-08T19:22:24.479071+0000","last_unstale":"2024-05-08T19:22:24.879217+0000","last_undegraded":"2024-05-08T19:22:24.879217+0000","last_fullsized":"2024-05-08T19:22:24.879217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:19.704360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T19:22:30.073584+0000","last_change":"2024-05-08T19:22:20.011799+0000","last_active":"2024-05-08T19:22:30.073584+0000","last_peered":"2024-05-08T19:22:30.073584+0000","last_clean":"2024-05-08T19:22:30.073584+0000","last_became_active":"2024-05-08T19:22:20.011331+0000","last_became_peered":"2024-05-08T19:22:20.011331+0000","last_unstale":"2024-05-08T19:22:30.073584+0000","last_undegraded":"2024-05-08T19:22:30.073584+0000","last_fullsized":"2024-05-08T19:22:30.073584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888497+0000","last_change":"2024-05-08T19:22:20.447583+0000","last_active":"2024-05-08T19:22:24.888497+0000","last_peered":"2024-05-08T19:22:24.888497+0000","last_clean":"2024-05-08T19:22:24.888497+0000","last_became_active":"2024-05-08T19:22:20.447243+0000","last_became_peered":"2024-05-08T19:22:20.447243+0000","last_unstale":"2024-05-08T19:22:24.888497+0000","last_undegraded":"2024-05-08T19:22:24.888497+0000","last_fullsized":"2024-05-08T19:22:24.888497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875687+0000","last_change":"2024-05-08T19:22:24.615622+0000","last_active":"2024-05-08T19:22:24.875687+0000","last_peered":"2024-05-08T19:22:24.875687+0000","last_clean":"2024-05-08T19:22:24.875687+0000","last_became_active":"2024-05-08T19:22:24.614790+0000","last_became_peered":"2024-05-08T19:22:24.614790+0000","last_unstale":"2024-05-08T19:22:24.875687+0000","last_undegraded":"2024-05-08T19:22:24.875687+0000","last_fullsized":"2024-05-08T19:22:24.875687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457513+0000","last_change":"2024-05-08T19:22:20.006367+0000","last_active":"2024-05-08T19:22:24.457513+0000","last_peered":"2024-05-08T19:22:24.457513+0000","last_clean":"2024-05-08T19:22:24.457513+0000","last_became_active":"2024-05-08T19:22:20.005738+0000","last_became_peered":"2024-05-08T19:22:20.005738+0000","last_unstale":"2024-05-08T19:22:24.457513+0000","last_undegraded":"2024-05-08T19:22:24.457513+0000","last_fullsized":"2024-05-08T19:22:24.457513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878788+0000","last_change":"2024-05-08T19:22:20.448713+0000","last_active":"2024-05-08T19:22:24.878788+0000","last_peered":"2024-05-08T19:22:24.878788+0000","last_clean":"2024-05-08T19:22:24.878788+0000","last_became_active":"2024-05-08T19:22:20.448268+0000","last_became_peered":"2024-05-08T19:22:20.448268+0000","last_unstale":"2024-05-08T19:22:24.878788+0000","last_undegraded":"2024-05-08T19:22:24.878788+0000","last_fullsized":"2024-05-08T19:22:24.878788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879370+0000","last_change":"2024-05-08T19:22:24.614076+0000","last_active":"2024-05-08T19:22:24.879370+0000","last_peered":"2024-05-08T19:22:24.879370+0000","last_clean":"2024-05-08T19:22:24.879370+0000","last_became_active":"2024-05-08T19:22:24.613698+0000","last_became_peered":"2024-05-08T19:22:24.613698+0000","last_unstale":"2024-05-08T19:22:24.879370+0000","last_undegraded":"2024-05-08T19:22:24.879370+0000","last_fullsized":"2024-05-08T19:22:24.879370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:26.030709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.450746+0000","last_change":"2024-05-08T19:22:20.011480+0000","last_active":"2024-05-08T19:22:24.450746+0000","last_peered":"2024-05-08T19:22:24.450746+0000","last_clean":"2024-05-08T19:22:24.450746+0000","last_became_active":"2024-05-08T19:22:20.011188+0000","last_became_peered":"2024-05-08T19:22:20.011188+0000","last_unstale":"2024-05-08T19:22:24.450746+0000","last_undegraded":"2024-05-08T19:22:24.450746+0000","last_fullsized":"2024-05-08T19:22:24.450746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888393+0000","last_change":"2024-05-08T19:22:20.455818+0000","last_active":"2024-05-08T19:22:24.888393+0000","last_peered":"2024-05-08T19:22:24.888393+0000","last_clean":"2024-05-08T19:22:24.888393+0000","last_became_active":"2024-05-08T19:22:20.455562+0000","last_became_peered":"2024-05-08T19:22:20.455562+0000","last_unstale":"2024-05-08T19:22:24.888393+0000","last_undegraded":"2024-05-08T19:22:24.888393+0000","last_fullsized":"2024-05-08T19:22:24.888393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879484+0000","last_change":"2024-05-08T19:22:24.616812+0000","last_active":"2024-05-08T19:22:24.879484+0000","last_peered":"2024-05-08T19:22:24.879484+0000","last_clean":"2024-05-08T19:22:24.879484+0000","last_became_active":"2024-05-08T19:22:24.615618+0000","last_became_peered":"2024-05-08T19:22:24.615618+0000","last_unstale":"2024-05-08T19:22:24.879484+0000","last_undegraded":"2024-05-08T19:22:24.879484+0000","last_fullsized":"2024-05-08T19:22:24.879484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:21.559278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457687+0000","last_change":"2024-05-08T19:22:20.004327+0000","last_active":"2024-05-08T19:22:24.457687+0000","last_peered":"2024-05-08T19:22:24.457687+0000","last_clean":"2024-05-08T19:22:24.457687+0000","last_became_active":"2024-05-08T19:22:20.003725+0000","last_became_peered":"2024-05-08T19:22:20.003725+0000","last_unstale":"2024-05-08T19:22:24.457687+0000","last_undegraded":"2024-05-08T19:22:24.457687+0000","last_fullsized":"2024-05-08T19:22:24.457687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884871+0000","last_change":"2024-05-08T19:22:20.459536+0000","last_active":"2024-05-08T19:22:24.884871+0000","last_peered":"2024-05-08T19:22:24.884871+0000","last_clean":"2024-05-08T19:22:24.884871+0000","last_became_active":"2024-05-08T19:22:20.452496+0000","last_became_peered":"2024-05-08T19:22:20.452496+0000","last_unstale":"2024-05-08T19:22:24.884871+0000","last_undegraded":"2024-05-08T19:22:24.884871+0000","last_fullsized":"2024-05-08T19:22:24.884871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878916+0000","last_change":"2024-05-08T19:22:24.478351+0000","last_active":"2024-05-08T19:22:24.878916+0000","last_peered":"2024-05-08T19:22:24.878916+0000","last_clean":"2024-05-08T19:22:24.878916+0000","last_became_active":"2024-05-08T19:22:24.477728+0000","last_became_peered":"2024-05-08T19:22:24.477728+0000","last_unstale":"2024-05-08T19:22:24.878916+0000","last_undegraded":"2024-05-08T19:22:24.878916+0000","last_fullsized":"2024-05-08T19:22:24.878916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457653+0000","last_change":"2024-05-08T19:22:20.008346+0000","last_active":"2024-05-08T19:22:24.457653+0000","last_peered":"2024-05-08T19:22:24.457653+0000","last_clean":"2024-05-08T19:22:24.457653+0000","last_became_active":"2024-05-08T19:22:20.007985+0000","last_became_peered":"2024-05-08T19:22:20.007985+0000","last_unstale":"2024-05-08T19:22:24.457653+0000","last_undegraded":"2024-05-08T19:22:24.457653+0000","last_fullsized":"2024-05-08T19:22:24.457653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888351+0000","last_change":"2024-05-08T19:22:20.458860+0000","last_active":"2024-05-08T19:22:24.888351+0000","last_peered":"2024-05-08T19:22:24.888351+0000","last_clean":"2024-05-08T19:22:24.888351+0000","last_became_active":"2024-05-08T19:22:20.458588+0000","last_became_peered":"2024-05-08T19:22:20.458588+0000","last_unstale":"2024-05-08T19:22:24.888351+0000","last_undegraded":"2024-05-08T19:22:24.888351+0000","last_fullsized":"2024-05-08T19:22:24.888351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882450+0000","last_change":"2024-05-08T19:22:24.464132+0000","last_active":"2024-05-08T19:22:24.882450+0000","last_peered":"2024-05-08T19:22:24.882450+0000","last_clean":"2024-05-08T19:22:24.882450+0000","last_became_active":"2024-05-08T19:22:24.463741+0000","last_became_peered":"2024-05-08T19:22:24.463741+0000","last_unstale":"2024-05-08T19:22:24.882450+0000","last_undegraded":"2024-05-08T19:22:24.882450+0000","last_fullsized":"2024-05-08T19:22:24.882450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:13.044112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.451210+0000","last_change":"2024-05-08T19:22:20.005994+0000","last_active":"2024-05-08T19:22:24.451210+0000","last_peered":"2024-05-08T19:22:24.451210+0000","last_clean":"2024-05-08T19:22:24.451210+0000","last_became_active":"2024-05-08T19:22:20.005680+0000","last_became_peered":"2024-05-08T19:22:20.005680+0000","last_unstale":"2024-05-08T19:22:24.451210+0000","last_undegraded":"2024-05-08T19:22:24.451210+0000","last_fullsized":"2024-05-08T19:22:24.451210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:18.387895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888538+0000","last_change":"2024-05-08T19:22:20.449812+0000","last_active":"2024-05-08T19:22:24.888538+0000","last_peered":"2024-05-08T19:22:24.888538+0000","last_clean":"2024-05-08T19:22:24.888538+0000","last_became_active":"2024-05-08T19:22:20.449512+0000","last_became_peered":"2024-05-08T19:22:20.449512+0000","last_unstale":"2024-05-08T19:22:24.888538+0000","last_undegraded":"2024-05-08T19:22:24.888538+0000","last_fullsized":"2024-05-08T19:22:24.888538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879207+0000","last_change":"2024-05-08T19:22:24.478647+0000","last_active":"2024-05-08T19:22:24.879207+0000","last_peered":"2024-05-08T19:22:24.879207+0000","last_clean":"2024-05-08T19:22:24.879207+0000","last_became_active":"2024-05-08T19:22:24.478248+0000","last_became_peered":"2024-05-08T19:22:24.478248+0000","last_unstale":"2024-05-08T19:22:24.879207+0000","last_undegraded":"2024-05-08T19:22:24.879207+0000","last_fullsized":"2024-05-08T19:22:24.879207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:26.651711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.469393+0000","last_change":"2024-05-08T19:22:20.003344+0000","last_active":"2024-05-08T19:22:24.469393+0000","last_peered":"2024-05-08T19:22:24.469393+0000","last_clean":"2024-05-08T19:22:24.469393+0000","last_became_active":"2024-05-08T19:22:20.003055+0000","last_became_peered":"2024-05-08T19:22:20.003055+0000","last_unstale":"2024-05-08T19:22:24.469393+0000","last_undegraded":"2024-05-08T19:22:24.469393+0000","last_fullsized":"2024-05-08T19:22:24.469393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875711+0000","last_change":"2024-05-08T19:22:20.450523+0000","last_active":"2024-05-08T19:22:24.875711+0000","last_peered":"2024-05-08T19:22:24.875711+0000","last_clean":"2024-05-08T19:22:24.875711+0000","last_became_active":"2024-05-08T19:22:20.449693+0000","last_became_peered":"2024-05-08T19:22:20.449693+0000","last_unstale":"2024-05-08T19:22:24.875711+0000","last_undegraded":"2024-05-08T19:22:24.875711+0000","last_fullsized":"2024-05-08T19:22:24.875711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879227+0000","last_change":"2024-05-08T19:22:24.472926+0000","last_active":"2024-05-08T19:22:24.879227+0000","last_peered":"2024-05-08T19:22:24.879227+0000","last_clean":"2024-05-08T19:22:24.879227+0000","last_became_active":"2024-05-08T19:22:24.472518+0000","last_became_peered":"2024-05-08T19:22:24.472518+0000","last_unstale":"2024-05-08T19:22:24.879227+0000","last_undegraded":"2024-05-08T19:22:24.879227+0000","last_fullsized":"2024-05-08T19:22:24.879227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.450651+0000","last_change":"2024-05-08T19:22:20.007824+0000","last_active":"2024-05-08T19:22:24.450651+0000","last_peered":"2024-05-08T19:22:24.450651+0000","last_clean":"2024-05-08T19:22:24.450651+0000","last_became_active":"2024-05-08T19:22:20.007542+0000","last_became_peered":"2024-05-08T19:22:20.007542+0000","last_unstale":"2024-05-08T19:22:24.450651+0000","last_undegraded":"2024-05-08T19:22:24.450651+0000","last_fullsized":"2024-05-08T19:22:24.450651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882574+0000","last_change":"2024-05-08T19:22:20.443326+0000","last_active":"2024-05-08T19:22:24.882574+0000","last_peered":"2024-05-08T19:22:24.882574+0000","last_clean":"2024-05-08T19:22:24.882574+0000","last_became_active":"2024-05-08T19:22:20.443049+0000","last_became_peered":"2024-05-08T19:22:20.443049+0000","last_unstale":"2024-05-08T19:22:24.882574+0000","last_undegraded":"2024-05-08T19:22:24.882574+0000","last_fullsized":"2024-05-08T19:22:24.882574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:04.174914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879300+0000","last_change":"2024-05-08T19:22:24.479362+0000","last_active":"2024-05-08T19:22:24.879300+0000","last_peered":"2024-05-08T19:22:24.879300+0000","last_clean":"2024-05-08T19:22:24.879300+0000","last_became_active":"2024-05-08T19:22:24.478640+0000","last_became_peered":"2024-05-08T19:22:24.478640+0000","last_unstale":"2024-05-08T19:22:24.879300+0000","last_undegraded":"2024-05-08T19:22:24.879300+0000","last_fullsized":"2024-05-08T19:22:24.879300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879078+0000","last_change":"2024-05-08T19:22:20.449968+0000","last_active":"2024-05-08T19:22:24.879078+0000","last_peered":"2024-05-08T19:22:24.879078+0000","last_clean":"2024-05-08T19:22:24.879078+0000","last_became_active":"2024-05-08T19:22:20.449709+0000","last_became_peered":"2024-05-08T19:22:20.449709+0000","last_unstale":"2024-05-08T19:22:24.879078+0000","last_undegraded":"2024-05-08T19:22:24.879078+0000","last_fullsized":"2024-05-08T19:22:24.879078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457916+0000","last_change":"2024-05-08T19:22:20.004708+0000","last_active":"2024-05-08T19:22:24.457916+0000","last_peered":"2024-05-08T19:22:24.457916+0000","last_clean":"2024-05-08T19:22:24.457916+0000","last_became_active":"2024-05-08T19:22:20.004404+0000","last_became_peered":"2024-05-08T19:22:20.004404+0000","last_unstale":"2024-05-08T19:22:24.457916+0000","last_undegraded":"2024-05-08T19:22:24.457916+0000","last_fullsized":"2024-05-08T19:22:24.457916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884988+0000","last_change":"2024-05-08T19:22:24.617952+0000","last_active":"2024-05-08T19:22:24.884988+0000","last_peered":"2024-05-08T19:22:24.884988+0000","last_clean":"2024-05-08T19:22:24.884988+0000","last_became_active":"2024-05-08T19:22:24.617627+0000","last_became_peered":"2024-05-08T19:22:24.617627+0000","last_unstale":"2024-05-08T19:22:24.884988+0000","last_undegraded":"2024-05-08T19:22:24.884988+0000","last_fullsized":"2024-05-08T19:22:24.884988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:57.825616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879298+0000","last_change":"2024-05-08T19:22:20.447152+0000","last_active":"2024-05-08T19:22:24.879298+0000","last_peered":"2024-05-08T19:22:24.879298+0000","last_clean":"2024-05-08T19:22:24.879298+0000","last_became_active":"2024-05-08T19:22:20.446864+0000","last_became_peered":"2024-05-08T19:22:20.446864+0000","last_unstale":"2024-05-08T19:22:24.879298+0000","last_undegraded":"2024-05-08T19:22:24.879298+0000","last_fullsized":"2024-05-08T19:22:24.879298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.450537+0000","last_change":"2024-05-08T19:22:20.003790+0000","last_active":"2024-05-08T19:22:24.450537+0000","last_peered":"2024-05-08T19:22:24.450537+0000","last_clean":"2024-05-08T19:22:24.450537+0000","last_became_active":"2024-05-08T19:22:20.003441+0000","last_became_peered":"2024-05-08T19:22:20.003441+0000","last_unstale":"2024-05-08T19:22:24.450537+0000","last_undegraded":"2024-05-08T19:22:24.450537+0000","last_fullsized":"2024-05-08T19:22:24.450537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612146+0000","last_change":"2024-05-08T19:22:17.117278+0000","last_active":"2024-05-08T19:22:24.612146+0000","last_peered":"2024-05-08T19:22:24.612146+0000","last_clean":"2024-05-08T19:22:24.612146+0000","last_became_active":"2024-05-08T19:22:17.116272+0000","last_became_peered":"2024-05-08T19:22:17.116272+0000","last_unstale":"2024-05-08T19:22:24.612146+0000","last_undegraded":"2024-05-08T19:22:24.612146+0000","last_fullsized":"2024-05-08T19:22:24.612146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_clean_scrub_stamp":"2024-05-08T19:22:15.924359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:37.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878934+0000","last_change":"2024-05-08T19:22:24.617594+0000","last_active":"2024-05-08T19:22:24.878934+0000","last_peered":"2024-05-08T19:22:24.878934+0000","last_clean":"2024-05-08T19:22:24.878934+0000","last_became_active":"2024-05-08T19:22:24.616486+0000","last_became_peered":"2024-05-08T19:22:24.616486+0000","last_unstale":"2024-05-08T19:22:24.878934+0000","last_undegraded":"2024-05-08T19:22:24.878934+0000","last_fullsized":"2024-05-08T19:22:24.878934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878747+0000","last_change":"2024-05-08T19:22:20.445458+0000","last_active":"2024-05-08T19:22:24.878747+0000","last_peered":"2024-05-08T19:22:24.878747+0000","last_clean":"2024-05-08T19:22:24.878747+0000","last_became_active":"2024-05-08T19:22:20.445191+0000","last_became_peered":"2024-05-08T19:22:20.445191+0000","last_unstale":"2024-05-08T19:22:24.878747+0000","last_undegraded":"2024-05-08T19:22:24.878747+0000","last_fullsized":"2024-05-08T19:22:24.878747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612265+0000","last_change":"2024-05-08T19:22:20.015288+0000","last_active":"2024-05-08T19:22:24.612265+0000","last_peered":"2024-05-08T19:22:24.612265+0000","last_clean":"2024-05-08T19:22:24.612265+0000","last_became_active":"2024-05-08T19:22:20.015062+0000","last_became_peered":"2024-05-08T19:22:20.015062+0000","last_unstale":"2024-05-08T19:22:24.612265+0000","last_undegraded":"2024-05-08T19:22:24.612265+0000","last_fullsized":"2024-05-08T19:22:24.612265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:12.577297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878827+0000","last_change":"2024-05-08T19:22:24.614066+0000","last_active":"2024-05-08T19:22:24.878827+0000","last_peered":"2024-05-08T19:22:24.878827+0000","last_clean":"2024-05-08T19:22:24.878827+0000","last_became_active":"2024-05-08T19:22:24.613661+0000","last_became_peered":"2024-05-08T19:22:24.613661+0000","last_unstale":"2024-05-08T19:22:24.878827+0000","last_undegraded":"2024-05-08T19:22:24.878827+0000","last_fullsized":"2024-05-08T19:22:24.878827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612417+0000","last_change":"2024-05-08T19:22:20.015193+0000","last_active":"2024-05-08T19:22:24.612417+0000","last_peered":"2024-05-08T19:22:24.612417+0000","last_clean":"2024-05-08T19:22:24.612417+0000","last_became_active":"2024-05-08T19:22:20.014926+0000","last_became_peered":"2024-05-08T19:22:20.014926+0000","last_unstale":"2024-05-08T19:22:24.612417+0000","last_undegraded":"2024-05-08T19:22:24.612417+0000","last_fullsized":"2024-05-08T19:22:24.612417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:13.701454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879254+0000","last_change":"2024-05-08T19:22:20.446453+0000","last_active":"2024-05-08T19:22:24.879254+0000","last_peered":"2024-05-08T19:22:24.879254+0000","last_clean":"2024-05-08T19:22:24.879254+0000","last_became_active":"2024-05-08T19:22:20.446194+0000","last_became_peered":"2024-05-08T19:22:20.446194+0000","last_unstale":"2024-05-08T19:22:24.879254+0000","last_undegraded":"2024-05-08T19:22:24.879254+0000","last_fullsized":"2024-05-08T19:22:24.879254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879174+0000","last_change":"2024-05-08T19:22:24.615481+0000","last_active":"2024-05-08T19:22:24.879174+0000","last_peered":"2024-05-08T19:22:24.879174+0000","last_clean":"2024-05-08T19:22:24.879174+0000","last_became_active":"2024-05-08T19:22:24.615069+0000","last_became_peered":"2024-05-08T19:22:24.615069+0000","last_unstale":"2024-05-08T19:22:24.879174+0000","last_undegraded":"2024-05-08T19:22:24.879174+0000","last_fullsized":"2024-05-08T19:22:24.879174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:28.211177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T19:22:25.515484+0000","last_change":"2024-05-08T19:22:20.001642+0000","last_active":"2024-05-08T19:22:25.515484+0000","last_peered":"2024-05-08T19:22:25.515484+0000","last_clean":"2024-05-08T19:22:25.515484+0000","last_became_active":"2024-05-08T19:22:20.001339+0000","last_became_peered":"2024-05-08T19:22:20.001339+0000","last_unstale":"2024-05-08T19:22:25.515484+0000","last_undegraded":"2024-05-08T19:22:25.515484+0000","last_fullsized":"2024-05-08T19:22:25.515484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879506+0000","last_change":"2024-05-08T19:22:20.447909+0000","last_active":"2024-05-08T19:22:24.879506+0000","last_peered":"2024-05-08T19:22:24.879506+0000","last_clean":"2024-05-08T19:22:24.879506+0000","last_became_active":"2024-05-08T19:22:20.447526+0000","last_became_peered":"2024-05-08T19:22:20.447526+0000","last_unstale":"2024-05-08T19:22:24.879506+0000","last_undegraded":"2024-05-08T19:22:24.879506+0000","last_fullsized":"2024-05-08T19:22:24.879506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882471+0000","last_change":"2024-05-08T19:22:24.614812+0000","last_active":"2024-05-08T19:22:24.882471+0000","last_peered":"2024-05-08T19:22:24.882471+0000","last_clean":"2024-05-08T19:22:24.882471+0000","last_became_active":"2024-05-08T19:22:24.614433+0000","last_became_peered":"2024-05-08T19:22:24.614433+0000","last_unstale":"2024-05-08T19:22:24.882471+0000","last_undegraded":"2024-05-08T19:22:24.882471+0000","last_fullsized":"2024-05-08T19:22:24.882471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:07.924115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458250+0000","last_change":"2024-05-08T19:22:20.012651+0000","last_active":"2024-05-08T19:22:24.458250+0000","last_peered":"2024-05-08T19:22:24.458250+0000","last_clean":"2024-05-08T19:22:24.458250+0000","last_became_active":"2024-05-08T19:22:20.012383+0000","last_became_peered":"2024-05-08T19:22:20.012383+0000","last_unstale":"2024-05-08T19:22:24.458250+0000","last_undegraded":"2024-05-08T19:22:24.458250+0000","last_fullsized":"2024-05-08T19:22:24.458250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878980+0000","last_change":"2024-05-08T19:22:20.436459+0000","last_active":"2024-05-08T19:22:24.878980+0000","last_peered":"2024-05-08T19:22:24.878980+0000","last_clean":"2024-05-08T19:22:24.878980+0000","last_became_active":"2024-05-08T19:22:20.435680+0000","last_became_peered":"2024-05-08T19:22:20.435680+0000","last_unstale":"2024-05-08T19:22:24.878980+0000","last_undegraded":"2024-05-08T19:22:24.878980+0000","last_fullsized":"2024-05-08T19:22:24.878980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:09.166091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882688+0000","last_change":"2024-05-08T19:22:24.473208+0000","last_active":"2024-05-08T19:22:24.882688+0000","last_peered":"2024-05-08T19:22:24.882688+0000","last_clean":"2024-05-08T19:22:24.882688+0000","last_became_active":"2024-05-08T19:22:24.472782+0000","last_became_peered":"2024-05-08T19:22:24.472782+0000","last_unstale":"2024-05-08T19:22:24.882688+0000","last_undegraded":"2024-05-08T19:22:24.882688+0000","last_fullsized":"2024-05-08T19:22:24.882688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612122+0000","last_change":"2024-05-08T19:22:20.014848+0000","last_active":"2024-05-08T19:22:24.612122+0000","last_peered":"2024-05-08T19:22:24.612122+0000","last_clean":"2024-05-08T19:22:24.612122+0000","last_became_active":"2024-05-08T19:22:20.013739+0000","last_became_peered":"2024-05-08T19:22:20.013739+0000","last_unstale":"2024-05-08T19:22:24.612122+0000","last_undegraded":"2024-05-08T19:22:24.612122+0000","last_fullsized":"2024-05-08T19:22:24.612122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:03.169714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882485+0000","last_change":"2024-05-08T19:22:20.447451+0000","last_active":"2024-05-08T19:22:24.882485+0000","last_peered":"2024-05-08T19:22:24.882485+0000","last_clean":"2024-05-08T19:22:24.882485+0000","last_became_active":"2024-05-08T19:22:20.447180+0000","last_became_peered":"2024-05-08T19:22:20.447180+0000","last_unstale":"2024-05-08T19:22:24.882485+0000","last_undegraded":"2024-05-08T19:22:24.882485+0000","last_fullsized":"2024-05-08T19:22:24.882485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879310+0000","last_change":"2024-05-08T19:22:24.614091+0000","last_active":"2024-05-08T19:22:24.879310+0000","last_peered":"2024-05-08T19:22:24.879310+0000","last_clean":"2024-05-08T19:22:24.879310+0000","last_became_active":"2024-05-08T19:22:24.613677+0000","last_became_peered":"2024-05-08T19:22:24.613677+0000","last_unstale":"2024-05-08T19:22:24.879310+0000","last_undegraded":"2024-05-08T19:22:24.879310+0000","last_fullsized":"2024-05-08T19:22:24.879310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:50.011809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466472+0000","last_change":"2024-05-08T19:22:20.011528+0000","last_active":"2024-05-08T19:22:24.466472+0000","last_peered":"2024-05-08T19:22:24.466472+0000","last_clean":"2024-05-08T19:22:24.466472+0000","last_became_active":"2024-05-08T19:22:20.011262+0000","last_became_peered":"2024-05-08T19:22:20.011262+0000","last_unstale":"2024-05-08T19:22:24.466472+0000","last_undegraded":"2024-05-08T19:22:24.466472+0000","last_fullsized":"2024-05-08T19:22:24.466472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879088+0000","last_change":"2024-05-08T19:22:20.438689+0000","last_active":"2024-05-08T19:22:24.879088+0000","last_peered":"2024-05-08T19:22:24.879088+0000","last_clean":"2024-05-08T19:22:24.879088+0000","last_became_active":"2024-05-08T19:22:20.438434+0000","last_became_peered":"2024-05-08T19:22:20.438434+0000","last_unstale":"2024-05-08T19:22:24.879088+0000","last_undegraded":"2024-05-08T19:22:24.879088+0000","last_fullsized":"2024-05-08T19:22:24.879088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882616+0000","last_change":"2024-05-08T19:22:24.473569+0000","last_active":"2024-05-08T19:22:24.882616+0000","last_peered":"2024-05-08T19:22:24.882616+0000","last_clean":"2024-05-08T19:22:24.882616+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:22:24.882616+0000","last_undegraded":"2024-05-08T19:22:24.882616+0000","last_fullsized":"2024-05-08T19:22:24.882616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:22.875469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466685+0000","last_change":"2024-05-08T19:22:20.007101+0000","last_active":"2024-05-08T19:22:24.466685+0000","last_peered":"2024-05-08T19:22:24.466685+0000","last_clean":"2024-05-08T19:22:24.466685+0000","last_became_active":"2024-05-08T19:22:20.006772+0000","last_became_peered":"2024-05-08T19:22:20.006772+0000","last_unstale":"2024-05-08T19:22:24.466685+0000","last_undegraded":"2024-05-08T19:22:24.466685+0000","last_fullsized":"2024-05-08T19:22:24.466685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:23.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879350+0000","last_change":"2024-05-08T19:22:20.436696+0000","last_active":"2024-05-08T19:22:24.879350+0000","last_peered":"2024-05-08T19:22:24.879350+0000","last_clean":"2024-05-08T19:22:24.879350+0000","last_became_active":"2024-05-08T19:22:20.436373+0000","last_became_peered":"2024-05-08T19:22:20.436373+0000","last_unstale":"2024-05-08T19:22:24.879350+0000","last_undegraded":"2024-05-08T19:22:24.879350+0000","last_fullsized":"2024-05-08T19:22:24.879350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882673+0000","last_change":"2024-05-08T19:22:24.478232+0000","last_active":"2024-05-08T19:22:24.882673+0000","last_peered":"2024-05-08T19:22:24.882673+0000","last_clean":"2024-05-08T19:22:24.882673+0000","last_became_active":"2024-05-08T19:22:24.477941+0000","last_became_peered":"2024-05-08T19:22:24.477941+0000","last_unstale":"2024-05-08T19:22:24.882673+0000","last_undegraded":"2024-05-08T19:22:24.882673+0000","last_fullsized":"2024-05-08T19:22:24.882673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612523+0000","last_change":"2024-05-08T19:22:20.014076+0000","last_active":"2024-05-08T19:22:24.612523+0000","last_peered":"2024-05-08T19:22:24.612523+0000","last_clean":"2024-05-08T19:22:24.612523+0000","last_became_active":"2024-05-08T19:22:20.013748+0000","last_became_peered":"2024-05-08T19:22:20.013748+0000","last_unstale":"2024-05-08T19:22:24.612523+0000","last_undegraded":"2024-05-08T19:22:24.612523+0000","last_fullsized":"2024-05-08T19:22:24.612523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:50.426177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884937+0000","last_change":"2024-05-08T19:22:20.457103+0000","last_active":"2024-05-08T19:22:24.884937+0000","last_peered":"2024-05-08T19:22:24.884937+0000","last_clean":"2024-05-08T19:22:24.884937+0000","last_became_active":"2024-05-08T19:22:20.456850+0000","last_became_peered":"2024-05-08T19:22:20.456850+0000","last_unstale":"2024-05-08T19:22:24.884937+0000","last_undegraded":"2024-05-08T19:22:24.884937+0000","last_fullsized":"2024-05-08T19:22:24.884937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884914+0000","last_change":"2024-05-08T19:22:24.614410+0000","last_active":"2024-05-08T19:22:24.884914+0000","last_peered":"2024-05-08T19:22:24.884914+0000","last_clean":"2024-05-08T19:22:24.884914+0000","last_became_active":"2024-05-08T19:22:24.613904+0000","last_became_peered":"2024-05-08T19:22:24.613904+0000","last_unstale":"2024-05-08T19:22:24.884914+0000","last_undegraded":"2024-05-08T19:22:24.884914+0000","last_fullsized":"2024-05-08T19:22:24.884914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:03.465351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458521+0000","last_change":"2024-05-08T19:22:20.000763+0000","last_active":"2024-05-08T19:22:24.458521+0000","last_peered":"2024-05-08T19:22:24.458521+0000","last_clean":"2024-05-08T19:22:24.458521+0000","last_became_active":"2024-05-08T19:22:20.000454+0000","last_became_peered":"2024-05-08T19:22:20.000454+0000","last_unstale":"2024-05-08T19:22:24.458521+0000","last_undegraded":"2024-05-08T19:22:24.458521+0000","last_fullsized":"2024-05-08T19:22:24.458521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888465+0000","last_change":"2024-05-08T19:22:20.456485+0000","last_active":"2024-05-08T19:22:24.888465+0000","last_peered":"2024-05-08T19:22:24.888465+0000","last_clean":"2024-05-08T19:22:24.888465+0000","last_became_active":"2024-05-08T19:22:20.456225+0000","last_became_peered":"2024-05-08T19:22:20.456225+0000","last_unstale":"2024-05-08T19:22:24.888465+0000","last_undegraded":"2024-05-08T19:22:24.888465+0000","last_fullsized":"2024-05-08T19:22:24.888465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878808+0000","last_change":"2024-05-08T19:22:24.473117+0000","last_active":"2024-05-08T19:22:24.878808+0000","last_peered":"2024-05-08T19:22:24.878808+0000","last_clean":"2024-05-08T19:22:24.878808+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:22:24.878808+0000","last_undegraded":"2024-05-08T19:22:24.878808+0000","last_fullsized":"2024-05-08T19:22:24.878808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466917+0000","last_change":"2024-05-08T19:22:20.006312+0000","last_active":"2024-05-08T19:22:24.466917+0000","last_peered":"2024-05-08T19:22:24.466917+0000","last_clean":"2024-05-08T19:22:24.466917+0000","last_became_active":"2024-05-08T19:22:20.005996+0000","last_became_peered":"2024-05-08T19:22:20.005996+0000","last_unstale":"2024-05-08T19:22:24.466917+0000","last_undegraded":"2024-05-08T19:22:24.466917+0000","last_fullsized":"2024-05-08T19:22:24.466917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:13.701454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875666+0000","last_change":"2024-05-08T19:22:20.452861+0000","last_active":"2024-05-08T19:22:24.875666+0000","last_peered":"2024-05-08T19:22:24.875666+0000","last_clean":"2024-05-08T19:22:24.875666+0000","last_became_active":"2024-05-08T19:22:20.452600+0000","last_became_peered":"2024-05-08T19:22:20.452600+0000","last_unstale":"2024-05-08T19:22:24.875666+0000","last_undegraded":"2024-05-08T19:22:24.875666+0000","last_fullsized":"2024-05-08T19:22:24.875666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875543+0000","last_change":"2024-05-08T19:22:24.614345+0000","last_active":"2024-05-08T19:22:24.875543+0000","last_peered":"2024-05-08T19:22:24.875543+0000","last_clean":"2024-05-08T19:22:24.875543+0000","last_became_active":"2024-05-08T19:22:24.613948+0000","last_became_peered":"2024-05-08T19:22:24.613948+0000","last_unstale":"2024-05-08T19:22:24.875543+0000","last_undegraded":"2024-05-08T19:22:24.875543+0000","last_fullsized":"2024-05-08T19:22:24.875543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457773+0000","last_change":"2024-05-08T19:22:20.004844+0000","last_active":"2024-05-08T19:22:24.457773+0000","last_peered":"2024-05-08T19:22:24.457773+0000","last_clean":"2024-05-08T19:22:24.457773+0000","last_became_active":"2024-05-08T19:22:20.004254+0000","last_became_peered":"2024-05-08T19:22:20.004254+0000","last_unstale":"2024-05-08T19:22:24.457773+0000","last_undegraded":"2024-05-08T19:22:24.457773+0000","last_fullsized":"2024-05-08T19:22:24.457773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888558+0000","last_change":"2024-05-08T19:22:20.455712+0000","last_active":"2024-05-08T19:22:24.888558+0000","last_peered":"2024-05-08T19:22:24.888558+0000","last_clean":"2024-05-08T19:22:24.888558+0000","last_became_active":"2024-05-08T19:22:20.455493+0000","last_became_peered":"2024-05-08T19:22:20.455493+0000","last_unstale":"2024-05-08T19:22:24.888558+0000","last_undegraded":"2024-05-08T19:22:24.888558+0000","last_fullsized":"2024-05-08T19:22:24.888558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:28.743156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884892+0000","last_change":"2024-05-08T19:22:20.459104+0000","last_active":"2024-05-08T19:22:24.884892+0000","last_peered":"2024-05-08T19:22:24.884892+0000","last_clean":"2024-05-08T19:22:24.884892+0000","last_became_active":"2024-05-08T19:22:20.452169+0000","last_became_peered":"2024-05-08T19:22:20.452169+0000","last_unstale":"2024-05-08T19:22:24.884892+0000","last_undegraded":"2024-05-08T19:22:24.884892+0000","last_fullsized":"2024-05-08T19:22:24.884892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.886216+0000","last_change":"2024-05-08T19:22:20.449335+0000","last_active":"2024-05-08T19:22:24.886216+0000","last_peered":"2024-05-08T19:22:24.886216+0000","last_clean":"2024-05-08T19:22:24.886216+0000","last_became_active":"2024-05-08T19:22:20.449047+0000","last_became_peered":"2024-05-08T19:22:20.449047+0000","last_unstale":"2024-05-08T19:22:24.886216+0000","last_undegraded":"2024-05-08T19:22:24.886216+0000","last_fullsized":"2024-05-08T19:22:24.886216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875600+0000","last_change":"2024-05-08T19:22:20.452192+0000","last_active":"2024-05-08T19:22:24.875600+0000","last_peered":"2024-05-08T19:22:24.875600+0000","last_clean":"2024-05-08T19:22:24.875600+0000","last_became_active":"2024-05-08T19:22:20.451625+0000","last_became_peered":"2024-05-08T19:22:20.451625+0000","last_unstale":"2024-05-08T19:22:24.875600+0000","last_undegraded":"2024-05-08T19:22:24.875600+0000","last_fullsized":"2024-05-08T19:22:24.875600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878859+0000","last_change":"2024-05-08T19:22:20.441131+0000","last_active":"2024-05-08T19:22:24.878859+0000","last_peered":"2024-05-08T19:22:24.878859+0000","last_clean":"2024-05-08T19:22:24.878859+0000","last_became_active":"2024-05-08T19:22:20.440718+0000","last_became_peered":"2024-05-08T19:22:20.440718+0000","last_unstale":"2024-05-08T19:22:24.878859+0000","last_undegraded":"2024-05-08T19:22:24.878859+0000","last_fullsized":"2024-05-08T19:22:24.878859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879397+0000","last_change":"2024-05-08T19:22:20.444479+0000","last_active":"2024-05-08T19:22:24.879397+0000","last_peered":"2024-05-08T19:22:24.879397+0000","last_clean":"2024-05-08T19:22:24.879397+0000","last_became_active":"2024-05-08T19:22:20.444219+0000","last_became_peered":"2024-05-08T19:22:20.444219+0000","last_unstale":"2024-05-08T19:22:24.879397+0000","last_undegraded":"2024-05-08T19:22:24.879397+0000","last_fullsized":"2024-05-08T19:22:24.879397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879264+0000","last_change":"2024-05-08T19:22:20.436874+0000","last_active":"2024-05-08T19:22:24.879264+0000","last_peered":"2024-05-08T19:22:24.879264+0000","last_clean":"2024-05-08T19:22:24.879264+0000","last_became_active":"2024-05-08T19:22:20.436626+0000","last_became_peered":"2024-05-08T19:22:20.436626+0000","last_unstale":"2024-05-08T19:22:24.879264+0000","last_undegraded":"2024-05-08T19:22:24.879264+0000","last_fullsized":"2024-05-08T19:22:24.879264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885056+0000","last_change":"2024-05-08T19:22:20.462445+0000","last_active":"2024-05-08T19:22:24.885056+0000","last_peered":"2024-05-08T19:22:24.885056+0000","last_clean":"2024-05-08T19:22:24.885056+0000","last_became_active":"2024-05-08T19:22:20.461547+0000","last_became_peered":"2024-05-08T19:22:20.461547+0000","last_unstale":"2024-05-08T19:22:24.885056+0000","last_undegraded":"2024-05-08T19:22:24.885056+0000","last_fullsized":"2024-05-08T19:22:24.885056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879523+0000","last_change":"2024-05-08T19:22:20.443498+0000","last_active":"2024-05-08T19:22:24.879523+0000","last_peered":"2024-05-08T19:22:24.879523+0000","last_clean":"2024-05-08T19:22:24.879523+0000","last_became_active":"2024-05-08T19:22:20.442667+0000","last_became_peered":"2024-05-08T19:22:20.442667+0000","last_unstale":"2024-05-08T19:22:24.879523+0000","last_undegraded":"2024-05-08T19:22:24.879523+0000","last_fullsized":"2024-05-08T19:22:24.879523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875577+0000","last_change":"2024-05-08T19:22:20.448722+0000","last_active":"2024-05-08T19:22:24.875577+0000","last_peered":"2024-05-08T19:22:24.875577+0000","last_clean":"2024-05-08T19:22:24.875577+0000","last_became_active":"2024-05-08T19:22:20.448449+0000","last_became_peered":"2024-05-08T19:22:20.448449+0000","last_unstale":"2024-05-08T19:22:24.875577+0000","last_undegraded":"2024-05-08T19:22:24.875577+0000","last_fullsized":"2024-05-08T19:22:24.875577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879255+0000","last_change":"2024-05-08T19:22:20.450677+0000","last_active":"2024-05-08T19:22:24.879255+0000","last_peered":"2024-05-08T19:22:24.879255+0000","last_clean":"2024-05-08T19:22:24.879255+0000","last_became_active":"2024-05-08T19:22:20.450217+0000","last_became_peered":"2024-05-08T19:22:20.450217+0000","last_unstale":"2024-05-08T19:22:24.879255+0000","last_undegraded":"2024-05-08T19:22:24.879255+0000","last_fullsized":"2024-05-08T19:22:24.879255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875609+0000","last_change":"2024-05-08T19:22:20.453450+0000","last_active":"2024-05-08T19:22:24.875609+0000","last_peered":"2024-05-08T19:22:24.875609+0000","last_clean":"2024-05-08T19:22:24.875609+0000","last_became_active":"2024-05-08T19:22:20.453191+0000","last_became_peered":"2024-05-08T19:22:20.453191+0000","last_unstale":"2024-05-08T19:22:24.875609+0000","last_undegraded":"2024-05-08T19:22:24.875609+0000","last_fullsized":"2024-05-08T19:22:24.875609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878873+0000","last_change":"2024-05-08T19:22:20.452591+0000","last_active":"2024-05-08T19:22:24.878873+0000","last_peered":"2024-05-08T19:22:24.878873+0000","last_clean":"2024-05-08T19:22:24.878873+0000","last_became_active":"2024-05-08T19:22:20.451209+0000","last_became_peered":"2024-05-08T19:22:20.451209+0000","last_unstale":"2024-05-08T19:22:24.878873+0000","last_undegraded":"2024-05-08T19:22:24.878873+0000","last_fullsized":"2024-05-08T19:22:24.878873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884969+0000","last_change":"2024-05-08T19:22:20.461584+0000","last_active":"2024-05-08T19:22:24.884969+0000","last_peered":"2024-05-08T19:22:24.884969+0000","last_clean":"2024-05-08T19:22:24.884969+0000","last_became_active":"2024-05-08T19:22:20.461097+0000","last_became_peered":"2024-05-08T19:22:20.461097+0000","last_unstale":"2024-05-08T19:22:24.884969+0000","last_undegraded":"2024-05-08T19:22:24.884969+0000","last_fullsized":"2024-05-08T19:22:24.884969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":690730,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":690786,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T19:22:48.962 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T19:22:49.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.130+0000 7f152692e700 1 Processor -- start 2024-05-08T19:22:49.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.130+0000 7f152692e700 1 -- start start 2024-05-08T19:22:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.131+0000 7f152692e700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f152014fc60 0x7f15200c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.131+0000 7f152692e700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1520150040 0x7f15200c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.131+0000 7f152692e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1520155e00 con 0x7f15200c2a80 2024-05-08T19:22:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.131+0000 7f152692e700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15201560e0 con 0x7f1520150040 2024-05-08T19:22:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.131+0000 7f152692e700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15201563c0 con 0x7f152014fc60 2024-05-08T19:22:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.131+0000 7f151f7fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1520150040 0x7f15200c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.131+0000 7f151f7fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1520150040 0x7f15200c4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56148/0 (socket says 172.21.15.47:56148) 2024-05-08T19:22:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.131+0000 7f151f7fe700 1 -- 172.21.15.47:0/1718378102 learned_addr learned my addr 172.21.15.47:0/1718378102 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.131+0000 7f151ffff700 1 --2- 172.21.15.47:0/1718378102 >> v2:172.21.15.177:3300/0 conn(0x7f152014fc60 0x7f15200c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.132+0000 7f151f7fe700 1 -- 172.21.15.47:0/1718378102 >> v2:172.21.15.177:3300/0 conn(0x7f152014fc60 msgr2=0x7f15200c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.132+0000 7f151f7fe700 1 --2- 172.21.15.47:0/1718378102 >> v2:172.21.15.177:3300/0 conn(0x7f152014fc60 0x7f15200c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.132+0000 7f151f7fe700 1 -- 172.21.15.47:0/1718378102 >> v1:172.21.15.177:6789/0 conn(0x7f15200c2a80 legacy=0x7f15201528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.132+0000 7f151f7fe700 1 -- 172.21.15.47:0/1718378102 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15201566a0 con 0x7f1520150040 2024-05-08T19:22:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.132+0000 7f151f7fe700 1 --2- 172.21.15.47:0/1718378102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1520150040 0x7f15200c4a00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f152006b630 tx=0x7f1508009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a594a0186ae5879e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.132+0000 7f151effd700 1 -- 172.21.15.47:0/1718378102 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508011830 con 0x7f1520150040 2024-05-08T19:22:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.132+0000 7f151effd700 1 -- 172.21.15.47:0/1718378102 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1508011990 con 0x7f1520150040 2024-05-08T19:22:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.132+0000 7f151effd700 1 -- 172.21.15.47:0/1718378102 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508011d20 con 0x7f1520150040 2024-05-08T19:22:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.132+0000 7f152692e700 1 -- 172.21.15.47:0/1718378102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1520150040 msgr2=0x7f15200c4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.132+0000 7f152692e700 1 --2- 172.21.15.47:0/1718378102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1520150040 0x7f15200c4a00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f152006b630 tx=0x7f1508009bd0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.132+0000 7f152692e700 1 -- 172.21.15.47:0/1718378102 shutdown_connections 2024-05-08T19:22:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.132+0000 7f152692e700 1 --2- 172.21.15.47:0/1718378102 >> v2:172.21.15.177:3300/0 conn(0x7f152014fc60 0x7f15200c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.132+0000 7f152692e700 1 --2- 172.21.15.47:0/1718378102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1520150040 0x7f15200c4a00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.132+0000 7f152692e700 1 -- 172.21.15.47:0/1718378102 >> 172.21.15.47:0/1718378102 conn(0x7f1520072dd0 msgr2=0x7f152006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.133+0000 7f152692e700 1 -- 172.21.15.47:0/1718378102 shutdown_connections 2024-05-08T19:22:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.133+0000 7f152692e700 1 -- 172.21.15.47:0/1718378102 wait complete. 2024-05-08T19:22:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.134+0000 7f152692e700 1 Processor -- start 2024-05-08T19:22:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.134+0000 7f152692e700 1 -- start start 2024-05-08T19:22:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f152692e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15200c2a80 0x7f152014c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f152692e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f152014fc60 0x7f15201e83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f152692e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1520150040 0x7f1520141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f152692e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1520141d50 con 0x7f1520150040 2024-05-08T19:22:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f152692e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152014d030 con 0x7f152014fc60 2024-05-08T19:22:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f152692e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15200ab2e0 con 0x7f15200c2a80 2024-05-08T19:22:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f1524ecb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1520150040 0x7f1520141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f1524ecb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1520150040 0x7f1520141810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56156/0 (socket says 172.21.15.47:56156) 2024-05-08T19:22:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f1524ecb700 1 -- 172.21.15.47:0/3562663240 learned_addr learned my addr 172.21.15.47:0/3562663240 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f151f7fe700 1 --2- 172.21.15.47:0/3562663240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f152014fc60 0x7f15201e83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f151ffff700 1 --2- 172.21.15.47:0/3562663240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15200c2a80 0x7f152014c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f1524ecb700 1 -- 172.21.15.47:0/3562663240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15200c2a80 msgr2=0x7f152014c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f1524ecb700 1 --2- 172.21.15.47:0/3562663240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15200c2a80 0x7f152014c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f1524ecb700 1 -- 172.21.15.47:0/3562663240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f152014fc60 msgr2=0x7f15201e83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f1524ecb700 1 --2- 172.21.15.47:0/3562663240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f152014fc60 0x7f15201e83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f1524ecb700 1 -- 172.21.15.47:0/3562663240 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508009550 con 0x7f1520150040 2024-05-08T19:22:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f1524ecb700 1 --2- 172.21.15.47:0/3562663240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1520150040 0x7f1520141810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f151800cc50 tx=0x7f151800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f151cff9700 1 -- 172.21.15.47:0/3562663240 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518003c00 con 0x7f1520150040 2024-05-08T19:22:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f151cff9700 1 -- 172.21.15.47:0/3562663240 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1518003d60 con 0x7f1520150040 2024-05-08T19:22:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f152692e700 1 -- 172.21.15.47:0/3562663240 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1520141530 con 0x7f1520150040 2024-05-08T19:22:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.135+0000 7f151cff9700 1 -- 172.21.15.47:0/3562663240 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151800abb0 con 0x7f1520150040 2024-05-08T19:22:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.136+0000 7f152692e700 1 -- 172.21.15.47:0/3562663240 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15201ec3e0 con 0x7f1520150040 2024-05-08T19:22:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.136+0000 7f152692e700 1 -- 172.21.15.47:0/3562663240 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15200c2510 con 0x7f1520150040 2024-05-08T19:22:49.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.137+0000 7f151cff9700 1 -- 172.21.15.47:0/3562663240 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f151800ad10 con 0x7f1520150040 2024-05-08T19:22:49.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.138+0000 7f151cff9700 1 --2- 172.21.15.47:0/3562663240 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f150006ac90 0x7f150006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.138+0000 7f151cff9700 1 -- 172.21.15.47:0/3562663240 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f151808a150 con 0x7f1520150040 2024-05-08T19:22:49.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.138+0000 7f151ffff700 1 --2- 172.21.15.47:0/3562663240 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f150006ac90 0x7f150006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.138+0000 7f151ffff700 1 --2- 172.21.15.47:0/3562663240 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f150006ac90 0x7f150006d150 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1510009b70 tx=0x7f1510008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:49.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.142+0000 7f151cff9700 1 -- 172.21.15.47:0/3562663240 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f15180550b0 con 0x7f1520150040 2024-05-08T19:22:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.343+0000 7f152692e700 1 -- 172.21.15.47:0/3562663240 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f152004ec60 con 0x7f150006ac90 2024-05-08T19:22:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.352+0000 7f151cff9700 1 -- 172.21.15.47:0/3562663240 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345317 (secure 0 0 0) 0x7f152004ec60 con 0x7f150006ac90 2024-05-08T19:22:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:49.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.356+0000 7f152692e700 1 -- 172.21.15.47:0/3562663240 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f150006ac90 msgr2=0x7f150006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.356+0000 7f152692e700 1 --2- 172.21.15.47:0/3562663240 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f150006ac90 0x7f150006d150 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1510009b70 tx=0x7f1510008040 comp rx=0 tx=0).stop 2024-05-08T19:22:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.356+0000 7f152692e700 1 -- 172.21.15.47:0/3562663240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1520150040 msgr2=0x7f1520141810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.356+0000 7f152692e700 1 --2- 172.21.15.47:0/3562663240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1520150040 0x7f1520141810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f151800cc50 tx=0x7f151800a340 comp rx=0 tx=0).stop 2024-05-08T19:22:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.356+0000 7f152692e700 1 -- 172.21.15.47:0/3562663240 shutdown_connections 2024-05-08T19:22:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.356+0000 7f152692e700 1 --2- 172.21.15.47:0/3562663240 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f150006ac90 0x7f150006d150 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.356+0000 7f152692e700 1 --2- 172.21.15.47:0/3562663240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1520150040 0x7f1520141810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.356+0000 7f152692e700 1 --2- 172.21.15.47:0/3562663240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f15200c2a80 0x7f152014c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.356+0000 7f152692e700 1 --2- 172.21.15.47:0/3562663240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f152014fc60 0x7f15201e83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.356+0000 7f152692e700 1 -- 172.21.15.47:0/3562663240 >> 172.21.15.47:0/3562663240 conn(0x7f1520072dd0 msgr2=0x7f152006f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.356+0000 7f152692e700 1 -- 172.21.15.47:0/3562663240 shutdown_connections 2024-05-08T19:22:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.356+0000 7f152692e700 1 -- 172.21.15.47:0/3562663240 wait complete. 2024-05-08T19:22:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-08T19:22:49.361 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-05-08T19:22:47.871911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218376,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756344,"statfs":{"total":773094113280,"available":772870496256,"internally_reserved":0,"allocated":2228224,"data_stored":1988164,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003617"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888597+0000","last_change":"2024-05-08T19:22:20.461758+0000","last_active":"2024-05-08T19:22:24.888597+0000","last_peered":"2024-05-08T19:22:24.888597+0000","last_clean":"2024-05-08T19:22:24.888597+0000","last_became_active":"2024-05-08T19:22:20.461515+0000","last_became_peered":"2024-05-08T19:22:20.461515+0000","last_unstale":"2024-05-08T19:22:24.888597+0000","last_undegraded":"2024-05-08T19:22:24.888597+0000","last_fullsized":"2024-05-08T19:22:24.888597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879290+0000","last_change":"2024-05-08T19:22:20.434929+0000","last_active":"2024-05-08T19:22:24.879290+0000","last_peered":"2024-05-08T19:22:24.879290+0000","last_clean":"2024-05-08T19:22:24.879290+0000","last_became_active":"2024-05-08T19:22:20.434629+0000","last_became_peered":"2024-05-08T19:22:20.434629+0000","last_unstale":"2024-05-08T19:22:24.879290+0000","last_undegraded":"2024-05-08T19:22:24.879290+0000","last_fullsized":"2024-05-08T19:22:24.879290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878900+0000","last_change":"2024-05-08T19:22:20.449450+0000","last_active":"2024-05-08T19:22:24.878900+0000","last_peered":"2024-05-08T19:22:24.878900+0000","last_clean":"2024-05-08T19:22:24.878900+0000","last_became_active":"2024-05-08T19:22:20.449184+0000","last_became_peered":"2024-05-08T19:22:20.449184+0000","last_unstale":"2024-05-08T19:22:24.878900+0000","last_undegraded":"2024-05-08T19:22:24.878900+0000","last_fullsized":"2024-05-08T19:22:24.878900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875678+0000","last_change":"2024-05-08T19:22:20.449919+0000","last_active":"2024-05-08T19:22:24.875678+0000","last_peered":"2024-05-08T19:22:24.875678+0000","last_clean":"2024-05-08T19:22:24.875678+0000","last_became_active":"2024-05-08T19:22:20.449637+0000","last_became_peered":"2024-05-08T19:22:20.449637+0000","last_unstale":"2024-05-08T19:22:24.875678+0000","last_undegraded":"2024-05-08T19:22:24.875678+0000","last_fullsized":"2024-05-08T19:22:24.875678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888369+0000","last_change":"2024-05-08T19:22:20.449676+0000","last_active":"2024-05-08T19:22:24.888369+0000","last_peered":"2024-05-08T19:22:24.888369+0000","last_clean":"2024-05-08T19:22:24.888369+0000","last_became_active":"2024-05-08T19:22:20.449347+0000","last_became_peered":"2024-05-08T19:22:20.449347+0000","last_unstale":"2024-05-08T19:22:24.888369+0000","last_undegraded":"2024-05-08T19:22:24.888369+0000","last_fullsized":"2024-05-08T19:22:24.888369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:29.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875620+0000","last_change":"2024-05-08T19:22:20.447174+0000","last_active":"2024-05-08T19:22:24.875620+0000","last_peered":"2024-05-08T19:22:24.875620+0000","last_clean":"2024-05-08T19:22:24.875620+0000","last_became_active":"2024-05-08T19:22:20.446893+0000","last_became_peered":"2024-05-08T19:22:20.446893+0000","last_unstale":"2024-05-08T19:22:24.875620+0000","last_undegraded":"2024-05-08T19:22:24.875620+0000","last_fullsized":"2024-05-08T19:22:24.875620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:25.101779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888313+0000","last_change":"2024-05-08T19:22:20.446830+0000","last_active":"2024-05-08T19:22:24.888313+0000","last_peered":"2024-05-08T19:22:24.888313+0000","last_clean":"2024-05-08T19:22:24.888313+0000","last_became_active":"2024-05-08T19:22:20.446520+0000","last_became_peered":"2024-05-08T19:22:20.446520+0000","last_unstale":"2024-05-08T19:22:24.888313+0000","last_undegraded":"2024-05-08T19:22:24.888313+0000","last_fullsized":"2024-05-08T19:22:24.888313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:25.101779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879197+0000","last_change":"2024-05-08T19:22:20.447313+0000","last_active":"2024-05-08T19:22:24.879197+0000","last_peered":"2024-05-08T19:22:24.879197+0000","last_clean":"2024-05-08T19:22:24.879197+0000","last_became_active":"2024-05-08T19:22:20.447031+0000","last_became_peered":"2024-05-08T19:22:20.447031+0000","last_unstale":"2024-05-08T19:22:24.879197+0000","last_undegraded":"2024-05-08T19:22:24.879197+0000","last_fullsized":"2024-05-08T19:22:24.879197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888578+0000","last_change":"2024-05-08T19:22:20.447186+0000","last_active":"2024-05-08T19:22:24.888578+0000","last_peered":"2024-05-08T19:22:24.888578+0000","last_clean":"2024-05-08T19:22:24.888578+0000","last_became_active":"2024-05-08T19:22:20.446803+0000","last_became_peered":"2024-05-08T19:22:20.446803+0000","last_unstale":"2024-05-08T19:22:24.888578+0000","last_undegraded":"2024-05-08T19:22:24.888578+0000","last_fullsized":"2024-05-08T19:22:24.888578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885037+0000","last_change":"2024-05-08T19:22:20.462899+0000","last_active":"2024-05-08T19:22:24.885037+0000","last_peered":"2024-05-08T19:22:24.885037+0000","last_clean":"2024-05-08T19:22:24.885037+0000","last_became_active":"2024-05-08T19:22:20.461395+0000","last_became_peered":"2024-05-08T19:22:20.461395+0000","last_unstale":"2024-05-08T19:22:24.885037+0000","last_undegraded":"2024-05-08T19:22:24.885037+0000","last_fullsized":"2024-05-08T19:22:24.885037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885018+0000","last_change":"2024-05-08T19:22:20.459545+0000","last_active":"2024-05-08T19:22:24.885018+0000","last_peered":"2024-05-08T19:22:24.885018+0000","last_clean":"2024-05-08T19:22:24.885018+0000","last_became_active":"2024-05-08T19:22:20.459253+0000","last_became_peered":"2024-05-08T19:22:20.459253+0000","last_unstale":"2024-05-08T19:22:24.885018+0000","last_undegraded":"2024-05-08T19:22:24.885018+0000","last_fullsized":"2024-05-08T19:22:24.885018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882661+0000","last_change":"2024-05-08T19:22:20.462193+0000","last_active":"2024-05-08T19:22:24.882661+0000","last_peered":"2024-05-08T19:22:24.882661+0000","last_clean":"2024-05-08T19:22:24.882661+0000","last_became_active":"2024-05-08T19:22:20.461852+0000","last_became_peered":"2024-05-08T19:22:20.461852+0000","last_unstale":"2024-05-08T19:22:24.882661+0000","last_undegraded":"2024-05-08T19:22:24.882661+0000","last_fullsized":"2024-05-08T19:22:24.882661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:51.431376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879318+0000","last_change":"2024-05-08T19:22:20.453169+0000","last_active":"2024-05-08T19:22:24.879318+0000","last_peered":"2024-05-08T19:22:24.879318+0000","last_clean":"2024-05-08T19:22:24.879318+0000","last_became_active":"2024-05-08T19:22:20.452884+0000","last_became_peered":"2024-05-08T19:22:20.452884+0000","last_unstale":"2024-05-08T19:22:24.879318+0000","last_undegraded":"2024-05-08T19:22:24.879318+0000","last_fullsized":"2024-05-08T19:22:24.879318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878772+0000","last_change":"2024-05-08T19:22:20.435745+0000","last_active":"2024-05-08T19:22:24.878772+0000","last_peered":"2024-05-08T19:22:24.878772+0000","last_clean":"2024-05-08T19:22:24.878772+0000","last_became_active":"2024-05-08T19:22:20.435456+0000","last_became_peered":"2024-05-08T19:22:20.435456+0000","last_unstale":"2024-05-08T19:22:24.878772+0000","last_undegraded":"2024-05-08T19:22:24.878772+0000","last_fullsized":"2024-05-08T19:22:24.878772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879116+0000","last_change":"2024-05-08T19:22:20.444615+0000","last_active":"2024-05-08T19:22:24.879116+0000","last_peered":"2024-05-08T19:22:24.879116+0000","last_clean":"2024-05-08T19:22:24.879116+0000","last_became_active":"2024-05-08T19:22:20.444369+0000","last_became_peered":"2024-05-08T19:22:20.444369+0000","last_unstale":"2024-05-08T19:22:24.879116+0000","last_undegraded":"2024-05-08T19:22:24.879116+0000","last_fullsized":"2024-05-08T19:22:24.879116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875527+0000","last_change":"2024-05-08T19:22:20.445391+0000","last_active":"2024-05-08T19:22:24.875527+0000","last_peered":"2024-05-08T19:22:24.875527+0000","last_clean":"2024-05-08T19:22:24.875527+0000","last_became_active":"2024-05-08T19:22:20.444996+0000","last_became_peered":"2024-05-08T19:22:20.444996+0000","last_unstale":"2024-05-08T19:22:24.875527+0000","last_undegraded":"2024-05-08T19:22:24.875527+0000","last_fullsized":"2024-05-08T19:22:24.875527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875748+0000","last_change":"2024-05-08T19:22:20.451170+0000","last_active":"2024-05-08T19:22:24.875748+0000","last_peered":"2024-05-08T19:22:24.875748+0000","last_clean":"2024-05-08T19:22:24.875748+0000","last_became_active":"2024-05-08T19:22:20.450843+0000","last_became_peered":"2024-05-08T19:22:20.450843+0000","last_unstale":"2024-05-08T19:22:24.875748+0000","last_undegraded":"2024-05-08T19:22:24.875748+0000","last_fullsized":"2024-05-08T19:22:24.875748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.886301+0000","last_change":"2024-05-08T19:22:20.462503+0000","last_active":"2024-05-08T19:22:24.886301+0000","last_peered":"2024-05-08T19:22:24.886301+0000","last_clean":"2024-05-08T19:22:24.886301+0000","last_became_active":"2024-05-08T19:22:20.462266+0000","last_became_peered":"2024-05-08T19:22:20.462266+0000","last_unstale":"2024-05-08T19:22:24.886301+0000","last_undegraded":"2024-05-08T19:22:24.886301+0000","last_fullsized":"2024-05-08T19:22:24.886301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:04.174914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888517+0000","last_change":"2024-05-08T19:22:20.454128+0000","last_active":"2024-05-08T19:22:24.888517+0000","last_peered":"2024-05-08T19:22:24.888517+0000","last_clean":"2024-05-08T19:22:24.888517+0000","last_became_active":"2024-05-08T19:22:20.453834+0000","last_became_peered":"2024-05-08T19:22:20.453834+0000","last_unstale":"2024-05-08T19:22:24.888517+0000","last_undegraded":"2024-05-08T19:22:24.888517+0000","last_fullsized":"2024-05-08T19:22:24.888517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:23.193366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879275+0000","last_change":"2024-05-08T19:22:24.616532+0000","last_active":"2024-05-08T19:22:24.879275+0000","last_peered":"2024-05-08T19:22:24.879275+0000","last_clean":"2024-05-08T19:22:24.879275+0000","last_became_active":"2024-05-08T19:22:24.616128+0000","last_became_peered":"2024-05-08T19:22:24.616128+0000","last_unstale":"2024-05-08T19:22:24.879275+0000","last_undegraded":"2024-05-08T19:22:24.879275+0000","last_fullsized":"2024-05-08T19:22:24.879275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:44.356550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.459339+0000","last_change":"2024-05-08T19:22:20.012743+0000","last_active":"2024-05-08T19:22:24.459339+0000","last_peered":"2024-05-08T19:22:24.459339+0000","last_clean":"2024-05-08T19:22:24.459339+0000","last_became_active":"2024-05-08T19:22:20.012453+0000","last_became_peered":"2024-05-08T19:22:20.012453+0000","last_unstale":"2024-05-08T19:22:24.459339+0000","last_undegraded":"2024-05-08T19:22:24.459339+0000","last_fullsized":"2024-05-08T19:22:24.459339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:52.547906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879448+0000","last_change":"2024-05-08T19:22:20.464578+0000","last_active":"2024-05-08T19:22:24.879448+0000","last_peered":"2024-05-08T19:22:24.879448+0000","last_clean":"2024-05-08T19:22:24.879448+0000","last_became_active":"2024-05-08T19:22:20.464396+0000","last_became_peered":"2024-05-08T19:22:20.464396+0000","last_unstale":"2024-05-08T19:22:24.879448+0000","last_undegraded":"2024-05-08T19:22:24.879448+0000","last_fullsized":"2024-05-08T19:22:24.879448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882432+0000","last_change":"2024-05-08T19:22:24.469561+0000","last_active":"2024-05-08T19:22:24.882432+0000","last_peered":"2024-05-08T19:22:24.882432+0000","last_clean":"2024-05-08T19:22:24.882432+0000","last_became_active":"2024-05-08T19:22:24.469161+0000","last_became_peered":"2024-05-08T19:22:24.469161+0000","last_unstale":"2024-05-08T19:22:24.882432+0000","last_undegraded":"2024-05-08T19:22:24.882432+0000","last_fullsized":"2024-05-08T19:22:24.882432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:50.011809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.449197+0000","last_change":"2024-05-08T19:22:20.006198+0000","last_active":"2024-05-08T19:22:24.449197+0000","last_peered":"2024-05-08T19:22:24.449197+0000","last_clean":"2024-05-08T19:22:24.449197+0000","last_became_active":"2024-05-08T19:22:20.005723+0000","last_became_peered":"2024-05-08T19:22:20.005723+0000","last_unstale":"2024-05-08T19:22:24.449197+0000","last_undegraded":"2024-05-08T19:22:24.449197+0000","last_fullsized":"2024-05-08T19:22:24.449197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878995+0000","last_change":"2024-05-08T19:22:20.451485+0000","last_active":"2024-05-08T19:22:24.878995+0000","last_peered":"2024-05-08T19:22:24.878995+0000","last_clean":"2024-05-08T19:22:24.878995+0000","last_became_active":"2024-05-08T19:22:20.446380+0000","last_became_peered":"2024-05-08T19:22:20.446380+0000","last_unstale":"2024-05-08T19:22:24.878995+0000","last_undegraded":"2024-05-08T19:22:24.878995+0000","last_fullsized":"2024-05-08T19:22:24.878995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:47.856077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882551+0000","last_change":"2024-05-08T19:22:24.465354+0000","last_active":"2024-05-08T19:22:24.882551+0000","last_peered":"2024-05-08T19:22:24.882551+0000","last_clean":"2024-05-08T19:22:24.882551+0000","last_became_active":"2024-05-08T19:22:24.464669+0000","last_became_peered":"2024-05-08T19:22:24.464669+0000","last_unstale":"2024-05-08T19:22:24.882551+0000","last_undegraded":"2024-05-08T19:22:24.882551+0000","last_fullsized":"2024-05-08T19:22:24.882551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:29.398413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612530+0000","last_change":"2024-05-08T19:22:20.014506+0000","last_active":"2024-05-08T19:22:24.612530+0000","last_peered":"2024-05-08T19:22:24.612530+0000","last_clean":"2024-05-08T19:22:24.612530+0000","last_became_active":"2024-05-08T19:22:20.014239+0000","last_became_peered":"2024-05-08T19:22:20.014239+0000","last_unstale":"2024-05-08T19:22:24.612530+0000","last_undegraded":"2024-05-08T19:22:24.612530+0000","last_fullsized":"2024-05-08T19:22:24.612530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:23.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875653+0000","last_change":"2024-05-08T19:22:20.460913+0000","last_active":"2024-05-08T19:22:24.875653+0000","last_peered":"2024-05-08T19:22:24.875653+0000","last_clean":"2024-05-08T19:22:24.875653+0000","last_became_active":"2024-05-08T19:22:20.460601+0000","last_became_peered":"2024-05-08T19:22:20.460601+0000","last_unstale":"2024-05-08T19:22:24.875653+0000","last_undegraded":"2024-05-08T19:22:24.875653+0000","last_fullsized":"2024-05-08T19:22:24.875653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882504+0000","last_change":"2024-05-08T19:22:24.479649+0000","last_active":"2024-05-08T19:22:24.882504+0000","last_peered":"2024-05-08T19:22:24.882504+0000","last_clean":"2024-05-08T19:22:24.882504+0000","last_became_active":"2024-05-08T19:22:24.479255+0000","last_became_peered":"2024-05-08T19:22:24.479255+0000","last_unstale":"2024-05-08T19:22:24.882504+0000","last_undegraded":"2024-05-08T19:22:24.882504+0000","last_fullsized":"2024-05-08T19:22:24.882504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612447+0000","last_change":"2024-05-08T19:22:20.014093+0000","last_active":"2024-05-08T19:22:24.612447+0000","last_peered":"2024-05-08T19:22:24.612447+0000","last_clean":"2024-05-08T19:22:24.612447+0000","last_became_active":"2024-05-08T19:22:20.013793+0000","last_became_peered":"2024-05-08T19:22:20.013793+0000","last_unstale":"2024-05-08T19:22:24.612447+0000","last_undegraded":"2024-05-08T19:22:24.612447+0000","last_fullsized":"2024-05-08T19:22:24.612447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875700+0000","last_change":"2024-05-08T19:22:20.455505+0000","last_active":"2024-05-08T19:22:24.875700+0000","last_peered":"2024-05-08T19:22:24.875700+0000","last_clean":"2024-05-08T19:22:24.875700+0000","last_became_active":"2024-05-08T19:22:20.455148+0000","last_became_peered":"2024-05-08T19:22:20.455148+0000","last_unstale":"2024-05-08T19:22:24.875700+0000","last_undegraded":"2024-05-08T19:22:24.875700+0000","last_fullsized":"2024-05-08T19:22:24.875700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879418+0000","last_change":"2024-05-08T19:22:24.465009+0000","last_active":"2024-05-08T19:22:24.879418+0000","last_peered":"2024-05-08T19:22:24.879418+0000","last_clean":"2024-05-08T19:22:24.879418+0000","last_became_active":"2024-05-08T19:22:24.464422+0000","last_became_peered":"2024-05-08T19:22:24.464422+0000","last_unstale":"2024-05-08T19:22:24.879418+0000","last_undegraded":"2024-05-08T19:22:24.879418+0000","last_fullsized":"2024-05-08T19:22:24.879418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:12.830755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.449208+0000","last_change":"2024-05-08T19:22:20.011515+0000","last_active":"2024-05-08T19:22:24.449208+0000","last_peered":"2024-05-08T19:22:24.449208+0000","last_clean":"2024-05-08T19:22:24.449208+0000","last_became_active":"2024-05-08T19:22:20.011183+0000","last_became_peered":"2024-05-08T19:22:20.011183+0000","last_unstale":"2024-05-08T19:22:24.449208+0000","last_undegraded":"2024-05-08T19:22:24.449208+0000","last_fullsized":"2024-05-08T19:22:24.449208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882529+0000","last_change":"2024-05-08T19:22:20.439371+0000","last_active":"2024-05-08T19:22:24.882529+0000","last_peered":"2024-05-08T19:22:24.882529+0000","last_clean":"2024-05-08T19:22:24.882529+0000","last_became_active":"2024-05-08T19:22:20.439096+0000","last_became_peered":"2024-05-08T19:22:20.439096+0000","last_unstale":"2024-05-08T19:22:24.882529+0000","last_undegraded":"2024-05-08T19:22:24.882529+0000","last_fullsized":"2024-05-08T19:22:24.882529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:56.795619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.886255+0000","last_change":"2024-05-08T19:22:24.476370+0000","last_active":"2024-05-08T19:22:24.886255+0000","last_peered":"2024-05-08T19:22:24.886255+0000","last_clean":"2024-05-08T19:22:24.886255+0000","last_became_active":"2024-05-08T19:22:24.475891+0000","last_became_peered":"2024-05-08T19:22:24.475891+0000","last_unstale":"2024-05-08T19:22:24.886255+0000","last_undegraded":"2024-05-08T19:22:24.886255+0000","last_fullsized":"2024-05-08T19:22:24.886255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:58.674524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458227+0000","last_change":"2024-05-08T19:22:20.004185+0000","last_active":"2024-05-08T19:22:24.458227+0000","last_peered":"2024-05-08T19:22:24.458227+0000","last_clean":"2024-05-08T19:22:24.458227+0000","last_became_active":"2024-05-08T19:22:20.003513+0000","last_became_peered":"2024-05-08T19:22:20.003513+0000","last_unstale":"2024-05-08T19:22:24.458227+0000","last_undegraded":"2024-05-08T19:22:24.458227+0000","last_fullsized":"2024-05-08T19:22:24.458227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878842+0000","last_change":"2024-05-08T19:22:20.446538+0000","last_active":"2024-05-08T19:22:24.878842+0000","last_peered":"2024-05-08T19:22:24.878842+0000","last_clean":"2024-05-08T19:22:24.878842+0000","last_became_active":"2024-05-08T19:22:20.445238+0000","last_became_peered":"2024-05-08T19:22:20.445238+0000","last_unstale":"2024-05-08T19:22:24.878842+0000","last_undegraded":"2024-05-08T19:22:24.878842+0000","last_fullsized":"2024-05-08T19:22:24.878842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885078+0000","last_change":"2024-05-08T19:22:24.479665+0000","last_active":"2024-05-08T19:22:24.885078+0000","last_peered":"2024-05-08T19:22:24.885078+0000","last_clean":"2024-05-08T19:22:24.885078+0000","last_became_active":"2024-05-08T19:22:24.478998+0000","last_became_peered":"2024-05-08T19:22:24.478998+0000","last_unstale":"2024-05-08T19:22:24.885078+0000","last_undegraded":"2024-05-08T19:22:24.885078+0000","last_fullsized":"2024-05-08T19:22:24.885078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:55.287155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.448886+0000","last_change":"2024-05-08T19:22:20.002850+0000","last_active":"2024-05-08T19:22:24.448886+0000","last_peered":"2024-05-08T19:22:24.448886+0000","last_clean":"2024-05-08T19:22:24.448886+0000","last_became_active":"2024-05-08T19:22:20.002534+0000","last_became_peered":"2024-05-08T19:22:20.002534+0000","last_unstale":"2024-05-08T19:22:24.448886+0000","last_undegraded":"2024-05-08T19:22:24.448886+0000","last_fullsized":"2024-05-08T19:22:24.448886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879154+0000","last_change":"2024-05-08T19:22:20.436698+0000","last_active":"2024-05-08T19:22:24.879154+0000","last_peered":"2024-05-08T19:22:24.879154+0000","last_clean":"2024-05-08T19:22:24.879154+0000","last_became_active":"2024-05-08T19:22:20.436431+0000","last_became_peered":"2024-05-08T19:22:20.436431+0000","last_unstale":"2024-05-08T19:22:24.879154+0000","last_undegraded":"2024-05-08T19:22:24.879154+0000","last_fullsized":"2024-05-08T19:22:24.879154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878964+0000","last_change":"2024-05-08T19:22:24.617420+0000","last_active":"2024-05-08T19:22:24.878964+0000","last_peered":"2024-05-08T19:22:24.878964+0000","last_clean":"2024-05-08T19:22:24.878964+0000","last_became_active":"2024-05-08T19:22:24.617030+0000","last_became_peered":"2024-05-08T19:22:24.617030+0000","last_unstale":"2024-05-08T19:22:24.878964+0000","last_undegraded":"2024-05-08T19:22:24.878964+0000","last_fullsized":"2024-05-08T19:22:24.878964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:29.274973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.451218+0000","last_change":"2024-05-08T19:22:20.003949+0000","last_active":"2024-05-08T19:22:24.451218+0000","last_peered":"2024-05-08T19:22:24.451218+0000","last_clean":"2024-05-08T19:22:24.451218+0000","last_became_active":"2024-05-08T19:22:20.003365+0000","last_became_peered":"2024-05-08T19:22:20.003365+0000","last_unstale":"2024-05-08T19:22:24.451218+0000","last_undegraded":"2024-05-08T19:22:24.451218+0000","last_fullsized":"2024-05-08T19:22:24.451218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879173+0000","last_change":"2024-05-08T19:22:20.437480+0000","last_active":"2024-05-08T19:22:24.879173+0000","last_peered":"2024-05-08T19:22:24.879173+0000","last_clean":"2024-05-08T19:22:24.879173+0000","last_became_active":"2024-05-08T19:22:20.437214+0000","last_became_peered":"2024-05-08T19:22:20.437214+0000","last_unstale":"2024-05-08T19:22:24.879173+0000","last_undegraded":"2024-05-08T19:22:24.879173+0000","last_fullsized":"2024-05-08T19:22:24.879173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879220+0000","last_change":"2024-05-08T19:22:24.615730+0000","last_active":"2024-05-08T19:22:24.879220+0000","last_peered":"2024-05-08T19:22:24.879220+0000","last_clean":"2024-05-08T19:22:24.879220+0000","last_became_active":"2024-05-08T19:22:24.615351+0000","last_became_peered":"2024-05-08T19:22:24.615351+0000","last_unstale":"2024-05-08T19:22:24.879220+0000","last_undegraded":"2024-05-08T19:22:24.879220+0000","last_fullsized":"2024-05-08T19:22:24.879220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458351+0000","last_change":"2024-05-08T19:22:20.002400+0000","last_active":"2024-05-08T19:22:24.458351+0000","last_peered":"2024-05-08T19:22:24.458351+0000","last_clean":"2024-05-08T19:22:24.458351+0000","last_became_active":"2024-05-08T19:22:20.001990+0000","last_became_peered":"2024-05-08T19:22:20.001990+0000","last_unstale":"2024-05-08T19:22:24.458351+0000","last_undegraded":"2024-05-08T19:22:24.458351+0000","last_fullsized":"2024-05-08T19:22:24.458351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875730+0000","last_change":"2024-05-08T19:22:20.447742+0000","last_active":"2024-05-08T19:22:24.875730+0000","last_peered":"2024-05-08T19:22:24.875730+0000","last_clean":"2024-05-08T19:22:24.875730+0000","last_became_active":"2024-05-08T19:22:20.447475+0000","last_became_peered":"2024-05-08T19:22:20.447475+0000","last_unstale":"2024-05-08T19:22:24.875730+0000","last_undegraded":"2024-05-08T19:22:24.875730+0000","last_fullsized":"2024-05-08T19:22:24.875730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879120+0000","last_change":"2024-05-08T19:22:24.469872+0000","last_active":"2024-05-08T19:22:24.879120+0000","last_peered":"2024-05-08T19:22:24.879120+0000","last_clean":"2024-05-08T19:22:24.879120+0000","last_became_active":"2024-05-08T19:22:24.469176+0000","last_became_peered":"2024-05-08T19:22:24.469176+0000","last_unstale":"2024-05-08T19:22:24.879120+0000","last_undegraded":"2024-05-08T19:22:24.879120+0000","last_fullsized":"2024-05-08T19:22:24.879120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:04.818467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.451462+0000","last_change":"2024-05-08T19:22:20.001272+0000","last_active":"2024-05-08T19:22:24.451462+0000","last_peered":"2024-05-08T19:22:24.451462+0000","last_clean":"2024-05-08T19:22:24.451462+0000","last_became_active":"2024-05-08T19:22:20.000981+0000","last_became_peered":"2024-05-08T19:22:20.000981+0000","last_unstale":"2024-05-08T19:22:24.451462+0000","last_undegraded":"2024-05-08T19:22:24.451462+0000","last_fullsized":"2024-05-08T19:22:24.451462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879018+0000","last_change":"2024-05-08T19:22:20.446938+0000","last_active":"2024-05-08T19:22:24.879018+0000","last_peered":"2024-05-08T19:22:24.879018+0000","last_clean":"2024-05-08T19:22:24.879018+0000","last_became_active":"2024-05-08T19:22:20.446644+0000","last_became_peered":"2024-05-08T19:22:20.446644+0000","last_unstale":"2024-05-08T19:22:24.879018+0000","last_undegraded":"2024-05-08T19:22:24.879018+0000","last_fullsized":"2024-05-08T19:22:24.879018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:39:35.443674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882595+0000","last_change":"2024-05-08T19:22:24.465089+0000","last_active":"2024-05-08T19:22:24.882595+0000","last_peered":"2024-05-08T19:22:24.882595+0000","last_clean":"2024-05-08T19:22:24.882595+0000","last_became_active":"2024-05-08T19:22:24.464178+0000","last_became_peered":"2024-05-08T19:22:24.464178+0000","last_unstale":"2024-05-08T19:22:24.882595+0000","last_undegraded":"2024-05-08T19:22:24.882595+0000","last_fullsized":"2024-05-08T19:22:24.882595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466970+0000","last_change":"2024-05-08T19:22:20.001300+0000","last_active":"2024-05-08T19:22:24.466970+0000","last_peered":"2024-05-08T19:22:24.466970+0000","last_clean":"2024-05-08T19:22:24.466970+0000","last_became_active":"2024-05-08T19:22:20.000985+0000","last_became_peered":"2024-05-08T19:22:20.000985+0000","last_unstale":"2024-05-08T19:22:24.466970+0000","last_undegraded":"2024-05-08T19:22:24.466970+0000","last_fullsized":"2024-05-08T19:22:24.466970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:50.426177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882648+0000","last_change":"2024-05-08T19:22:20.447801+0000","last_active":"2024-05-08T19:22:24.882648+0000","last_peered":"2024-05-08T19:22:24.882648+0000","last_clean":"2024-05-08T19:22:24.882648+0000","last_became_active":"2024-05-08T19:22:20.447538+0000","last_became_peered":"2024-05-08T19:22:20.447538+0000","last_unstale":"2024-05-08T19:22:24.882648+0000","last_undegraded":"2024-05-08T19:22:24.882648+0000","last_fullsized":"2024-05-08T19:22:24.882648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:14.706653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879217+0000","last_change":"2024-05-08T19:22:24.479544+0000","last_active":"2024-05-08T19:22:24.879217+0000","last_peered":"2024-05-08T19:22:24.879217+0000","last_clean":"2024-05-08T19:22:24.879217+0000","last_became_active":"2024-05-08T19:22:24.479071+0000","last_became_peered":"2024-05-08T19:22:24.479071+0000","last_unstale":"2024-05-08T19:22:24.879217+0000","last_undegraded":"2024-05-08T19:22:24.879217+0000","last_fullsized":"2024-05-08T19:22:24.879217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:19.704360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T19:22:30.073584+0000","last_change":"2024-05-08T19:22:20.011799+0000","last_active":"2024-05-08T19:22:30.073584+0000","last_peered":"2024-05-08T19:22:30.073584+0000","last_clean":"2024-05-08T19:22:30.073584+0000","last_became_active":"2024-05-08T19:22:20.011331+0000","last_became_peered":"2024-05-08T19:22:20.011331+0000","last_unstale":"2024-05-08T19:22:30.073584+0000","last_undegraded":"2024-05-08T19:22:30.073584+0000","last_fullsized":"2024-05-08T19:22:30.073584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888497+0000","last_change":"2024-05-08T19:22:20.447583+0000","last_active":"2024-05-08T19:22:24.888497+0000","last_peered":"2024-05-08T19:22:24.888497+0000","last_clean":"2024-05-08T19:22:24.888497+0000","last_became_active":"2024-05-08T19:22:20.447243+0000","last_became_peered":"2024-05-08T19:22:20.447243+0000","last_unstale":"2024-05-08T19:22:24.888497+0000","last_undegraded":"2024-05-08T19:22:24.888497+0000","last_fullsized":"2024-05-08T19:22:24.888497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875687+0000","last_change":"2024-05-08T19:22:24.615622+0000","last_active":"2024-05-08T19:22:24.875687+0000","last_peered":"2024-05-08T19:22:24.875687+0000","last_clean":"2024-05-08T19:22:24.875687+0000","last_became_active":"2024-05-08T19:22:24.614790+0000","last_became_peered":"2024-05-08T19:22:24.614790+0000","last_unstale":"2024-05-08T19:22:24.875687+0000","last_undegraded":"2024-05-08T19:22:24.875687+0000","last_fullsized":"2024-05-08T19:22:24.875687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457513+0000","last_change":"2024-05-08T19:22:20.006367+0000","last_active":"2024-05-08T19:22:24.457513+0000","last_peered":"2024-05-08T19:22:24.457513+0000","last_clean":"2024-05-08T19:22:24.457513+0000","last_became_active":"2024-05-08T19:22:20.005738+0000","last_became_peered":"2024-05-08T19:22:20.005738+0000","last_unstale":"2024-05-08T19:22:24.457513+0000","last_undegraded":"2024-05-08T19:22:24.457513+0000","last_fullsized":"2024-05-08T19:22:24.457513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878788+0000","last_change":"2024-05-08T19:22:20.448713+0000","last_active":"2024-05-08T19:22:24.878788+0000","last_peered":"2024-05-08T19:22:24.878788+0000","last_clean":"2024-05-08T19:22:24.878788+0000","last_became_active":"2024-05-08T19:22:20.448268+0000","last_became_peered":"2024-05-08T19:22:20.448268+0000","last_unstale":"2024-05-08T19:22:24.878788+0000","last_undegraded":"2024-05-08T19:22:24.878788+0000","last_fullsized":"2024-05-08T19:22:24.878788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879370+0000","last_change":"2024-05-08T19:22:24.614076+0000","last_active":"2024-05-08T19:22:24.879370+0000","last_peered":"2024-05-08T19:22:24.879370+0000","last_clean":"2024-05-08T19:22:24.879370+0000","last_became_active":"2024-05-08T19:22:24.613698+0000","last_became_peered":"2024-05-08T19:22:24.613698+0000","last_unstale":"2024-05-08T19:22:24.879370+0000","last_undegraded":"2024-05-08T19:22:24.879370+0000","last_fullsized":"2024-05-08T19:22:24.879370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:26.030709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.450746+0000","last_change":"2024-05-08T19:22:20.011480+0000","last_active":"2024-05-08T19:22:24.450746+0000","last_peered":"2024-05-08T19:22:24.450746+0000","last_clean":"2024-05-08T19:22:24.450746+0000","last_became_active":"2024-05-08T19:22:20.011188+0000","last_became_peered":"2024-05-08T19:22:20.011188+0000","last_unstale":"2024-05-08T19:22:24.450746+0000","last_undegraded":"2024-05-08T19:22:24.450746+0000","last_fullsized":"2024-05-08T19:22:24.450746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888393+0000","last_change":"2024-05-08T19:22:20.455818+0000","last_active":"2024-05-08T19:22:24.888393+0000","last_peered":"2024-05-08T19:22:24.888393+0000","last_clean":"2024-05-08T19:22:24.888393+0000","last_became_active":"2024-05-08T19:22:20.455562+0000","last_became_peered":"2024-05-08T19:22:20.455562+0000","last_unstale":"2024-05-08T19:22:24.888393+0000","last_undegraded":"2024-05-08T19:22:24.888393+0000","last_fullsized":"2024-05-08T19:22:24.888393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879484+0000","last_change":"2024-05-08T19:22:24.616812+0000","last_active":"2024-05-08T19:22:24.879484+0000","last_peered":"2024-05-08T19:22:24.879484+0000","last_clean":"2024-05-08T19:22:24.879484+0000","last_became_active":"2024-05-08T19:22:24.615618+0000","last_became_peered":"2024-05-08T19:22:24.615618+0000","last_unstale":"2024-05-08T19:22:24.879484+0000","last_undegraded":"2024-05-08T19:22:24.879484+0000","last_fullsized":"2024-05-08T19:22:24.879484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:21.559278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457687+0000","last_change":"2024-05-08T19:22:20.004327+0000","last_active":"2024-05-08T19:22:24.457687+0000","last_peered":"2024-05-08T19:22:24.457687+0000","last_clean":"2024-05-08T19:22:24.457687+0000","last_became_active":"2024-05-08T19:22:20.003725+0000","last_became_peered":"2024-05-08T19:22:20.003725+0000","last_unstale":"2024-05-08T19:22:24.457687+0000","last_undegraded":"2024-05-08T19:22:24.457687+0000","last_fullsized":"2024-05-08T19:22:24.457687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884871+0000","last_change":"2024-05-08T19:22:20.459536+0000","last_active":"2024-05-08T19:22:24.884871+0000","last_peered":"2024-05-08T19:22:24.884871+0000","last_clean":"2024-05-08T19:22:24.884871+0000","last_became_active":"2024-05-08T19:22:20.452496+0000","last_became_peered":"2024-05-08T19:22:20.452496+0000","last_unstale":"2024-05-08T19:22:24.884871+0000","last_undegraded":"2024-05-08T19:22:24.884871+0000","last_fullsized":"2024-05-08T19:22:24.884871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878916+0000","last_change":"2024-05-08T19:22:24.478351+0000","last_active":"2024-05-08T19:22:24.878916+0000","last_peered":"2024-05-08T19:22:24.878916+0000","last_clean":"2024-05-08T19:22:24.878916+0000","last_became_active":"2024-05-08T19:22:24.477728+0000","last_became_peered":"2024-05-08T19:22:24.477728+0000","last_unstale":"2024-05-08T19:22:24.878916+0000","last_undegraded":"2024-05-08T19:22:24.878916+0000","last_fullsized":"2024-05-08T19:22:24.878916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457653+0000","last_change":"2024-05-08T19:22:20.008346+0000","last_active":"2024-05-08T19:22:24.457653+0000","last_peered":"2024-05-08T19:22:24.457653+0000","last_clean":"2024-05-08T19:22:24.457653+0000","last_became_active":"2024-05-08T19:22:20.007985+0000","last_became_peered":"2024-05-08T19:22:20.007985+0000","last_unstale":"2024-05-08T19:22:24.457653+0000","last_undegraded":"2024-05-08T19:22:24.457653+0000","last_fullsized":"2024-05-08T19:22:24.457653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888351+0000","last_change":"2024-05-08T19:22:20.458860+0000","last_active":"2024-05-08T19:22:24.888351+0000","last_peered":"2024-05-08T19:22:24.888351+0000","last_clean":"2024-05-08T19:22:24.888351+0000","last_became_active":"2024-05-08T19:22:20.458588+0000","last_became_peered":"2024-05-08T19:22:20.458588+0000","last_unstale":"2024-05-08T19:22:24.888351+0000","last_undegraded":"2024-05-08T19:22:24.888351+0000","last_fullsized":"2024-05-08T19:22:24.888351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882450+0000","last_change":"2024-05-08T19:22:24.464132+0000","last_active":"2024-05-08T19:22:24.882450+0000","last_peered":"2024-05-08T19:22:24.882450+0000","last_clean":"2024-05-08T19:22:24.882450+0000","last_became_active":"2024-05-08T19:22:24.463741+0000","last_became_peered":"2024-05-08T19:22:24.463741+0000","last_unstale":"2024-05-08T19:22:24.882450+0000","last_undegraded":"2024-05-08T19:22:24.882450+0000","last_fullsized":"2024-05-08T19:22:24.882450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:13.044112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.451210+0000","last_change":"2024-05-08T19:22:20.005994+0000","last_active":"2024-05-08T19:22:24.451210+0000","last_peered":"2024-05-08T19:22:24.451210+0000","last_clean":"2024-05-08T19:22:24.451210+0000","last_became_active":"2024-05-08T19:22:20.005680+0000","last_became_peered":"2024-05-08T19:22:20.005680+0000","last_unstale":"2024-05-08T19:22:24.451210+0000","last_undegraded":"2024-05-08T19:22:24.451210+0000","last_fullsized":"2024-05-08T19:22:24.451210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:18.387895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888538+0000","last_change":"2024-05-08T19:22:20.449812+0000","last_active":"2024-05-08T19:22:24.888538+0000","last_peered":"2024-05-08T19:22:24.888538+0000","last_clean":"2024-05-08T19:22:24.888538+0000","last_became_active":"2024-05-08T19:22:20.449512+0000","last_became_peered":"2024-05-08T19:22:20.449512+0000","last_unstale":"2024-05-08T19:22:24.888538+0000","last_undegraded":"2024-05-08T19:22:24.888538+0000","last_fullsized":"2024-05-08T19:22:24.888538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879207+0000","last_change":"2024-05-08T19:22:24.478647+0000","last_active":"2024-05-08T19:22:24.879207+0000","last_peered":"2024-05-08T19:22:24.879207+0000","last_clean":"2024-05-08T19:22:24.879207+0000","last_became_active":"2024-05-08T19:22:24.478248+0000","last_became_peered":"2024-05-08T19:22:24.478248+0000","last_unstale":"2024-05-08T19:22:24.879207+0000","last_undegraded":"2024-05-08T19:22:24.879207+0000","last_fullsized":"2024-05-08T19:22:24.879207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:26.651711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.469393+0000","last_change":"2024-05-08T19:22:20.003344+0000","last_active":"2024-05-08T19:22:24.469393+0000","last_peered":"2024-05-08T19:22:24.469393+0000","last_clean":"2024-05-08T19:22:24.469393+0000","last_became_active":"2024-05-08T19:22:20.003055+0000","last_became_peered":"2024-05-08T19:22:20.003055+0000","last_unstale":"2024-05-08T19:22:24.469393+0000","last_undegraded":"2024-05-08T19:22:24.469393+0000","last_fullsized":"2024-05-08T19:22:24.469393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875711+0000","last_change":"2024-05-08T19:22:20.450523+0000","last_active":"2024-05-08T19:22:24.875711+0000","last_peered":"2024-05-08T19:22:24.875711+0000","last_clean":"2024-05-08T19:22:24.875711+0000","last_became_active":"2024-05-08T19:22:20.449693+0000","last_became_peered":"2024-05-08T19:22:20.449693+0000","last_unstale":"2024-05-08T19:22:24.875711+0000","last_undegraded":"2024-05-08T19:22:24.875711+0000","last_fullsized":"2024-05-08T19:22:24.875711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879227+0000","last_change":"2024-05-08T19:22:24.472926+0000","last_active":"2024-05-08T19:22:24.879227+0000","last_peered":"2024-05-08T19:22:24.879227+0000","last_clean":"2024-05-08T19:22:24.879227+0000","last_became_active":"2024-05-08T19:22:24.472518+0000","last_became_peered":"2024-05-08T19:22:24.472518+0000","last_unstale":"2024-05-08T19:22:24.879227+0000","last_undegraded":"2024-05-08T19:22:24.879227+0000","last_fullsized":"2024-05-08T19:22:24.879227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.450651+0000","last_change":"2024-05-08T19:22:20.007824+0000","last_active":"2024-05-08T19:22:24.450651+0000","last_peered":"2024-05-08T19:22:24.450651+0000","last_clean":"2024-05-08T19:22:24.450651+0000","last_became_active":"2024-05-08T19:22:20.007542+0000","last_became_peered":"2024-05-08T19:22:20.007542+0000","last_unstale":"2024-05-08T19:22:24.450651+0000","last_undegraded":"2024-05-08T19:22:24.450651+0000","last_fullsized":"2024-05-08T19:22:24.450651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882574+0000","last_change":"2024-05-08T19:22:20.443326+0000","last_active":"2024-05-08T19:22:24.882574+0000","last_peered":"2024-05-08T19:22:24.882574+0000","last_clean":"2024-05-08T19:22:24.882574+0000","last_became_active":"2024-05-08T19:22:20.443049+0000","last_became_peered":"2024-05-08T19:22:20.443049+0000","last_unstale":"2024-05-08T19:22:24.882574+0000","last_undegraded":"2024-05-08T19:22:24.882574+0000","last_fullsized":"2024-05-08T19:22:24.882574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:04.174914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879300+0000","last_change":"2024-05-08T19:22:24.479362+0000","last_active":"2024-05-08T19:22:24.879300+0000","last_peered":"2024-05-08T19:22:24.879300+0000","last_clean":"2024-05-08T19:22:24.879300+0000","last_became_active":"2024-05-08T19:22:24.478640+0000","last_became_peered":"2024-05-08T19:22:24.478640+0000","last_unstale":"2024-05-08T19:22:24.879300+0000","last_undegraded":"2024-05-08T19:22:24.879300+0000","last_fullsized":"2024-05-08T19:22:24.879300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879078+0000","last_change":"2024-05-08T19:22:20.449968+0000","last_active":"2024-05-08T19:22:24.879078+0000","last_peered":"2024-05-08T19:22:24.879078+0000","last_clean":"2024-05-08T19:22:24.879078+0000","last_became_active":"2024-05-08T19:22:20.449709+0000","last_became_peered":"2024-05-08T19:22:20.449709+0000","last_unstale":"2024-05-08T19:22:24.879078+0000","last_undegraded":"2024-05-08T19:22:24.879078+0000","last_fullsized":"2024-05-08T19:22:24.879078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457916+0000","last_change":"2024-05-08T19:22:20.004708+0000","last_active":"2024-05-08T19:22:24.457916+0000","last_peered":"2024-05-08T19:22:24.457916+0000","last_clean":"2024-05-08T19:22:24.457916+0000","last_became_active":"2024-05-08T19:22:20.004404+0000","last_became_peered":"2024-05-08T19:22:20.004404+0000","last_unstale":"2024-05-08T19:22:24.457916+0000","last_undegraded":"2024-05-08T19:22:24.457916+0000","last_fullsized":"2024-05-08T19:22:24.457916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884988+0000","last_change":"2024-05-08T19:22:24.617952+0000","last_active":"2024-05-08T19:22:24.884988+0000","last_peered":"2024-05-08T19:22:24.884988+0000","last_clean":"2024-05-08T19:22:24.884988+0000","last_became_active":"2024-05-08T19:22:24.617627+0000","last_became_peered":"2024-05-08T19:22:24.617627+0000","last_unstale":"2024-05-08T19:22:24.884988+0000","last_undegraded":"2024-05-08T19:22:24.884988+0000","last_fullsized":"2024-05-08T19:22:24.884988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:57.825616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879298+0000","last_change":"2024-05-08T19:22:20.447152+0000","last_active":"2024-05-08T19:22:24.879298+0000","last_peered":"2024-05-08T19:22:24.879298+0000","last_clean":"2024-05-08T19:22:24.879298+0000","last_became_active":"2024-05-08T19:22:20.446864+0000","last_became_peered":"2024-05-08T19:22:20.446864+0000","last_unstale":"2024-05-08T19:22:24.879298+0000","last_undegraded":"2024-05-08T19:22:24.879298+0000","last_fullsized":"2024-05-08T19:22:24.879298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.450537+0000","last_change":"2024-05-08T19:22:20.003790+0000","last_active":"2024-05-08T19:22:24.450537+0000","last_peered":"2024-05-08T19:22:24.450537+0000","last_clean":"2024-05-08T19:22:24.450537+0000","last_became_active":"2024-05-08T19:22:20.003441+0000","last_became_peered":"2024-05-08T19:22:20.003441+0000","last_unstale":"2024-05-08T19:22:24.450537+0000","last_undegraded":"2024-05-08T19:22:24.450537+0000","last_fullsized":"2024-05-08T19:22:24.450537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612146+0000","last_change":"2024-05-08T19:22:17.117278+0000","last_active":"2024-05-08T19:22:24.612146+0000","last_peered":"2024-05-08T19:22:24.612146+0000","last_clean":"2024-05-08T19:22:24.612146+0000","last_became_active":"2024-05-08T19:22:17.116272+0000","last_became_peered":"2024-05-08T19:22:17.116272+0000","last_unstale":"2024-05-08T19:22:24.612146+0000","last_undegraded":"2024-05-08T19:22:24.612146+0000","last_fullsized":"2024-05-08T19:22:24.612146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_clean_scrub_stamp":"2024-05-08T19:22:15.924359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:37.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878934+0000","last_change":"2024-05-08T19:22:24.617594+0000","last_active":"2024-05-08T19:22:24.878934+0000","last_peered":"2024-05-08T19:22:24.878934+0000","last_clean":"2024-05-08T19:22:24.878934+0000","last_became_active":"2024-05-08T19:22:24.616486+0000","last_became_peered":"2024-05-08T19:22:24.616486+0000","last_unstale":"2024-05-08T19:22:24.878934+0000","last_undegraded":"2024-05-08T19:22:24.878934+0000","last_fullsized":"2024-05-08T19:22:24.878934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878747+0000","last_change":"2024-05-08T19:22:20.445458+0000","last_active":"2024-05-08T19:22:24.878747+0000","last_peered":"2024-05-08T19:22:24.878747+0000","last_clean":"2024-05-08T19:22:24.878747+0000","last_became_active":"2024-05-08T19:22:20.445191+0000","last_became_peered":"2024-05-08T19:22:20.445191+0000","last_unstale":"2024-05-08T19:22:24.878747+0000","last_undegraded":"2024-05-08T19:22:24.878747+0000","last_fullsized":"2024-05-08T19:22:24.878747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612265+0000","last_change":"2024-05-08T19:22:20.015288+0000","last_active":"2024-05-08T19:22:24.612265+0000","last_peered":"2024-05-08T19:22:24.612265+0000","last_clean":"2024-05-08T19:22:24.612265+0000","last_became_active":"2024-05-08T19:22:20.015062+0000","last_became_peered":"2024-05-08T19:22:20.015062+0000","last_unstale":"2024-05-08T19:22:24.612265+0000","last_undegraded":"2024-05-08T19:22:24.612265+0000","last_fullsized":"2024-05-08T19:22:24.612265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:12.577297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878827+0000","last_change":"2024-05-08T19:22:24.614066+0000","last_active":"2024-05-08T19:22:24.878827+0000","last_peered":"2024-05-08T19:22:24.878827+0000","last_clean":"2024-05-08T19:22:24.878827+0000","last_became_active":"2024-05-08T19:22:24.613661+0000","last_became_peered":"2024-05-08T19:22:24.613661+0000","last_unstale":"2024-05-08T19:22:24.878827+0000","last_undegraded":"2024-05-08T19:22:24.878827+0000","last_fullsized":"2024-05-08T19:22:24.878827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612417+0000","last_change":"2024-05-08T19:22:20.015193+0000","last_active":"2024-05-08T19:22:24.612417+0000","last_peered":"2024-05-08T19:22:24.612417+0000","last_clean":"2024-05-08T19:22:24.612417+0000","last_became_active":"2024-05-08T19:22:20.014926+0000","last_became_peered":"2024-05-08T19:22:20.014926+0000","last_unstale":"2024-05-08T19:22:24.612417+0000","last_undegraded":"2024-05-08T19:22:24.612417+0000","last_fullsized":"2024-05-08T19:22:24.612417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:13.701454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879254+0000","last_change":"2024-05-08T19:22:20.446453+0000","last_active":"2024-05-08T19:22:24.879254+0000","last_peered":"2024-05-08T19:22:24.879254+0000","last_clean":"2024-05-08T19:22:24.879254+0000","last_became_active":"2024-05-08T19:22:20.446194+0000","last_became_peered":"2024-05-08T19:22:20.446194+0000","last_unstale":"2024-05-08T19:22:24.879254+0000","last_undegraded":"2024-05-08T19:22:24.879254+0000","last_fullsized":"2024-05-08T19:22:24.879254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879174+0000","last_change":"2024-05-08T19:22:24.615481+0000","last_active":"2024-05-08T19:22:24.879174+0000","last_peered":"2024-05-08T19:22:24.879174+0000","last_clean":"2024-05-08T19:22:24.879174+0000","last_became_active":"2024-05-08T19:22:24.615069+0000","last_became_peered":"2024-05-08T19:22:24.615069+0000","last_unstale":"2024-05-08T19:22:24.879174+0000","last_undegraded":"2024-05-08T19:22:24.879174+0000","last_fullsized":"2024-05-08T19:22:24.879174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:28.211177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T19:22:25.515484+0000","last_change":"2024-05-08T19:22:20.001642+0000","last_active":"2024-05-08T19:22:25.515484+0000","last_peered":"2024-05-08T19:22:25.515484+0000","last_clean":"2024-05-08T19:22:25.515484+0000","last_became_active":"2024-05-08T19:22:20.001339+0000","last_became_peered":"2024-05-08T19:22:20.001339+0000","last_unstale":"2024-05-08T19:22:25.515484+0000","last_undegraded":"2024-05-08T19:22:25.515484+0000","last_fullsized":"2024-05-08T19:22:25.515484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879506+0000","last_change":"2024-05-08T19:22:20.447909+0000","last_active":"2024-05-08T19:22:24.879506+0000","last_peered":"2024-05-08T19:22:24.879506+0000","last_clean":"2024-05-08T19:22:24.879506+0000","last_became_active":"2024-05-08T19:22:20.447526+0000","last_became_peered":"2024-05-08T19:22:20.447526+0000","last_unstale":"2024-05-08T19:22:24.879506+0000","last_undegraded":"2024-05-08T19:22:24.879506+0000","last_fullsized":"2024-05-08T19:22:24.879506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882471+0000","last_change":"2024-05-08T19:22:24.614812+0000","last_active":"2024-05-08T19:22:24.882471+0000","last_peered":"2024-05-08T19:22:24.882471+0000","last_clean":"2024-05-08T19:22:24.882471+0000","last_became_active":"2024-05-08T19:22:24.614433+0000","last_became_peered":"2024-05-08T19:22:24.614433+0000","last_unstale":"2024-05-08T19:22:24.882471+0000","last_undegraded":"2024-05-08T19:22:24.882471+0000","last_fullsized":"2024-05-08T19:22:24.882471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:07.924115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458250+0000","last_change":"2024-05-08T19:22:20.012651+0000","last_active":"2024-05-08T19:22:24.458250+0000","last_peered":"2024-05-08T19:22:24.458250+0000","last_clean":"2024-05-08T19:22:24.458250+0000","last_became_active":"2024-05-08T19:22:20.012383+0000","last_became_peered":"2024-05-08T19:22:20.012383+0000","last_unstale":"2024-05-08T19:22:24.458250+0000","last_undegraded":"2024-05-08T19:22:24.458250+0000","last_fullsized":"2024-05-08T19:22:24.458250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878980+0000","last_change":"2024-05-08T19:22:20.436459+0000","last_active":"2024-05-08T19:22:24.878980+0000","last_peered":"2024-05-08T19:22:24.878980+0000","last_clean":"2024-05-08T19:22:24.878980+0000","last_became_active":"2024-05-08T19:22:20.435680+0000","last_became_peered":"2024-05-08T19:22:20.435680+0000","last_unstale":"2024-05-08T19:22:24.878980+0000","last_undegraded":"2024-05-08T19:22:24.878980+0000","last_fullsized":"2024-05-08T19:22:24.878980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:09.166091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882688+0000","last_change":"2024-05-08T19:22:24.473208+0000","last_active":"2024-05-08T19:22:24.882688+0000","last_peered":"2024-05-08T19:22:24.882688+0000","last_clean":"2024-05-08T19:22:24.882688+0000","last_became_active":"2024-05-08T19:22:24.472782+0000","last_became_peered":"2024-05-08T19:22:24.472782+0000","last_unstale":"2024-05-08T19:22:24.882688+0000","last_undegraded":"2024-05-08T19:22:24.882688+0000","last_fullsized":"2024-05-08T19:22:24.882688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612122+0000","last_change":"2024-05-08T19:22:20.014848+0000","last_active":"2024-05-08T19:22:24.612122+0000","last_peered":"2024-05-08T19:22:24.612122+0000","last_clean":"2024-05-08T19:22:24.612122+0000","last_became_active":"2024-05-08T19:22:20.013739+0000","last_became_peered":"2024-05-08T19:22:20.013739+0000","last_unstale":"2024-05-08T19:22:24.612122+0000","last_undegraded":"2024-05-08T19:22:24.612122+0000","last_fullsized":"2024-05-08T19:22:24.612122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:03.169714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882485+0000","last_change":"2024-05-08T19:22:20.447451+0000","last_active":"2024-05-08T19:22:24.882485+0000","last_peered":"2024-05-08T19:22:24.882485+0000","last_clean":"2024-05-08T19:22:24.882485+0000","last_became_active":"2024-05-08T19:22:20.447180+0000","last_became_peered":"2024-05-08T19:22:20.447180+0000","last_unstale":"2024-05-08T19:22:24.882485+0000","last_undegraded":"2024-05-08T19:22:24.882485+0000","last_fullsized":"2024-05-08T19:22:24.882485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879310+0000","last_change":"2024-05-08T19:22:24.614091+0000","last_active":"2024-05-08T19:22:24.879310+0000","last_peered":"2024-05-08T19:22:24.879310+0000","last_clean":"2024-05-08T19:22:24.879310+0000","last_became_active":"2024-05-08T19:22:24.613677+0000","last_became_peered":"2024-05-08T19:22:24.613677+0000","last_unstale":"2024-05-08T19:22:24.879310+0000","last_undegraded":"2024-05-08T19:22:24.879310+0000","last_fullsized":"2024-05-08T19:22:24.879310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:50.011809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466472+0000","last_change":"2024-05-08T19:22:20.011528+0000","last_active":"2024-05-08T19:22:24.466472+0000","last_peered":"2024-05-08T19:22:24.466472+0000","last_clean":"2024-05-08T19:22:24.466472+0000","last_became_active":"2024-05-08T19:22:20.011262+0000","last_became_peered":"2024-05-08T19:22:20.011262+0000","last_unstale":"2024-05-08T19:22:24.466472+0000","last_undegraded":"2024-05-08T19:22:24.466472+0000","last_fullsized":"2024-05-08T19:22:24.466472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879088+0000","last_change":"2024-05-08T19:22:20.438689+0000","last_active":"2024-05-08T19:22:24.879088+0000","last_peered":"2024-05-08T19:22:24.879088+0000","last_clean":"2024-05-08T19:22:24.879088+0000","last_became_active":"2024-05-08T19:22:20.438434+0000","last_became_peered":"2024-05-08T19:22:20.438434+0000","last_unstale":"2024-05-08T19:22:24.879088+0000","last_undegraded":"2024-05-08T19:22:24.879088+0000","last_fullsized":"2024-05-08T19:22:24.879088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882616+0000","last_change":"2024-05-08T19:22:24.473569+0000","last_active":"2024-05-08T19:22:24.882616+0000","last_peered":"2024-05-08T19:22:24.882616+0000","last_clean":"2024-05-08T19:22:24.882616+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:22:24.882616+0000","last_undegraded":"2024-05-08T19:22:24.882616+0000","last_fullsized":"2024-05-08T19:22:24.882616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:22.875469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466685+0000","last_change":"2024-05-08T19:22:20.007101+0000","last_active":"2024-05-08T19:22:24.466685+0000","last_peered":"2024-05-08T19:22:24.466685+0000","last_clean":"2024-05-08T19:22:24.466685+0000","last_became_active":"2024-05-08T19:22:20.006772+0000","last_became_peered":"2024-05-08T19:22:20.006772+0000","last_unstale":"2024-05-08T19:22:24.466685+0000","last_undegraded":"2024-05-08T19:22:24.466685+0000","last_fullsized":"2024-05-08T19:22:24.466685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:23.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879350+0000","last_change":"2024-05-08T19:22:20.436696+0000","last_active":"2024-05-08T19:22:24.879350+0000","last_peered":"2024-05-08T19:22:24.879350+0000","last_clean":"2024-05-08T19:22:24.879350+0000","last_became_active":"2024-05-08T19:22:20.436373+0000","last_became_peered":"2024-05-08T19:22:20.436373+0000","last_unstale":"2024-05-08T19:22:24.879350+0000","last_undegraded":"2024-05-08T19:22:24.879350+0000","last_fullsized":"2024-05-08T19:22:24.879350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.882673+0000","last_change":"2024-05-08T19:22:24.478232+0000","last_active":"2024-05-08T19:22:24.882673+0000","last_peered":"2024-05-08T19:22:24.882673+0000","last_clean":"2024-05-08T19:22:24.882673+0000","last_became_active":"2024-05-08T19:22:24.477941+0000","last_became_peered":"2024-05-08T19:22:24.477941+0000","last_unstale":"2024-05-08T19:22:24.882673+0000","last_undegraded":"2024-05-08T19:22:24.882673+0000","last_fullsized":"2024-05-08T19:22:24.882673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.612523+0000","last_change":"2024-05-08T19:22:20.014076+0000","last_active":"2024-05-08T19:22:24.612523+0000","last_peered":"2024-05-08T19:22:24.612523+0000","last_clean":"2024-05-08T19:22:24.612523+0000","last_became_active":"2024-05-08T19:22:20.013748+0000","last_became_peered":"2024-05-08T19:22:20.013748+0000","last_unstale":"2024-05-08T19:22:24.612523+0000","last_undegraded":"2024-05-08T19:22:24.612523+0000","last_fullsized":"2024-05-08T19:22:24.612523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:50.426177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884937+0000","last_change":"2024-05-08T19:22:20.457103+0000","last_active":"2024-05-08T19:22:24.884937+0000","last_peered":"2024-05-08T19:22:24.884937+0000","last_clean":"2024-05-08T19:22:24.884937+0000","last_became_active":"2024-05-08T19:22:20.456850+0000","last_became_peered":"2024-05-08T19:22:20.456850+0000","last_unstale":"2024-05-08T19:22:24.884937+0000","last_undegraded":"2024-05-08T19:22:24.884937+0000","last_fullsized":"2024-05-08T19:22:24.884937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884914+0000","last_change":"2024-05-08T19:22:24.614410+0000","last_active":"2024-05-08T19:22:24.884914+0000","last_peered":"2024-05-08T19:22:24.884914+0000","last_clean":"2024-05-08T19:22:24.884914+0000","last_became_active":"2024-05-08T19:22:24.613904+0000","last_became_peered":"2024-05-08T19:22:24.613904+0000","last_unstale":"2024-05-08T19:22:24.884914+0000","last_undegraded":"2024-05-08T19:22:24.884914+0000","last_fullsized":"2024-05-08T19:22:24.884914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:03.465351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.458521+0000","last_change":"2024-05-08T19:22:20.000763+0000","last_active":"2024-05-08T19:22:24.458521+0000","last_peered":"2024-05-08T19:22:24.458521+0000","last_clean":"2024-05-08T19:22:24.458521+0000","last_became_active":"2024-05-08T19:22:20.000454+0000","last_became_peered":"2024-05-08T19:22:20.000454+0000","last_unstale":"2024-05-08T19:22:24.458521+0000","last_undegraded":"2024-05-08T19:22:24.458521+0000","last_fullsized":"2024-05-08T19:22:24.458521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888465+0000","last_change":"2024-05-08T19:22:20.456485+0000","last_active":"2024-05-08T19:22:24.888465+0000","last_peered":"2024-05-08T19:22:24.888465+0000","last_clean":"2024-05-08T19:22:24.888465+0000","last_became_active":"2024-05-08T19:22:20.456225+0000","last_became_peered":"2024-05-08T19:22:20.456225+0000","last_unstale":"2024-05-08T19:22:24.888465+0000","last_undegraded":"2024-05-08T19:22:24.888465+0000","last_fullsized":"2024-05-08T19:22:24.888465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878808+0000","last_change":"2024-05-08T19:22:24.473117+0000","last_active":"2024-05-08T19:22:24.878808+0000","last_peered":"2024-05-08T19:22:24.878808+0000","last_clean":"2024-05-08T19:22:24.878808+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:22:24.878808+0000","last_undegraded":"2024-05-08T19:22:24.878808+0000","last_fullsized":"2024-05-08T19:22:24.878808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.466917+0000","last_change":"2024-05-08T19:22:20.006312+0000","last_active":"2024-05-08T19:22:24.466917+0000","last_peered":"2024-05-08T19:22:24.466917+0000","last_clean":"2024-05-08T19:22:24.466917+0000","last_became_active":"2024-05-08T19:22:20.005996+0000","last_became_peered":"2024-05-08T19:22:20.005996+0000","last_unstale":"2024-05-08T19:22:24.466917+0000","last_undegraded":"2024-05-08T19:22:24.466917+0000","last_fullsized":"2024-05-08T19:22:24.466917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:13.701454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875666+0000","last_change":"2024-05-08T19:22:20.452861+0000","last_active":"2024-05-08T19:22:24.875666+0000","last_peered":"2024-05-08T19:22:24.875666+0000","last_clean":"2024-05-08T19:22:24.875666+0000","last_became_active":"2024-05-08T19:22:20.452600+0000","last_became_peered":"2024-05-08T19:22:20.452600+0000","last_unstale":"2024-05-08T19:22:24.875666+0000","last_undegraded":"2024-05-08T19:22:24.875666+0000","last_fullsized":"2024-05-08T19:22:24.875666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875543+0000","last_change":"2024-05-08T19:22:24.614345+0000","last_active":"2024-05-08T19:22:24.875543+0000","last_peered":"2024-05-08T19:22:24.875543+0000","last_clean":"2024-05-08T19:22:24.875543+0000","last_became_active":"2024-05-08T19:22:24.613948+0000","last_became_peered":"2024-05-08T19:22:24.613948+0000","last_unstale":"2024-05-08T19:22:24.875543+0000","last_undegraded":"2024-05-08T19:22:24.875543+0000","last_fullsized":"2024-05-08T19:22:24.875543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.457773+0000","last_change":"2024-05-08T19:22:20.004844+0000","last_active":"2024-05-08T19:22:24.457773+0000","last_peered":"2024-05-08T19:22:24.457773+0000","last_clean":"2024-05-08T19:22:24.457773+0000","last_became_active":"2024-05-08T19:22:20.004254+0000","last_became_peered":"2024-05-08T19:22:20.004254+0000","last_unstale":"2024-05-08T19:22:24.457773+0000","last_undegraded":"2024-05-08T19:22:24.457773+0000","last_fullsized":"2024-05-08T19:22:24.457773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.888558+0000","last_change":"2024-05-08T19:22:20.455712+0000","last_active":"2024-05-08T19:22:24.888558+0000","last_peered":"2024-05-08T19:22:24.888558+0000","last_clean":"2024-05-08T19:22:24.888558+0000","last_became_active":"2024-05-08T19:22:20.455493+0000","last_became_peered":"2024-05-08T19:22:20.455493+0000","last_unstale":"2024-05-08T19:22:24.888558+0000","last_undegraded":"2024-05-08T19:22:24.888558+0000","last_fullsized":"2024-05-08T19:22:24.888558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:28.743156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884892+0000","last_change":"2024-05-08T19:22:20.459104+0000","last_active":"2024-05-08T19:22:24.884892+0000","last_peered":"2024-05-08T19:22:24.884892+0000","last_clean":"2024-05-08T19:22:24.884892+0000","last_became_active":"2024-05-08T19:22:20.452169+0000","last_became_peered":"2024-05-08T19:22:20.452169+0000","last_unstale":"2024-05-08T19:22:24.884892+0000","last_undegraded":"2024-05-08T19:22:24.884892+0000","last_fullsized":"2024-05-08T19:22:24.884892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.886216+0000","last_change":"2024-05-08T19:22:20.449335+0000","last_active":"2024-05-08T19:22:24.886216+0000","last_peered":"2024-05-08T19:22:24.886216+0000","last_clean":"2024-05-08T19:22:24.886216+0000","last_became_active":"2024-05-08T19:22:20.449047+0000","last_became_peered":"2024-05-08T19:22:20.449047+0000","last_unstale":"2024-05-08T19:22:24.886216+0000","last_undegraded":"2024-05-08T19:22:24.886216+0000","last_fullsized":"2024-05-08T19:22:24.886216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875600+0000","last_change":"2024-05-08T19:22:20.452192+0000","last_active":"2024-05-08T19:22:24.875600+0000","last_peered":"2024-05-08T19:22:24.875600+0000","last_clean":"2024-05-08T19:22:24.875600+0000","last_became_active":"2024-05-08T19:22:20.451625+0000","last_became_peered":"2024-05-08T19:22:20.451625+0000","last_unstale":"2024-05-08T19:22:24.875600+0000","last_undegraded":"2024-05-08T19:22:24.875600+0000","last_fullsized":"2024-05-08T19:22:24.875600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878859+0000","last_change":"2024-05-08T19:22:20.441131+0000","last_active":"2024-05-08T19:22:24.878859+0000","last_peered":"2024-05-08T19:22:24.878859+0000","last_clean":"2024-05-08T19:22:24.878859+0000","last_became_active":"2024-05-08T19:22:20.440718+0000","last_became_peered":"2024-05-08T19:22:20.440718+0000","last_unstale":"2024-05-08T19:22:24.878859+0000","last_undegraded":"2024-05-08T19:22:24.878859+0000","last_fullsized":"2024-05-08T19:22:24.878859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879397+0000","last_change":"2024-05-08T19:22:20.444479+0000","last_active":"2024-05-08T19:22:24.879397+0000","last_peered":"2024-05-08T19:22:24.879397+0000","last_clean":"2024-05-08T19:22:24.879397+0000","last_became_active":"2024-05-08T19:22:20.444219+0000","last_became_peered":"2024-05-08T19:22:20.444219+0000","last_unstale":"2024-05-08T19:22:24.879397+0000","last_undegraded":"2024-05-08T19:22:24.879397+0000","last_fullsized":"2024-05-08T19:22:24.879397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879264+0000","last_change":"2024-05-08T19:22:20.436874+0000","last_active":"2024-05-08T19:22:24.879264+0000","last_peered":"2024-05-08T19:22:24.879264+0000","last_clean":"2024-05-08T19:22:24.879264+0000","last_became_active":"2024-05-08T19:22:20.436626+0000","last_became_peered":"2024-05-08T19:22:20.436626+0000","last_unstale":"2024-05-08T19:22:24.879264+0000","last_undegraded":"2024-05-08T19:22:24.879264+0000","last_fullsized":"2024-05-08T19:22:24.879264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.885056+0000","last_change":"2024-05-08T19:22:20.462445+0000","last_active":"2024-05-08T19:22:24.885056+0000","last_peered":"2024-05-08T19:22:24.885056+0000","last_clean":"2024-05-08T19:22:24.885056+0000","last_became_active":"2024-05-08T19:22:20.461547+0000","last_became_peered":"2024-05-08T19:22:20.461547+0000","last_unstale":"2024-05-08T19:22:24.885056+0000","last_undegraded":"2024-05-08T19:22:24.885056+0000","last_fullsized":"2024-05-08T19:22:24.885056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879523+0000","last_change":"2024-05-08T19:22:20.443498+0000","last_active":"2024-05-08T19:22:24.879523+0000","last_peered":"2024-05-08T19:22:24.879523+0000","last_clean":"2024-05-08T19:22:24.879523+0000","last_became_active":"2024-05-08T19:22:20.442667+0000","last_became_peered":"2024-05-08T19:22:20.442667+0000","last_unstale":"2024-05-08T19:22:24.879523+0000","last_undegraded":"2024-05-08T19:22:24.879523+0000","last_fullsized":"2024-05-08T19:22:24.879523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875577+0000","last_change":"2024-05-08T19:22:20.448722+0000","last_active":"2024-05-08T19:22:24.875577+0000","last_peered":"2024-05-08T19:22:24.875577+0000","last_clean":"2024-05-08T19:22:24.875577+0000","last_became_active":"2024-05-08T19:22:20.448449+0000","last_became_peered":"2024-05-08T19:22:20.448449+0000","last_unstale":"2024-05-08T19:22:24.875577+0000","last_undegraded":"2024-05-08T19:22:24.875577+0000","last_fullsized":"2024-05-08T19:22:24.875577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.879255+0000","last_change":"2024-05-08T19:22:20.450677+0000","last_active":"2024-05-08T19:22:24.879255+0000","last_peered":"2024-05-08T19:22:24.879255+0000","last_clean":"2024-05-08T19:22:24.879255+0000","last_became_active":"2024-05-08T19:22:20.450217+0000","last_became_peered":"2024-05-08T19:22:20.450217+0000","last_unstale":"2024-05-08T19:22:24.879255+0000","last_undegraded":"2024-05-08T19:22:24.879255+0000","last_fullsized":"2024-05-08T19:22:24.879255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.875609+0000","last_change":"2024-05-08T19:22:20.453450+0000","last_active":"2024-05-08T19:22:24.875609+0000","last_peered":"2024-05-08T19:22:24.875609+0000","last_clean":"2024-05-08T19:22:24.875609+0000","last_became_active":"2024-05-08T19:22:20.453191+0000","last_became_peered":"2024-05-08T19:22:20.453191+0000","last_unstale":"2024-05-08T19:22:24.875609+0000","last_undegraded":"2024-05-08T19:22:24.875609+0000","last_fullsized":"2024-05-08T19:22:24.875609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.878873+0000","last_change":"2024-05-08T19:22:20.452591+0000","last_active":"2024-05-08T19:22:24.878873+0000","last_peered":"2024-05-08T19:22:24.878873+0000","last_clean":"2024-05-08T19:22:24.878873+0000","last_became_active":"2024-05-08T19:22:20.451209+0000","last_became_peered":"2024-05-08T19:22:20.451209+0000","last_unstale":"2024-05-08T19:22:24.878873+0000","last_undegraded":"2024-05-08T19:22:24.878873+0000","last_fullsized":"2024-05-08T19:22:24.878873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T19:22:24.884969+0000","last_change":"2024-05-08T19:22:20.461584+0000","last_active":"2024-05-08T19:22:24.884969+0000","last_peered":"2024-05-08T19:22:24.884969+0000","last_clean":"2024-05-08T19:22:24.884969+0000","last_became_active":"2024-05-08T19:22:20.461097+0000","last_became_peered":"2024-05-08T19:22:20.461097+0000","last_unstale":"2024-05-08T19:22:24.884969+0000","last_undegraded":"2024-05-08T19:22:24.884969+0000","last_fullsized":"2024-05-08T19:22:24.884969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":690730,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":690786,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T19:22:49.369 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T19:22:49.369 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T19:22:49.369 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T19:22:49.370 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T19:22:49.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.533+0000 7fb7319bd700 1 Processor -- start 2024-05-08T19:22:49.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.533+0000 7fb7319bd700 1 -- start start 2024-05-08T19:22:49.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb7319bd700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb72c06bd40 0x7fb72c155650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb7319bd700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72c0c4eb0 con 0x7fb72c1522b0 2024-05-08T19:22:49.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb7319bd700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72c154b90 con 0x7fb72c0c5480 2024-05-08T19:22:49.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb7319bd700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb72c06c870 con 0x7fb72c06bd40 2024-05-08T19:22:49.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb72a7fc700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb72c06bd40 0x7fb72c155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb72a7fc700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb72c06bd40 0x7fb72c155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56158/0 (socket says 172.21.15.47:56158) 2024-05-08T19:22:49.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb72affd700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb72c1522b0 0x7fb72c0c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59970/0 (socket says 172.21.15.47:59970) 2024-05-08T19:22:49.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb72a7fc700 1 -- 172.21.15.47:0/1261036551 learned_addr learned my addr 172.21.15.47:0/1261036551 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:49.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb72a7fc700 1 -- 172.21.15.47:0/1261036551 >> v1:172.21.15.177:6789/0 conn(0x7fb72c0c5480 legacy=0x7fb72c0c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:49.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb72a7fc700 1 -- 172.21.15.47:0/1261036551 >> v1:172.21.15.47:6789/0 conn(0x7fb72c1522b0 legacy=0x7fb72c0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb729ffb700 1 -- 172.21.15.47:0/1261036551 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470028049 0 0) 0x7fb72c0c4eb0 con 0x7fb72c1522b0 2024-05-08T19:22:49.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb72a7fc700 1 -- 172.21.15.47:0/1261036551 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c0c5100 con 0x7fb72c06bd40 2024-05-08T19:22:49.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb72a7fc700 1 --2- 172.21.15.47:0/1261036551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c06bd40 0x7fb72c155650 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb7200098f0 tx=0x7fb720009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ebabd2250d7e68 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:49.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb729ffb700 1 -- 172.21.15.47:0/1261036551 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720004230 con 0x7fb72c06bd40 2024-05-08T19:22:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb729ffb700 1 -- 172.21.15.47:0/1261036551 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb720004390 con 0x7fb72c06bd40 2024-05-08T19:22:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.534+0000 7fb729ffb700 1 -- 172.21.15.47:0/1261036551 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7200036a0 con 0x7fb72c06bd40 2024-05-08T19:22:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.535+0000 7fb7319bd700 1 -- 172.21.15.47:0/1261036551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c06bd40 msgr2=0x7fb72c155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.535+0000 7fb7319bd700 1 --2- 172.21.15.47:0/1261036551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c06bd40 0x7fb72c155650 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb7200098f0 tx=0x7fb720009c00 comp rx=0 tx=0).stop 2024-05-08T19:22:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.535+0000 7fb7319bd700 1 -- 172.21.15.47:0/1261036551 shutdown_connections 2024-05-08T19:22:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.535+0000 7fb7319bd700 1 --2- 172.21.15.47:0/1261036551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c06bd40 0x7fb72c155650 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.535+0000 7fb7319bd700 1 -- 172.21.15.47:0/1261036551 >> 172.21.15.47:0/1261036551 conn(0x7fb72c0abd10 msgr2=0x7fb72c0ac0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.535+0000 7fb7319bd700 1 -- 172.21.15.47:0/1261036551 shutdown_connections 2024-05-08T19:22:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.535+0000 7fb7319bd700 1 -- 172.21.15.47:0/1261036551 wait complete. 2024-05-08T19:22:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.536+0000 7fb7319bd700 1 Processor -- start 2024-05-08T19:22:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.536+0000 7fb7319bd700 1 -- start start 2024-05-08T19:22:49.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.537+0000 7fb7319bd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb72c06bd40 0x7fb72c14ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.537+0000 7fb7319bd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0c5480 0x7fb72c1418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.537+0000 7fb7319bd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb72c1522b0 0x7fb72c141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.537+0000 7fb7319bd700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c0c4150 con 0x7fb72c0c5480 2024-05-08T19:22:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.537+0000 7fb7319bd700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c0c16b0 con 0x7fb72c06bd40 2024-05-08T19:22:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.537+0000 7fb7319bd700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c14c5f0 con 0x7fb72c1522b0 2024-05-08T19:22:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.537+0000 7fb72a7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0c5480 0x7fb72c1418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.537+0000 7fb72a7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0c5480 0x7fb72c1418f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56170/0 (socket says 172.21.15.47:56170) 2024-05-08T19:22:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.537+0000 7fb72a7fc700 1 -- 172.21.15.47:0/3425664338 learned_addr learned my addr 172.21.15.47:0/3425664338 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.537+0000 7fb72affd700 1 --2- 172.21.15.47:0/3425664338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb72c06bd40 0x7fb72c14ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.537+0000 7fb72b7fe700 1 --2- 172.21.15.47:0/3425664338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb72c1522b0 0x7fb72c141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.537+0000 7fb72a7fc700 1 -- 172.21.15.47:0/3425664338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb72c1522b0 msgr2=0x7fb72c141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.537+0000 7fb72a7fc700 1 --2- 172.21.15.47:0/3425664338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb72c1522b0 0x7fb72c141e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.537+0000 7fb72a7fc700 1 -- 172.21.15.47:0/3425664338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb72c06bd40 msgr2=0x7fb72c14ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.537+0000 7fb72a7fc700 1 --2- 172.21.15.47:0/3425664338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb72c06bd40 0x7fb72c14ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.538+0000 7fb72a7fc700 1 -- 172.21.15.47:0/3425664338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720009550 con 0x7fb72c0c5480 2024-05-08T19:22:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.538+0000 7fb72a7fc700 1 --2- 172.21.15.47:0/3425664338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0c5480 0x7fb72c1418f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb720009840 tx=0x7fb720004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.538+0000 7fb713fff700 1 -- 172.21.15.47:0/3425664338 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72000b6a0 con 0x7fb72c0c5480 2024-05-08T19:22:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.538+0000 7fb713fff700 1 -- 172.21.15.47:0/3425664338 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72000b800 con 0x7fb72c0c5480 2024-05-08T19:22:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.538+0000 7fb7319bd700 1 -- 172.21.15.47:0/3425664338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72c153720 con 0x7fb72c0c5480 2024-05-08T19:22:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.538+0000 7fb713fff700 1 -- 172.21.15.47:0/3425664338 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72000bb90 con 0x7fb72c0c5480 2024-05-08T19:22:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.538+0000 7fb7319bd700 1 -- 172.21.15.47:0/3425664338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72c14c890 con 0x7fb72c0c5480 2024-05-08T19:22:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.539+0000 7fb7319bd700 1 -- 172.21.15.47:0/3425664338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72c14cab0 con 0x7fb72c0c5480 2024-05-08T19:22:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.539+0000 7fb713fff700 1 -- 172.21.15.47:0/3425664338 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb72000bcf0 con 0x7fb72c0c5480 2024-05-08T19:22:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.540+0000 7fb713fff700 1 --2- 172.21.15.47:0/3425664338 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb71806ac90 0x7fb71806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.540+0000 7fb713fff700 1 -- 172.21.15.47:0/3425664338 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb72008aeb0 con 0x7fb72c0c5480 2024-05-08T19:22:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.540+0000 7fb72affd700 1 --2- 172.21.15.47:0/3425664338 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb71806ac90 0x7fb71806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.541+0000 7fb72affd700 1 --2- 172.21.15.47:0/3425664338 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb71806ac90 0x7fb71806d150 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb71c000f60 tx=0x7fb71c007c00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:49.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.545+0000 7fb713fff700 1 -- 172.21.15.47:0/3425664338 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb720055e30 con 0x7fb72c0c5480 2024-05-08T19:22:49.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.802+0000 7fb7319bd700 1 -- 172.21.15.47:0/3425664338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb72c04ec60 con 0x7fb72c0c5480 2024-05-08T19:22:49.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.802+0000 7fb713fff700 1 -- 172.21.15.47:0/3425664338 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb720059450 con 0x7fb72c0c5480 2024-05-08T19:22:49.794 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:49.794 INFO:teuthology.orchestra.run.smithi047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T19:22:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.804+0000 7fb7319bd700 1 -- 172.21.15.47:0/3425664338 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb71806ac90 msgr2=0x7fb71806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.804+0000 7fb7319bd700 1 --2- 172.21.15.47:0/3425664338 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb71806ac90 0x7fb71806d150 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb71c000f60 tx=0x7fb71c007c00 comp rx=0 tx=0).stop 2024-05-08T19:22:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.804+0000 7fb7319bd700 1 -- 172.21.15.47:0/3425664338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0c5480 msgr2=0x7fb72c1418f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.804+0000 7fb7319bd700 1 --2- 172.21.15.47:0/3425664338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0c5480 0x7fb72c1418f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb720009840 tx=0x7fb720004750 comp rx=0 tx=0).stop 2024-05-08T19:22:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.804+0000 7fb7319bd700 1 -- 172.21.15.47:0/3425664338 shutdown_connections 2024-05-08T19:22:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.804+0000 7fb7319bd700 1 --2- 172.21.15.47:0/3425664338 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb71806ac90 0x7fb71806d150 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.804+0000 7fb7319bd700 1 --2- 172.21.15.47:0/3425664338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb72c1522b0 0x7fb72c141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.804+0000 7fb7319bd700 1 --2- 172.21.15.47:0/3425664338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb72c06bd40 0x7fb72c14ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.804+0000 7fb7319bd700 1 --2- 172.21.15.47:0/3425664338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c0c5480 0x7fb72c1418f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.804+0000 7fb7319bd700 1 -- 172.21.15.47:0/3425664338 >> 172.21.15.47:0/3425664338 conn(0x7fb72c0abd10 msgr2=0x7fb72c152b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.804+0000 7fb7319bd700 1 -- 172.21.15.47:0/3425664338 shutdown_connections 2024-05-08T19:22:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.804+0000 7fb7319bd700 1 -- 172.21.15.47:0/3425664338 wait complete. 2024-05-08T19:22:49.809 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T19:22:49.809 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.943+0000 7f48b9b1e700 1 Processor -- start 2024-05-08T19:22:49.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.943+0000 7f48b9b1e700 1 -- start start 2024-05-08T19:22:49.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.944+0000 7f48b9b1e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48b414fc60 0x7f48b40c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.944+0000 7f48b9b1e700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f48b4150040 0x7f48b40c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.944+0000 7f48b9b1e700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b4155e00 con 0x7f48b40c2a80 2024-05-08T19:22:49.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.944+0000 7f48b9b1e700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b41560e0 con 0x7f48b4150040 2024-05-08T19:22:49.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.944+0000 7f48b9b1e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b41563c0 con 0x7f48b414fc60 2024-05-08T19:22:49.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.944+0000 7f48b3fff700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f48b40c2a80 0x7f48b41528f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59982/0 (socket says 172.21.15.47:59982) 2024-05-08T19:22:49.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.944+0000 7f48b3fff700 1 -- 172.21.15.47:0/802163812 learned_addr learned my addr 172.21.15.47:0/802163812 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:49.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.944+0000 7f48b37fe700 1 --2- 172.21.15.47:0/802163812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48b414fc60 0x7f48b40c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.944+0000 7f48b2ffd700 1 --2- 172.21.15.47:0/802163812 >> v2:172.21.15.177:3300/0 conn(0x7f48b4150040 0x7f48b40c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.944+0000 7f48b27fc700 1 -- 172.21.15.47:0/802163812 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183832584 0 0) 0x7f48b4155e00 con 0x7f48b40c2a80 2024-05-08T19:22:49.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b27fc700 1 -- 172.21.15.47:0/802163812 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f489c0035b0 con 0x7f48b40c2a80 2024-05-08T19:22:49.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b27fc700 1 -- 172.21.15.47:0/802163812 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3263147714 0 0) 0x7f489c0035b0 con 0x7f48b40c2a80 2024-05-08T19:22:49.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b27fc700 1 -- 172.21.15.47:0/802163812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48b414fc60 msgr2=0x7f48b40c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:49.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b27fc700 1 --2- 172.21.15.47:0/802163812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48b414fc60 0x7f48b40c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b27fc700 1 -- 172.21.15.47:0/802163812 >> v2:172.21.15.177:3300/0 conn(0x7f48b4150040 msgr2=0x7f48b40c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b27fc700 1 --2- 172.21.15.47:0/802163812 >> v2:172.21.15.177:3300/0 conn(0x7f48b4150040 0x7f48b40c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b27fc700 1 -- 172.21.15.47:0/802163812 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b41566a0 con 0x7f48b40c2a80 2024-05-08T19:22:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b27fc700 1 -- 172.21.15.47:0/802163812 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f48ac0019f0 con 0x7f48b40c2a80 2024-05-08T19:22:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b27fc700 1 -- 172.21.15.47:0/802163812 >> v1:172.21.15.47:6789/0 conn(0x7f48b40c2a80 legacy=0x7f48b41528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b27fc700 1 --2- 172.21.15.47:0/802163812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f489c003a00 0x7f489c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b27fc700 1 --2- 172.21.15.47:0/802163812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48b414fc60 0x7f489c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b27fc700 1 --2- 172.21.15.47:0/802163812 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489c004d90 0x7f489c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b27fc700 1 -- 172.21.15.47:0/802163812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b41560e0 con 0x7f489c003a00 2024-05-08T19:22:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b27fc700 1 -- 172.21.15.47:0/802163812 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b41563c0 con 0x7f489c004d90 2024-05-08T19:22:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b27fc700 1 -- 172.21.15.47:0/802163812 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c00ba10 con 0x7f48b414fc60 2024-05-08T19:22:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b37fe700 1 --2- 172.21.15.47:0/802163812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f489c003a00 0x7f489c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b2ffd700 1 --2- 172.21.15.47:0/802163812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48b414fc60 0x7f489c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b3fff700 1 --2- 172.21.15.47:0/802163812 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489c004d90 0x7f489c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b37fe700 1 -- 172.21.15.47:0/802163812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48b414fc60 msgr2=0x7f489c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:49.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b37fe700 1 --2- 172.21.15.47:0/802163812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48b414fc60 0x7f489c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b37fe700 1 -- 172.21.15.47:0/802163812 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489c004d90 msgr2=0x7f489c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:49.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b37fe700 1 --2- 172.21.15.47:0/802163812 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489c004d90 0x7f489c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b37fe700 1 -- 172.21.15.47:0/802163812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c0035b0 con 0x7f489c003a00 2024-05-08T19:22:49.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.945+0000 7f48b37fe700 1 --2- 172.21.15.47:0/802163812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f489c003a00 0x7f489c003e20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009b60 tx=0x7f489c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f3cbe751d17005 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:49.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.946+0000 7f48b27fc700 1 -- 172.21.15.47:0/802163812 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a400e6c0 con 0x7f489c003a00 2024-05-08T19:22:49.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.946+0000 7f48b27fc700 1 -- 172.21.15.47:0/802163812 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a400e820 con 0x7f489c003a00 2024-05-08T19:22:49.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.946+0000 7f48b27fc700 1 -- 172.21.15.47:0/802163812 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a400eb90 con 0x7f489c003a00 2024-05-08T19:22:49.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.946+0000 7f48b9b1e700 1 -- 172.21.15.47:0/802163812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f489c003a00 msgr2=0x7f489c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.946+0000 7f48b9b1e700 1 --2- 172.21.15.47:0/802163812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f489c003a00 0x7f489c003e20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009b60 tx=0x7f489c005880 comp rx=0 tx=0).stop 2024-05-08T19:22:49.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.946+0000 7f48b3fff700 1 -- 172.21.15.47:0/802163812 reap_dead start 2024-05-08T19:22:49.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.946+0000 7f48b9b1e700 1 -- 172.21.15.47:0/802163812 shutdown_connections 2024-05-08T19:22:49.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.946+0000 7f48b9b1e700 1 -- 172.21.15.47:0/802163812 >> 172.21.15.47:0/802163812 conn(0x7f48b4072dd0 msgr2=0x7f48b406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:49.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.946+0000 7f48b9b1e700 1 -- 172.21.15.47:0/802163812 shutdown_connections 2024-05-08T19:22:49.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.946+0000 7f48b9b1e700 1 -- 172.21.15.47:0/802163812 wait complete. 2024-05-08T19:22:49.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.947+0000 7f48b9b1e700 1 Processor -- start 2024-05-08T19:22:49.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.948+0000 7f48b9b1e700 1 -- start start 2024-05-08T19:22:49.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.948+0000 7f48b9b1e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f489c003a00 0x7f48b40acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.948+0000 7f48b9b1e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48b40ad1a0 0x7f48b40c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.948+0000 7f48b9b1e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48b406bad0 0x7f48b41447f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.948+0000 7f48b9b1e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40abba0 con 0x7f48b406bad0 2024-05-08T19:22:49.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.948+0000 7f48b9b1e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40abdd0 con 0x7f48b40ad1a0 2024-05-08T19:22:49.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.948+0000 7f48b9b1e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40ac0b0 con 0x7f489c003a00 2024-05-08T19:22:49.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f48b3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48b406bad0 0x7f48b41447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f48b3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48b406bad0 0x7f48b41447f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56178/0 (socket says 172.21.15.47:56178) 2024-05-08T19:22:49.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f48b3fff700 1 -- 172.21.15.47:0/2904772498 learned_addr learned my addr 172.21.15.47:0/2904772498 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:49.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f48b2ffd700 1 --2- 172.21.15.47:0/2904772498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48b40ad1a0 0x7f48b40c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f48b37fe700 1 --2- 172.21.15.47:0/2904772498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f489c003a00 0x7f48b40acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f48b3fff700 1 -- 172.21.15.47:0/2904772498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f489c003a00 msgr2=0x7f48b40acb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f48b3fff700 1 --2- 172.21.15.47:0/2904772498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f489c003a00 0x7f48b40acb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f48b3fff700 1 -- 172.21.15.47:0/2904772498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48b40ad1a0 msgr2=0x7f48b40c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:49.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f48b3fff700 1 --2- 172.21.15.47:0/2904772498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48b40ad1a0 0x7f48b40c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:49.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f48b3fff700 1 -- 172.21.15.47:0/2904772498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b40ac390 con 0x7f48b406bad0 2024-05-08T19:22:49.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f48b3fff700 1 --2- 172.21.15.47:0/2904772498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48b406bad0 0x7f48b41447f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48b40c2f10 tx=0x7f48ac00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:49.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f489bfff700 1 -- 172.21.15.47:0/2904772498 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00adf0 con 0x7f48b406bad0 2024-05-08T19:22:49.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f489bfff700 1 -- 172.21.15.47:0/2904772498 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac0133f0 con 0x7f48b406bad0 2024-05-08T19:22:49.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f48b9b1e700 1 -- 172.21.15.47:0/2904772498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b40ac670 con 0x7f48b406bad0 2024-05-08T19:22:49.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f489bfff700 1 -- 172.21.15.47:0/2904772498 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac0137a0 con 0x7f48b406bad0 2024-05-08T19:22:49.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.949+0000 7f48b9b1e700 1 -- 172.21.15.47:0/2904772498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b4154eb0 con 0x7f48b406bad0 2024-05-08T19:22:49.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.950+0000 7f48b9b1e700 1 -- 172.21.15.47:0/2904772498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b40c44e0 con 0x7f48b406bad0 2024-05-08T19:22:49.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.951+0000 7f489bfff700 1 -- 172.21.15.47:0/2904772498 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f48ac013900 con 0x7f48b406bad0 2024-05-08T19:22:49.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.951+0000 7f489bfff700 1 --2- 172.21.15.47:0/2904772498 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f48a006ac90 0x7f48a006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:49.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.951+0000 7f489bfff700 1 -- 172.21.15.47:0/2904772498 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f48ac08a180 con 0x7f48b406bad0 2024-05-08T19:22:49.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.951+0000 7f48b37fe700 1 --2- 172.21.15.47:0/2904772498 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f48a006ac90 0x7f48a006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:49.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.952+0000 7f48b37fe700 1 --2- 172.21.15.47:0/2904772498 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f48a006ac90 0x7f48a006d150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48a40090b0 tx=0x7f48a4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:49.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:49.956+0000 7f489bfff700 1 -- 172.21.15.47:0/2904772498 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f48ac055100 con 0x7f48b406bad0 2024-05-08T19:22:50.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.167+0000 7f48b9b1e700 1 -- 172.21.15.47:0/2904772498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48b404ec60 con 0x7f48b406bad0 2024-05-08T19:22:50.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.168+0000 7f489bfff700 1 -- 172.21.15.47:0/2904772498 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f48ac058720 con 0x7f48b406bad0 2024-05-08T19:22:50.161 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:50.161 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:24.891864+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:50.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.170+0000 7f48b9b1e700 1 -- 172.21.15.47:0/2904772498 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f48a006ac90 msgr2=0x7f48a006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:50.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.170+0000 7f48b9b1e700 1 --2- 172.21.15.47:0/2904772498 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f48a006ac90 0x7f48a006d150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48a40090b0 tx=0x7f48a4008030 comp rx=0 tx=0).stop 2024-05-08T19:22:50.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.170+0000 7f48b9b1e700 1 -- 172.21.15.47:0/2904772498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48b406bad0 msgr2=0x7f48b41447f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:50.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.170+0000 7f48b9b1e700 1 --2- 172.21.15.47:0/2904772498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48b406bad0 0x7f48b41447f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48b40c2f10 tx=0x7f48ac00a620 comp rx=0 tx=0).stop 2024-05-08T19:22:50.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.170+0000 7f48b9b1e700 1 -- 172.21.15.47:0/2904772498 shutdown_connections 2024-05-08T19:22:50.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.170+0000 7f48b9b1e700 1 --2- 172.21.15.47:0/2904772498 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f48a006ac90 0x7f48a006d150 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.170+0000 7f48b9b1e700 1 --2- 172.21.15.47:0/2904772498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48b406bad0 0x7f48b41447f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.170+0000 7f48b9b1e700 1 --2- 172.21.15.47:0/2904772498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f489c003a00 0x7f48b40acb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.170+0000 7f48b9b1e700 1 --2- 172.21.15.47:0/2904772498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48b40ad1a0 0x7f48b40c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.170+0000 7f48b9b1e700 1 -- 172.21.15.47:0/2904772498 >> 172.21.15.47:0/2904772498 conn(0x7f48b4072dd0 msgr2=0x7f48b406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:50.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.170+0000 7f48b9b1e700 1 -- 172.21.15.47:0/2904772498 shutdown_connections 2024-05-08T19:22:50.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.170+0000 7f48b9b1e700 1 -- 172.21.15.47:0/2904772498 wait complete. 2024-05-08T19:22:50.176 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T19:22:15.923832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T19:22:18.529792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T19:22:19.389797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T19:22:22.474001+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T19:22:50.177 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T19:22:50.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.313+0000 7f6fea054700 1 Processor -- start 2024-05-08T19:22:50.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.313+0000 7f6fea054700 1 -- start start 2024-05-08T19:22:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.314+0000 7f6fea054700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe40c5410 0x7f6fe40c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.314+0000 7f6fea054700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6fe40c5960 0x7f6fe4151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.314+0000 7f6fea054700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe406ba60 con 0x7f6fe40c62e0 2024-05-08T19:22:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.314+0000 7f6fea054700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe406bd40 con 0x7f6fe40c5960 2024-05-08T19:22:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.314+0000 7f6fea054700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe406b890 con 0x7f6fe40c5410 2024-05-08T19:22:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.314+0000 7f6fe2ffd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe40c5410 0x7f6fe40c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:50.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.314+0000 7f6fe3fff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6fe40c5960 0x7f6fe4151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:50.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.315+0000 7f6fe3fff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6fe40c5960 0x7f6fe4151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:42260/0 (socket says 172.21.15.47:42260) 2024-05-08T19:22:50.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.315+0000 7f6fe2ffd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe40c5410 0x7f6fe40c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:41338/0 (socket says 172.21.15.47:41338) 2024-05-08T19:22:50.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.315+0000 7f6fe3fff700 1 -- 172.21.15.47:0/2419996671 learned_addr learned my addr 172.21.15.47:0/2419996671 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:50.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.315+0000 7f6fe37fe700 1 --1- 172.21.15.47:0/2419996671 >> v1:172.21.15.177:6789/0 conn(0x7f6fe40c62e0 0x7f6fe406b180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:36372/0 (socket says 172.21.15.47:36372) 2024-05-08T19:22:50.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.315+0000 7f6fe2ffd700 1 -- 172.21.15.47:0/2419996671 >> v2:172.21.15.177:3300/0 conn(0x7f6fe40c5960 msgr2=0x7f6fe4151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:50.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.315+0000 7f6fe2ffd700 1 --2- 172.21.15.47:0/2419996671 >> v2:172.21.15.177:3300/0 conn(0x7f6fe40c5960 0x7f6fe4151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.315+0000 7f6fe2ffd700 1 -- 172.21.15.47:0/2419996671 >> v1:172.21.15.177:6789/0 conn(0x7f6fe40c62e0 legacy=0x7f6fe406b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:50.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.315+0000 7f6fe2ffd700 1 -- 172.21.15.47:0/2419996671 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe40c51b0 con 0x7f6fe40c5410 2024-05-08T19:22:50.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.315+0000 7f6fe3fff700 1 --2- 172.21.15.47:0/2419996671 >> v2:172.21.15.177:3300/0 conn(0x7f6fe40c5960 0x7f6fe4151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:50.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.315+0000 7f6fe2ffd700 1 --2- 172.21.15.47:0/2419996671 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe40c5410 0x7f6fe40c8120 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009840 tx=0x7f6fcc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a6b78fe023889c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:50.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.315+0000 7f6fe27fc700 1 -- 172.21.15.47:0/2419996671 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc011830 con 0x7f6fe40c5410 2024-05-08T19:22:50.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.315+0000 7f6fe27fc700 1 -- 172.21.15.47:0/2419996671 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc011990 con 0x7f6fe40c5410 2024-05-08T19:22:50.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.315+0000 7f6fe27fc700 1 -- 172.21.15.47:0/2419996671 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc011d20 con 0x7f6fe40c5410 2024-05-08T19:22:50.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.316+0000 7f6fea054700 1 -- 172.21.15.47:0/2419996671 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe40c5410 msgr2=0x7f6fe40c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:50.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.316+0000 7f6fea054700 1 --2- 172.21.15.47:0/2419996671 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe40c5410 0x7f6fe40c8120 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009840 tx=0x7f6fcc009b50 comp rx=0 tx=0).stop 2024-05-08T19:22:50.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.316+0000 7f6fea054700 1 -- 172.21.15.47:0/2419996671 shutdown_connections 2024-05-08T19:22:50.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.316+0000 7f6fea054700 1 --2- 172.21.15.47:0/2419996671 >> v2:172.21.15.177:3300/0 conn(0x7f6fe40c5960 0x7f6fe4151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.316+0000 7f6fea054700 1 --2- 172.21.15.47:0/2419996671 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe40c5410 0x7f6fe40c8120 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.316+0000 7f6fea054700 1 -- 172.21.15.47:0/2419996671 >> 172.21.15.47:0/2419996671 conn(0x7f6fe40c6ca0 msgr2=0x7f6fe40c7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.316+0000 7f6fea054700 1 -- 172.21.15.47:0/2419996671 shutdown_connections 2024-05-08T19:22:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.316+0000 7f6fea054700 1 -- 172.21.15.47:0/2419996671 wait complete. 2024-05-08T19:22:50.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.317+0000 7f6fea054700 1 Processor -- start 2024-05-08T19:22:50.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.317+0000 7f6fea054700 1 -- start start 2024-05-08T19:22:50.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.318+0000 7f6fea054700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40c5410 0x7f6fe40ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:50.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.318+0000 7f6fea054700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fe40c5960 0x7f6fe40abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:50.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.318+0000 7f6fea054700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe40c62e0 0x7f6fe40c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:50.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.318+0000 7f6fea054700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40ab5c0 con 0x7f6fe40c5960 2024-05-08T19:22:50.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.318+0000 7f6fea054700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe41eae70 con 0x7f6fe40c5410 2024-05-08T19:22:50.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.318+0000 7f6fea054700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40c1d80 con 0x7f6fe40c62e0 2024-05-08T19:22:50.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.318+0000 7f6fe2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fe40c5960 0x7f6fe40abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:50.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.318+0000 7f6fe2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fe40c5960 0x7f6fe40abbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56190/0 (socket says 172.21.15.47:56190) 2024-05-08T19:22:50.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.318+0000 7f6fe2ffd700 1 -- 172.21.15.47:0/27113201 learned_addr learned my addr 172.21.15.47:0/27113201 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:50.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.318+0000 7f6fe37fe700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40c5410 0x7f6fe40ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:50.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.318+0000 7f6fe3fff700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe40c62e0 0x7f6fe40c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:50.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.319+0000 7f6fe2ffd700 1 -- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe40c62e0 msgr2=0x7f6fe40c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:50.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.319+0000 7f6fe2ffd700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe40c62e0 0x7f6fe40c3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.319+0000 7f6fe2ffd700 1 -- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40c5410 msgr2=0x7f6fe40ab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:50.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.319+0000 7f6fe2ffd700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40c5410 0x7f6fe40ab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.319+0000 7f6fe2ffd700 1 -- 172.21.15.47:0/27113201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc009b30 con 0x7f6fe40c5960 2024-05-08T19:22:50.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.319+0000 7f6fe3fff700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe40c62e0 0x7f6fe40c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:50.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.319+0000 7f6fe37fe700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40c5410 0x7f6fe40ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:50.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.319+0000 7f6fe2ffd700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fe40c5960 0x7f6fe40abbc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009fd0 tx=0x7f6fcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.319+0000 7f6fdbfff700 1 -- 172.21.15.47:0/27113201 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc004530 con 0x7f6fe40c5960 2024-05-08T19:22:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.319+0000 7f6fea054700 1 -- 172.21.15.47:0/27113201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc0094a0 con 0x7f6fe40c5960 2024-05-08T19:22:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.319+0000 7f6fdbfff700 1 -- 172.21.15.47:0/27113201 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc01f070 con 0x7f6fe40c5960 2024-05-08T19:22:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.319+0000 7f6fdbfff700 1 -- 172.21.15.47:0/27113201 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0038e0 con 0x7f6fe40c5960 2024-05-08T19:22:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.319+0000 7f6fea054700 1 -- 172.21.15.47:0/27113201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe40aa0c0 con 0x7f6fe40c5960 2024-05-08T19:22:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.320+0000 7f6fea054700 1 -- 172.21.15.47:0/27113201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe4155c80 con 0x7f6fe40c5960 2024-05-08T19:22:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.320+0000 7f6fdbfff700 1 -- 172.21.15.47:0/27113201 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6fcc021030 con 0x7f6fe40c5960 2024-05-08T19:22:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.321+0000 7f6fdbfff700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f6fc406ac90 0x7f6fc406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.321+0000 7f6fdbfff700 1 -- 172.21.15.47:0/27113201 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6fcc08a8d0 con 0x7f6fe40c5960 2024-05-08T19:22:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.321+0000 7f6fe37fe700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f6fc406ac90 0x7f6fc406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.321+0000 7f6fe37fe700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f6fc406ac90 0x7f6fc406d150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4000f60 tx=0x7f6fd4007df0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:50.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.325+0000 7f6fdbfff700 1 -- 172.21.15.47:0/27113201 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6fcc0557d0 con 0x7f6fe40c5960 2024-05-08T19:22:50.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.529+0000 7f6fea054700 1 -- 172.21.15.47:0/27113201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6fe404ec60 con 0x7f6fe40c5960 2024-05-08T19:22:50.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.529+0000 7f6fdbfff700 1 -- 172.21.15.47:0/27113201 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fcc058df0 con 0x7f6fe40c5960 2024-05-08T19:22:50.521 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-08T19:22:50.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.531+0000 7f6fea054700 1 -- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f6fc406ac90 msgr2=0x7f6fc406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:50.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.531+0000 7f6fea054700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f6fc406ac90 0x7f6fc406d150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4000f60 tx=0x7f6fd4007df0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.531+0000 7f6fea054700 1 -- 172.21.15.47:0/27113201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fe40c5960 msgr2=0x7f6fe40abbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:50.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.531+0000 7f6fea054700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fe40c5960 0x7f6fe40abbc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009fd0 tx=0x7f6fcc004750 comp rx=0 tx=0).stop 2024-05-08T19:22:50.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.531+0000 7f6fea054700 1 -- 172.21.15.47:0/27113201 shutdown_connections 2024-05-08T19:22:50.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.531+0000 7f6fea054700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f6fc406ac90 0x7f6fc406d150 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.531+0000 7f6fea054700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fe40c62e0 0x7f6fe40c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.531+0000 7f6fea054700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40c5410 0x7f6fe40ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.531+0000 7f6fea054700 1 --2- 172.21.15.47:0/27113201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fe40c5960 0x7f6fe40abbc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.531+0000 7f6fea054700 1 -- 172.21.15.47:0/27113201 >> 172.21.15.47:0/27113201 conn(0x7f6fe40c6ca0 msgr2=0x7f6fe414d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:50.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.532+0000 7f6fea054700 1 -- 172.21.15.47:0/27113201 shutdown_connections 2024-05-08T19:22:50.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.532+0000 7f6fea054700 1 -- 172.21.15.47:0/27113201 wait complete. 2024-05-08T19:22:50.536 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T19:22:50.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.673+0000 7fa4fb0f1700 1 Processor -- start 2024-05-08T19:22:50.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.673+0000 7fa4fb0f1700 1 -- start start 2024-05-08T19:22:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.674+0000 7fa4fb0f1700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa4f4152130 0x7fa4f4154de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.674+0000 7fa4fb0f1700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f40716a0 con 0x7fa4f40c0770 2024-05-08T19:22:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.674+0000 7fa4fb0f1700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f40c3a40 con 0x7fa4f406e6e0 2024-05-08T19:22:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.674+0000 7fa4fb0f1700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f40c11f0 con 0x7fa4f4152130 2024-05-08T19:22:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.674+0000 7fa4f8e8d700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa4f4152130 0x7fa4f4154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.674+0000 7fa4f3fff700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa4f40c0770 0x7fa4f4155320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59988/0 (socket says 172.21.15.47:59988) 2024-05-08T19:22:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.674+0000 7fa4f3fff700 1 -- 172.21.15.47:0/3774543635 learned_addr learned my addr 172.21.15.47:0/3774543635 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.675+0000 7fa4f8e8d700 1 -- 172.21.15.47:0/3774543635 >> v1:172.21.15.177:6789/0 conn(0x7fa4f406e6e0 legacy=0x7fa4f406eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.675+0000 7fa4f8e8d700 1 -- 172.21.15.47:0/3774543635 >> v1:172.21.15.47:6789/0 conn(0x7fa4f40c0770 legacy=0x7fa4f4155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:50.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.675+0000 7fa4f8e8d700 1 -- 172.21.15.47:0/3774543635 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f406b470 con 0x7fa4f4152130 2024-05-08T19:22:50.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.675+0000 7fa4f37fe700 1 -- 172.21.15.47:0/3774543635 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821771730 0 0) 0x7fa4f40716a0 con 0x7fa4f40c0770 2024-05-08T19:22:50.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.675+0000 7fa4f8e8d700 1 --2- 172.21.15.47:0/3774543635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f4152130 0x7fa4f4154de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009840 tx=0x7fa4e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8df4b0893f3c45e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:50.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.675+0000 7fa4f37fe700 1 -- 172.21.15.47:0/3774543635 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8011830 con 0x7fa4f4152130 2024-05-08T19:22:50.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.675+0000 7fa4f37fe700 1 -- 172.21.15.47:0/3774543635 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e8011990 con 0x7fa4f4152130 2024-05-08T19:22:50.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.675+0000 7fa4f37fe700 1 -- 172.21.15.47:0/3774543635 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8011d20 con 0x7fa4f4152130 2024-05-08T19:22:50.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.675+0000 7fa4fb0f1700 1 -- 172.21.15.47:0/3774543635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f4152130 msgr2=0x7fa4f4154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:50.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.675+0000 7fa4fb0f1700 1 --2- 172.21.15.47:0/3774543635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f4152130 0x7fa4f4154de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009840 tx=0x7fa4e8009b50 comp rx=0 tx=0).stop 2024-05-08T19:22:50.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.675+0000 7fa4fb0f1700 1 -- 172.21.15.47:0/3774543635 shutdown_connections 2024-05-08T19:22:50.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.676+0000 7fa4fb0f1700 1 --2- 172.21.15.47:0/3774543635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f4152130 0x7fa4f4154de0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.676+0000 7fa4fb0f1700 1 -- 172.21.15.47:0/3774543635 >> 172.21.15.47:0/3774543635 conn(0x7fa4f40c7120 msgr2=0x7fa4f40c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:50.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.676+0000 7fa4fb0f1700 1 -- 172.21.15.47:0/3774543635 shutdown_connections 2024-05-08T19:22:50.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.676+0000 7fa4fb0f1700 1 -- 172.21.15.47:0/3774543635 wait complete. 2024-05-08T19:22:50.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.677+0000 7fa4fb0f1700 1 Processor -- start 2024-05-08T19:22:50.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.677+0000 7fa4fb0f1700 1 -- start start 2024-05-08T19:22:50.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.677+0000 7fa4fb0f1700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4f406e6e0 0x7fa4f4153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:50.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.677+0000 7fa4fb0f1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f40c0770 0x7fa4f4139910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:50.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.677+0000 7fa4fb0f1700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4f4152130 0x7fa4f4139e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:50.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4fb0f1700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f40c6fe0 con 0x7fa4f40c0770 2024-05-08T19:22:50.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4fb0f1700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f4152800 con 0x7fa4f406e6e0 2024-05-08T19:22:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4fb0f1700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f4153380 con 0x7fa4f4152130 2024-05-08T19:22:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4f3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f40c0770 0x7fa4f4139910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4f3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f40c0770 0x7fa4f4139910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56200/0 (socket says 172.21.15.47:56200) 2024-05-08T19:22:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4f3fff700 1 -- 172.21.15.47:0/373983515 learned_addr learned my addr 172.21.15.47:0/373983515 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4f8e8d700 1 --2- 172.21.15.47:0/373983515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4f406e6e0 0x7fa4f4153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4f968e700 1 --2- 172.21.15.47:0/373983515 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4f4152130 0x7fa4f4139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4f3fff700 1 -- 172.21.15.47:0/373983515 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4f4152130 msgr2=0x7fa4f4139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4f3fff700 1 --2- 172.21.15.47:0/373983515 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4f4152130 0x7fa4f4139e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4f3fff700 1 -- 172.21.15.47:0/373983515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4f406e6e0 msgr2=0x7fa4f4153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4f3fff700 1 --2- 172.21.15.47:0/373983515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4f406e6e0 0x7fa4f4153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4f3fff700 1 -- 172.21.15.47:0/373983515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e80094a0 con 0x7fa4f40c0770 2024-05-08T19:22:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4f3fff700 1 --2- 172.21.15.47:0/373983515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f40c0770 0x7fa4f4139910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000c550 tx=0x7fa4e000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4f17fa700 1 -- 172.21.15.47:0/373983515 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0004c80 con 0x7fa4f40c0770 2024-05-08T19:22:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4f17fa700 1 -- 172.21.15.47:0/373983515 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e0004de0 con 0x7fa4f40c0770 2024-05-08T19:22:50.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4fb0f1700 1 -- 172.21.15.47:0/373983515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f4152a50 con 0x7fa4f40c0770 2024-05-08T19:22:50.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4f17fa700 1 -- 172.21.15.47:0/373983515 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0007310 con 0x7fa4f40c0770 2024-05-08T19:22:50.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.678+0000 7fa4fb0f1700 1 -- 172.21.15.47:0/373983515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f4153010 con 0x7fa4f40c0770 2024-05-08T19:22:50.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.679+0000 7fa4fb0f1700 1 -- 172.21.15.47:0/373983515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f404ec60 con 0x7fa4f40c0770 2024-05-08T19:22:50.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.680+0000 7fa4f17fa700 1 -- 172.21.15.47:0/373983515 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa4e0007470 con 0x7fa4f40c0770 2024-05-08T19:22:50.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.680+0000 7fa4f17fa700 1 --2- 172.21.15.47:0/373983515 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa4d806ac90 0x7fa4d806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:50.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.680+0000 7fa4f17fa700 1 -- 172.21.15.47:0/373983515 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa4e0089100 con 0x7fa4f40c0770 2024-05-08T19:22:50.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.681+0000 7fa4f8e8d700 1 --2- 172.21.15.47:0/373983515 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa4d806ac90 0x7fa4d806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:50.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.681+0000 7fa4f8e8d700 1 --2- 172.21.15.47:0/373983515 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa4d806ac90 0x7fa4d806d150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80090b0 tx=0x7fa4e801c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:50.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.685+0000 7fa4f17fa700 1 -- 172.21.15.47:0/373983515 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa4e0054080 con 0x7fa4f40c0770 2024-05-08T19:22:50.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.892+0000 7fa4fb0f1700 1 -- 172.21.15.47:0/373983515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4f40aca90 con 0x7fa4f40c0770 2024-05-08T19:22:50.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.893+0000 7fa4f17fa700 1 -- 172.21.15.47:0/373983515 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa4e00576a0 con 0x7fa4f40c0770 2024-05-08T19:22:50.885 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-08T19:22:50.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.894+0000 7fa4fb0f1700 1 -- 172.21.15.47:0/373983515 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa4d806ac90 msgr2=0x7fa4d806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:50.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.894+0000 7fa4fb0f1700 1 --2- 172.21.15.47:0/373983515 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa4d806ac90 0x7fa4d806d150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80090b0 tx=0x7fa4e801c040 comp rx=0 tx=0).stop 2024-05-08T19:22:50.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.894+0000 7fa4fb0f1700 1 -- 172.21.15.47:0/373983515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f40c0770 msgr2=0x7fa4f4139910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:50.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.894+0000 7fa4fb0f1700 1 --2- 172.21.15.47:0/373983515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f40c0770 0x7fa4f4139910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000c550 tx=0x7fa4e000c860 comp rx=0 tx=0).stop 2024-05-08T19:22:50.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.895+0000 7fa4fb0f1700 1 -- 172.21.15.47:0/373983515 shutdown_connections 2024-05-08T19:22:50.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.895+0000 7fa4fb0f1700 1 --2- 172.21.15.47:0/373983515 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa4d806ac90 0x7fa4d806d150 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.895+0000 7fa4fb0f1700 1 --2- 172.21.15.47:0/373983515 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4f4152130 0x7fa4f4139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.895+0000 7fa4fb0f1700 1 --2- 172.21.15.47:0/373983515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4f406e6e0 0x7fa4f4153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.895+0000 7fa4fb0f1700 1 --2- 172.21.15.47:0/373983515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4f40c0770 0x7fa4f4139910 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:50.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.895+0000 7fa4fb0f1700 1 -- 172.21.15.47:0/373983515 >> 172.21.15.47:0/373983515 conn(0x7fa4f40c7120 msgr2=0x7fa4f4150840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:50.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.895+0000 7fa4fb0f1700 1 -- 172.21.15.47:0/373983515 shutdown_connections 2024-05-08T19:22:50.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:50.895+0000 7fa4fb0f1700 1 -- 172.21.15.47:0/373983515 wait complete. 2024-05-08T19:22:50.899 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T19:22:51.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.036+0000 7f519d4ad700 1 Processor -- start 2024-05-08T19:22:51.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.037+0000 7f519d4ad700 1 -- start start 2024-05-08T19:22:51.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.037+0000 7f519d4ad700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5198152100 0x7f519806b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.037+0000 7f519d4ad700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5198155550 0x7f5198157f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.037+0000 7f519d4ad700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51981550c0 con 0x7f5198158470 2024-05-08T19:22:51.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.037+0000 7f519d4ad700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519806c500 con 0x7f5198155550 2024-05-08T19:22:51.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.037+0000 7f519d4ad700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519806bab0 con 0x7f5198152100 2024-05-08T19:22:51.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.037+0000 7f51967fc700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5198155550 0x7f5198157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.037+0000 7f51967fc700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5198155550 0x7f5198157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56216/0 (socket says 172.21.15.47:56216) 2024-05-08T19:22:51.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.037+0000 7f51967fc700 1 -- 172.21.15.47:0/2280211297 learned_addr learned my addr 172.21.15.47:0/2280211297 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:51.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.038+0000 7f5196ffd700 1 --2- 172.21.15.47:0/2280211297 >> v2:172.21.15.177:3300/0 conn(0x7f5198152100 0x7f519806b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.038+0000 7f51967fc700 1 -- 172.21.15.47:0/2280211297 >> v2:172.21.15.177:3300/0 conn(0x7f5198152100 msgr2=0x7f519806b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:51.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.038+0000 7f51967fc700 1 --2- 172.21.15.47:0/2280211297 >> v2:172.21.15.177:3300/0 conn(0x7f5198152100 0x7f519806b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.038+0000 7f51967fc700 1 -- 172.21.15.47:0/2280211297 >> v1:172.21.15.177:6789/0 conn(0x7f5198158470 legacy=0x7f51980c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:51.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.038+0000 7f51967fc700 1 -- 172.21.15.47:0/2280211297 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519806bd50 con 0x7f5198155550 2024-05-08T19:22:51.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.038+0000 7f51967fc700 1 --2- 172.21.15.47:0/2280211297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5198155550 0x7f5198157f30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f51980c78f0 tx=0x7f5188009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4c3f963296d0df server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:51.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.038+0000 7f5195ffb700 1 -- 172.21.15.47:0/2280211297 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188004230 con 0x7f5198155550 2024-05-08T19:22:51.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.038+0000 7f5195ffb700 1 -- 172.21.15.47:0/2280211297 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188004390 con 0x7f5198155550 2024-05-08T19:22:51.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.038+0000 7f5195ffb700 1 -- 172.21.15.47:0/2280211297 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51880036a0 con 0x7f5198155550 2024-05-08T19:22:51.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.039+0000 7f519d4ad700 1 -- 172.21.15.47:0/2280211297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5198155550 msgr2=0x7f5198157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:51.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.039+0000 7f519d4ad700 1 --2- 172.21.15.47:0/2280211297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5198155550 0x7f5198157f30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f51980c78f0 tx=0x7f5188009bd0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.039+0000 7f519d4ad700 1 -- 172.21.15.47:0/2280211297 shutdown_connections 2024-05-08T19:22:51.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.039+0000 7f519d4ad700 1 --2- 172.21.15.47:0/2280211297 >> v2:172.21.15.177:3300/0 conn(0x7f5198152100 0x7f519806b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.039+0000 7f519d4ad700 1 --2- 172.21.15.47:0/2280211297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5198155550 0x7f5198157f30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.039+0000 7f519d4ad700 1 -- 172.21.15.47:0/2280211297 >> 172.21.15.47:0/2280211297 conn(0x7f51980abef0 msgr2=0x7f51980ac300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:51.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.039+0000 7f519d4ad700 1 -- 172.21.15.47:0/2280211297 shutdown_connections 2024-05-08T19:22:51.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.039+0000 7f519d4ad700 1 -- 172.21.15.47:0/2280211297 wait complete. 2024-05-08T19:22:51.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.040+0000 7f519d4ad700 1 Processor -- start 2024-05-08T19:22:51.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.040+0000 7f519d4ad700 1 -- start start 2024-05-08T19:22:51.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f519d4ad700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5198152100 0x7f519814a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f519d4ad700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5198155550 0x7f519814ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f519d4ad700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5198158470 0x7f51981ed770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f519d4ad700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5198157450 con 0x7f5198152100 2024-05-08T19:22:51.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f519d4ad700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51981eabc0 con 0x7f5198155550 2024-05-08T19:22:51.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f519d4ad700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519814b350 con 0x7f5198158470 2024-05-08T19:22:51.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f5196ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5198152100 0x7f519814a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f5196ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5198152100 0x7f519814a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56224/0 (socket says 172.21.15.47:56224) 2024-05-08T19:22:51.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f5196ffd700 1 -- 172.21.15.47:0/496560415 learned_addr learned my addr 172.21.15.47:0/496560415 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:51.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f51967fc700 1 --2- 172.21.15.47:0/496560415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5198155550 0x7f519814ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f51977fe700 1 --2- 172.21.15.47:0/496560415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5198158470 0x7f51981ed770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f5196ffd700 1 -- 172.21.15.47:0/496560415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5198158470 msgr2=0x7f51981ed770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:51.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f5196ffd700 1 --2- 172.21.15.47:0/496560415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5198158470 0x7f51981ed770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f5196ffd700 1 -- 172.21.15.47:0/496560415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5198155550 msgr2=0x7f519814ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:51.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f5196ffd700 1 --2- 172.21.15.47:0/496560415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5198155550 0x7f519814ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f5196ffd700 1 -- 172.21.15.47:0/496560415 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5188009550 con 0x7f5198152100 2024-05-08T19:22:51.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f5196ffd700 1 --2- 172.21.15.47:0/496560415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5198152100 0x7f519814a7f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f518c00e840 tx=0x7f518c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:51.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f517f7fe700 1 -- 172.21.15.47:0/496560415 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c013610 con 0x7f5198152100 2024-05-08T19:22:51.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f517f7fe700 1 -- 172.21.15.47:0/496560415 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c013770 con 0x7f5198152100 2024-05-08T19:22:51.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.041+0000 7f519d4ad700 1 -- 172.21.15.47:0/496560415 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51981ea290 con 0x7f5198152100 2024-05-08T19:22:51.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.042+0000 7f517f7fe700 1 -- 172.21.15.47:0/496560415 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c013b20 con 0x7f5198152100 2024-05-08T19:22:51.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.042+0000 7f519d4ad700 1 -- 172.21.15.47:0/496560415 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51981ea850 con 0x7f5198152100 2024-05-08T19:22:51.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.043+0000 7f519d4ad700 1 -- 172.21.15.47:0/496560415 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51981eaea0 con 0x7f5198152100 2024-05-08T19:22:51.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.043+0000 7f517f7fe700 1 -- 172.21.15.47:0/496560415 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f518c013c80 con 0x7f5198152100 2024-05-08T19:22:51.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.043+0000 7f517f7fe700 1 --2- 172.21.15.47:0/496560415 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f518406ac90 0x7f518406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.044+0000 7f517f7fe700 1 -- 172.21.15.47:0/496560415 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f518c0891f0 con 0x7f5198152100 2024-05-08T19:22:51.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.044+0000 7f51967fc700 1 --2- 172.21.15.47:0/496560415 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f518406ac90 0x7f518406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.044+0000 7f51967fc700 1 --2- 172.21.15.47:0/496560415 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f518406ac90 0x7f518406d150 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5188009130 tx=0x7f5188008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:51.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.048+0000 7f517f7fe700 1 -- 172.21.15.47:0/496560415 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f518c0540f0 con 0x7f5198152100 2024-05-08T19:22:51.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.253+0000 7f519d4ad700 1 -- 172.21.15.47:0/496560415 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f519804ec60 con 0x7f5198152100 2024-05-08T19:22:51.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.254+0000 7f517f7fe700 1 -- 172.21.15.47:0/496560415 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f518c057710 con 0x7f5198152100 2024-05-08T19:22:51.246 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-08T19:22:51.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.256+0000 7f519d4ad700 1 -- 172.21.15.47:0/496560415 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f518406ac90 msgr2=0x7f518406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:51.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.256+0000 7f519d4ad700 1 --2- 172.21.15.47:0/496560415 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f518406ac90 0x7f518406d150 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5188009130 tx=0x7f5188008030 comp rx=0 tx=0).stop 2024-05-08T19:22:51.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.256+0000 7f519d4ad700 1 -- 172.21.15.47:0/496560415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5198152100 msgr2=0x7f519814a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:51.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.256+0000 7f519d4ad700 1 --2- 172.21.15.47:0/496560415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5198152100 0x7f519814a7f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f518c00e840 tx=0x7f518c00eb50 comp rx=0 tx=0).stop 2024-05-08T19:22:51.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.256+0000 7f519d4ad700 1 -- 172.21.15.47:0/496560415 shutdown_connections 2024-05-08T19:22:51.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.256+0000 7f519d4ad700 1 --2- 172.21.15.47:0/496560415 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f518406ac90 0x7f518406d150 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.256+0000 7f519d4ad700 1 --2- 172.21.15.47:0/496560415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5198152100 0x7f519814a7f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.256+0000 7f519d4ad700 1 --2- 172.21.15.47:0/496560415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5198158470 0x7f51981ed770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.256+0000 7f519d4ad700 1 --2- 172.21.15.47:0/496560415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5198155550 0x7f519814ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.256+0000 7f519d4ad700 1 -- 172.21.15.47:0/496560415 >> 172.21.15.47:0/496560415 conn(0x7f51980abef0 msgr2=0x7f51980c7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:51.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.256+0000 7f519d4ad700 1 -- 172.21.15.47:0/496560415 shutdown_connections 2024-05-08T19:22:51.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.256+0000 7f519d4ad700 1 -- 172.21.15.47:0/496560415 wait complete. 2024-05-08T19:22:51.260 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T19:22:51.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.397+0000 7fd830135700 1 Processor -- start 2024-05-08T19:22:51.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.397+0000 7fd830135700 1 -- start start 2024-05-08T19:22:51.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.398+0000 7fd830135700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd828152230 0x7fd8280c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.398+0000 7fd830135700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd828070470 0x7fd8280c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.398+0000 7fd830135700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8280c2fc0 con 0x7fd8280c62b0 2024-05-08T19:22:51.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.398+0000 7fd830135700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8280c3e20 con 0x7fd828070470 2024-05-08T19:22:51.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.398+0000 7fd830135700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd828152610 con 0x7fd828152230 2024-05-08T19:22:51.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.399+0000 7fd82d6d0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd828070470 0x7fd8280c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.399+0000 7fd82ded1700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd828152230 0x7fd8280c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.399+0000 7fd82d6d0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd828070470 0x7fd8280c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:42308/0 (socket says 172.21.15.47:42308) 2024-05-08T19:22:51.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.399+0000 7fd82ded1700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd828152230 0x7fd8280c2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:41370/0 (socket says 172.21.15.47:41370) 2024-05-08T19:22:51.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.399+0000 7fd82d6d0700 1 -- 172.21.15.47:0/3930400144 learned_addr learned my addr 172.21.15.47:0/3930400144 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:51.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.399+0000 7fd82e6d2700 1 --1- 172.21.15.47:0/3930400144 >> v1:172.21.15.177:6789/0 conn(0x7fd8280c62b0 0x7fd8280c14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:36392/0 (socket says 172.21.15.47:36392) 2024-05-08T19:22:51.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.399+0000 7fd82ded1700 1 -- 172.21.15.47:0/3930400144 >> v2:172.21.15.177:3300/0 conn(0x7fd828070470 msgr2=0x7fd8280c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:51.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.399+0000 7fd82ded1700 1 --2- 172.21.15.47:0/3930400144 >> v2:172.21.15.177:3300/0 conn(0x7fd828070470 0x7fd8280c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.399+0000 7fd82ded1700 1 -- 172.21.15.47:0/3930400144 >> v1:172.21.15.177:6789/0 conn(0x7fd8280c62b0 legacy=0x7fd8280c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:51.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.399+0000 7fd82ded1700 1 -- 172.21.15.47:0/3930400144 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8280702a0 con 0x7fd828152230 2024-05-08T19:22:51.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.399+0000 7fd82d6d0700 1 --2- 172.21.15.47:0/3930400144 >> v2:172.21.15.177:3300/0 conn(0x7fd828070470 0x7fd8280c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:51.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.399+0000 7fd82ded1700 1 --2- 172.21.15.47:0/3930400144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd828152230 0x7fd8280c2a80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd820009dc0 tx=0x7fd82000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e0d995f456bab97 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:51.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.399+0000 7fd82cecf700 1 -- 172.21.15.47:0/3930400144 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000e070 con 0x7fd828152230 2024-05-08T19:22:51.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.399+0000 7fd82cecf700 1 -- 172.21.15.47:0/3930400144 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82000bae0 con 0x7fd828152230 2024-05-08T19:22:51.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.399+0000 7fd82cecf700 1 -- 172.21.15.47:0/3930400144 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000be90 con 0x7fd828152230 2024-05-08T19:22:51.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.400+0000 7fd830135700 1 -- 172.21.15.47:0/3930400144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd828152230 msgr2=0x7fd8280c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:51.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.400+0000 7fd830135700 1 --2- 172.21.15.47:0/3930400144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd828152230 0x7fd8280c2a80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd820009dc0 tx=0x7fd82000b330 comp rx=0 tx=0).stop 2024-05-08T19:22:51.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.400+0000 7fd830135700 1 -- 172.21.15.47:0/3930400144 shutdown_connections 2024-05-08T19:22:51.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.400+0000 7fd830135700 1 --2- 172.21.15.47:0/3930400144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd828152230 0x7fd8280c2a80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.400+0000 7fd830135700 1 --2- 172.21.15.47:0/3930400144 >> v2:172.21.15.177:3300/0 conn(0x7fd828070470 0x7fd8280c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.400+0000 7fd830135700 1 -- 172.21.15.47:0/3930400144 >> 172.21.15.47:0/3930400144 conn(0x7fd82806b1b0 msgr2=0x7fd8280a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:51.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.400+0000 7fd830135700 1 -- 172.21.15.47:0/3930400144 shutdown_connections 2024-05-08T19:22:51.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.400+0000 7fd830135700 1 -- 172.21.15.47:0/3930400144 wait complete. 2024-05-08T19:22:51.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.401+0000 7fd830135700 1 Processor -- start 2024-05-08T19:22:51.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.401+0000 7fd830135700 1 -- start start 2024-05-08T19:22:51.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd830135700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd828070470 0x7fd8281486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd830135700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8280c62b0 0x7fd8281541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd830135700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd828152230 0x7fd82814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd830135700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8281581c0 con 0x7fd8280c62b0 2024-05-08T19:22:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd830135700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8281560e0 con 0x7fd828152230 2024-05-08T19:22:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd830135700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8281483e0 con 0x7fd828070470 2024-05-08T19:22:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd82d6d0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8280c62b0 0x7fd8281541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd82d6d0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8280c62b0 0x7fd8281541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56230/0 (socket says 172.21.15.47:56230) 2024-05-08T19:22:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd82d6d0700 1 -- 172.21.15.47:0/204571716 learned_addr learned my addr 172.21.15.47:0/204571716 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd82ded1700 1 --2- 172.21.15.47:0/204571716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd828070470 0x7fd8281486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd82e6d2700 1 --2- 172.21.15.47:0/204571716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd828152230 0x7fd82814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd82d6d0700 1 -- 172.21.15.47:0/204571716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd828070470 msgr2=0x7fd8281486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd82d6d0700 1 --2- 172.21.15.47:0/204571716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd828070470 0x7fd8281486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd82d6d0700 1 -- 172.21.15.47:0/204571716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd828152230 msgr2=0x7fd82814c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd82d6d0700 1 --2- 172.21.15.47:0/204571716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd828152230 0x7fd82814c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.402+0000 7fd82d6d0700 1 -- 172.21.15.47:0/204571716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81c009550 con 0x7fd8280c62b0 2024-05-08T19:22:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.403+0000 7fd82d6d0700 1 --2- 172.21.15.47:0/204571716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8280c62b0 0x7fd8281541c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00ebe0 tx=0x7fd81c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.403+0000 7fd8267fc700 1 -- 172.21.15.47:0/204571716 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c00c850 con 0x7fd8280c62b0 2024-05-08T19:22:51.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.403+0000 7fd8267fc700 1 -- 172.21.15.47:0/204571716 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81c00c9b0 con 0x7fd8280c62b0 2024-05-08T19:22:51.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.403+0000 7fd830135700 1 -- 172.21.15.47:0/204571716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd820009a70 con 0x7fd8280c62b0 2024-05-08T19:22:51.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.403+0000 7fd8267fc700 1 -- 172.21.15.47:0/204571716 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c00cd60 con 0x7fd8280c62b0 2024-05-08T19:22:51.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.403+0000 7fd830135700 1 -- 172.21.15.47:0/204571716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8281565d0 con 0x7fd8280c62b0 2024-05-08T19:22:51.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.404+0000 7fd830135700 1 -- 172.21.15.47:0/204571716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82804ec60 con 0x7fd8280c62b0 2024-05-08T19:22:51.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.404+0000 7fd8267fc700 1 -- 172.21.15.47:0/204571716 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd81c013470 con 0x7fd8280c62b0 2024-05-08T19:22:51.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.405+0000 7fd8267fc700 1 --2- 172.21.15.47:0/204571716 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd81406ac90 0x7fd81406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.405+0000 7fd8267fc700 1 -- 172.21.15.47:0/204571716 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd81c089de0 con 0x7fd8280c62b0 2024-05-08T19:22:51.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.405+0000 7fd82ded1700 1 --2- 172.21.15.47:0/204571716 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd81406ac90 0x7fd81406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.406+0000 7fd82ded1700 1 --2- 172.21.15.47:0/204571716 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd81406ac90 0x7fd81406d150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd820014040 tx=0x7fd820011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:51.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.409+0000 7fd8267fc700 1 -- 172.21.15.47:0/204571716 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd81c054d60 con 0x7fd8280c62b0 2024-05-08T19:22:51.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.615+0000 7fd830135700 1 -- 172.21.15.47:0/204571716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd82806bba0 con 0x7fd8280c62b0 2024-05-08T19:22:51.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.616+0000 7fd8267fc700 1 -- 172.21.15.47:0/204571716 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd81c0170a0 con 0x7fd8280c62b0 2024-05-08T19:22:51.608 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-08T19:22:51.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.618+0000 7fd830135700 1 -- 172.21.15.47:0/204571716 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd81406ac90 msgr2=0x7fd81406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:51.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.618+0000 7fd830135700 1 --2- 172.21.15.47:0/204571716 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd81406ac90 0x7fd81406d150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd820014040 tx=0x7fd820011000 comp rx=0 tx=0).stop 2024-05-08T19:22:51.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.618+0000 7fd830135700 1 -- 172.21.15.47:0/204571716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8280c62b0 msgr2=0x7fd8281541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:51.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.618+0000 7fd830135700 1 --2- 172.21.15.47:0/204571716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8280c62b0 0x7fd8281541c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00ebe0 tx=0x7fd81c00eef0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.618+0000 7fd830135700 1 -- 172.21.15.47:0/204571716 shutdown_connections 2024-05-08T19:22:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.618+0000 7fd830135700 1 --2- 172.21.15.47:0/204571716 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd81406ac90 0x7fd81406d150 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.618+0000 7fd830135700 1 --2- 172.21.15.47:0/204571716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd828152230 0x7fd82814c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.618+0000 7fd830135700 1 --2- 172.21.15.47:0/204571716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd828070470 0x7fd8281486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.618+0000 7fd830135700 1 --2- 172.21.15.47:0/204571716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8280c62b0 0x7fd8281541c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.618+0000 7fd830135700 1 -- 172.21.15.47:0/204571716 >> 172.21.15.47:0/204571716 conn(0x7fd82806b1b0 msgr2=0x7fd828154d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.618+0000 7fd830135700 1 -- 172.21.15.47:0/204571716 shutdown_connections 2024-05-08T19:22:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.618+0000 7fd830135700 1 -- 172.21.15.47:0/204571716 wait complete. 2024-05-08T19:22:51.622 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T19:22:51.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.756+0000 7f9490146700 1 Processor -- start 2024-05-08T19:22:51.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.756+0000 7f9490146700 1 -- start start 2024-05-08T19:22:51.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.757+0000 7f9490146700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f948806f490 0x7f94880bfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.757+0000 7f9490146700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9488155150 0x7f94880c05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.757+0000 7f9490146700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94880c1950 con 0x7f948806bc40 2024-05-08T19:22:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.757+0000 7f9490146700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94880c1180 con 0x7f9488155150 2024-05-08T19:22:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.757+0000 7f9490146700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9488154970 con 0x7f948806f490 2024-05-08T19:22:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.757+0000 7f948e6e3700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9488155150 0x7f94880c05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.757+0000 7f948e6e3700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9488155150 0x7f94880c05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56234/0 (socket says 172.21.15.47:56234) 2024-05-08T19:22:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.757+0000 7f948e6e3700 1 -- 172.21.15.47:0/4139915553 learned_addr learned my addr 172.21.15.47:0/4139915553 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.757+0000 7f948d6e1700 1 --2- 172.21.15.47:0/4139915553 >> v2:172.21.15.177:3300/0 conn(0x7f948806f490 0x7f94880bfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.757+0000 7f948e6e3700 1 -- 172.21.15.47:0/4139915553 >> v2:172.21.15.177:3300/0 conn(0x7f948806f490 msgr2=0x7f94880bfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.757+0000 7f948e6e3700 1 --2- 172.21.15.47:0/4139915553 >> v2:172.21.15.177:3300/0 conn(0x7f948806f490 0x7f94880bfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.757+0000 7f948e6e3700 1 -- 172.21.15.47:0/4139915553 >> v1:172.21.15.177:6789/0 conn(0x7f948806bc40 legacy=0x7f9488066780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.757+0000 7f948e6e3700 1 -- 172.21.15.47:0/4139915553 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94880c1390 con 0x7f9488155150 2024-05-08T19:22:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.758+0000 7f948e6e3700 1 --2- 172.21.15.47:0/4139915553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9488155150 0x7f94880c05f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9480009e50 tx=0x7f948000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb26f9aceb3544 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.758+0000 7f948cee0700 1 -- 172.21.15.47:0/4139915553 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948000e070 con 0x7f9488155150 2024-05-08T19:22:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.758+0000 7f948cee0700 1 -- 172.21.15.47:0/4139915553 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948000b8d0 con 0x7f9488155150 2024-05-08T19:22:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.758+0000 7f948cee0700 1 -- 172.21.15.47:0/4139915553 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948000bc80 con 0x7f9488155150 2024-05-08T19:22:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.758+0000 7f9490146700 1 -- 172.21.15.47:0/4139915553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9488155150 msgr2=0x7f94880c05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.758+0000 7f9490146700 1 --2- 172.21.15.47:0/4139915553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9488155150 0x7f94880c05f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9480009e50 tx=0x7f948000b330 comp rx=0 tx=0).stop 2024-05-08T19:22:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.758+0000 7f9490146700 1 -- 172.21.15.47:0/4139915553 shutdown_connections 2024-05-08T19:22:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.758+0000 7f9490146700 1 --2- 172.21.15.47:0/4139915553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9488155150 0x7f94880c05f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.758+0000 7f9490146700 1 --2- 172.21.15.47:0/4139915553 >> v2:172.21.15.177:3300/0 conn(0x7f948806f490 0x7f94880bfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.758+0000 7f9490146700 1 -- 172.21.15.47:0/4139915553 >> 172.21.15.47:0/4139915553 conn(0x7f94880c3280 msgr2=0x7f94880c3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.758+0000 7f9490146700 1 -- 172.21.15.47:0/4139915553 shutdown_connections 2024-05-08T19:22:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.759+0000 7f9490146700 1 -- 172.21.15.47:0/4139915553 wait complete. 2024-05-08T19:22:51.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.760+0000 7f9490146700 1 Processor -- start 2024-05-08T19:22:51.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.760+0000 7f9490146700 1 -- start start 2024-05-08T19:22:51.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f9490146700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948806bc40 0x7f948814d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f9490146700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948806f490 0x7f9488071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f9490146700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9488155150 0x7f94881ed050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f9490146700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94880a9d60 con 0x7f9488155150 2024-05-08T19:22:51.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f9490146700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94880abd50 con 0x7f948806bc40 2024-05-08T19:22:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f9490146700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94880a9830 con 0x7f948806f490 2024-05-08T19:22:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f948e6e3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9488155150 0x7f94881ed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f948e6e3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9488155150 0x7f94881ed050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56250/0 (socket says 172.21.15.47:56250) 2024-05-08T19:22:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f948e6e3700 1 -- 172.21.15.47:0/515292106 learned_addr learned my addr 172.21.15.47:0/515292106 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f948dee2700 1 --2- 172.21.15.47:0/515292106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948806bc40 0x7f948814d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f948d6e1700 1 --2- 172.21.15.47:0/515292106 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948806f490 0x7f9488071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f948e6e3700 1 -- 172.21.15.47:0/515292106 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948806f490 msgr2=0x7f9488071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f948e6e3700 1 --2- 172.21.15.47:0/515292106 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948806f490 0x7f9488071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f948e6e3700 1 -- 172.21.15.47:0/515292106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948806bc40 msgr2=0x7f948814d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f948e6e3700 1 --2- 172.21.15.47:0/515292106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948806bc40 0x7f948814d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f948e6e3700 1 -- 172.21.15.47:0/515292106 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9480009b30 con 0x7f9488155150 2024-05-08T19:22:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.761+0000 7f948d6e1700 1 --2- 172.21.15.47:0/515292106 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948806f490 0x7f9488071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.762+0000 7f948e6e3700 1 --2- 172.21.15.47:0/515292106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9488155150 0x7f94881ed050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9488074750 tx=0x7f9480004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.762+0000 7f947e7fc700 1 -- 172.21.15.47:0/515292106 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800048b0 con 0x7f9488155150 2024-05-08T19:22:51.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.762+0000 7f947e7fc700 1 -- 172.21.15.47:0/515292106 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94800092e0 con 0x7f9488155150 2024-05-08T19:22:51.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.762+0000 7f9490146700 1 -- 172.21.15.47:0/515292106 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94881ea690 con 0x7f9488155150 2024-05-08T19:22:51.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.762+0000 7f947e7fc700 1 -- 172.21.15.47:0/515292106 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948001c650 con 0x7f9488155150 2024-05-08T19:22:51.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.762+0000 7f9490146700 1 -- 172.21.15.47:0/515292106 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9488155dc0 con 0x7f9488155150 2024-05-08T19:22:51.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.763+0000 7f9490146700 1 -- 172.21.15.47:0/515292106 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9488155c20 con 0x7f9488155150 2024-05-08T19:22:51.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.763+0000 7f947e7fc700 1 -- 172.21.15.47:0/515292106 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f948001c7b0 con 0x7f9488155150 2024-05-08T19:22:51.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.763+0000 7f947e7fc700 1 --2- 172.21.15.47:0/515292106 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f946c06ac90 0x7f946c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:51.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.764+0000 7f947e7fc700 1 -- 172.21.15.47:0/515292106 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f948008b210 con 0x7f9488155150 2024-05-08T19:22:51.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.764+0000 7f948dee2700 1 --2- 172.21.15.47:0/515292106 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f946c06ac90 0x7f946c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:51.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.764+0000 7f948dee2700 1 --2- 172.21.15.47:0/515292106 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f946c06ac90 0x7f946c06d150 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9478001800 tx=0x7f9478009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:51.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:51.768+0000 7f947e7fc700 1 -- 172.21.15.47:0/515292106 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9488155c20 con 0x7f9488155150 2024-05-08T19:22:52.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.027+0000 7f9490146700 1 -- 172.21.15.47:0/515292106 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9488155c20 con 0x7f9488155150 2024-05-08T19:22:52.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.028+0000 7f947e7fc700 1 -- 172.21.15.47:0/515292106 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f9488155c20 con 0x7f9488155150 2024-05-08T19:22:52.020 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:52.020 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3927983771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3927983771},{"type":"v1","addr":"172.21.15.47:6833","nonce":3927983771}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/201830514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":201830514},{"type":"v1","addr":"172.21.15.47:6835","nonce":201830514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1266001461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1266001461},{"type":"v1","addr":"172.21.15.177:6836","nonce":1266001461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T19:22:20.424727+0000","modified":"2024-05-08T19:22:42.943964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/2990594738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2990594738},{"type":"v1","addr":"172.21.15.177:6837","nonce":2990594738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T19:22:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.030+0000 7f9490146700 1 -- 172.21.15.47:0/515292106 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f946c06ac90 msgr2=0x7f946c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.030+0000 7f9490146700 1 --2- 172.21.15.47:0/515292106 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f946c06ac90 0x7f946c06d150 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9478001800 tx=0x7f9478009040 comp rx=0 tx=0).stop 2024-05-08T19:22:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.030+0000 7f9490146700 1 -- 172.21.15.47:0/515292106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9488155150 msgr2=0x7f94881ed050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.030+0000 7f9490146700 1 --2- 172.21.15.47:0/515292106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9488155150 0x7f94881ed050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9488074750 tx=0x7f9480004ad0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.030+0000 7f9490146700 1 -- 172.21.15.47:0/515292106 shutdown_connections 2024-05-08T19:22:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.030+0000 7f9490146700 1 --2- 172.21.15.47:0/515292106 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f946c06ac90 0x7f946c06d150 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.030+0000 7f9490146700 1 --2- 172.21.15.47:0/515292106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9488155150 0x7f94881ed050 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.030+0000 7f9490146700 1 --2- 172.21.15.47:0/515292106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948806bc40 0x7f948814d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.030+0000 7f9490146700 1 --2- 172.21.15.47:0/515292106 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948806f490 0x7f9488071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.030+0000 7f9490146700 1 -- 172.21.15.47:0/515292106 >> 172.21.15.47:0/515292106 conn(0x7f94880c3280 msgr2=0x7f9488153460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.030+0000 7f9490146700 1 -- 172.21.15.47:0/515292106 shutdown_connections 2024-05-08T19:22:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.030+0000 7f9490146700 1 -- 172.21.15.47:0/515292106 wait complete. 2024-05-08T19:22:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-05-08T19:22:52.034 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:52.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.168+0000 7fe4aaabd700 1 Processor -- start 2024-05-08T19:22:52.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.168+0000 7fe4aaabd700 1 -- start start 2024-05-08T19:22:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.169+0000 7fe4aaabd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4a4150040 0x7fe4a40c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.169+0000 7fe4aaabd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe4a40c2a80 0x7fe4a41528f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.169+0000 7fe4aaabd700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a4155e00 con 0x7fe4a414fc60 2024-05-08T19:22:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.169+0000 7fe4aaabd700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a41560e0 con 0x7fe4a40c2a80 2024-05-08T19:22:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.169+0000 7fe4aaabd700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a41563c0 con 0x7fe4a4150040 2024-05-08T19:22:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.169+0000 7fe4a8859700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe4a414fc60 0x7fe4a40c4a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59992/0 (socket says 172.21.15.47:59992) 2024-05-08T19:22:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.169+0000 7fe4a8859700 1 -- 172.21.15.47:0/638207206 learned_addr learned my addr 172.21.15.47:0/638207206 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.169+0000 7fe4a905a700 1 --2- 172.21.15.47:0/638207206 >> v2:172.21.15.177:3300/0 conn(0x7fe4a40c2a80 0x7fe4a41528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.169+0000 7fe4a3fff700 1 --2- 172.21.15.47:0/638207206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4a4150040 0x7fe4a40c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.169+0000 7fe4a37fe700 1 -- 172.21.15.47:0/638207206 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463718032 0 0) 0x7fe4a4155e00 con 0x7fe4a414fc60 2024-05-08T19:22:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.169+0000 7fe4a37fe700 1 -- 172.21.15.47:0/638207206 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4940035b0 con 0x7fe4a414fc60 2024-05-08T19:22:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 -- 172.21.15.47:0/638207206 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 997685020 0 0) 0x7fe4940035b0 con 0x7fe4a414fc60 2024-05-08T19:22:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 -- 172.21.15.47:0/638207206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4a4150040 msgr2=0x7fe4a40c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 --2- 172.21.15.47:0/638207206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4a4150040 0x7fe4a40c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 -- 172.21.15.47:0/638207206 >> v2:172.21.15.177:3300/0 conn(0x7fe4a40c2a80 msgr2=0x7fe4a41528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 --2- 172.21.15.47:0/638207206 >> v2:172.21.15.177:3300/0 conn(0x7fe4a40c2a80 0x7fe4a41528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 -- 172.21.15.47:0/638207206 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a41566a0 con 0x7fe4a414fc60 2024-05-08T19:22:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 -- 172.21.15.47:0/638207206 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7fe498001670 con 0x7fe4a414fc60 2024-05-08T19:22:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 -- 172.21.15.47:0/638207206 >> v1:172.21.15.47:6789/0 conn(0x7fe4a414fc60 legacy=0x7fe4a40c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 --2- 172.21.15.47:0/638207206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494003a00 0x7fe494003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 --2- 172.21.15.47:0/638207206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe494004850 0x7fe494004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 --2- 172.21.15.47:0/638207206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4a4150040 0x7fe494005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 -- 172.21.15.47:0/638207206 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a41560e0 con 0x7fe494003a00 2024-05-08T19:22:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 -- 172.21.15.47:0/638207206 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a41563c0 con 0x7fe494004850 2024-05-08T19:22:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 -- 172.21.15.47:0/638207206 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49400ba40 con 0x7fe4a4150040 2024-05-08T19:22:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a8859700 1 --2- 172.21.15.47:0/638207206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494003a00 0x7fe494003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a3fff700 1 --2- 172.21.15.47:0/638207206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe494004850 0x7fe494004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a905a700 1 --2- 172.21.15.47:0/638207206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4a4150040 0x7fe494005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a8859700 1 -- 172.21.15.47:0/638207206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4a4150040 msgr2=0x7fe494005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:52.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a8859700 1 --2- 172.21.15.47:0/638207206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4a4150040 0x7fe494005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a8859700 1 -- 172.21.15.47:0/638207206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe494004850 msgr2=0x7fe494004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:52.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a8859700 1 --2- 172.21.15.47:0/638207206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe494004850 0x7fe494004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a8859700 1 -- 172.21.15.47:0/638207206 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4940035b0 con 0x7fe494003a00 2024-05-08T19:22:52.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a8859700 1 --2- 172.21.15.47:0/638207206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494003a00 0x7fe494003e20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe49800c2f0 tx=0x7fe494005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b035db25feb88cec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:52.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 -- 172.21.15.47:0/638207206 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49800cdd0 con 0x7fe494003a00 2024-05-08T19:22:52.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 -- 172.21.15.47:0/638207206 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe498005960 con 0x7fe494003a00 2024-05-08T19:22:52.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.170+0000 7fe4a37fe700 1 -- 172.21.15.47:0/638207206 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498005d10 con 0x7fe494003a00 2024-05-08T19:22:52.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.171+0000 7fe4aaabd700 1 -- 172.21.15.47:0/638207206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494003a00 msgr2=0x7fe494003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.171+0000 7fe4aaabd700 1 --2- 172.21.15.47:0/638207206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494003a00 0x7fe494003e20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe49800c2f0 tx=0x7fe494005880 comp rx=0 tx=0).stop 2024-05-08T19:22:52.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.171+0000 7fe4a905a700 1 -- 172.21.15.47:0/638207206 reap_dead start 2024-05-08T19:22:52.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.171+0000 7fe4aaabd700 1 -- 172.21.15.47:0/638207206 shutdown_connections 2024-05-08T19:22:52.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.171+0000 7fe4aaabd700 1 -- 172.21.15.47:0/638207206 >> 172.21.15.47:0/638207206 conn(0x7fe4a4072dd0 msgr2=0x7fe4a406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:52.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.171+0000 7fe4aaabd700 1 -- 172.21.15.47:0/638207206 shutdown_connections 2024-05-08T19:22:52.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.171+0000 7fe4aaabd700 1 -- 172.21.15.47:0/638207206 wait complete. 2024-05-08T19:22:52.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.172+0000 7fe4aaabd700 1 Processor -- start 2024-05-08T19:22:52.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.172+0000 7fe4aaabd700 1 -- start start 2024-05-08T19:22:52.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.173+0000 7fe4aaabd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494003a00 0x7fe4a41e9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.173+0000 7fe4aaabd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4a406d870 0x7fe4a4155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.173+0000 7fe4aaabd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a414f280 0x7fe4a4155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.173+0000 7fe4aaabd700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a414d750 con 0x7fe494003a00 2024-05-08T19:22:52.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.173+0000 7fe4aaabd700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a406c470 con 0x7fe4a414f280 2024-05-08T19:22:52.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.173+0000 7fe4aaabd700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a41ea550 con 0x7fe4a406d870 2024-05-08T19:22:52.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.173+0000 7fe4a8859700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494003a00 0x7fe4a41e9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.173+0000 7fe4a8859700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494003a00 0x7fe4a41e9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56264/0 (socket says 172.21.15.47:56264) 2024-05-08T19:22:52.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.173+0000 7fe4a8859700 1 -- 172.21.15.47:0/3637735855 learned_addr learned my addr 172.21.15.47:0/3637735855 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:52.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.174+0000 7fe4a3fff700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4a406d870 0x7fe4a4155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.174+0000 7fe4a905a700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a414f280 0x7fe4a4155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.174+0000 7fe4a8859700 1 -- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4a406d870 msgr2=0x7fe4a4155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.174+0000 7fe4a8859700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4a406d870 0x7fe4a4155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.174+0000 7fe4a8859700 1 -- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a414f280 msgr2=0x7fe4a4155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.174+0000 7fe4a8859700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a414f280 0x7fe4a4155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.174+0000 7fe4a8859700 1 -- 172.21.15.47:0/3637735855 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a406c6c0 con 0x7fe494003a00 2024-05-08T19:22:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.174+0000 7fe4a905a700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a414f280 0x7fe4a4155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.174+0000 7fe4a3fff700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4a406d870 0x7fe4a4155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.174+0000 7fe4a8859700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494003a00 0x7fe4a41e9c30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe498001930 tx=0x7fe4a41527f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.174+0000 7fe4a17fa700 1 -- 172.21.15.47:0/3637735855 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498004a80 con 0x7fe494003a00 2024-05-08T19:22:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.174+0000 7fe4a17fa700 1 -- 172.21.15.47:0/3637735855 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe498004c00 con 0x7fe494003a00 2024-05-08T19:22:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.174+0000 7fe4a17fa700 1 -- 172.21.15.47:0/3637735855 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498004db0 con 0x7fe494003a00 2024-05-08T19:22:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.174+0000 7fe4aaabd700 1 -- 172.21.15.47:0/3637735855 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a406c9a0 con 0x7fe494003a00 2024-05-08T19:22:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.174+0000 7fe4aaabd700 1 -- 172.21.15.47:0/3637735855 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a414d480 con 0x7fe494003a00 2024-05-08T19:22:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.175+0000 7fe4aaabd700 1 -- 172.21.15.47:0/3637735855 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a414d9f0 con 0x7fe494003a00 2024-05-08T19:22:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.175+0000 7fe4a17fa700 1 -- 172.21.15.47:0/3637735855 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe4980070d0 con 0x7fe494003a00 2024-05-08T19:22:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.176+0000 7fe4a17fa700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe48806ac90 0x7fe48806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.176+0000 7fe4a17fa700 1 -- 172.21.15.47:0/3637735855 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe49808aa10 con 0x7fe494003a00 2024-05-08T19:22:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.176+0000 7fe4a3fff700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe48806ac90 0x7fe48806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.177+0000 7fe4a3fff700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe48806ac90 0x7fe48806d150 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4150420 tx=0x7fe490008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:52.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.180+0000 7fe4a17fa700 1 -- 172.21.15.47:0/3637735855 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe498055990 con 0x7fe494003a00 2024-05-08T19:22:52.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.391+0000 7fe4aaabd700 1 -- 172.21.15.47:0/3637735855 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4a414d220 con 0x7fe494003a00 2024-05-08T19:22:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.392+0000 7fe4a17fa700 1 -- 172.21.15.47:0/3637735855 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17878 (secure 0 0 0) 0x7fe498022090 con 0x7fe494003a00 2024-05-08T19:22:52.385 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:52.386 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:24.891864+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:52.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.394+0000 7fe4aaabd700 1 -- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe48806ac90 msgr2=0x7fe48806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.394+0000 7fe4aaabd700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe48806ac90 0x7fe48806d150 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4150420 tx=0x7fe490008040 comp rx=0 tx=0).stop 2024-05-08T19:22:52.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.394+0000 7fe4aaabd700 1 -- 172.21.15.47:0/3637735855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494003a00 msgr2=0x7fe4a41e9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.394+0000 7fe4aaabd700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494003a00 0x7fe4a41e9c30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe498001930 tx=0x7fe4a41527f0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.394+0000 7fe4aaabd700 1 -- 172.21.15.47:0/3637735855 shutdown_connections 2024-05-08T19:22:52.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.394+0000 7fe4aaabd700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe48806ac90 0x7fe48806d150 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.394+0000 7fe4aaabd700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494003a00 0x7fe4a41e9c30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.394+0000 7fe4aaabd700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a414f280 0x7fe4a4155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.394+0000 7fe4aaabd700 1 --2- 172.21.15.47:0/3637735855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4a406d870 0x7fe4a4155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.394+0000 7fe4aaabd700 1 -- 172.21.15.47:0/3637735855 >> 172.21.15.47:0/3637735855 conn(0x7fe4a4072dd0 msgr2=0x7fe4a4148ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:52.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.394+0000 7fe4aaabd700 1 -- 172.21.15.47:0/3637735855 shutdown_connections 2024-05-08T19:22:52.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.394+0000 7fe4aaabd700 1 -- 172.21.15.47:0/3637735855 wait complete. 2024-05-08T19:22:52.399 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T19:22:15.923832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T19:22:18.529792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T19:22:19.389797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T19:22:22.474001+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T19:22:52.400 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T19:22:52.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.538+0000 7f0a77c23700 1 Processor -- start 2024-05-08T19:22:52.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.538+0000 7f0a77c23700 1 -- start start 2024-05-08T19:22:52.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a77c23700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0a70152130 0x7f0a70154de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a77c23700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a700c0770 0x7f0a70155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a77c23700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a700716a0 con 0x7f0a70157f80 2024-05-08T19:22:52.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a77c23700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a700c3a40 con 0x7f0a70152130 2024-05-08T19:22:52.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a77c23700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a700c11f0 con 0x7f0a700c0770 2024-05-08T19:22:52.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a761c0700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0a70157f80 0x7f0a70158410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60002/0 (socket says 172.21.15.47:60002) 2024-05-08T19:22:52.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a761c0700 1 -- 172.21.15.47:0/1136243604 learned_addr learned my addr 172.21.15.47:0/1136243604 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:52.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a751be700 1 --2- 172.21.15.47:0/1136243604 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a700c0770 0x7f0a70155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a759bf700 1 --2- 172.21.15.47:0/1136243604 >> v2:172.21.15.177:3300/0 conn(0x7f0a70152130 0x7f0a70154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a749bd700 1 -- 172.21.15.47:0/1136243604 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699418653 0 0) 0x7f0a700716a0 con 0x7f0a70157f80 2024-05-08T19:22:52.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a749bd700 1 -- 172.21.15.47:0/1136243604 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a5c0035b0 con 0x7f0a70157f80 2024-05-08T19:22:52.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a749bd700 1 -- 172.21.15.47:0/1136243604 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1857764132 0 0) 0x7f0a5c0035b0 con 0x7f0a70157f80 2024-05-08T19:22:52.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a749bd700 1 -- 172.21.15.47:0/1136243604 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a700c0770 msgr2=0x7f0a70155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:52.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a749bd700 1 --2- 172.21.15.47:0/1136243604 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a700c0770 0x7f0a70155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a749bd700 1 -- 172.21.15.47:0/1136243604 >> v2:172.21.15.177:3300/0 conn(0x7f0a70152130 msgr2=0x7f0a70154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:52.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a749bd700 1 --2- 172.21.15.47:0/1136243604 >> v2:172.21.15.177:3300/0 conn(0x7f0a70152130 0x7f0a70154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.539+0000 7f0a749bd700 1 -- 172.21.15.47:0/1136243604 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7006b470 con 0x7f0a70157f80 2024-05-08T19:22:52.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a749bd700 1 -- 172.21.15.47:0/1136243604 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f0a680019f0 con 0x7f0a70157f80 2024-05-08T19:22:52.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a749bd700 1 -- 172.21.15.47:0/1136243604 >> v1:172.21.15.47:6789/0 conn(0x7f0a70157f80 legacy=0x7f0a70158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a749bd700 1 --2- 172.21.15.47:0/1136243604 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a700c0770 0x7f0a5c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a749bd700 1 --2- 172.21.15.47:0/1136243604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a5c003f80 0x7f0a5c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a749bd700 1 --2- 172.21.15.47:0/1136243604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a5c004d90 0x7f0a5c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a749bd700 1 -- 172.21.15.47:0/1136243604 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a700c3a40 con 0x7f0a5c003f80 2024-05-08T19:22:52.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a749bd700 1 -- 172.21.15.47:0/1136243604 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a700c11f0 con 0x7f0a5c004d90 2024-05-08T19:22:52.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a749bd700 1 -- 172.21.15.47:0/1136243604 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c00baf0 con 0x7f0a700c0770 2024-05-08T19:22:52.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a751be700 1 --2- 172.21.15.47:0/1136243604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a5c003f80 0x7f0a5c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a759bf700 1 --2- 172.21.15.47:0/1136243604 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a700c0770 0x7f0a5c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a761c0700 1 --2- 172.21.15.47:0/1136243604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a5c004d90 0x7f0a5c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a751be700 1 -- 172.21.15.47:0/1136243604 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a700c0770 msgr2=0x7f0a5c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:52.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a751be700 1 --2- 172.21.15.47:0/1136243604 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a700c0770 0x7f0a5c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a751be700 1 -- 172.21.15.47:0/1136243604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a5c004d90 msgr2=0x7f0a5c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:52.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a751be700 1 --2- 172.21.15.47:0/1136243604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a5c004d90 0x7f0a5c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a751be700 1 -- 172.21.15.47:0/1136243604 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c0035b0 con 0x7f0a5c003f80 2024-05-08T19:22:52.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a761c0700 1 --2- 172.21.15.47:0/1136243604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a5c004d90 0x7f0a5c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:52.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a751be700 1 --2- 172.21.15.47:0/1136243604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a5c003f80 0x7f0a5c004850 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009b60 tx=0x7f0a5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909e86ee6ce16c54 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:52.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a749bd700 1 -- 172.21.15.47:0/1136243604 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00e6c0 con 0x7f0a5c003f80 2024-05-08T19:22:52.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a749bd700 1 -- 172.21.15.47:0/1136243604 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c00e820 con 0x7f0a5c003f80 2024-05-08T19:22:52.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.540+0000 7f0a749bd700 1 -- 172.21.15.47:0/1136243604 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00eb90 con 0x7f0a5c003f80 2024-05-08T19:22:52.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.541+0000 7f0a77c23700 1 -- 172.21.15.47:0/1136243604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a5c003f80 msgr2=0x7f0a5c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.541+0000 7f0a77c23700 1 --2- 172.21.15.47:0/1136243604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a5c003f80 0x7f0a5c004850 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009b60 tx=0x7f0a5c005880 comp rx=0 tx=0).stop 2024-05-08T19:22:52.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.541+0000 7f0a761c0700 1 -- 172.21.15.47:0/1136243604 reap_dead start 2024-05-08T19:22:52.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.541+0000 7f0a77c23700 1 -- 172.21.15.47:0/1136243604 shutdown_connections 2024-05-08T19:22:52.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.541+0000 7f0a77c23700 1 -- 172.21.15.47:0/1136243604 >> 172.21.15.47:0/1136243604 conn(0x7f0a700c7120 msgr2=0x7f0a700c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:52.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.541+0000 7f0a77c23700 1 -- 172.21.15.47:0/1136243604 shutdown_connections 2024-05-08T19:22:52.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.541+0000 7f0a77c23700 1 -- 172.21.15.47:0/1136243604 wait complete. 2024-05-08T19:22:52.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.542+0000 7f0a77c23700 1 Processor -- start 2024-05-08T19:22:52.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.542+0000 7f0a77c23700 1 -- start start 2024-05-08T19:22:52.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a77c23700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a5c003f80 0x7f0a7006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a77c23700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a7014b180 0x7f0a701407f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a77c23700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a701ee3d0 0x7f0a70140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a77c23700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a701ee920 con 0x7f0a7014b180 2024-05-08T19:22:52.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a77c23700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70156a70 con 0x7f0a701ee3d0 2024-05-08T19:22:52.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a77c23700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70156d50 con 0x7f0a5c003f80 2024-05-08T19:22:52.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a751be700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a7014b180 0x7f0a701407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a751be700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a7014b180 0x7f0a701407f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56288/0 (socket says 172.21.15.47:56288) 2024-05-08T19:22:52.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a751be700 1 -- 172.21.15.47:0/2033736250 learned_addr learned my addr 172.21.15.47:0/2033736250 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:52.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a759bf700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a5c003f80 0x7f0a7006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a761c0700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a701ee3d0 0x7f0a70140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a751be700 1 -- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a5c003f80 msgr2=0x7f0a7006e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a751be700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a5c003f80 0x7f0a7006e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a751be700 1 -- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a701ee3d0 msgr2=0x7f0a70140d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a751be700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a701ee3d0 0x7f0a70140d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a751be700 1 -- 172.21.15.47:0/2033736250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a70157030 con 0x7f0a7014b180 2024-05-08T19:22:52.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a761c0700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a701ee3d0 0x7f0a70140d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:52.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.543+0000 7f0a759bf700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a5c003f80 0x7f0a7006e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:52.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.544+0000 7f0a751be700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a7014b180 0x7f0a701407f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00ba40 tx=0x7f0a6c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:52.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.544+0000 7f0a667fc700 1 -- 172.21.15.47:0/2033736250 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00e6c0 con 0x7f0a7014b180 2024-05-08T19:22:52.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.544+0000 7f0a667fc700 1 -- 172.21.15.47:0/2033736250 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c003ad0 con 0x7f0a7014b180 2024-05-08T19:22:52.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.544+0000 7f0a667fc700 1 -- 172.21.15.47:0/2033736250 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c003e80 con 0x7f0a7014b180 2024-05-08T19:22:52.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.544+0000 7f0a77c23700 1 -- 172.21.15.47:0/2033736250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7006ee90 con 0x7f0a7014b180 2024-05-08T19:22:52.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.544+0000 7f0a77c23700 1 -- 172.21.15.47:0/2033736250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a70152510 con 0x7f0a7014b180 2024-05-08T19:22:52.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.545+0000 7f0a77c23700 1 -- 172.21.15.47:0/2033736250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a701ea880 con 0x7f0a7014b180 2024-05-08T19:22:52.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.545+0000 7f0a667fc700 1 -- 172.21.15.47:0/2033736250 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0a6c013470 con 0x7f0a7014b180 2024-05-08T19:22:52.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.546+0000 7f0a667fc700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0a5406ac90 0x7f0a5406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.546+0000 7f0a667fc700 1 -- 172.21.15.47:0/2033736250 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0a6c08b070 con 0x7f0a7014b180 2024-05-08T19:22:52.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.546+0000 7f0a759bf700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0a5406ac90 0x7f0a5406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.546+0000 7f0a759bf700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0a5406ac90 0x7f0a5406d150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009bd0 tx=0x7f0a60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:52.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.550+0000 7f0a667fc700 1 -- 172.21.15.47:0/2033736250 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0a6c056110 con 0x7f0a7014b180 2024-05-08T19:22:52.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.752+0000 7f0a77c23700 1 -- 172.21.15.47:0/2033736250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a701ee920 con 0x7f0a7014b180 2024-05-08T19:22:52.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.752+0000 7f0a667fc700 1 -- 172.21.15.47:0/2033736250 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a6c059730 con 0x7f0a7014b180 2024-05-08T19:22:52.745 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-08T19:22:52.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.754+0000 7f0a77c23700 1 -- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0a5406ac90 msgr2=0x7f0a5406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.754+0000 7f0a77c23700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0a5406ac90 0x7f0a5406d150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009bd0 tx=0x7f0a60008040 comp rx=0 tx=0).stop 2024-05-08T19:22:52.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.754+0000 7f0a77c23700 1 -- 172.21.15.47:0/2033736250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a7014b180 msgr2=0x7f0a701407f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.754+0000 7f0a77c23700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a7014b180 0x7f0a701407f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00ba40 tx=0x7f0a6c0047c0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.754+0000 7f0a77c23700 1 -- 172.21.15.47:0/2033736250 shutdown_connections 2024-05-08T19:22:52.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.754+0000 7f0a77c23700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f0a5406ac90 0x7f0a5406d150 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.754+0000 7f0a77c23700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a701ee3d0 0x7f0a70140d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.754+0000 7f0a77c23700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a5c003f80 0x7f0a7006e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.754+0000 7f0a77c23700 1 --2- 172.21.15.47:0/2033736250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a7014b180 0x7f0a701407f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.754+0000 7f0a77c23700 1 -- 172.21.15.47:0/2033736250 >> 172.21.15.47:0/2033736250 conn(0x7f0a700c7120 msgr2=0x7f0a70150eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:52.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.754+0000 7f0a77c23700 1 -- 172.21.15.47:0/2033736250 shutdown_connections 2024-05-08T19:22:52.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.754+0000 7f0a77c23700 1 -- 172.21.15.47:0/2033736250 wait complete. 2024-05-08T19:22:52.759 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T19:22:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.895+0000 7f1f80df2700 1 Processor -- start 2024-05-08T19:22:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.895+0000 7f1f80df2700 1 -- start start 2024-05-08T19:22:52.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.896+0000 7f1f80df2700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c152160 0x7f1f7c06a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.896+0000 7f1f80df2700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c1554f0 con 0x7f1f7c06b5f0 2024-05-08T19:22:52.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.896+0000 7f1f80df2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c152540 con 0x7f1f7c06af00 2024-05-08T19:22:52.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.896+0000 7f1f80df2700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c0a8850 con 0x7f1f7c152160 2024-05-08T19:22:52.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.896+0000 7f1f79d9b700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f1f7c06b5f0 0x7f1f7c06e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60008/0 (socket says 172.21.15.47:60008) 2024-05-08T19:22:52.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.896+0000 7f1f79d9b700 1 -- 172.21.15.47:0/3424884305 learned_addr learned my addr 172.21.15.47:0/3424884305 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:52.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7a59c700 1 --2- 172.21.15.47:0/3424884305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c152160 0x7f1f7c06a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7959a700 1 -- 172.21.15.47:0/3424884305 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604685139 0 0) 0x7f1f7c1554f0 con 0x7f1f7c06b5f0 2024-05-08T19:22:52.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7959a700 1 -- 172.21.15.47:0/3424884305 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f680035b0 con 0x7f1f7c06b5f0 2024-05-08T19:22:52.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7959a700 1 -- 172.21.15.47:0/3424884305 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3438333342 0 0) 0x7f1f680035b0 con 0x7f1f7c06b5f0 2024-05-08T19:22:52.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7959a700 1 -- 172.21.15.47:0/3424884305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c152160 msgr2=0x7f1f7c06a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:52.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7959a700 1 --2- 172.21.15.47:0/3424884305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c152160 0x7f1f7c06a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7959a700 1 -- 172.21.15.47:0/3424884305 >> v1:172.21.15.177:6789/0 conn(0x7f1f7c06af00 legacy=0x7f1f7c15f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7959a700 1 -- 172.21.15.47:0/3424884305 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c0a9940 con 0x7f1f7c06b5f0 2024-05-08T19:22:52.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7959a700 1 -- 172.21.15.47:0/3424884305 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f1f6c001670 con 0x7f1f7c06b5f0 2024-05-08T19:22:52.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7959a700 1 -- 172.21.15.47:0/3424884305 >> v1:172.21.15.47:6789/0 conn(0x7f1f7c06b5f0 legacy=0x7f1f7c06e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7959a700 1 --2- 172.21.15.47:0/3424884305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c152160 0x7f1f68003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7959a700 1 --2- 172.21.15.47:0/3424884305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f68003fb0 0x7f1f68004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7959a700 1 --2- 172.21.15.47:0/3424884305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f68004d90 0x7f1f68005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7959a700 1 -- 172.21.15.47:0/3424884305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6800bba0 con 0x7f1f68004d90 2024-05-08T19:22:52.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7959a700 1 -- 172.21.15.47:0/3424884305 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6800bce0 con 0x7f1f68003fb0 2024-05-08T19:22:52.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7959a700 1 -- 172.21.15.47:0/3424884305 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6800bea0 con 0x7f1f7c152160 2024-05-08T19:22:52.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7ad9d700 1 --2- 172.21.15.47:0/3424884305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f68004d90 0x7f1f68005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7a59c700 1 --2- 172.21.15.47:0/3424884305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c152160 0x7f1f68003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f79d9b700 1 --2- 172.21.15.47:0/3424884305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f68003fb0 0x7f1f68004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7ad9d700 1 -- 172.21.15.47:0/3424884305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c152160 msgr2=0x7f1f68003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:52.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7ad9d700 1 --2- 172.21.15.47:0/3424884305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c152160 0x7f1f68003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7ad9d700 1 -- 172.21.15.47:0/3424884305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f68003fb0 msgr2=0x7f1f68004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:52.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7ad9d700 1 --2- 172.21.15.47:0/3424884305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f68003fb0 0x7f1f68004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.897+0000 7f1f7ad9d700 1 -- 172.21.15.47:0/3424884305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680035b0 con 0x7f1f68004d90 2024-05-08T19:22:52.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.898+0000 7f1f7ad9d700 1 --2- 172.21.15.47:0/3424884305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f68004d90 0x7f1f68005210 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400c190 tx=0x7f1f68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b8a9de70515225 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:52.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.898+0000 7f1f7959a700 1 -- 172.21.15.47:0/3424884305 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74001db0 con 0x7f1f68004d90 2024-05-08T19:22:52.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.898+0000 7f1f7959a700 1 -- 172.21.15.47:0/3424884305 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7400ccd0 con 0x7f1f68004d90 2024-05-08T19:22:52.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.898+0000 7f1f7959a700 1 -- 172.21.15.47:0/3424884305 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74003c40 con 0x7f1f68004d90 2024-05-08T19:22:52.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.898+0000 7f1f80df2700 1 -- 172.21.15.47:0/3424884305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f68004d90 msgr2=0x7f1f68005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.898+0000 7f1f80df2700 1 --2- 172.21.15.47:0/3424884305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f68004d90 0x7f1f68005210 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400c190 tx=0x7f1f68005880 comp rx=0 tx=0).stop 2024-05-08T19:22:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.898+0000 7f1f7ad9d700 1 -- 172.21.15.47:0/3424884305 reap_dead start 2024-05-08T19:22:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.898+0000 7f1f80df2700 1 -- 172.21.15.47:0/3424884305 shutdown_connections 2024-05-08T19:22:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.898+0000 7f1f80df2700 1 -- 172.21.15.47:0/3424884305 >> 172.21.15.47:0/3424884305 conn(0x7f1f7c0c71c0 msgr2=0x7f1f7c0c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.898+0000 7f1f80df2700 1 -- 172.21.15.47:0/3424884305 shutdown_connections 2024-05-08T19:22:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.898+0000 7f1f80df2700 1 -- 172.21.15.47:0/3424884305 wait complete. 2024-05-08T19:22:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.900+0000 7f1f80df2700 1 Processor -- start 2024-05-08T19:22:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.900+0000 7f1f80df2700 1 -- start start 2024-05-08T19:22:52.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f80df2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f68004d90 0x7f1f7c1e7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f80df2700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c14c040 0x7f1f7c0ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f80df2700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f7c0acda0 0x7f1f7c1ea320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f80df2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c0ab710 con 0x7f1f68004d90 2024-05-08T19:22:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f80df2700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c0ab9b0 con 0x7f1f7c0acda0 2024-05-08T19:22:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f80df2700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c0abc90 con 0x7f1f7c14c040 2024-05-08T19:22:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f7a59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f68004d90 0x7f1f7c1e7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f7a59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f68004d90 0x7f1f7c1e7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56298/0 (socket says 172.21.15.47:56298) 2024-05-08T19:22:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f7a59c700 1 -- 172.21.15.47:0/3683782446 learned_addr learned my addr 172.21.15.47:0/3683782446 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f7ad9d700 1 --2- 172.21.15.47:0/3683782446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f7c0acda0 0x7f1f7c1ea320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f79d9b700 1 --2- 172.21.15.47:0/3683782446 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c14c040 0x7f1f7c0ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f7a59c700 1 -- 172.21.15.47:0/3683782446 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c14c040 msgr2=0x7f1f7c0ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f7a59c700 1 --2- 172.21.15.47:0/3683782446 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c14c040 0x7f1f7c0ac860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f7a59c700 1 -- 172.21.15.47:0/3683782446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f7c0acda0 msgr2=0x7f1f7c1ea320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f7a59c700 1 --2- 172.21.15.47:0/3683782446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f7c0acda0 0x7f1f7c1ea320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f7a59c700 1 -- 172.21.15.47:0/3683782446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c0abf70 con 0x7f1f68004d90 2024-05-08T19:22:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f7ad9d700 1 --2- 172.21.15.47:0/3683782446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f7c0acda0 0x7f1f7c1ea320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:22:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f7a59c700 1 --2- 172.21.15.47:0/3683782446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f68004d90 0x7f1f7c1e7840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1f64011aa0 tx=0x7f1f64011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f72ffd700 1 -- 172.21.15.47:0/3683782446 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400f980 con 0x7f1f68004d90 2024-05-08T19:22:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f72ffd700 1 -- 172.21.15.47:0/3683782446 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6400fae0 con 0x7f1f68004d90 2024-05-08T19:22:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f80df2700 1 -- 172.21.15.47:0/3683782446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7c0ac250 con 0x7f1f68004d90 2024-05-08T19:22:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f72ffd700 1 -- 172.21.15.47:0/3683782446 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400fe90 con 0x7f1f68004d90 2024-05-08T19:22:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.901+0000 7f1f80df2700 1 -- 172.21.15.47:0/3683782446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7c14ab20 con 0x7f1f68004d90 2024-05-08T19:22:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.902+0000 7f1f80df2700 1 -- 172.21.15.47:0/3683782446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7c148bf0 con 0x7f1f68004d90 2024-05-08T19:22:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.903+0000 7f1f72ffd700 1 -- 172.21.15.47:0/3683782446 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1f64014440 con 0x7f1f68004d90 2024-05-08T19:22:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.903+0000 7f1f72ffd700 1 --2- 172.21.15.47:0/3683782446 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1f5c06ac90 0x7f1f5c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.903+0000 7f1f72ffd700 1 -- 172.21.15.47:0/3683782446 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f64089d70 con 0x7f1f68004d90 2024-05-08T19:22:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.903+0000 7f1f79d9b700 1 --2- 172.21.15.47:0/3683782446 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1f5c06ac90 0x7f1f5c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.904+0000 7f1f79d9b700 1 --2- 172.21.15.47:0/3683782446 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1f5c06ac90 0x7f1f5c06d150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c001b40 tx=0x7f1f6c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:52.908+0000 7f1f72ffd700 1 -- 172.21.15.47:0/3683782446 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1f64054db0 con 0x7f1f68004d90 2024-05-08T19:22:53.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.113+0000 7f1f80df2700 1 -- 172.21.15.47:0/3683782446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f7c04ec60 con 0x7f1f68004d90 2024-05-08T19:22:53.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.114+0000 7f1f72ffd700 1 -- 172.21.15.47:0/3683782446 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f640583d0 con 0x7f1f68004d90 2024-05-08T19:22:53.106 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-08T19:22:53.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.116+0000 7f1f80df2700 1 -- 172.21.15.47:0/3683782446 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1f5c06ac90 msgr2=0x7f1f5c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.116+0000 7f1f80df2700 1 --2- 172.21.15.47:0/3683782446 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1f5c06ac90 0x7f1f5c06d150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c001b40 tx=0x7f1f6c009040 comp rx=0 tx=0).stop 2024-05-08T19:22:53.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.116+0000 7f1f80df2700 1 -- 172.21.15.47:0/3683782446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f68004d90 msgr2=0x7f1f7c1e7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.116+0000 7f1f80df2700 1 --2- 172.21.15.47:0/3683782446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f68004d90 0x7f1f7c1e7840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1f64011aa0 tx=0x7f1f64011e60 comp rx=0 tx=0).stop 2024-05-08T19:22:53.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.116+0000 7f1f80df2700 1 -- 172.21.15.47:0/3683782446 shutdown_connections 2024-05-08T19:22:53.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.116+0000 7f1f80df2700 1 --2- 172.21.15.47:0/3683782446 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1f5c06ac90 0x7f1f5c06d150 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.116+0000 7f1f80df2700 1 --2- 172.21.15.47:0/3683782446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f68004d90 0x7f1f7c1e7840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.116+0000 7f1f80df2700 1 --2- 172.21.15.47:0/3683782446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f7c0acda0 0x7f1f7c1ea320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.116+0000 7f1f80df2700 1 --2- 172.21.15.47:0/3683782446 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c14c040 0x7f1f7c0ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.116+0000 7f1f80df2700 1 -- 172.21.15.47:0/3683782446 >> 172.21.15.47:0/3683782446 conn(0x7f1f7c0c71c0 msgr2=0x7f1f7c14e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:53.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.116+0000 7f1f80df2700 1 -- 172.21.15.47:0/3683782446 shutdown_connections 2024-05-08T19:22:53.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.116+0000 7f1f80df2700 1 -- 172.21.15.47:0/3683782446 wait complete. 2024-05-08T19:22:53.121 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T19:22:53.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.257+0000 7fd7ba30e700 1 Processor -- start 2024-05-08T19:22:53.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.257+0000 7fd7ba30e700 1 -- start start 2024-05-08T19:22:53.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.258+0000 7fd7ba30e700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd7b40c2be0 0x7fd7b41526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.258+0000 7fd7ba30e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7b40c4f60 0x7fd7b40c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.258+0000 7fd7ba30e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b40ab720 con 0x7fd7b40aae80 2024-05-08T19:22:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.258+0000 7fd7ba30e700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b40aba00 con 0x7fd7b40c2be0 2024-05-08T19:22:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.258+0000 7fd7ba30e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b40abce0 con 0x7fd7b40c4f60 2024-05-08T19:22:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.258+0000 7fd7b88ab700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7b40c4f60 0x7fd7b40c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.258+0000 7fd7b3fff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd7b40c2be0 0x7fd7b41526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.259+0000 7fd7b88ab700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7b40c4f60 0x7fd7b40c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:41516/0 (socket says 172.21.15.47:41516) 2024-05-08T19:22:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.259+0000 7fd7b88ab700 1 -- 172.21.15.47:0/3731606987 learned_addr learned my addr 172.21.15.47:0/3731606987 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.259+0000 7fd7b37fe700 1 --1- 172.21.15.47:0/3731606987 >> v1:172.21.15.177:6789/0 conn(0x7fd7b40aae80 0x7fd7b406b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:36420/0 (socket says 172.21.15.47:36420) 2024-05-08T19:22:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.259+0000 7fd7b3fff700 1 -- 172.21.15.47:0/3731606987 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7b40c4f60 msgr2=0x7fd7b40c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.259+0000 7fd7b3fff700 1 --2- 172.21.15.47:0/3731606987 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7b40c4f60 0x7fd7b40c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.259+0000 7fd7b3fff700 1 -- 172.21.15.47:0/3731606987 >> v1:172.21.15.177:6789/0 conn(0x7fd7b40aae80 legacy=0x7fd7b406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.259+0000 7fd7b2ffd700 1 -- 172.21.15.47:0/3731606987 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926853318 0 0) 0x7fd7b40ab720 con 0x7fd7b40aae80 2024-05-08T19:22:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.259+0000 7fd7b3fff700 1 -- 172.21.15.47:0/3731606987 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b40c4760 con 0x7fd7b40c2be0 2024-05-08T19:22:53.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.259+0000 7fd7b88ab700 1 --2- 172.21.15.47:0/3731606987 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7b40c4f60 0x7fd7b40c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:53.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.259+0000 7fd7b3fff700 1 --2- 172.21.15.47:0/3731606987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b40c2be0 0x7fd7b41526f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009840 tx=0x7fd7a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcd3aa6965660de0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:53.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.259+0000 7fd7b2ffd700 1 -- 172.21.15.47:0/3731606987 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4011830 con 0x7fd7b40c2be0 2024-05-08T19:22:53.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.259+0000 7fd7b2ffd700 1 -- 172.21.15.47:0/3731606987 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a4011990 con 0x7fd7b40c2be0 2024-05-08T19:22:53.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.259+0000 7fd7b2ffd700 1 -- 172.21.15.47:0/3731606987 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4011d20 con 0x7fd7b40c2be0 2024-05-08T19:22:53.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.260+0000 7fd7ba30e700 1 -- 172.21.15.47:0/3731606987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b40c2be0 msgr2=0x7fd7b41526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.260+0000 7fd7ba30e700 1 --2- 172.21.15.47:0/3731606987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b40c2be0 0x7fd7b41526f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009840 tx=0x7fd7a4009b50 comp rx=0 tx=0).stop 2024-05-08T19:22:53.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.260+0000 7fd7ba30e700 1 -- 172.21.15.47:0/3731606987 shutdown_connections 2024-05-08T19:22:53.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.260+0000 7fd7ba30e700 1 --2- 172.21.15.47:0/3731606987 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7b40c4f60 0x7fd7b40c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.260+0000 7fd7ba30e700 1 --2- 172.21.15.47:0/3731606987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b40c2be0 0x7fd7b41526f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.260+0000 7fd7ba30e700 1 -- 172.21.15.47:0/3731606987 >> 172.21.15.47:0/3731606987 conn(0x7fd7b40c3360 msgr2=0x7fd7b40c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:53.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.260+0000 7fd7ba30e700 1 -- 172.21.15.47:0/3731606987 shutdown_connections 2024-05-08T19:22:53.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.260+0000 7fd7ba30e700 1 -- 172.21.15.47:0/3731606987 wait complete. 2024-05-08T19:22:53.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.261+0000 7fd7ba30e700 1 Processor -- start 2024-05-08T19:22:53.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.261+0000 7fd7ba30e700 1 -- start start 2024-05-08T19:22:53.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7ba30e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b40aae80 0x7fd7b40bfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7ba30e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b40c2be0 0x7fd7b40c00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7ba30e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7b40c4f60 0x7fd7b40be530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7ba30e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b40be110 con 0x7fd7b40aae80 2024-05-08T19:22:53.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7ba30e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b41ebe10 con 0x7fd7b40c2be0 2024-05-08T19:22:53.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7ba30e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b41ec0f0 con 0x7fd7b40c4f60 2024-05-08T19:22:53.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7b3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b40aae80 0x7fd7b40bfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7b3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b40aae80 0x7fd7b40bfb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56300/0 (socket says 172.21.15.47:56300) 2024-05-08T19:22:53.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7b3fff700 1 -- 172.21.15.47:0/919412727 learned_addr learned my addr 172.21.15.47:0/919412727 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:53.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7b88ab700 1 --2- 172.21.15.47:0/919412727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7b40c4f60 0x7fd7b40be530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7b37fe700 1 --2- 172.21.15.47:0/919412727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b40c2be0 0x7fd7b40c00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7b3fff700 1 -- 172.21.15.47:0/919412727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7b40c4f60 msgr2=0x7fd7b40be530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7b3fff700 1 --2- 172.21.15.47:0/919412727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7b40c4f60 0x7fd7b40be530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7b3fff700 1 -- 172.21.15.47:0/919412727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b40c2be0 msgr2=0x7fd7b40c00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7b3fff700 1 --2- 172.21.15.47:0/919412727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b40c2be0 0x7fd7b40c00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.262+0000 7fd7b3fff700 1 -- 172.21.15.47:0/919412727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac009b30 con 0x7fd7b40aae80 2024-05-08T19:22:53.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.263+0000 7fd7b3fff700 1 --2- 172.21.15.47:0/919412727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b40aae80 0x7fd7b40bfb90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009fd0 tx=0x7fd7a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:53.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.263+0000 7fd7b0ff9700 1 -- 172.21.15.47:0/919412727 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4004550 con 0x7fd7b40aae80 2024-05-08T19:22:53.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.263+0000 7fd7b0ff9700 1 -- 172.21.15.47:0/919412727 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a401f070 con 0x7fd7b40aae80 2024-05-08T19:22:53.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.263+0000 7fd7ba30e700 1 -- 172.21.15.47:0/919412727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a40094a0 con 0x7fd7b40aae80 2024-05-08T19:22:53.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.263+0000 7fd7b0ff9700 1 -- 172.21.15.47:0/919412727 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a40038e0 con 0x7fd7b40aae80 2024-05-08T19:22:53.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.263+0000 7fd7ba30e700 1 -- 172.21.15.47:0/919412727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b40bdd30 con 0x7fd7b40aae80 2024-05-08T19:22:53.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.264+0000 7fd7ba30e700 1 -- 172.21.15.47:0/919412727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b406d810 con 0x7fd7b40aae80 2024-05-08T19:22:53.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.264+0000 7fd7b0ff9700 1 -- 172.21.15.47:0/919412727 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd7a4003a40 con 0x7fd7b40aae80 2024-05-08T19:22:53.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.265+0000 7fd7b0ff9700 1 --2- 172.21.15.47:0/919412727 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd7a006ac90 0x7fd7a006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.265+0000 7fd7b0ff9700 1 -- 172.21.15.47:0/919412727 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7a4021070 con 0x7fd7b40aae80 2024-05-08T19:22:53.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.265+0000 7fd7b37fe700 1 --2- 172.21.15.47:0/919412727 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd7a006ac90 0x7fd7a006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.265+0000 7fd7b37fe700 1 --2- 172.21.15.47:0/919412727 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd7a006ac90 0x7fd7a006d150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8000f60 tx=0x7fd7a8007e70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.269+0000 7fd7b0ff9700 1 -- 172.21.15.47:0/919412727 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd7a4055cd0 con 0x7fd7b40aae80 2024-05-08T19:22:53.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.478+0000 7fd7ba30e700 1 -- 172.21.15.47:0/919412727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd7b404ec60 con 0x7fd7b40aae80 2024-05-08T19:22:53.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.478+0000 7fd7b0ff9700 1 -- 172.21.15.47:0/919412727 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd7a402b0a0 con 0x7fd7b40aae80 2024-05-08T19:22:53.471 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-08T19:22:53.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.481+0000 7fd7ba30e700 1 -- 172.21.15.47:0/919412727 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd7a006ac90 msgr2=0x7fd7a006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.481+0000 7fd7ba30e700 1 --2- 172.21.15.47:0/919412727 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd7a006ac90 0x7fd7a006d150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8000f60 tx=0x7fd7a8007e70 comp rx=0 tx=0).stop 2024-05-08T19:22:53.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.481+0000 7fd7ba30e700 1 -- 172.21.15.47:0/919412727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b40aae80 msgr2=0x7fd7b40bfb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.481+0000 7fd7ba30e700 1 --2- 172.21.15.47:0/919412727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b40aae80 0x7fd7b40bfb90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009fd0 tx=0x7fd7a4004750 comp rx=0 tx=0).stop 2024-05-08T19:22:53.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.481+0000 7fd7ba30e700 1 -- 172.21.15.47:0/919412727 shutdown_connections 2024-05-08T19:22:53.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.481+0000 7fd7ba30e700 1 --2- 172.21.15.47:0/919412727 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd7a006ac90 0x7fd7a006d150 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.481+0000 7fd7ba30e700 1 --2- 172.21.15.47:0/919412727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b40aae80 0x7fd7b40bfb90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.481+0000 7fd7ba30e700 1 --2- 172.21.15.47:0/919412727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7b40c4f60 0x7fd7b40be530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.481+0000 7fd7ba30e700 1 --2- 172.21.15.47:0/919412727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b40c2be0 0x7fd7b40c00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.481+0000 7fd7ba30e700 1 -- 172.21.15.47:0/919412727 >> 172.21.15.47:0/919412727 conn(0x7fd7b40c3360 msgr2=0x7fd7b406b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:53.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.481+0000 7fd7ba30e700 1 -- 172.21.15.47:0/919412727 shutdown_connections 2024-05-08T19:22:53.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.481+0000 7fd7ba30e700 1 -- 172.21.15.47:0/919412727 wait complete. 2024-05-08T19:22:53.485 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T19:22:53.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.622+0000 7f216db62700 1 Processor -- start 2024-05-08T19:22:53.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.622+0000 7f216db62700 1 -- start start 2024-05-08T19:22:53.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.623+0000 7f216db62700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f216814ffe0 0x7f216806a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.623+0000 7f216db62700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216806b5e0 0x7f21681529b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.623+0000 7f216db62700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21680c27d0 con 0x7f21680a84b0 2024-05-08T19:22:53.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.623+0000 7f216db62700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21681567f0 con 0x7f216814ffe0 2024-05-08T19:22:53.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.623+0000 7f216db62700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21681569e0 con 0x7f216806b5e0 2024-05-08T19:22:53.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.623+0000 7f21677fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f216814ffe0 0x7f216806a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.623+0000 7f21677fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f216814ffe0 0x7f216806a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56316/0 (socket says 172.21.15.47:56316) 2024-05-08T19:22:53.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.623+0000 7f21677fe700 1 -- 172.21.15.47:0/3142861615 learned_addr learned my addr 172.21.15.47:0/3142861615 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:53.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.623+0000 7f2167fff700 1 --1- 172.21.15.47:0/3142861615 >> v1:172.21.15.47:6789/0 conn(0x7f21680a84b0 0x7f2168152ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60018/0 (socket says 172.21.15.47:60018) 2024-05-08T19:22:53.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.624+0000 7f2166ffd700 1 --2- 172.21.15.47:0/3142861615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216806b5e0 0x7f21681529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.624+0000 7f21677fe700 1 -- 172.21.15.47:0/3142861615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216806b5e0 msgr2=0x7f21681529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:53.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.624+0000 7f21677fe700 1 --2- 172.21.15.47:0/3142861615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216806b5e0 0x7f21681529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.624+0000 7f21677fe700 1 -- 172.21.15.47:0/3142861615 >> v1:172.21.15.47:6789/0 conn(0x7f21680a84b0 legacy=0x7f2168152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.624+0000 7f21677fe700 1 -- 172.21.15.47:0/3142861615 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21680c1cd0 con 0x7f216814ffe0 2024-05-08T19:22:53.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.624+0000 7f2166ffd700 1 --2- 172.21.15.47:0/3142861615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216806b5e0 0x7f21681529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:53.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.624+0000 7f21677fe700 1 --2- 172.21.15.47:0/3142861615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f216814ffe0 0x7f216806a9c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f21580098f0 tx=0x7f2158009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec70e9081feeaf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:53.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.624+0000 7f21667fc700 1 -- 172.21.15.47:0/3142861615 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215800b8a0 con 0x7f216814ffe0 2024-05-08T19:22:53.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.624+0000 7f21667fc700 1 -- 172.21.15.47:0/3142861615 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215800ba00 con 0x7f216814ffe0 2024-05-08T19:22:53.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.624+0000 7f21667fc700 1 -- 172.21.15.47:0/3142861615 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215800bd90 con 0x7f216814ffe0 2024-05-08T19:22:53.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.624+0000 7f216db62700 1 -- 172.21.15.47:0/3142861615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f216814ffe0 msgr2=0x7f216806a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.624+0000 7f216db62700 1 --2- 172.21.15.47:0/3142861615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f216814ffe0 0x7f216806a9c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f21580098f0 tx=0x7f2158009c00 comp rx=0 tx=0).stop 2024-05-08T19:22:53.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.625+0000 7f216db62700 1 -- 172.21.15.47:0/3142861615 shutdown_connections 2024-05-08T19:22:53.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.625+0000 7f216db62700 1 --2- 172.21.15.47:0/3142861615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f216814ffe0 0x7f216806a9c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.625+0000 7f216db62700 1 --2- 172.21.15.47:0/3142861615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216806b5e0 0x7f21681529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.625+0000 7f216db62700 1 -- 172.21.15.47:0/3142861615 >> 172.21.15.47:0/3142861615 conn(0x7f21680c7230 msgr2=0x7f21680c7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:53.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.625+0000 7f216db62700 1 -- 172.21.15.47:0/3142861615 shutdown_connections 2024-05-08T19:22:53.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.625+0000 7f216db62700 1 -- 172.21.15.47:0/3142861615 wait complete. 2024-05-08T19:22:53.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.626+0000 7f216db62700 1 Processor -- start 2024-05-08T19:22:53.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.626+0000 7f216db62700 1 -- start start 2024-05-08T19:22:53.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f216db62700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f216806b5e0 0x7f2168153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f216db62700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21680a84b0 0x7f21681ead90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f216db62700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216814ffe0 0x7f2168151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f216db62700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2168147320 con 0x7f216806b5e0 2024-05-08T19:22:53.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f216db62700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2168145cf0 con 0x7f21680a84b0 2024-05-08T19:22:53.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f216db62700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21680c4e20 con 0x7f216814ffe0 2024-05-08T19:22:53.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f21677fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f216806b5e0 0x7f2168153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f21677fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f216806b5e0 0x7f2168153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56318/0 (socket says 172.21.15.47:56318) 2024-05-08T19:22:53.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f21677fe700 1 -- 172.21.15.47:0/3662032644 learned_addr learned my addr 172.21.15.47:0/3662032644 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:53.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f2166ffd700 1 --2- 172.21.15.47:0/3662032644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21680a84b0 0x7f21681ead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f2167fff700 1 --2- 172.21.15.47:0/3662032644 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216814ffe0 0x7f2168151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f21677fe700 1 -- 172.21.15.47:0/3662032644 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216814ffe0 msgr2=0x7f2168151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f21677fe700 1 --2- 172.21.15.47:0/3662032644 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216814ffe0 0x7f2168151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f21677fe700 1 -- 172.21.15.47:0/3662032644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21680a84b0 msgr2=0x7f21681ead90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f21677fe700 1 --2- 172.21.15.47:0/3662032644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21680a84b0 0x7f21681ead90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f21677fe700 1 -- 172.21.15.47:0/3662032644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158009550 con 0x7f216806b5e0 2024-05-08T19:22:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f21677fe700 1 --2- 172.21.15.47:0/3662032644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f216806b5e0 0x7f2168153e30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2158014040 tx=0x7f2158004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f215ffff700 1 -- 172.21.15.47:0/3662032644 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21580036a0 con 0x7f216806b5e0 2024-05-08T19:22:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f215ffff700 1 -- 172.21.15.47:0/3662032644 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215801e070 con 0x7f216806b5e0 2024-05-08T19:22:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f216db62700 1 -- 172.21.15.47:0/3662032644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21681eb2d0 con 0x7f216806b5e0 2024-05-08T19:22:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.627+0000 7f215ffff700 1 -- 172.21.15.47:0/3662032644 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158003a60 con 0x7f216806b5e0 2024-05-08T19:22:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.628+0000 7f216db62700 1 -- 172.21.15.47:0/3662032644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2168146190 con 0x7f216806b5e0 2024-05-08T19:22:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.628+0000 7f216db62700 1 -- 172.21.15.47:0/3662032644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21680c2a20 con 0x7f216806b5e0 2024-05-08T19:22:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.629+0000 7f215ffff700 1 -- 172.21.15.47:0/3662032644 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2158003bc0 con 0x7f216806b5e0 2024-05-08T19:22:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.629+0000 7f215ffff700 1 --2- 172.21.15.47:0/3662032644 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f214806ac90 0x7f214806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.629+0000 7f215ffff700 1 -- 172.21.15.47:0/3662032644 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2158020070 con 0x7f216806b5e0 2024-05-08T19:22:53.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.629+0000 7f2166ffd700 1 --2- 172.21.15.47:0/3662032644 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f214806ac90 0x7f214806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.630+0000 7f2166ffd700 1 --2- 172.21.15.47:0/3662032644 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f214806ac90 0x7f214806d150 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2168152560 tx=0x7f2150008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:53.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.634+0000 7f215ffff700 1 -- 172.21.15.47:0/3662032644 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f21580558a0 con 0x7f216806b5e0 2024-05-08T19:22:53.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.838+0000 7f216db62700 1 -- 172.21.15.47:0/3662032644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f21681eb2d0 con 0x7f216806b5e0 2024-05-08T19:22:53.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.838+0000 7f215ffff700 1 -- 172.21.15.47:0/3662032644 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f21681eb2d0 con 0x7f216806b5e0 2024-05-08T19:22:53.830 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-08T19:22:53.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.840+0000 7f216db62700 1 -- 172.21.15.47:0/3662032644 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f214806ac90 msgr2=0x7f214806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.840+0000 7f216db62700 1 --2- 172.21.15.47:0/3662032644 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f214806ac90 0x7f214806d150 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2168152560 tx=0x7f2150008040 comp rx=0 tx=0).stop 2024-05-08T19:22:53.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.840+0000 7f216db62700 1 -- 172.21.15.47:0/3662032644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f216806b5e0 msgr2=0x7f2168153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.840+0000 7f216db62700 1 --2- 172.21.15.47:0/3662032644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f216806b5e0 0x7f2168153e30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2158014040 tx=0x7f2158004750 comp rx=0 tx=0).stop 2024-05-08T19:22:53.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.841+0000 7f216db62700 1 -- 172.21.15.47:0/3662032644 shutdown_connections 2024-05-08T19:22:53.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.841+0000 7f216db62700 1 --2- 172.21.15.47:0/3662032644 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f214806ac90 0x7f214806d150 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.841+0000 7f216db62700 1 --2- 172.21.15.47:0/3662032644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f216806b5e0 0x7f2168153e30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.841+0000 7f216db62700 1 --2- 172.21.15.47:0/3662032644 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f216814ffe0 0x7f2168151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.841+0000 7f216db62700 1 --2- 172.21.15.47:0/3662032644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21680a84b0 0x7f21681ead90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.841+0000 7f216db62700 1 -- 172.21.15.47:0/3662032644 >> 172.21.15.47:0/3662032644 conn(0x7f21680c7230 msgr2=0x7f21680c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:53.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.841+0000 7f216db62700 1 -- 172.21.15.47:0/3662032644 shutdown_connections 2024-05-08T19:22:53.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.841+0000 7f216db62700 1 -- 172.21.15.47:0/3662032644 wait complete. 2024-05-08T19:22:53.845 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T19:22:53.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.979+0000 7fa2fa869700 1 Processor -- start 2024-05-08T19:22:53.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.979+0000 7fa2fa869700 1 -- start start 2024-05-08T19:22:53.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.979+0000 7fa2fa869700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa2f41521c0 0x7fa2f40720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.979+0000 7fa2fa869700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2f4071710 0x7fa2f4154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.980+0000 7fa2fa869700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f40c0be0 con 0x7fa2f40725e0 2024-05-08T19:22:53.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.980+0000 7fa2fa869700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f406b470 con 0x7fa2f41521c0 2024-05-08T19:22:53.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.980+0000 7fa2fa869700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40c1250 con 0x7fa2f4071710 2024-05-08T19:22:53.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.980+0000 7fa2f3fff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa2f41521c0 0x7fa2f40720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.980+0000 7fa2f8e06700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fa2f40725e0 0x7fa2f41551f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:36428/0 (socket says 172.21.15.47:36428) 2024-05-08T19:22:53.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.980+0000 7fa2f3fff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa2f41521c0 0x7fa2f40720a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:42426/0 (socket says 172.21.15.47:42426) 2024-05-08T19:22:53.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.980+0000 7fa2f8e06700 1 -- 172.21.15.47:0/429869715 learned_addr learned my addr 172.21.15.47:0/429869715 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:53.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.980+0000 7fa2f37fe700 1 --2- 172.21.15.47:0/429869715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2f4071710 0x7fa2f4154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.980+0000 7fa2f3fff700 1 -- 172.21.15.47:0/429869715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2f4071710 msgr2=0x7fa2f4154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:53.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.980+0000 7fa2f3fff700 1 --2- 172.21.15.47:0/429869715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2f4071710 0x7fa2f4154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.980+0000 7fa2f3fff700 1 -- 172.21.15.47:0/429869715 >> v1:172.21.15.177:6789/0 conn(0x7fa2f40725e0 legacy=0x7fa2f41551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.980+0000 7fa2f3fff700 1 -- 172.21.15.47:0/429869715 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f406b710 con 0x7fa2f41521c0 2024-05-08T19:22:53.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.980+0000 7fa2f2ffd700 1 -- 172.21.15.47:0/429869715 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492037324 0 0) 0x7fa2f40c0be0 con 0x7fa2f40725e0 2024-05-08T19:22:53.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.980+0000 7fa2f3fff700 1 --2- 172.21.15.47:0/429869715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2f41521c0 0x7fa2f40720a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009840 tx=0x7fa2e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1deba9a03e215de server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:53.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.981+0000 7fa2f2ffd700 1 -- 172.21.15.47:0/429869715 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4011830 con 0x7fa2f41521c0 2024-05-08T19:22:53.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.981+0000 7fa2f2ffd700 1 -- 172.21.15.47:0/429869715 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e4011990 con 0x7fa2f41521c0 2024-05-08T19:22:53.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.981+0000 7fa2f2ffd700 1 -- 172.21.15.47:0/429869715 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4011d20 con 0x7fa2f41521c0 2024-05-08T19:22:53.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.981+0000 7fa2fa869700 1 -- 172.21.15.47:0/429869715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2f41521c0 msgr2=0x7fa2f40720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.981+0000 7fa2fa869700 1 --2- 172.21.15.47:0/429869715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2f41521c0 0x7fa2f40720a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009840 tx=0x7fa2e4009b50 comp rx=0 tx=0).stop 2024-05-08T19:22:53.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.981+0000 7fa2fa869700 1 -- 172.21.15.47:0/429869715 shutdown_connections 2024-05-08T19:22:53.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.981+0000 7fa2fa869700 1 --2- 172.21.15.47:0/429869715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2f41521c0 0x7fa2f40720a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.981+0000 7fa2fa869700 1 --2- 172.21.15.47:0/429869715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2f4071710 0x7fa2f4154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.981+0000 7fa2fa869700 1 -- 172.21.15.47:0/429869715 >> 172.21.15.47:0/429869715 conn(0x7fa2f40c7120 msgr2=0x7fa2f40c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:53.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.981+0000 7fa2fa869700 1 -- 172.21.15.47:0/429869715 shutdown_connections 2024-05-08T19:22:53.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.981+0000 7fa2fa869700 1 -- 172.21.15.47:0/429869715 wait complete. 2024-05-08T19:22:53.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.982+0000 7fa2fa869700 1 Processor -- start 2024-05-08T19:22:53.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.983+0000 7fa2fa869700 1 -- start start 2024-05-08T19:22:53.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.983+0000 7fa2fa869700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2f4071710 0x7fa2f4157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.983+0000 7fa2fa869700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f40725e0 0x7fa2f40c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.983+0000 7fa2fa869700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2f41521c0 0x7fa2f41ed730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.983+0000 7fa2fa869700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f41eaa70 con 0x7fa2f40725e0 2024-05-08T19:22:53.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.983+0000 7fa2fa869700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f41ea160 con 0x7fa2f41521c0 2024-05-08T19:22:53.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.983+0000 7fa2fa869700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f4157b00 con 0x7fa2f4071710 2024-05-08T19:22:53.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.983+0000 7fa2f37fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f40725e0 0x7fa2f40c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.983+0000 7fa2f37fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f40725e0 0x7fa2f40c2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56334/0 (socket says 172.21.15.47:56334) 2024-05-08T19:22:53.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.983+0000 7fa2f37fe700 1 -- 172.21.15.47:0/1511859014 learned_addr learned my addr 172.21.15.47:0/1511859014 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:53.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.984+0000 7fa2f3fff700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2f4071710 0x7fa2f4157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.984+0000 7fa2f8e06700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2f41521c0 0x7fa2f41ed730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.984+0000 7fa2f37fe700 1 -- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2f4071710 msgr2=0x7fa2f4157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.984+0000 7fa2f37fe700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2f4071710 0x7fa2f4157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.984+0000 7fa2f37fe700 1 -- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2f41521c0 msgr2=0x7fa2f41ed730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:53.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.984+0000 7fa2f37fe700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2f41521c0 0x7fa2f41ed730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:53.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.984+0000 7fa2f37fe700 1 -- 172.21.15.47:0/1511859014 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e40094a0 con 0x7fa2f40725e0 2024-05-08T19:22:53.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.984+0000 7fa2f8e06700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2f41521c0 0x7fa2f41ed730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:53.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.984+0000 7fa2f3fff700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2f4071710 0x7fa2f4157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:53.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.984+0000 7fa2f37fe700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f40725e0 0x7fa2f40c2750 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800e9b0 tx=0x7fa2e800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:53.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.984+0000 7fa2f0ff9700 1 -- 172.21.15.47:0/1511859014 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8009710 con 0x7fa2f40725e0 2024-05-08T19:22:53.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.984+0000 7fa2f0ff9700 1 -- 172.21.15.47:0/1511859014 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e800c850 con 0x7fa2f40725e0 2024-05-08T19:22:53.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.984+0000 7fa2fa869700 1 -- 172.21.15.47:0/1511859014 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f41ea420 con 0x7fa2f40725e0 2024-05-08T19:22:53.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.984+0000 7fa2f0ff9700 1 -- 172.21.15.47:0/1511859014 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e800cbc0 con 0x7fa2f40725e0 2024-05-08T19:22:53.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.984+0000 7fa2fa869700 1 -- 172.21.15.47:0/1511859014 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f40c2c90 con 0x7fa2f40725e0 2024-05-08T19:22:53.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.985+0000 7fa2fa869700 1 -- 172.21.15.47:0/1511859014 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f41eac20 con 0x7fa2f40725e0 2024-05-08T19:22:53.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.986+0000 7fa2f0ff9700 1 -- 172.21.15.47:0/1511859014 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa2e800cd20 con 0x7fa2f40725e0 2024-05-08T19:22:53.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.986+0000 7fa2f0ff9700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa2e006ac90 0x7fa2e006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:53.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.986+0000 7fa2f0ff9700 1 -- 172.21.15.47:0/1511859014 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa2e8089690 con 0x7fa2f40725e0 2024-05-08T19:22:53.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.986+0000 7fa2f3fff700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa2e006ac90 0x7fa2e006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:53.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.987+0000 7fa2f3fff700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa2e006ac90 0x7fa2e006d150 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40090b0 tx=0x7fa2e401c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:53.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:53.991+0000 7fa2f0ff9700 1 -- 172.21.15.47:0/1511859014 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa2f41eac20 con 0x7fa2f40725e0 2024-05-08T19:22:54.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.244+0000 7fa2fa869700 1 -- 172.21.15.47:0/1511859014 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2f404ec60 con 0x7fa2f40725e0 2024-05-08T19:22:54.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.244+0000 7fa2f0ff9700 1 -- 172.21.15.47:0/1511859014 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7fa2e80580a0 con 0x7fa2f40725e0 2024-05-08T19:22:54.236 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:54.237 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3927983771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3927983771},{"type":"v1","addr":"172.21.15.47:6833","nonce":3927983771}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/201830514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":201830514},{"type":"v1","addr":"172.21.15.47:6835","nonce":201830514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1266001461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1266001461},{"type":"v1","addr":"172.21.15.177:6836","nonce":1266001461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T19:22:20.424727+0000","modified":"2024-05-08T19:22:42.943964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/2990594738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2990594738},{"type":"v1","addr":"172.21.15.177:6837","nonce":2990594738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T19:22:54.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.246+0000 7fa2fa869700 1 -- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa2e006ac90 msgr2=0x7fa2e006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:54.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.246+0000 7fa2fa869700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa2e006ac90 0x7fa2e006d150 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40090b0 tx=0x7fa2e401c040 comp rx=0 tx=0).stop 2024-05-08T19:22:54.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.246+0000 7fa2fa869700 1 -- 172.21.15.47:0/1511859014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f40725e0 msgr2=0x7fa2f40c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:54.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.246+0000 7fa2fa869700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f40725e0 0x7fa2f40c2750 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800e9b0 tx=0x7fa2e800ed70 comp rx=0 tx=0).stop 2024-05-08T19:22:54.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.246+0000 7fa2fa869700 1 -- 172.21.15.47:0/1511859014 shutdown_connections 2024-05-08T19:22:54.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.246+0000 7fa2fa869700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa2e006ac90 0x7fa2e006d150 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.246+0000 7fa2fa869700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2f41521c0 0x7fa2f41ed730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.246+0000 7fa2fa869700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2f4071710 0x7fa2f4157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.246+0000 7fa2fa869700 1 --2- 172.21.15.47:0/1511859014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2f40725e0 0x7fa2f40c2750 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.246+0000 7fa2fa869700 1 -- 172.21.15.47:0/1511859014 >> 172.21.15.47:0/1511859014 conn(0x7fa2f40c7120 msgr2=0x7fa2f4154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:54.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.246+0000 7fa2fa869700 1 -- 172.21.15.47:0/1511859014 shutdown_connections 2024-05-08T19:22:54.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.246+0000 7fa2fa869700 1 -- 172.21.15.47:0/1511859014 wait complete. 2024-05-08T19:22:54.244 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-05-08T19:22:54.251 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:22:54.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.385+0000 7fb19e3be700 1 Processor -- start 2024-05-08T19:22:54.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.385+0000 7fb19e3be700 1 -- start start 2024-05-08T19:22:54.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.386+0000 7fb19e3be700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1980c1d90 0x7fb1980c2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:54.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.386+0000 7fb19e3be700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb1980c2b10 0x7fb1980a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:54.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.386+0000 7fb19e3be700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1980c3690 con 0x7fb1980a89f0 2024-05-08T19:22:54.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.386+0000 7fb19e3be700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1980c3970 con 0x7fb1980c2b10 2024-05-08T19:22:54.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.386+0000 7fb19e3be700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb198154d00 con 0x7fb1980c1d90 2024-05-08T19:22:54.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.386+0000 7fb19c95b700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb1980a89f0 0x7fb19814ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60028/0 (socket says 172.21.15.47:60028) 2024-05-08T19:22:54.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.386+0000 7fb19c95b700 1 -- 172.21.15.47:0/203085436 learned_addr learned my addr 172.21.15.47:0/203085436 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:54.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.386+0000 7fb1977fe700 1 --2- 172.21.15.47:0/203085436 >> v2:172.21.15.177:3300/0 conn(0x7fb1980c2b10 0x7fb1980a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:54.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.386+0000 7fb197fff700 1 --2- 172.21.15.47:0/203085436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1980c1d90 0x7fb1980c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:54.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.386+0000 7fb196ffd700 1 -- 172.21.15.47:0/203085436 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891574546 0 0) 0x7fb1980c3690 con 0x7fb1980a89f0 2024-05-08T19:22:54.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb196ffd700 1 -- 172.21.15.47:0/203085436 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1800035b0 con 0x7fb1980a89f0 2024-05-08T19:22:54.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb196ffd700 1 -- 172.21.15.47:0/203085436 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2685926483 0 0) 0x7fb1800035b0 con 0x7fb1980a89f0 2024-05-08T19:22:54.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb196ffd700 1 -- 172.21.15.47:0/203085436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1980c1d90 msgr2=0x7fb1980c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:54.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb196ffd700 1 --2- 172.21.15.47:0/203085436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1980c1d90 0x7fb1980c2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb196ffd700 1 -- 172.21.15.47:0/203085436 >> v2:172.21.15.177:3300/0 conn(0x7fb1980c2b10 msgr2=0x7fb1980a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:54.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb196ffd700 1 --2- 172.21.15.47:0/203085436 >> v2:172.21.15.177:3300/0 conn(0x7fb1980c2b10 0x7fb1980a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb196ffd700 1 -- 172.21.15.47:0/203085436 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198154fe0 con 0x7fb1980a89f0 2024-05-08T19:22:54.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb196ffd700 1 -- 172.21.15.47:0/203085436 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7fb1900019f0 con 0x7fb1980a89f0 2024-05-08T19:22:54.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb196ffd700 1 -- 172.21.15.47:0/203085436 >> v1:172.21.15.47:6789/0 conn(0x7fb1980a89f0 legacy=0x7fb19814ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:54.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb196ffd700 1 --2- 172.21.15.47:0/203085436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb180003a00 0x7fb180003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:54.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb196ffd700 1 --2- 172.21.15.47:0/203085436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb180004850 0x7fb180004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:54.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb196ffd700 1 --2- 172.21.15.47:0/203085436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1980c1d90 0x7fb180005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:54.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb196ffd700 1 -- 172.21.15.47:0/203085436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980c3970 con 0x7fb180004850 2024-05-08T19:22:54.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb196ffd700 1 -- 172.21.15.47:0/203085436 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb198154d00 con 0x7fb180003a00 2024-05-08T19:22:54.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb196ffd700 1 -- 172.21.15.47:0/203085436 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18000baf0 con 0x7fb1980c1d90 2024-05-08T19:22:54.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb1977fe700 1 --2- 172.21.15.47:0/203085436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb180004850 0x7fb180004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:54.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb197fff700 1 --2- 172.21.15.47:0/203085436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb180003a00 0x7fb180003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:54.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb19c95b700 1 --2- 172.21.15.47:0/203085436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1980c1d90 0x7fb180005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:54.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb1977fe700 1 -- 172.21.15.47:0/203085436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1980c1d90 msgr2=0x7fb180005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:54.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb1977fe700 1 --2- 172.21.15.47:0/203085436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1980c1d90 0x7fb180005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb1977fe700 1 -- 172.21.15.47:0/203085436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb180003a00 msgr2=0x7fb180003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:54.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb1977fe700 1 --2- 172.21.15.47:0/203085436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb180003a00 0x7fb180003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb1977fe700 1 -- 172.21.15.47:0/203085436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1800035b0 con 0x7fb180004850 2024-05-08T19:22:54.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.387+0000 7fb1977fe700 1 --2- 172.21.15.47:0/203085436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb180004850 0x7fb180004cd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009b30 tx=0x7fb180005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2af35d94f6405a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:54.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.388+0000 7fb196ffd700 1 -- 172.21.15.47:0/203085436 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c00e6c0 con 0x7fb180004850 2024-05-08T19:22:54.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.388+0000 7fb196ffd700 1 -- 172.21.15.47:0/203085436 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c00e820 con 0x7fb180004850 2024-05-08T19:22:54.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.388+0000 7fb196ffd700 1 -- 172.21.15.47:0/203085436 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c00eb90 con 0x7fb180004850 2024-05-08T19:22:54.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.388+0000 7fb19e3be700 1 -- 172.21.15.47:0/203085436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb180004850 msgr2=0x7fb180004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:54.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.388+0000 7fb19e3be700 1 --2- 172.21.15.47:0/203085436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb180004850 0x7fb180004cd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009b30 tx=0x7fb180005880 comp rx=0 tx=0).stop 2024-05-08T19:22:54.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.388+0000 7fb19c95b700 1 -- 172.21.15.47:0/203085436 reap_dead start 2024-05-08T19:22:54.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.388+0000 7fb19e3be700 1 -- 172.21.15.47:0/203085436 shutdown_connections 2024-05-08T19:22:54.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.388+0000 7fb19e3be700 1 -- 172.21.15.47:0/203085436 >> 172.21.15.47:0/203085436 conn(0x7fb1980c3c20 msgr2=0x7fb1980c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:54.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.388+0000 7fb19e3be700 1 -- 172.21.15.47:0/203085436 shutdown_connections 2024-05-08T19:22:54.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.388+0000 7fb19e3be700 1 -- 172.21.15.47:0/203085436 wait complete. 2024-05-08T19:22:54.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.389+0000 7fb19e3be700 1 Processor -- start 2024-05-08T19:22:54.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.389+0000 7fb19e3be700 1 -- start start 2024-05-08T19:22:54.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.390+0000 7fb19e3be700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb180004850 0x7fb19814e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:54.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.390+0000 7fb19e3be700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1981453d0 0x7fb19813e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:54.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.390+0000 7fb19e3be700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb198153f90 0x7fb198154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:54.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.390+0000 7fb19e3be700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb198154950 con 0x7fb1981453d0 2024-05-08T19:22:54.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.390+0000 7fb19e3be700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19813e6b0 con 0x7fb180004850 2024-05-08T19:22:54.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.390+0000 7fb19e3be700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1981eb490 con 0x7fb198153f90 2024-05-08T19:22:54.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.390+0000 7fb1977fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1981453d0 0x7fb19813e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:54.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.390+0000 7fb1977fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1981453d0 0x7fb19813e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56348/0 (socket says 172.21.15.47:56348) 2024-05-08T19:22:54.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.390+0000 7fb1977fe700 1 -- 172.21.15.47:0/3797324188 learned_addr learned my addr 172.21.15.47:0/3797324188 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:54.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.390+0000 7fb197fff700 1 --2- 172.21.15.47:0/3797324188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb180004850 0x7fb19814e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:54.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.390+0000 7fb19c95b700 1 --2- 172.21.15.47:0/3797324188 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb198153f90 0x7fb198154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:54.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.391+0000 7fb1977fe700 1 -- 172.21.15.47:0/3797324188 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb198153f90 msgr2=0x7fb198154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:54.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.391+0000 7fb1977fe700 1 --2- 172.21.15.47:0/3797324188 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb198153f90 0x7fb198154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.391+0000 7fb1977fe700 1 -- 172.21.15.47:0/3797324188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb180004850 msgr2=0x7fb19814e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:54.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.391+0000 7fb1977fe700 1 --2- 172.21.15.47:0/3797324188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb180004850 0x7fb19814e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.391+0000 7fb1977fe700 1 -- 172.21.15.47:0/3797324188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1981eb770 con 0x7fb1981453d0 2024-05-08T19:22:54.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.391+0000 7fb1977fe700 1 --2- 172.21.15.47:0/3797324188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1981453d0 0x7fb19813e840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb180004780 tx=0x7fb18c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:54.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.391+0000 7fb194ff9700 1 -- 172.21.15.47:0/3797324188 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c00e6c0 con 0x7fb1981453d0 2024-05-08T19:22:54.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.391+0000 7fb194ff9700 1 -- 172.21.15.47:0/3797324188 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c003ab0 con 0x7fb1981453d0 2024-05-08T19:22:54.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.391+0000 7fb19e3be700 1 -- 172.21.15.47:0/3797324188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19814d5e0 con 0x7fb1981453d0 2024-05-08T19:22:54.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.391+0000 7fb194ff9700 1 -- 172.21.15.47:0/3797324188 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c003e60 con 0x7fb1981453d0 2024-05-08T19:22:54.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.391+0000 7fb19e3be700 1 -- 172.21.15.47:0/3797324188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19814dba0 con 0x7fb1981453d0 2024-05-08T19:22:54.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.392+0000 7fb19e3be700 1 -- 172.21.15.47:0/3797324188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19814df10 con 0x7fb1981453d0 2024-05-08T19:22:54.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.392+0000 7fb194ff9700 1 -- 172.21.15.47:0/3797324188 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb18c013470 con 0x7fb1981453d0 2024-05-08T19:22:54.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.393+0000 7fb194ff9700 1 --2- 172.21.15.47:0/3797324188 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb18406ac90 0x7fb18406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:54.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.393+0000 7fb194ff9700 1 -- 172.21.15.47:0/3797324188 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb18c08b0e0 con 0x7fb1981453d0 2024-05-08T19:22:54.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.393+0000 7fb197fff700 1 --2- 172.21.15.47:0/3797324188 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb18406ac90 0x7fb18406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:54.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.393+0000 7fb197fff700 1 --2- 172.21.15.47:0/3797324188 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb18406ac90 0x7fb18406d150 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb188009ac0 tx=0x7fb188008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:54.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.397+0000 7fb194ff9700 1 -- 172.21.15.47:0/3797324188 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb18c0560e0 con 0x7fb1981453d0 2024-05-08T19:22:54.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.606+0000 7fb19e3be700 1 -- 172.21.15.47:0/3797324188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb198154950 con 0x7fb1981453d0 2024-05-08T19:22:54.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.607+0000 7fb194ff9700 1 -- 172.21.15.47:0/3797324188 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17878 (secure 0 0 0) 0x7fb198154950 con 0x7fb1981453d0 2024-05-08T19:22:54.600 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:54.600 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:22:24.891864+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:22:54.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.610+0000 7fb19e3be700 1 -- 172.21.15.47:0/3797324188 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb18406ac90 msgr2=0x7fb18406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:54.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.610+0000 7fb19e3be700 1 --2- 172.21.15.47:0/3797324188 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb18406ac90 0x7fb18406d150 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb188009ac0 tx=0x7fb188008040 comp rx=0 tx=0).stop 2024-05-08T19:22:54.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.610+0000 7fb19e3be700 1 -- 172.21.15.47:0/3797324188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1981453d0 msgr2=0x7fb19813e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:54.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.610+0000 7fb19e3be700 1 --2- 172.21.15.47:0/3797324188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1981453d0 0x7fb19813e840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb180004780 tx=0x7fb18c0047c0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.610+0000 7fb19e3be700 1 -- 172.21.15.47:0/3797324188 shutdown_connections 2024-05-08T19:22:54.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.610+0000 7fb19e3be700 1 --2- 172.21.15.47:0/3797324188 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb18406ac90 0x7fb18406d150 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.610+0000 7fb19e3be700 1 --2- 172.21.15.47:0/3797324188 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb198153f90 0x7fb198154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.610+0000 7fb19e3be700 1 --2- 172.21.15.47:0/3797324188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb180004850 0x7fb19814e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.610+0000 7fb19e3be700 1 --2- 172.21.15.47:0/3797324188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1981453d0 0x7fb19813e840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.610+0000 7fb19e3be700 1 -- 172.21.15.47:0/3797324188 >> 172.21.15.47:0/3797324188 conn(0x7fb1980c3c20 msgr2=0x7fb1981425c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:54.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.610+0000 7fb19e3be700 1 -- 172.21.15.47:0/3797324188 shutdown_connections 2024-05-08T19:22:54.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.610+0000 7fb19e3be700 1 -- 172.21.15.47:0/3797324188 wait complete. 2024-05-08T19:22:54.615 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T19:22:54.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.749+0000 7fe2a1831700 1 Processor -- start 2024-05-08T19:22:54.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.749+0000 7fe2a1831700 1 -- start start 2024-05-08T19:22:54.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.750+0000 7fe2a1831700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe29c1522b0 0x7fe29c155650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:54.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.750+0000 7fe2a1831700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe29c0c5480 0x7fe29c0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:54.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.750+0000 7fe2a1831700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c0c4eb0 con 0x7fe29c06bd40 2024-05-08T19:22:54.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.750+0000 7fe2a1831700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29c06c870 con 0x7fe29c1522b0 2024-05-08T19:22:54.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.750+0000 7fe2a1831700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c0c8830 con 0x7fe29c0c5480 2024-05-08T19:22:54.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.750+0000 7fe29affd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe29c1522b0 0x7fe29c155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:54.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.750+0000 7fe29b7fe700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe29c0c5480 0x7fe29c0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:54.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.750+0000 7fe29a7fc700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe29c06bd40 0x7fe29c0c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:36432/0 (socket says 172.21.15.47:36432) 2024-05-08T19:22:54.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.750+0000 7fe29a7fc700 1 -- 172.21.15.47:0/3352486062 learned_addr learned my addr 172.21.15.47:0/3352486062 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:54.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.750+0000 7fe29b7fe700 1 -- 172.21.15.47:0/3352486062 >> v2:172.21.15.177:3300/0 conn(0x7fe29c1522b0 msgr2=0x7fe29c155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:54.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.750+0000 7fe29b7fe700 1 --2- 172.21.15.47:0/3352486062 >> v2:172.21.15.177:3300/0 conn(0x7fe29c1522b0 0x7fe29c155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.750+0000 7fe29b7fe700 1 -- 172.21.15.47:0/3352486062 >> v1:172.21.15.177:6789/0 conn(0x7fe29c06bd40 legacy=0x7fe29c0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:54.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.750+0000 7fe29b7fe700 1 -- 172.21.15.47:0/3352486062 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c154b90 con 0x7fe29c0c5480 2024-05-08T19:22:54.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.751+0000 7fe29b7fe700 1 --2- 172.21.15.47:0/3352486062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe29c0c5480 0x7fe29c0c6070 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe294009d90 tx=0x7fe29400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df0683f2cd6af280 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:54.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.751+0000 7fe299ffb700 1 -- 172.21.15.47:0/3352486062 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29400e070 con 0x7fe29c0c5480 2024-05-08T19:22:54.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.751+0000 7fe299ffb700 1 -- 172.21.15.47:0/3352486062 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29400bb20 con 0x7fe29c0c5480 2024-05-08T19:22:54.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.751+0000 7fe299ffb700 1 -- 172.21.15.47:0/3352486062 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe294012430 con 0x7fe29c0c5480 2024-05-08T19:22:54.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.751+0000 7fe2a1831700 1 -- 172.21.15.47:0/3352486062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe29c0c5480 msgr2=0x7fe29c0c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:54.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.751+0000 7fe2a1831700 1 --2- 172.21.15.47:0/3352486062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe29c0c5480 0x7fe29c0c6070 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe294009d90 tx=0x7fe29400b330 comp rx=0 tx=0).stop 2024-05-08T19:22:54.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.751+0000 7fe2a1831700 1 -- 172.21.15.47:0/3352486062 shutdown_connections 2024-05-08T19:22:54.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.751+0000 7fe2a1831700 1 --2- 172.21.15.47:0/3352486062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe29c0c5480 0x7fe29c0c6070 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.751+0000 7fe2a1831700 1 --2- 172.21.15.47:0/3352486062 >> v2:172.21.15.177:3300/0 conn(0x7fe29c1522b0 0x7fe29c155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.751+0000 7fe2a1831700 1 -- 172.21.15.47:0/3352486062 >> 172.21.15.47:0/3352486062 conn(0x7fe29c0abd10 msgr2=0x7fe29c0ac0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:54.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.752+0000 7fe2a1831700 1 -- 172.21.15.47:0/3352486062 shutdown_connections 2024-05-08T19:22:54.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.752+0000 7fe2a1831700 1 -- 172.21.15.47:0/3352486062 wait complete. 2024-05-08T19:22:54.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.753+0000 7fe2a1831700 1 Processor -- start 2024-05-08T19:22:54.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.753+0000 7fe2a1831700 1 -- start start 2024-05-08T19:22:54.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe2a1831700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe29c06bd40 0x7fe29c14dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:54.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe2a1831700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe29c0c5480 0x7fe29c0adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:54.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe2a1831700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe29c1522b0 0x7fe29c1481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:54.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe2a1831700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c14f260 con 0x7fe29c06bd40 2024-05-08T19:22:54.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe2a1831700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c14d000 con 0x7fe29c0c5480 2024-05-08T19:22:54.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe2a1831700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c14d2e0 con 0x7fe29c1522b0 2024-05-08T19:22:54.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe29affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe29c06bd40 0x7fe29c14dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:54.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe29affd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe29c06bd40 0x7fe29c14dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56352/0 (socket says 172.21.15.47:56352) 2024-05-08T19:22:54.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe29affd700 1 -- 172.21.15.47:0/1594787686 learned_addr learned my addr 172.21.15.47:0/1594787686 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:54.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe29b7fe700 1 --2- 172.21.15.47:0/1594787686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe29c1522b0 0x7fe29c1481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:54.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe29a7fc700 1 --2- 172.21.15.47:0/1594787686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe29c0c5480 0x7fe29c0adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:54.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe29affd700 1 -- 172.21.15.47:0/1594787686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe29c1522b0 msgr2=0x7fe29c1481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:54.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe29affd700 1 --2- 172.21.15.47:0/1594787686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe29c1522b0 0x7fe29c1481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe29affd700 1 -- 172.21.15.47:0/1594787686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe29c0c5480 msgr2=0x7fe29c0adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:54.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe29affd700 1 --2- 172.21.15.47:0/1594787686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe29c0c5480 0x7fe29c0adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:54.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe29affd700 1 -- 172.21.15.47:0/1594787686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe294009a70 con 0x7fe29c06bd40 2024-05-08T19:22:54.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe29a7fc700 1 --2- 172.21.15.47:0/1594787686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe29c0c5480 0x7fe29c0adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:54.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe29affd700 1 --2- 172.21.15.47:0/1594787686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe29c06bd40 0x7fe29c14dae0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe29000e870 tx=0x7fe29000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:54.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe283fff700 1 -- 172.21.15.47:0/1594787686 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe290009590 con 0x7fe29c06bd40 2024-05-08T19:22:54.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe283fff700 1 -- 172.21.15.47:0/1594787686 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe290013680 con 0x7fe29c06bd40 2024-05-08T19:22:54.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.754+0000 7fe2a1831700 1 -- 172.21.15.47:0/1594787686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29c14d5c0 con 0x7fe29c06bd40 2024-05-08T19:22:54.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.755+0000 7fe283fff700 1 -- 172.21.15.47:0/1594787686 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900139f0 con 0x7fe29c06bd40 2024-05-08T19:22:54.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.755+0000 7fe2a1831700 1 -- 172.21.15.47:0/1594787686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29c158d80 con 0x7fe29c06bd40 2024-05-08T19:22:54.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.756+0000 7fe2a1831700 1 -- 172.21.15.47:0/1594787686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29c04ec60 con 0x7fe29c06bd40 2024-05-08T19:22:54.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.756+0000 7fe283fff700 1 -- 172.21.15.47:0/1594787686 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe290013b50 con 0x7fe29c06bd40 2024-05-08T19:22:54.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.756+0000 7fe283fff700 1 --2- 172.21.15.47:0/1594787686 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe28806ac90 0x7fe28806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:54.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.757+0000 7fe283fff700 1 -- 172.21.15.47:0/1594787686 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe2900895b0 con 0x7fe29c06bd40 2024-05-08T19:22:54.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.757+0000 7fe29a7fc700 1 --2- 172.21.15.47:0/1594787686 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe28806ac90 0x7fe28806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:54.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.757+0000 7fe29a7fc700 1 --2- 172.21.15.47:0/1594787686 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe28806ac90 0x7fe28806d150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe28c007fd0 tx=0x7fe28c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:54.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:54.761+0000 7fe283fff700 1 -- 172.21.15.47:0/1594787686 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe2900544a0 con 0x7fe29c06bd40 2024-05-08T19:22:54.966 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:22:54.968 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:22:55.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.022+0000 7fe2a1831700 1 -- 172.21.15.47:0/1594787686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe29c0ca000 con 0x7fe29c06bd40 2024-05-08T19:22:55.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.023+0000 7fe283fff700 1 -- 172.21.15.47:0/1594787686 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7fe290057ac0 con 0x7fe29c06bd40 2024-05-08T19:22:55.015 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:22:55.015 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3927983771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3927983771},{"type":"v1","addr":"172.21.15.47:6833","nonce":3927983771}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/201830514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":201830514},{"type":"v1","addr":"172.21.15.47:6835","nonce":201830514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1266001461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1266001461},{"type":"v1","addr":"172.21.15.177:6836","nonce":1266001461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T19:22:20.424727+0000","modified":"2024-05-08T19:22:42.943964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/2990594738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2990594738},{"type":"v1","addr":"172.21.15.177:6837","nonce":2990594738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T19:22:55.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.025+0000 7fe2a1831700 1 -- 172.21.15.47:0/1594787686 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe28806ac90 msgr2=0x7fe28806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:55.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.025+0000 7fe2a1831700 1 --2- 172.21.15.47:0/1594787686 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe28806ac90 0x7fe28806d150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe28c007fd0 tx=0x7fe28c009040 comp rx=0 tx=0).stop 2024-05-08T19:22:55.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.025+0000 7fe2a1831700 1 -- 172.21.15.47:0/1594787686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe29c06bd40 msgr2=0x7fe29c14dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:55.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.025+0000 7fe2a1831700 1 --2- 172.21.15.47:0/1594787686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe29c06bd40 0x7fe29c14dae0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe29000e870 tx=0x7fe29000eb80 comp rx=0 tx=0).stop 2024-05-08T19:22:55.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.025+0000 7fe2a1831700 1 -- 172.21.15.47:0/1594787686 shutdown_connections 2024-05-08T19:22:55.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.025+0000 7fe2a1831700 1 --2- 172.21.15.47:0/1594787686 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe28806ac90 0x7fe28806d150 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.025+0000 7fe2a1831700 1 --2- 172.21.15.47:0/1594787686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe29c06bd40 0x7fe29c14dae0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.025+0000 7fe2a1831700 1 --2- 172.21.15.47:0/1594787686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe29c1522b0 0x7fe29c1481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.025+0000 7fe2a1831700 1 --2- 172.21.15.47:0/1594787686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe29c0c5480 0x7fe29c0adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.025+0000 7fe2a1831700 1 -- 172.21.15.47:0/1594787686 >> 172.21.15.47:0/1594787686 conn(0x7fe29c0abd10 msgr2=0x7fe29c153110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:55.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.025+0000 7fe2a1831700 1 -- 172.21.15.47:0/1594787686 shutdown_connections 2024-05-08T19:22:55.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.025+0000 7fe2a1831700 1 -- 172.21.15.47:0/1594787686 wait complete. 2024-05-08T19:22:55.019 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-05-08T19:22:55.433 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T19:22:20.424727+0000', 'modified': '2024-05-08T19:22:42.943964+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.177:6837/2990594738', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6835', 'nonce': 2990594738}, {'type': 'v1', 'addr': '172.21.15.177:6837', 'nonce': 2990594738}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T19:22:55.433 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T19:22:55.433 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-08T19:22:55.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.576+0000 7fd54b269700 1 Processor -- start 2024-05-08T19:22:55.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.577+0000 7fd54b269700 1 -- start start 2024-05-08T19:22:55.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.577+0000 7fd54b269700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd5440c3640 0x7fd54406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.577+0000 7fd54b269700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd544154a10 0x7fd544154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.577+0000 7fd54b269700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5440c1b20 con 0x7fd54406fe60 2024-05-08T19:22:55.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.577+0000 7fd54b269700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5440c2e00 con 0x7fd5440c3640 2024-05-08T19:22:55.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.577+0000 7fd54b269700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5440c1e00 con 0x7fd544154a10 2024-05-08T19:22:55.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.578+0000 7fd548804700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd5440c3640 0x7fd54406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.578+0000 7fd548804700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd5440c3640 0x7fd54406b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56356/0 (socket says 172.21.15.47:56356) 2024-05-08T19:22:55.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.578+0000 7fd548804700 1 -- 172.21.15.47:0/2387384864 learned_addr learned my addr 172.21.15.47:0/2387384864 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:55.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.578+0000 7fd549806700 1 --2- 172.21.15.47:0/2387384864 >> v2:172.21.15.177:3300/0 conn(0x7fd544154a10 0x7fd544154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.578+0000 7fd548804700 1 -- 172.21.15.47:0/2387384864 >> v2:172.21.15.177:3300/0 conn(0x7fd544154a10 msgr2=0x7fd544154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:55.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.578+0000 7fd548804700 1 --2- 172.21.15.47:0/2387384864 >> v2:172.21.15.177:3300/0 conn(0x7fd544154a10 0x7fd544154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.578+0000 7fd548804700 1 -- 172.21.15.47:0/2387384864 >> v1:172.21.15.177:6789/0 conn(0x7fd54406fe60 legacy=0x7fd54406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:55.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.578+0000 7fd548804700 1 -- 172.21.15.47:0/2387384864 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5440a8890 con 0x7fd5440c3640 2024-05-08T19:22:55.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.578+0000 7fd548804700 1 --2- 172.21.15.47:0/2387384864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5440c3640 0x7fd54406b0d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd5340098f0 tx=0x7fd534009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7057340998d7a2b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:55.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.578+0000 7fd53bfff700 1 -- 172.21.15.47:0/2387384864 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534011830 con 0x7fd5440c3640 2024-05-08T19:22:55.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.578+0000 7fd53bfff700 1 -- 172.21.15.47:0/2387384864 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534011990 con 0x7fd5440c3640 2024-05-08T19:22:55.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.578+0000 7fd53bfff700 1 -- 172.21.15.47:0/2387384864 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534011d20 con 0x7fd5440c3640 2024-05-08T19:22:55.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.579+0000 7fd54b269700 1 -- 172.21.15.47:0/2387384864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5440c3640 msgr2=0x7fd54406b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:55.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.579+0000 7fd54b269700 1 --2- 172.21.15.47:0/2387384864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5440c3640 0x7fd54406b0d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd5340098f0 tx=0x7fd534009c00 comp rx=0 tx=0).stop 2024-05-08T19:22:55.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.579+0000 7fd54b269700 1 -- 172.21.15.47:0/2387384864 shutdown_connections 2024-05-08T19:22:55.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.579+0000 7fd54b269700 1 --2- 172.21.15.47:0/2387384864 >> v2:172.21.15.177:3300/0 conn(0x7fd544154a10 0x7fd544154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.579+0000 7fd54b269700 1 --2- 172.21.15.47:0/2387384864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5440c3640 0x7fd54406b0d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.579+0000 7fd54b269700 1 -- 172.21.15.47:0/2387384864 >> 172.21.15.47:0/2387384864 conn(0x7fd5440c3c20 msgr2=0x7fd5440c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:55.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.579+0000 7fd54b269700 1 -- 172.21.15.47:0/2387384864 shutdown_connections 2024-05-08T19:22:55.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.579+0000 7fd54b269700 1 -- 172.21.15.47:0/2387384864 wait complete. 2024-05-08T19:22:55.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.580+0000 7fd54b269700 1 Processor -- start 2024-05-08T19:22:55.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.580+0000 7fd54b269700 1 -- start start 2024-05-08T19:22:55.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.581+0000 7fd54b269700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54406fe60 0x7fd5440ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.581+0000 7fd54b269700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5440c3640 0x7fd544153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.581+0000 7fd54b269700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd544154a10 0x7fd5441426f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.581+0000 7fd54b269700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5441e7dd0 con 0x7fd54406fe60 2024-05-08T19:22:55.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.581+0000 7fd54b269700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5441ed830 con 0x7fd5440c3640 2024-05-08T19:22:55.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.581+0000 7fd54b269700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5441edad0 con 0x7fd544154a10 2024-05-08T19:22:55.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.581+0000 7fd549005700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54406fe60 0x7fd5440ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.581+0000 7fd549005700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54406fe60 0x7fd5440ab930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56370/0 (socket says 172.21.15.47:56370) 2024-05-08T19:22:55.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.581+0000 7fd549005700 1 -- 172.21.15.47:0/1739917802 learned_addr learned my addr 172.21.15.47:0/1739917802 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:55.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.581+0000 7fd549806700 1 --2- 172.21.15.47:0/1739917802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd544154a10 0x7fd5441426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.581+0000 7fd548804700 1 --2- 172.21.15.47:0/1739917802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5440c3640 0x7fd544153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.582+0000 7fd549005700 1 -- 172.21.15.47:0/1739917802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd544154a10 msgr2=0x7fd5441426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:55.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.582+0000 7fd549005700 1 --2- 172.21.15.47:0/1739917802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd544154a10 0x7fd5441426f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.582+0000 7fd549005700 1 -- 172.21.15.47:0/1739917802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5440c3640 msgr2=0x7fd544153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:55.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.582+0000 7fd549005700 1 --2- 172.21.15.47:0/1739917802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5440c3640 0x7fd544153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.582+0000 7fd549005700 1 -- 172.21.15.47:0/1739917802 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534009550 con 0x7fd54406fe60 2024-05-08T19:22:55.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.582+0000 7fd549806700 1 --2- 172.21.15.47:0/1739917802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd544154a10 0x7fd5441426f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:22:55.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.582+0000 7fd549005700 1 --2- 172.21.15.47:0/1739917802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54406fe60 0x7fd5440ab930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd54000c450 tx=0x7fd54000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:55.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.582+0000 7fd539ffb700 1 -- 172.21.15.47:0/1739917802 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400052d0 con 0x7fd54406fe60 2024-05-08T19:22:55.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.582+0000 7fd539ffb700 1 -- 172.21.15.47:0/1739917802 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd540005430 con 0x7fd54406fe60 2024-05-08T19:22:55.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.582+0000 7fd54b269700 1 -- 172.21.15.47:0/1739917802 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5441eddb0 con 0x7fd54406fe60 2024-05-08T19:22:55.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.582+0000 7fd539ffb700 1 -- 172.21.15.47:0/1739917802 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400038c0 con 0x7fd54406fe60 2024-05-08T19:22:55.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.582+0000 7fd54b269700 1 -- 172.21.15.47:0/1739917802 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5441ee370 con 0x7fd54406fe60 2024-05-08T19:22:55.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.584+0000 7fd539ffb700 1 -- 172.21.15.47:0/1739917802 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd540003a20 con 0x7fd54406fe60 2024-05-08T19:22:55.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.584+0000 7fd539ffb700 1 --2- 172.21.15.47:0/1739917802 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd52806ac90 0x7fd52806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.584+0000 7fd539ffb700 1 -- 172.21.15.47:0/1739917802 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd540088a90 con 0x7fd54406fe60 2024-05-08T19:22:55.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.585+0000 7fd548804700 1 --2- 172.21.15.47:0/1739917802 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd52806ac90 0x7fd52806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.585+0000 7fd548804700 1 --2- 172.21.15.47:0/1739917802 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd52806ac90 0x7fd52806d150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd534009130 tx=0x7fd534008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:55.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.586+0000 7fd557423b80 1 Processor -- start 2024-05-08T19:22:55.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.586+0000 7fd557423b80 1 -- start start 2024-05-08T19:22:55.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd557423b80 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cd980 0x5568c010b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd557423b80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cf010 0x5568c00c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd557423b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cdd60 0x5568c00ebc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd557423b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c0024100 con 0x5568c00cdd60 2024-05-08T19:22:55.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd557423b80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c0021ac0 con 0x5568c00cf010 2024-05-08T19:22:55.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd557423b80 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568c001d3b0 con 0x5568c00cd980 2024-05-08T19:22:55.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd549806700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cdd60 0x5568c00ebc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd549806700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cdd60 0x5568c00ebc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56386/0 (socket says 172.21.15.47:56386) 2024-05-08T19:22:55.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd549806700 1 -- 172.21.15.47:0/2113049141 learned_addr learned my addr 172.21.15.47:0/2113049141 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:55.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd549005700 1 --2- 172.21.15.47:0/2113049141 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cd980 0x5568c010b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd548804700 1 --2- 172.21.15.47:0/2113049141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cf010 0x5568c00c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd549806700 1 -- 172.21.15.47:0/2113049141 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cd980 msgr2=0x5568c010b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:55.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd549806700 1 --2- 172.21.15.47:0/2113049141 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cd980 0x5568c010b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd549806700 1 -- 172.21.15.47:0/2113049141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cf010 msgr2=0x5568c00c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:55.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd549806700 1 --2- 172.21.15.47:0/2113049141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cf010 0x5568c00c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.587+0000 7fd549806700 1 -- 172.21.15.47:0/2113049141 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568bfe9e360 con 0x5568c00cdd60 2024-05-08T19:22:55.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.588+0000 7fd549806700 1 --2- 172.21.15.47:0/2113049141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cdd60 0x5568c00ebc20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd53c007680 tx=0x7fd53c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561c5a04e643f35f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:55.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.588+0000 7fd52effd700 1 -- 172.21.15.47:0/2113049141 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00e030 con 0x5568c00cdd60 2024-05-08T19:22:55.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.588+0000 7fd52effd700 1 -- 172.21.15.47:0/2113049141 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c0153f0 con 0x5568c00cdd60 2024-05-08T19:22:55.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.588+0000 7fd52effd700 1 -- 172.21.15.47:0/2113049141 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c015780 con 0x5568c00cdd60 2024-05-08T19:22:55.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.588+0000 7fd557423b80 1 -- 172.21.15.47:0/2113049141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cdd60 msgr2=0x5568c00ebc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:55.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.588+0000 7fd557423b80 1 --2- 172.21.15.47:0/2113049141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cdd60 0x5568c00ebc20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd53c007680 tx=0x7fd53c009750 comp rx=0 tx=0).stop 2024-05-08T19:22:55.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.588+0000 7fd557423b80 1 -- 172.21.15.47:0/2113049141 shutdown_connections 2024-05-08T19:22:55.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.588+0000 7fd557423b80 1 --2- 172.21.15.47:0/2113049141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cdd60 0x5568c00ebc20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.588+0000 7fd557423b80 1 --2- 172.21.15.47:0/2113049141 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cd980 0x5568c010b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.588+0000 7fd557423b80 1 --2- 172.21.15.47:0/2113049141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cf010 0x5568c00c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.588+0000 7fd557423b80 1 -- 172.21.15.47:0/2113049141 >> 172.21.15.47:0/2113049141 conn(0x5568c002b1c0 msgr2=0x5568c00cb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:55.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.588+0000 7fd557423b80 1 -- 172.21.15.47:0/2113049141 shutdown_connections 2024-05-08T19:22:55.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.588+0000 7fd557423b80 1 -- 172.21.15.47:0/2113049141 wait complete. 2024-05-08T19:22:55.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.589+0000 7fd557423b80 1 -- start start 2024-05-08T19:22:55.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.589+0000 7fd557423b80 1 Processor -- start 2024-05-08T19:22:55.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd557423b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cd980 0x5568c0119140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd557423b80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cdd60 0x5568c0101290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd557423b80 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cf010 0x5568c01089f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd557423b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568bffb9510 con 0x5568c00cd980 2024-05-08T19:22:55.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd557423b80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568bffb91b0 con 0x5568c00cdd60 2024-05-08T19:22:55.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd557423b80 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568bfea0650 con 0x5568c00cf010 2024-05-08T19:22:55.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd557423b80 10 client.0 _ll_register_callbacks cb 0x5568bffc2ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T19:22:55.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd549005700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cd980 0x5568c0119140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd549005700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cd980 0x5568c0119140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56390/0 (socket says 172.21.15.47:56390) 2024-05-08T19:22:55.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd549005700 1 -- 172.21.15.47:0/3624060445 learned_addr learned my addr 172.21.15.47:0/3624060445 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:55.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd549806700 1 --2- 172.21.15.47:0/3624060445 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cf010 0x5568c01089f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd548804700 1 --2- 172.21.15.47:0/3624060445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cdd60 0x5568c0101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd549005700 1 -- 172.21.15.47:0/3624060445 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cf010 msgr2=0x5568c01089f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:55.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd549005700 1 --2- 172.21.15.47:0/3624060445 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cf010 0x5568c01089f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd549005700 1 -- 172.21.15.47:0/3624060445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cdd60 msgr2=0x5568c0101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd549005700 1 --2- 172.21.15.47:0/3624060445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cdd60 0x5568c0101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd549005700 1 -- 172.21.15.47:0/3624060445 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c007330 con 0x5568c00cd980 2024-05-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd549005700 1 --2- 172.21.15.47:0/3624060445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cd980 0x5568c0119140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd5400572a0 tx=0x7fd540057d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f9a384a6d76b75 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.590+0000 7fd523fff700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.591+0000 7fd523fff700 1 -- 172.21.15.47:0/3624060445 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd540056c90 con 0x5568c00cd980 2024-05-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.591+0000 7fd523fff700 1 -- 172.21.15.47:0/3624060445 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd54005b1b0 con 0x5568c00cd980 2024-05-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.591+0000 7fd557423b80 1 -- 172.21.15.47:0/3624060445 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568bff76220 con 0x5568c00cd980 2024-05-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.591+0000 7fd523fff700 1 -- 172.21.15.47:0/3624060445 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd54005b3d0 con 0x5568c00cd980 2024-05-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.591+0000 7fd557423b80 10 client.4815 fetch_fsmap learned FSMap version 9 2024-05-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.591+0000 7fd557423b80 1 -- 172.21.15.47:0/3624060445 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5568bfe4ab10 con 0x5568c00cd980 2024-05-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.591+0000 7fd523fff700 1 -- 172.21.15.47:0/3624060445 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568bff76220 con 0x5568c00cd980 2024-05-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.591+0000 7fd523fff700 1 -- 172.21.15.47:0/3624060445 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fd54005f500 con 0x5568c00cd980 2024-05-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.591+0000 7fd557423b80 10 client.4815 fetch_fsmap finished waiting for FSMap version 9 2024-05-08T19:22:55.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.591+0000 7fd557423b80 10 client.4815 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-08T19:22:55.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.591+0000 7fd557423b80 20 client.4815 populate_metadata read hostname 'smithi047' 2024-05-08T19:22:55.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.591+0000 7fd557423b80 1 --2- 172.21.15.47:0/3624060445 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x5568c0106e70 0x5568c011c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.591+0000 7fd557423b80 4 client.4815 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T19:22:55.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.591+0000 7fd557423b80 1 -- 172.21.15.47:0/3624060445 --> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568c009c790 con 0x5568c0106e70 2024-05-08T19:22:55.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.591+0000 7fd548804700 1 --2- 172.21.15.47:0/3624060445 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x5568c0106e70 0x5568c011c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.592+0000 7fd523fff700 10 client.4815 ms_handle_connect on v2:172.21.15.177:6835/2990594738 2024-05-08T19:22:55.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.592+0000 7fd548804700 1 --2- 172.21.15.47:0/3624060445 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x5568c0106e70 0x5568c011c6b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e514d91d6324567f server_cookie=7e7c75cd4043ffe4 in_seq=0 out_seq=0 2024-05-08T19:22:55.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.592+0000 7fd523fff700 1 -- 172.21.15.47:0/3624060445 <== mds.0 v2:172.21.15.177:6835/2990594738 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5568c009c790 con 0x5568c0106e70 2024-05-08T19:22:55.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.592+0000 7fd523fff700 10 client.4815 handle_command_reply: tid=0 2024-05-08T19:22:55.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.592+0000 7fd557423b80 1 client.4815 shutdown 2024-05-08T19:22:55.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.593+0000 7fd557423b80 1 -- 172.21.15.47:0/3624060445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cd980 msgr2=0x5568c0119140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:55.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.593+0000 7fd557423b80 1 --2- 172.21.15.47:0/3624060445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cd980 0x5568c0119140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd5400572a0 tx=0x7fd540057d50 comp rx=0 tx=0).stop 2024-05-08T19:22:55.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.593+0000 7fd557423b80 1 -- 172.21.15.47:0/3624060445 shutdown_connections 2024-05-08T19:22:55.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.593+0000 7fd557423b80 1 --2- 172.21.15.47:0/3624060445 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x5568c0106e70 0x5568c011c6b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.593+0000 7fd557423b80 1 --2- 172.21.15.47:0/3624060445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cd980 0x5568c0119140 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.593+0000 7fd557423b80 1 --2- 172.21.15.47:0/3624060445 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cf010 0x5568c01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.593+0000 7fd523fff700 0 client.4815 ms_handle_reset on v2:172.21.15.177:6835/2990594738 2024-05-08T19:22:55.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.593+0000 7fd557423b80 1 --2- 172.21.15.47:0/3624060445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cdd60 0x5568c0101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.593+0000 7fd557423b80 1 -- 172.21.15.47:0/3624060445 >> 172.21.15.47:0/3624060445 conn(0x5568c002b1c0 msgr2=0x5568c010d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:55.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.593+0000 7fd557423b80 1 -- 172.21.15.47:0/3624060445 shutdown_connections 2024-05-08T19:22:55.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.593+0000 7fd557423b80 1 -- 172.21.15.47:0/3624060445 wait complete. 2024-05-08T19:22:55.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.593+0000 7fd557423b80 20 client.4815 trim_cache size 0 max 16384 2024-05-08T19:22:55.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.611+0000 7fd557423b80 1 Processor -- start 2024-05-08T19:22:55.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.611+0000 7fd557423b80 1 -- start start 2024-05-08T19:22:55.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd557423b80 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cd980 0x5568c010d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd557423b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cdd60 0x5568c0103ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd557423b80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cf010 0x5568c0104020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd557423b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c00c78d0 con 0x5568c00cdd60 2024-05-08T19:22:55.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd557423b80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c00ea710 con 0x5568c00cf010 2024-05-08T19:22:55.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd557423b80 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568c00ea110 con 0x5568c00cd980 2024-05-08T19:22:55.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd548804700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cdd60 0x5568c0103ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd548804700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cdd60 0x5568c0103ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56406/0 (socket says 172.21.15.47:56406) 2024-05-08T19:22:55.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd548804700 1 -- 172.21.15.47:0/2525610867 learned_addr learned my addr 172.21.15.47:0/2525610867 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:55.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd549806700 1 --2- 172.21.15.47:0/2525610867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cf010 0x5568c0104020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd549005700 1 --2- 172.21.15.47:0/2525610867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cd980 0x5568c010d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd548804700 1 -- 172.21.15.47:0/2525610867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cd980 msgr2=0x5568c010d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:55.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd548804700 1 --2- 172.21.15.47:0/2525610867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cd980 0x5568c010d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd548804700 1 -- 172.21.15.47:0/2525610867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cf010 msgr2=0x5568c0104020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:55.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd548804700 1 --2- 172.21.15.47:0/2525610867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cf010 0x5568c0104020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd548804700 1 -- 172.21.15.47:0/2525610867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c00c80d0 con 0x5568c00cdd60 2024-05-08T19:22:55.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd548804700 1 --2- 172.21.15.47:0/2525610867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cdd60 0x5568c0103ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd544074170 tx=0x7fd534010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c828d7f54254299f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:55.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.612+0000 7fd52f7fe700 1 -- 172.21.15.47:0/2525610867 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53402f040 con 0x5568c00cdd60 2024-05-08T19:22:55.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.613+0000 7fd52f7fe700 1 -- 172.21.15.47:0/2525610867 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534003a80 con 0x5568c00cdd60 2024-05-08T19:22:55.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.613+0000 7fd52f7fe700 1 -- 172.21.15.47:0/2525610867 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534020070 con 0x5568c00cdd60 2024-05-08T19:22:55.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.613+0000 7fd557423b80 1 -- 172.21.15.47:0/2525610867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cdd60 msgr2=0x5568c0103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:55.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.613+0000 7fd557423b80 1 --2- 172.21.15.47:0/2525610867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cdd60 0x5568c0103ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd544074170 tx=0x7fd534010000 comp rx=0 tx=0).stop 2024-05-08T19:22:55.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.613+0000 7fd557423b80 1 -- 172.21.15.47:0/2525610867 shutdown_connections 2024-05-08T19:22:55.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.613+0000 7fd557423b80 1 --2- 172.21.15.47:0/2525610867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cf010 0x5568c0104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.613+0000 7fd557423b80 1 --2- 172.21.15.47:0/2525610867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cd980 0x5568c010d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.613+0000 7fd557423b80 1 --2- 172.21.15.47:0/2525610867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cdd60 0x5568c0103ae0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.613+0000 7fd557423b80 1 -- 172.21.15.47:0/2525610867 >> 172.21.15.47:0/2525610867 conn(0x5568c002b1c0 msgr2=0x5568c01163c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:55.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.613+0000 7fd557423b80 1 -- 172.21.15.47:0/2525610867 shutdown_connections 2024-05-08T19:22:55.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.613+0000 7fd557423b80 1 -- 172.21.15.47:0/2525610867 wait complete. 2024-05-08T19:22:55.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.614+0000 7fd557423b80 1 -- start start 2024-05-08T19:22:55.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.614+0000 7fd557423b80 1 Processor -- start 2024-05-08T19:22:55.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd557423b80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cd980 0x5568c0103cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd557423b80 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cdd60 0x5568c01734f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd557423b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cf010 0x5568c01704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd557423b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c01730a0 con 0x5568c00cf010 2024-05-08T19:22:55.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd557423b80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c00eb4d0 con 0x5568c00cd980 2024-05-08T19:22:55.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd557423b80 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568c010b950 con 0x5568c00cdd60 2024-05-08T19:22:55.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd557423b80 10 client.0 _ll_register_callbacks cb 0x7fd5400570e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T19:22:55.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd549806700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cf010 0x5568c01704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd549806700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cf010 0x5568c01704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56412/0 (socket says 172.21.15.47:56412) 2024-05-08T19:22:55.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd549806700 1 -- 172.21.15.47:0/414765248 learned_addr learned my addr 172.21.15.47:0/414765248 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:55.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd548804700 1 --2- 172.21.15.47:0/414765248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cdd60 0x5568c01734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd549005700 1 --2- 172.21.15.47:0/414765248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cd980 0x5568c0103cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd549806700 1 -- 172.21.15.47:0/414765248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cdd60 msgr2=0x5568c01734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:55.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd549806700 1 --2- 172.21.15.47:0/414765248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cdd60 0x5568c01734f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd549806700 1 -- 172.21.15.47:0/414765248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cd980 msgr2=0x5568c0103cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:55.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd549806700 1 --2- 172.21.15.47:0/414765248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cd980 0x5568c0103cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd549806700 1 -- 172.21.15.47:0/414765248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5440a8890 con 0x5568c00cf010 2024-05-08T19:22:55.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd549806700 1 --2- 172.21.15.47:0/414765248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cf010 0x5568c01704c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd53c007620 tx=0x7fd53c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c03b3de5e1e2e63 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:55.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd523fff700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-08T19:22:55.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd523fff700 1 -- 172.21.15.47:0/414765248 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c024070 con 0x5568c00cf010 2024-05-08T19:22:55.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd557423b80 1 -- 172.21.15.47:0/414765248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd53c0153f0 con 0x5568c00cf010 2024-05-08T19:22:55.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.615+0000 7fd523fff700 1 -- 172.21.15.47:0/414765248 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd53c00f070 con 0x5568c00cf010 2024-05-08T19:22:55.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.616+0000 7fd523fff700 1 -- 172.21.15.47:0/414765248 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd53c00e040 con 0x5568c00cf010 2024-05-08T19:22:55.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.616+0000 7fd557423b80 10 client.4821 fetch_fsmap learned FSMap version 9 2024-05-08T19:22:55.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.616+0000 7fd557423b80 1 -- 172.21.15.47:0/414765248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5568bffe3510 con 0x5568c00cf010 2024-05-08T19:22:55.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.616+0000 7fd523fff700 1 -- 172.21.15.47:0/414765248 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c0153f0 con 0x5568c00cf010 2024-05-08T19:22:55.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.616+0000 7fd523fff700 1 -- 172.21.15.47:0/414765248 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fd53c014070 con 0x5568c00cf010 2024-05-08T19:22:55.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.616+0000 7fd557423b80 10 client.4821 fetch_fsmap finished waiting for FSMap version 9 2024-05-08T19:22:55.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.616+0000 7fd557423b80 10 client.4821 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-08T19:22:55.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.616+0000 7fd557423b80 20 client.4821 populate_metadata read hostname 'smithi047' 2024-05-08T19:22:55.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.616+0000 7fd557423b80 1 --2- 172.21.15.47:0/414765248 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x5568c0170a00 0x5568c00febf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:55.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.616+0000 7fd557423b80 4 client.4821 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T19:22:55.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.616+0000 7fd557423b80 1 -- 172.21.15.47:0/414765248 --> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5568c0015e70 con 0x5568c0170a00 2024-05-08T19:22:55.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.616+0000 7fd549005700 1 --2- 172.21.15.47:0/414765248 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x5568c0170a00 0x5568c00febf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:55.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.616+0000 7fd523fff700 10 client.4821 ms_handle_connect on v2:172.21.15.177:6835/2990594738 2024-05-08T19:22:55.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.616+0000 7fd549005700 1 --2- 172.21.15.47:0/414765248 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x5568c0170a00 0x5568c00febf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=352a3bf37ae3a8b8 server_cookie=6dea7667c05ee968 in_seq=0 out_seq=0 2024-05-08T19:22:55.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.617+0000 7fd523fff700 1 -- 172.21.15.47:0/414765248 <== mds.0 v2:172.21.15.177:6835/2990594738 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5568c0015e70 con 0x5568c0170a00 2024-05-08T19:22:55.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.617+0000 7fd523fff700 10 client.4821 handle_command_reply: tid=0 2024-05-08T19:22:55.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.617+0000 7fd557423b80 1 client.4821 shutdown 2024-05-08T19:22:55.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.617+0000 7fd557423b80 1 -- 172.21.15.47:0/414765248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cf010 msgr2=0x5568c01704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:55.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.617+0000 7fd557423b80 1 --2- 172.21.15.47:0/414765248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cf010 0x5568c01704c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd53c007620 tx=0x7fd53c004b40 comp rx=0 tx=0).stop 2024-05-08T19:22:55.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.617+0000 7fd557423b80 1 -- 172.21.15.47:0/414765248 shutdown_connections 2024-05-08T19:22:55.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.617+0000 7fd557423b80 1 --2- 172.21.15.47:0/414765248 >> [v2:172.21.15.177:6835/2990594738,v1:172.21.15.177:6837/2990594738] conn(0x5568c0170a00 0x5568c00febf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.617+0000 7fd557423b80 1 --2- 172.21.15.47:0/414765248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568c00cf010 0x5568c01704c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.617+0000 7fd523fff700 0 client.4821 ms_handle_reset on v2:172.21.15.177:6835/2990594738 2024-05-08T19:22:55.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.617+0000 7fd557423b80 1 --2- 172.21.15.47:0/414765248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568c00cd980 0x5568c0103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.617+0000 7fd557423b80 1 --2- 172.21.15.47:0/414765248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568c00cdd60 0x5568c01734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.617+0000 7fd557423b80 1 -- 172.21.15.47:0/414765248 >> 172.21.15.47:0/414765248 conn(0x5568c002b1c0 msgr2=0x5568c012bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:55.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.617+0000 7fd557423b80 1 -- 172.21.15.47:0/414765248 shutdown_connections 2024-05-08T19:22:55.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.617+0000 7fd557423b80 1 -- 172.21.15.47:0/414765248 wait complete. 2024-05-08T19:22:55.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.617+0000 7fd557423b80 20 client.4821 trim_cache size 0 max 16384 2024-05-08T19:22:55.627 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-08T19:22:55.627 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e1596084-137b-43d3-b844-c72a72dda1f6", 2024-05-08T19:22:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-05-08T19:22:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4282, 2024-05-08T19:22:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-08T19:22:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-08T19:22:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-08T19:22:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 35.190986617, 2024-05-08T19:22:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 9, 2024-05-08T19:22:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 24, 2024-05-08T19:22:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 24, 2024-05-08T19:22:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 39.647332464000002 2024-05-08T19:22:55.629 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-08T19:22:55.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.618+0000 7fd54b269700 1 -- 172.21.15.47:0/1739917802 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd52806ac90 msgr2=0x7fd52806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:55.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.618+0000 7fd54b269700 1 --2- 172.21.15.47:0/1739917802 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd52806ac90 0x7fd52806d150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd534009130 tx=0x7fd534008030 comp rx=0 tx=0).stop 2024-05-08T19:22:55.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.618+0000 7fd54b269700 1 -- 172.21.15.47:0/1739917802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54406fe60 msgr2=0x7fd5440ab930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:55.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.618+0000 7fd54b269700 1 --2- 172.21.15.47:0/1739917802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54406fe60 0x7fd5440ab930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd54000c450 tx=0x7fd54000c760 comp rx=0 tx=0).stop 2024-05-08T19:22:55.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.618+0000 7fd54b269700 1 -- 172.21.15.47:0/1739917802 shutdown_connections 2024-05-08T19:22:55.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.618+0000 7fd54b269700 1 --2- 172.21.15.47:0/1739917802 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fd52806ac90 0x7fd52806d150 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.618+0000 7fd54b269700 1 --2- 172.21.15.47:0/1739917802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd54406fe60 0x7fd5440ab930 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.618+0000 7fd54b269700 1 --2- 172.21.15.47:0/1739917802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd544154a10 0x7fd5441426f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.618+0000 7fd54b269700 1 --2- 172.21.15.47:0/1739917802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5440c3640 0x7fd544153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:55.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.618+0000 7fd54b269700 1 -- 172.21.15.47:0/1739917802 >> 172.21.15.47:0/1739917802 conn(0x7fd5440c3c20 msgr2=0x7fd544152ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:55.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.618+0000 7fd54b269700 1 -- 172.21.15.47:0/1739917802 shutdown_connections 2024-05-08T19:22:55.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:55.618+0000 7fd54b269700 1 -- 172.21.15.47:0/1739917802 wait complete. 2024-05-08T19:22:55.632 INFO:teuthology.run_tasks:Running task sequential... 2024-05-08T19:22:55.644 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-08T19:22:55.644 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-08T19:22:55.645 INFO:teuthology.task.print:Enabling mgr modules 2024-05-08T19:22:55.645 INFO:teuthology.run_tasks:Running task parallel... 2024-05-08T19:22:55.703 INFO:teuthology.task.parallel:starting parallel... 2024-05-08T19:22:55.704 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-05-08T19:22:55.704 INFO:teuthology.task.sequential:In sequential, running task ceph-fuse... 2024-05-08T19:22:55.706 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-08T19:22:55.707 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-08T19:22:55.707 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-08T19:22:55.707 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T19:22:55.707 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T19:22:55.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:55.708 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-08T19:22:55.708 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-05-08T19:22:55.709 INFO:teuthology.task.sequential:In sequential, running task kclient... 2024-05-08T19:22:55.735 INFO:tasks.kclient:Mounting kernel clients... 2024-05-08T19:22:55.735 INFO:tasks.kclient:config is {'client.1': {}} 2024-05-08T19:22:55.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:55.735 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-05-08T19:22:55.754 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-08T19:22:55.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:55.755 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-08T19:22:55.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:55.758 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-05-08T19:22:55.833 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2024-05-08T19:22:55.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T19:22:55.835 INFO:tasks.kclient:client.1 config is {} 2024-05-08T19:22:55.835 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T19:22:55.835 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-08T19:22:55.836 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T19:22:55.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:55.838 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-05-08T19:22:55.940 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-08T19:22:55.940 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T19:22:56.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.017+0000 7fa354f58700 1 Processor -- start 2024-05-08T19:22:56.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.017+0000 7fa354f58700 1 -- start start 2024-05-08T19:22:56.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.018+0000 7fa354f58700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa350152080 0x7fa35006c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:56.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.018+0000 7fa354f58700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa35014e7b0 0x7fa35014ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:56.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.018+0000 7fa354f58700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa350070dd0 con 0x7fa350071c00 2024-05-08T19:22:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.018+0000 7fa354f58700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3500c1160 con 0x7fa350152080 2024-05-08T19:22:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.018+0000 7fa354f58700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3500c0e80 con 0x7fa35014e7b0 2024-05-08T19:22:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.018+0000 7fa34e59c700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa350071c00 0x7fa350071260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60032/0 (socket says 172.21.15.47:60032) 2024-05-08T19:22:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.018+0000 7fa34e59c700 1 -- 172.21.15.47:0/3161431955 learned_addr learned my addr 172.21.15.47:0/3161431955 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.019+0000 7fa34ed9d700 1 --2- 172.21.15.47:0/3161431955 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa35014e7b0 0x7fa35014ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.019+0000 7fa34dd9b700 1 --2- 172.21.15.47:0/3161431955 >> v2:172.21.15.177:3300/0 conn(0x7fa350152080 0x7fa35006c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.019+0000 7fa34d59a700 1 -- 172.21.15.47:0/3161431955 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701147052 0 0) 0x7fa350070dd0 con 0x7fa350071c00 2024-05-08T19:22:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.019+0000 7fa34d59a700 1 -- 172.21.15.47:0/3161431955 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3380035b0 con 0x7fa350071c00 2024-05-08T19:22:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.019+0000 7fa34ed9d700 1 -- 172.21.15.47:0/3161431955 >> v2:172.21.15.177:3300/0 conn(0x7fa350152080 msgr2=0x7fa35006c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:22:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.019+0000 7fa34ed9d700 1 --2- 172.21.15.47:0/3161431955 >> v2:172.21.15.177:3300/0 conn(0x7fa350152080 0x7fa35006c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.019+0000 7fa34ed9d700 1 -- 172.21.15.47:0/3161431955 >> v1:172.21.15.47:6789/0 conn(0x7fa350071c00 legacy=0x7fa350071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.019+0000 7fa34ed9d700 1 -- 172.21.15.47:0/3161431955 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa350070780 con 0x7fa35014e7b0 2024-05-08T19:22:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.019+0000 7fa34dd9b700 1 --2- 172.21.15.47:0/3161431955 >> v2:172.21.15.177:3300/0 conn(0x7fa350152080 0x7fa35006c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:22:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.019+0000 7fa34ed9d700 1 --2- 172.21.15.47:0/3161431955 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa35014e7b0 0x7fa35014ebc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa348009d90 tx=0x7fa34800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bb35cbfea4fbfa0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:56.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.019+0000 7fa34d59a700 1 -- 172.21.15.47:0/3161431955 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34800e070 con 0x7fa35014e7b0 2024-05-08T19:22:56.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.019+0000 7fa34d59a700 1 -- 172.21.15.47:0/3161431955 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34800bb20 con 0x7fa35014e7b0 2024-05-08T19:22:56.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.019+0000 7fa34d59a700 1 -- 172.21.15.47:0/3161431955 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348012430 con 0x7fa35014e7b0 2024-05-08T19:22:56.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.020+0000 7fa354f58700 1 -- 172.21.15.47:0/3161431955 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa35014e7b0 msgr2=0x7fa35014ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:56.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.020+0000 7fa354f58700 1 --2- 172.21.15.47:0/3161431955 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa35014e7b0 0x7fa35014ebc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa348009d90 tx=0x7fa34800b330 comp rx=0 tx=0).stop 2024-05-08T19:22:56.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.020+0000 7fa354f58700 1 -- 172.21.15.47:0/3161431955 shutdown_connections 2024-05-08T19:22:56.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.020+0000 7fa354f58700 1 --2- 172.21.15.47:0/3161431955 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa35014e7b0 0x7fa35014ebc0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.020+0000 7fa354f58700 1 --2- 172.21.15.47:0/3161431955 >> v2:172.21.15.177:3300/0 conn(0x7fa350152080 0x7fa35006c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.020+0000 7fa354f58700 1 -- 172.21.15.47:0/3161431955 >> 172.21.15.47:0/3161431955 conn(0x7fa35006a9c0 msgr2=0x7fa35006ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:56.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.020+0000 7fa354f58700 1 -- 172.21.15.47:0/3161431955 shutdown_connections 2024-05-08T19:22:56.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.020+0000 7fa354f58700 1 -- 172.21.15.47:0/3161431955 wait complete. 2024-05-08T19:22:56.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.022+0000 7fa354f58700 1 Processor -- start 2024-05-08T19:22:56.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.022+0000 7fa354f58700 1 -- start start 2024-05-08T19:22:56.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.022+0000 7fa354f58700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa350071c00 0x7fa3501eb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:56.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.022+0000 7fa354f58700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa35014e7b0 0x7fa35006d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:56.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.022+0000 7fa354f58700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa350152080 0x7fa3501e7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:56.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.022+0000 7fa354f58700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3501eb460 con 0x7fa350152080 2024-05-08T19:22:56.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.022+0000 7fa354f58700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3501eae80 con 0x7fa350071c00 2024-05-08T19:22:56.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.022+0000 7fa354f58700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3500c1750 con 0x7fa35014e7b0 2024-05-08T19:22:56.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa34ed9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa350152080 0x7fa3501e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:56.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa34ed9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa350152080 0x7fa3501e7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56424/0 (socket says 172.21.15.47:56424) 2024-05-08T19:22:56.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa34ed9d700 1 -- 172.21.15.47:0/3626311378 learned_addr learned my addr 172.21.15.47:0/3626311378 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:56.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa34dd9b700 1 --2- 172.21.15.47:0/3626311378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa35014e7b0 0x7fa35006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:56.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa34e59c700 1 --2- 172.21.15.47:0/3626311378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa350071c00 0x7fa3501eb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:56.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa34ed9d700 1 -- 172.21.15.47:0/3626311378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa35014e7b0 msgr2=0x7fa35006d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:56.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa34ed9d700 1 --2- 172.21.15.47:0/3626311378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa35014e7b0 0x7fa35006d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa34ed9d700 1 -- 172.21.15.47:0/3626311378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa350071c00 msgr2=0x7fa3501eb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:56.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa34ed9d700 1 --2- 172.21.15.47:0/3626311378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa350071c00 0x7fa3501eb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa34ed9d700 1 -- 172.21.15.47:0/3626311378 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3440094a0 con 0x7fa350152080 2024-05-08T19:22:56.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa34ed9d700 1 --2- 172.21.15.47:0/3626311378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa350152080 0x7fa3501e7870 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa348014040 tx=0x7fa348004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:56.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa33effd700 1 -- 172.21.15.47:0/3626311378 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348012a70 con 0x7fa350152080 2024-05-08T19:22:56.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa33effd700 1 -- 172.21.15.47:0/3626311378 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa348020070 con 0x7fa350152080 2024-05-08T19:22:56.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa354f58700 1 -- 172.21.15.47:0/3626311378 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa348009a70 con 0x7fa350152080 2024-05-08T19:22:56.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa33effd700 1 -- 172.21.15.47:0/3626311378 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348012e30 con 0x7fa350152080 2024-05-08T19:22:56.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.023+0000 7fa354f58700 1 -- 172.21.15.47:0/3626311378 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35006d9c0 con 0x7fa350152080 2024-05-08T19:22:56.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.024+0000 7fa354f58700 1 -- 172.21.15.47:0/3626311378 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3501eb610 con 0x7fa350152080 2024-05-08T19:22:56.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.025+0000 7fa33effd700 1 -- 172.21.15.47:0/3626311378 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa348004040 con 0x7fa350152080 2024-05-08T19:22:56.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.025+0000 7fa33effd700 1 --2- 172.21.15.47:0/3626311378 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa33006ac90 0x7fa33006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:56.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.026+0000 7fa33effd700 1 -- 172.21.15.47:0/3626311378 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa348022070 con 0x7fa350152080 2024-05-08T19:22:56.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.026+0000 7fa34e59c700 1 --2- 172.21.15.47:0/3626311378 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa33006ac90 0x7fa33006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:56.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.026+0000 7fa34e59c700 1 --2- 172.21.15.47:0/3626311378 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa33006ac90 0x7fa33006d150 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa3400011e0 tx=0x7fa340009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:56.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.030+0000 7fa33effd700 1 -- 172.21.15.47:0/3626311378 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa3501eb610 con 0x7fa350152080 2024-05-08T19:22:56.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.118+0000 7f0586adf700 1 Processor -- start 2024-05-08T19:22:56.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.118+0000 7f0586adf700 1 -- start start 2024-05-08T19:22:56.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.119+0000 7f0586adf700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05800c1d90 0x7f05800c2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:56.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.119+0000 7f0586adf700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05800a8bc0 con 0x7f05801557e0 2024-05-08T19:22:56.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.119+0000 7f0586adf700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05800c3690 con 0x7f05800c2b10 2024-05-08T19:22:56.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.119+0000 7f0586adf700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05800c3970 con 0x7f05800c1d90 2024-05-08T19:22:56.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.119+0000 7f058507c700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f05801557e0 0x7f058014ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60034/0 (socket says 172.21.15.47:60034) 2024-05-08T19:22:56.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.119+0000 7f058507c700 1 -- 172.21.15.47:0/3400438744 learned_addr learned my addr 172.21.15.47:0/3400438744 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:22:56.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.120+0000 7f058487b700 1 --2- 172.21.15.47:0/3400438744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05800c1d90 0x7f05800c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:56.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.120+0000 7f057f7fe700 1 -- 172.21.15.47:0/3400438744 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223624667 0 0) 0x7f05800a8bc0 con 0x7f05801557e0 2024-05-08T19:22:56.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.120+0000 7f057f7fe700 1 -- 172.21.15.47:0/3400438744 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f056c0035b0 con 0x7f05801557e0 2024-05-08T19:22:56.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.120+0000 7f057f7fe700 1 -- 172.21.15.47:0/3400438744 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848609216 0 0) 0x7f05800c3690 con 0x7f05800c2b10 2024-05-08T19:22:56.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.120+0000 7f057f7fe700 1 -- 172.21.15.47:0/3400438744 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05800a8bc0 con 0x7f05800c2b10 2024-05-08T19:22:56.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.120+0000 7f057f7fe700 1 -- 172.21.15.47:0/3400438744 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2898208797 0 0) 0x7f056c0035b0 con 0x7f05801557e0 2024-05-08T19:22:56.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.120+0000 7f058487b700 1 -- 172.21.15.47:0/3400438744 >> v1:172.21.15.177:6789/0 conn(0x7f05800c2b10 legacy=0x7f05800a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:56.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.120+0000 7f058487b700 1 -- 172.21.15.47:0/3400438744 >> v1:172.21.15.47:6789/0 conn(0x7f05801557e0 legacy=0x7f058014ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:56.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.120+0000 7f058487b700 1 -- 172.21.15.47:0/3400438744 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0580154d00 con 0x7f05800c1d90 2024-05-08T19:22:56.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.120+0000 7f058487b700 1 --2- 172.21.15.47:0/3400438744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05800c1d90 0x7f05800c2170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0578009dc0 tx=0x7f057800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=110229e2060f146d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:56.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.120+0000 7f057f7fe700 1 -- 172.21.15.47:0/3400438744 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057800e070 con 0x7f05800c1d90 2024-05-08T19:22:56.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.120+0000 7f057f7fe700 1 -- 172.21.15.47:0/3400438744 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0578003a20 con 0x7f05800c1d90 2024-05-08T19:22:56.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.120+0000 7f057f7fe700 1 -- 172.21.15.47:0/3400438744 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570001670 con 0x7f05800c1d90 2024-05-08T19:22:56.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.121+0000 7f0586adf700 1 -- 172.21.15.47:0/3400438744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05800c1d90 msgr2=0x7f05800c2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:56.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.121+0000 7f0586adf700 1 --2- 172.21.15.47:0/3400438744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05800c1d90 0x7f05800c2170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0578009dc0 tx=0x7f057800b330 comp rx=0 tx=0).stop 2024-05-08T19:22:56.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.121+0000 7f0586adf700 1 -- 172.21.15.47:0/3400438744 shutdown_connections 2024-05-08T19:22:56.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.121+0000 7f0586adf700 1 --2- 172.21.15.47:0/3400438744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05800c1d90 0x7f05800c2170 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.121+0000 7f0586adf700 1 -- 172.21.15.47:0/3400438744 >> 172.21.15.47:0/3400438744 conn(0x7f05800c3c20 msgr2=0x7f05800c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:56.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.121+0000 7f0586adf700 1 -- 172.21.15.47:0/3400438744 shutdown_connections 2024-05-08T19:22:56.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.121+0000 7f0586adf700 1 -- 172.21.15.47:0/3400438744 wait complete. 2024-05-08T19:22:56.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.122+0000 7f0586adf700 1 Processor -- start 2024-05-08T19:22:56.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.123+0000 7f0586adf700 1 -- start start 2024-05-08T19:22:56.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.123+0000 7f0586adf700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05800c1d90 0x7f05801e9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:56.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.123+0000 7f0586adf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05800c2b10 0x7f05801e88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:56.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.123+0000 7f0586adf700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05801557e0 0x7f05801ebc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:56.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.123+0000 7f0586adf700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05801e8e00 con 0x7f05800c2b10 2024-05-08T19:22:56.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.123+0000 7f0586adf700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05800aa040 con 0x7f05800c1d90 2024-05-08T19:22:56.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.123+0000 7f0586adf700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05800aa320 con 0x7f05801557e0 2024-05-08T19:22:56.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.123+0000 7f057ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05800c2b10 0x7f05801e88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:56.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.124+0000 7f057ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05800c2b10 0x7f05801e88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56436/0 (socket says 172.21.15.47:56436) 2024-05-08T19:22:56.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.124+0000 7f057ffff700 1 -- 172.21.15.47:0/3120155382 learned_addr learned my addr 172.21.15.47:0/3120155382 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:22:56.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.124+0000 7f058507c700 1 --2- 172.21.15.47:0/3120155382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05801557e0 0x7f05801ebc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:56.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.124+0000 7f058487b700 1 --2- 172.21.15.47:0/3120155382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05800c1d90 0x7f05801e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:56.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.124+0000 7f057ffff700 1 -- 172.21.15.47:0/3120155382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05801557e0 msgr2=0x7f05801ebc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:56.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.124+0000 7f057ffff700 1 --2- 172.21.15.47:0/3120155382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05801557e0 0x7f05801ebc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.124+0000 7f057ffff700 1 -- 172.21.15.47:0/3120155382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05800c1d90 msgr2=0x7f05801e9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:56.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.124+0000 7f057ffff700 1 --2- 172.21.15.47:0/3120155382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05800c1d90 0x7f05801e9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.124+0000 7f057ffff700 1 -- 172.21.15.47:0/3120155382 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0578009a70 con 0x7f05800c2b10 2024-05-08T19:22:56.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.124+0000 7f057ffff700 1 --2- 172.21.15.47:0/3120155382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05800c2b10 0x7f05801e88c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f056800c520 tx=0x7f056800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.124+0000 7f057d7fa700 1 -- 172.21.15.47:0/3120155382 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680052d0 con 0x7f05800c2b10 2024-05-08T19:22:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.124+0000 7f057d7fa700 1 -- 172.21.15.47:0/3120155382 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0568005430 con 0x7f05800c2b10 2024-05-08T19:22:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.124+0000 7f057d7fa700 1 -- 172.21.15.47:0/3120155382 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680038c0 con 0x7f05800c2b10 2024-05-08T19:22:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.124+0000 7f0586adf700 1 -- 172.21.15.47:0/3120155382 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05800aa600 con 0x7f05800c2b10 2024-05-08T19:22:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.124+0000 7f0586adf700 1 -- 172.21.15.47:0/3120155382 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05801eb710 con 0x7f05800c2b10 2024-05-08T19:22:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.125+0000 7f0586adf700 1 -- 172.21.15.47:0/3120155382 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058004ec60 con 0x7f05800c2b10 2024-05-08T19:22:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.126+0000 7f057d7fa700 1 -- 172.21.15.47:0/3120155382 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0568003a20 con 0x7f05800c2b10 2024-05-08T19:22:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.126+0000 7f057d7fa700 1 --2- 172.21.15.47:0/3120155382 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f056006ac90 0x7f056006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:22:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.126+0000 7f057d7fa700 1 -- 172.21.15.47:0/3120155382 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0568088ba0 con 0x7f05800c2b10 2024-05-08T19:22:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.126+0000 7f058487b700 1 --2- 172.21.15.47:0/3120155382 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f056006ac90 0x7f056006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:22:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.127+0000 7f058487b700 1 --2- 172.21.15.47:0/3120155382 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f056006ac90 0x7f056006d150 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0578009dc0 tx=0x7f0578011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:22:56.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.131+0000 7f057d7fa700 1 -- 172.21.15.47:0/3120155382 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0568053a80 con 0x7f05800c2b10 2024-05-08T19:22:56.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.304+0000 7fa354f58700 1 -- 172.21.15.47:0/3626311378 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa3501eb610 con 0x7fa350152080 2024-05-08T19:22:56.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.304+0000 7fa33effd700 1 -- 172.21.15.47:0/3626311378 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa3501eb610 con 0x7fa350152080 2024-05-08T19:22:56.300 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-08T19:22:56.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.306+0000 7fa354f58700 1 -- 172.21.15.47:0/3626311378 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa33006ac90 msgr2=0x7fa33006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:56.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.306+0000 7fa354f58700 1 --2- 172.21.15.47:0/3626311378 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa33006ac90 0x7fa33006d150 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa3400011e0 tx=0x7fa340009040 comp rx=0 tx=0).stop 2024-05-08T19:22:56.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.306+0000 7fa354f58700 1 -- 172.21.15.47:0/3626311378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa350152080 msgr2=0x7fa3501e7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:56.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.306+0000 7fa354f58700 1 --2- 172.21.15.47:0/3626311378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa350152080 0x7fa3501e7870 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa348014040 tx=0x7fa348004ad0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.306+0000 7fa354f58700 1 -- 172.21.15.47:0/3626311378 shutdown_connections 2024-05-08T19:22:56.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.306+0000 7fa354f58700 1 --2- 172.21.15.47:0/3626311378 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa33006ac90 0x7fa33006d150 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.306+0000 7fa354f58700 1 --2- 172.21.15.47:0/3626311378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa350152080 0x7fa3501e7870 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.306+0000 7fa354f58700 1 --2- 172.21.15.47:0/3626311378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa350071c00 0x7fa3501eb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.306+0000 7fa354f58700 1 --2- 172.21.15.47:0/3626311378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa35014e7b0 0x7fa35006d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.306+0000 7fa354f58700 1 -- 172.21.15.47:0/3626311378 >> 172.21.15.47:0/3626311378 conn(0x7fa35006a9c0 msgr2=0x7fa350148480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:56.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.306+0000 7fa354f58700 1 -- 172.21.15.47:0/3626311378 shutdown_connections 2024-05-08T19:22:56.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.306+0000 7fa354f58700 1 -- 172.21.15.47:0/3626311378 wait complete. 2024-05-08T19:22:56.311 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T19:22:56.311 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T19:22:56.312 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-05-08T19:22:56.312 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-08T19:22:56.312 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-08T19:22:56.312 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T19:22:56.312 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T19:22:56.312 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T19:22:56.312 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-08T19:22:56.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.312 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-05-08T19:22:56.334 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T19:22:56.334 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T19:22:56.334 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T19:22:56.334 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-05-08T19:22:56.334 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-05-08T19:22:56.334 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-05-08T19:22:56.334 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T19:22:56.334 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-05-08T19:22:56.335 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-05-08T19:22:56.335 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T19:22:56.335 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-05-08T19:22:56.335 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-05-08T19:22:56.335 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T19:22:56.335 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-05-08T19:22:56.336 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T19:22:56.336 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-05-08T19:22:56.336 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T19:22:56.336 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42290sec preferred_lft 42290sec 2024-05-08T19:22:56.336 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::d4a4:ce7b:9914:3b33/64 scope link noprefixroute 2024-05-08T19:22:56.336 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-05-08T19:22:56.337 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T19:22:56.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.337 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-05-08T19:22:56.337 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-05-08T19:22:56.337 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add name ceph-brx type bridge 2024-05-08T19:22:56.337 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr flush dev ceph-brx 2024-05-08T19:22:56.337 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set ceph-brx up 2024-05-08T19:22:56.338 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T19:22:56.338 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-05-08T19:22:56.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.396+0000 7f0586adf700 1 -- 172.21.15.47:0/3120155382 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f05801452d0 con 0x7f05800c2b10 2024-05-08T19:22:56.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.397+0000 7f057d7fa700 1 -- 172.21.15.47:0/3120155382 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0568017070 con 0x7f05800c2b10 2024-05-08T19:22:56.389 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-08T19:22:56.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.399+0000 7f0586adf700 1 -- 172.21.15.47:0/3120155382 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f056006ac90 msgr2=0x7f056006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:56.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.399+0000 7f0586adf700 1 --2- 172.21.15.47:0/3120155382 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f056006ac90 0x7f056006d150 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0578009dc0 tx=0x7f0578011000 comp rx=0 tx=0).stop 2024-05-08T19:22:56.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.399+0000 7f0586adf700 1 -- 172.21.15.47:0/3120155382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05800c2b10 msgr2=0x7f05801e88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:22:56.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.399+0000 7f0586adf700 1 --2- 172.21.15.47:0/3120155382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05800c2b10 0x7f05801e88c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f056800c520 tx=0x7f056800c8e0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.399+0000 7f0586adf700 1 -- 172.21.15.47:0/3120155382 shutdown_connections 2024-05-08T19:22:56.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.399+0000 7f0586adf700 1 --2- 172.21.15.47:0/3120155382 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f056006ac90 0x7f056006d150 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.399+0000 7f0586adf700 1 --2- 172.21.15.47:0/3120155382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05801557e0 0x7f05801ebc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.399+0000 7f0586adf700 1 --2- 172.21.15.47:0/3120155382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05800c1d90 0x7f05801e9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.399+0000 7f0586adf700 1 --2- 172.21.15.47:0/3120155382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05800c2b10 0x7f05801e88c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:22:56.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.399+0000 7f0586adf700 1 -- 172.21.15.47:0/3120155382 >> 172.21.15.47:0/3120155382 conn(0x7f05800c3c20 msgr2=0x7f05800c2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:22:56.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.399+0000 7f0586adf700 1 -- 172.21.15.47:0/3120155382 shutdown_connections 2024-05-08T19:22:56.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:22:56.399+0000 7f0586adf700 1 -- 172.21.15.47:0/3120155382 wait complete. 2024-05-08T19:22:56.403 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T19:22:56.403 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T19:22:56.403 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-05-08T19:22:56.403 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T19:22:56.404 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T19:22:56.404 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T19:22:56.404 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T19:22:56.404 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T19:22:56.404 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T19:22:56.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.404 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-05-08T19:22:56.422 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T19:22:56.422 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T19:22:56.422 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T19:22:56.422 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-08T19:22:56.422 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-05-08T19:22:56.423 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-08T19:22:56.423 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T19:22:56.423 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-05-08T19:22:56.423 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-05-08T19:22:56.423 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T19:22:56.423 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-05-08T19:22:56.423 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-05-08T19:22:56.423 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T19:22:56.423 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-05-08T19:22:56.423 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-05-08T19:22:56.423 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-08T19:22:56.423 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42281sec preferred_lft 42281sec 2024-05-08T19:22:56.423 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link 2024-05-08T19:22:56.424 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-08T19:22:56.424 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T19:22:56.424 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-05-08T19:22:56.424 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-05-08T19:22:56.424 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T19:22:56.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.424 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-08T19:22:56.424 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-08T19:22:56.424 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-05-08T19:22:56.425 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-05-08T19:22:56.425 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-05-08T19:22:56.425 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T19:22:56.425 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-08T19:22:56.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.512 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T19:22:56.541 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-05-08T19:22:56.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.543 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-05-08T19:22:56.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.544 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T19:22:56.573 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-05-08T19:22:56.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.574 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-05-08T19:22:56.619 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-05-08T19:22:56.619 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T19:22:56.619 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T19:22:56.619 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T19:22:56.619 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T19:22:56.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.620 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-05-08T19:22:56.620 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-05-08T19:22:56.620 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T19:22:56.620 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T19:22:56.620 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T19:22:56.621 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-05-08T19:22:56.636 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-05-08T19:22:56.636 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T19:22:56.636 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-08T19:22:56.636 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-08T19:22:56.637 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T19:22:56.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.637 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-08T19:22:56.637 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-08T19:22:56.637 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-08T19:22:56.638 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-08T19:22:56.638 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-08T19:22:56.638 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-08T19:22:56.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.744 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-08T19:22:56.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.762 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-05-08T19:22:56.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.819 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-08T19:22:56.819 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-08T19:22:56.820 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T19:22:56.820 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-08T19:22:56.820 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-08T19:22:56.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.870 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-05-08T19:22:56.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.888 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2024-05-08T19:22:56.916 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-08T19:22:56.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.917 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-08T19:22:56.917 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-08T19:22:56.917 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-08T19:22:56.917 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T19:22:56.917 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-08T19:22:56.917 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-08T19:22:56.917 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-08T19:22:56.917 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-08T19:22:56.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:56.945 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-05-08T19:22:56.945 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-05-08T19:22:56.945 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T19:22:56.945 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-08T19:22:56.945 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-05-08T19:22:57.040 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-08T19:22:57.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:57.041 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-05-08T19:22:57.041 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-05-08T19:22:57.041 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-08T19:22:57.041 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T19:22:57.041 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-08T19:22:57.041 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-08T19:22:57.041 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-08T19:22:57.041 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-05-08T19:22:57.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:57.120 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-08T19:22:57.120 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-08T19:22:57.120 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-05-08T19:22:57.120 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T19:22:57.120 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-08T19:22:57.219 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-08T19:22:57.219 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T19:22:57.219 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T19:22:57.236 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T19:22:57.237 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T19:22:57.237 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T19:22:57.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:57.240 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-05-08T19:22:57.240 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-05-08T19:22:57.241 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-05-08T19:22:57.241 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T19:22:57.241 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-05-08T19:22:57.293 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-08T19:22:57.338 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T19:22:57.338 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-08T19:22:57.355 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-08T19:22:57.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T19:22:57.356 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-08T19:22:57.362 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T19:22:57.362 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T19:22:57.413 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-08T19:22:57.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:57.413 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T19:22:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T19:22:57.430 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T19:22:57.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:57.431 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-08T19:22:57.489 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T19:22:57.489 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-08T19:22:57.499 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T19:22:57.499 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T19:22:57.534 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-08T19:22:57.562 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T19:22:57.562 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T19:22:57.592 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T19:22:57.592 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T19:22:57.592 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-05-08T19:22:57.593 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with new device syntax: 1@e1596084-137b-43d3-b844-c72a72dda1f6.cephfs=/ 2024-05-08T19:22:57.593 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.47:3300/172.21.15.177:3300/172.21.15.177:3301" will pass to kernel 2024-05-08T19:22:57.593 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: v2 mount support check returned 2 2024-05-08T19:22:57.593 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: kernel does not support v2 syntax 2024-05-08T19:22:57.593 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-08T19:22:57.610 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T19:22:57.610 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T19:22:57.610 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-05-08T19:22:57.610 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with new device syntax: 1@e1596084-137b-43d3-b844-c72a72dda1f6.cephfs=/ 2024-05-08T19:22:57.610 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.47:3300/172.21.15.177:3300/172.21.15.177:3301" will pass to kernel 2024-05-08T19:22:57.611 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: v2 mount support check returned 2 2024-05-08T19:22:57.611 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: kernel does not support v2 syntax 2024-05-08T19:22:57.611 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-08T19:22:57.611 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.47:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-05-08T19:22:57.611 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.47:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-05-08T19:22:57.611 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=e1596084-137b-43d3-b844-c72a72dda1f6" will pass to kernel 2024-05-08T19:22:57.613 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T19:22:57.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:57.613 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-08T19:22:57.625 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:2024-05-08T19:22:57.634+0000 7f24e910b5c0 -1 init, newargv = 0x559313ae0ae0 newargc=15 2024-05-08T19:22:57.626 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[56975]: starting ceph client 2024-05-08T19:22:57.631 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[56975]: starting fuse 2024-05-08T19:22:57.631 INFO:teuthology.orchestra.run.smithi047.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T19:22:57.633 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T19:22:57.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:57.634 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-08T19:22:57.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:57.641 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T19:22:57.691 INFO:teuthology.orchestra.run.smithi047.stdout:47 2024-05-08T19:22:57.691 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2024-05-08T19:22:57.692 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-08T19:22:57.692 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-05-08T19:22:57.692 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-05-08T19:22:57.692 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-05-08T19:22:57.692 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-05-08T19:22:57.692 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-08T19:22:57.692 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-05-08T19:22:57.692 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-08T19:22:57.692 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-05-08T19:22:57.692 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-08T19:22:57.692 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-08T19:22:57.692 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-05-08T19:22:57.692 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-05-08T19:22:57.693 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-05-08T19:22:57.693 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-05-08T19:22:57.693 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-08T19:22:57.693 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-05-08T19:22:57.693 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T19:22:57.693 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T19:22:57.693 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T19:22:57.693 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-05-08T19:22:57.693 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-05-08T19:22:57.693 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-05-08T19:22:57.693 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T19:22:57.693 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-08T19:22:57.693 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.0")) 2024-05-08T19:22:57.693 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-05-08T19:22:57.713 INFO:teuthology.orchestra.run.smithi177.stdout:client4622 2024-05-08T19:22:57.714 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:22:57.714 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T19:22:57.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:57.772 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T19:22:57.818 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.0.56975.asok 2024-05-08T19:22:57.844 INFO:teuthology.orchestra.run.smithi177.stdout:client4622 2024-05-08T19:22:57.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:57.845 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T19:22:57.917 INFO:teuthology.orchestra.run.smithi177.stdout:client4622 2024-05-08T19:22:57.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:57.917 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e1596084-137b-43d3-b844-c72a72dda1f6.client4622/status') 2024-05-08T19:22:57.998 INFO:teuthology.orchestra.run.smithi177.stdout:instance: client.4622 (3)192.168.0.1:0/2531397725 2024-05-08T19:22:57.998 INFO:teuthology.orchestra.run.smithi177.stdout:blocklisted: false 2024-05-08T19:22:57.998 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records in 2024-05-08T19:22:57.998 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records out 2024-05-08T19:22:57.998 INFO:teuthology.orchestra.run.smithi177.stderr:69 bytes copied, 2.3217e-05 s, 3.0 MB/s 2024-05-08T19:22:58.000 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.56975.asok 2024-05-08T19:22:58.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:58.000 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.56975.asok status 2024-05-08T19:22:58.001 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-05-08T19:22:58.004 INFO:tasks.workunit:Pulling workunits from ref d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:22:58.005 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-08T19:22:58.005 DEBUG:teuthology.orchestra.run.smithi177:> stat -- /home/ubuntu/cephtest/mnt.1 2024-05-08T19:22:58.058 INFO:teuthology.orchestra.run.smithi177.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-05-08T19:22:58.058 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-08T19:22:58.058 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 2eh/46d Inode: 1 Links: 2 2024-05-08T19:22:58.058 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:22:58.058 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:cephfs_t:s0 2024-05-08T19:22:58.059 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-08T19:22:58.059 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-05-08 19:22:20.427920150 +0000 2024-05-08T19:22:58.059 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-05-08 19:22:30.071219490 +0000 2024-05-08T19:22:58.059 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-05-08 19:22:20.427920150 +0000 2024-05-08T19:22:58.059 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-05-08T19:22:58.059 DEBUG:teuthology.orchestra.run.smithi177:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-05-08T19:22:58.130 INFO:tasks.workunit:timeout=3h 2024-05-08T19:22:58.130 INFO:tasks.workunit:cleanup=True 2024-05-08T19:22:58.131 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:22:58.162 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-08T19:22:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-05-08T19:22:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "d21e4f961318b56f0d915caa2490c3711bf13c34", 2024-05-08T19:22:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T19:22:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "0", 2024-05-08T19:22:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-05-08T19:22:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-08T19:22:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "56975", 2024-05-08T19:22:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/" 2024-05-08T19:22:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-08T19:22:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-05-08T19:22:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-05-08T19:22:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4842, 2024-05-08T19:22:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-05-08T19:22:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-05-08T19:22:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-05-08T19:22:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 4842 2024-05-08T19:22:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-08T19:22:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-05-08T19:22:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-05-08T19:22:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-05-08T19:22:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3429379766 2024-05-08T19:22:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-08T19:22:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-08T19:22:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-05-08T19:22:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-05-08T19:22:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-05-08T19:22:58.164 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3429379766 2024-05-08T19:22:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-08T19:22:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.4842 192.168.0.1:0/3429379766", 2024-05-08T19:22:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "192.168.0.1:0/3429379766", 2024-05-08T19:22:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 1, 2024-05-08T19:22:58.165 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 9, 2024-05-08T19:22:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 24, 2024-05-08T19:22:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 24, 2024-05-08T19:22:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-05-08T19:22:58.166 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-05-08T19:22:58.166 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-08T19:22:58.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:58.172 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-05-08T19:22:58.172 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-08T19:22:58.187 INFO:tasks.workunit.client.1.smithi177.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-05-08T19:22:58.191 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-05-08T19:22:58.192 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-08T19:22:58.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:22:58.192 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T19:22:58.260 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-05-08T19:22:58.260 INFO:tasks.workunit:Pulling workunits from ref d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:22:58.261 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-08T19:22:58.261 DEBUG:teuthology.orchestra.run.smithi047:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-08T19:22:58.319 INFO:teuthology.orchestra.run.smithi047.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-08T19:22:58.319 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-08T19:22:58.319 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 2fh/47d Inode: 1 Links: 3 2024-05-08T19:22:58.319 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:22:58.319 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:fusefs_t:s0 2024-05-08T19:22:58.319 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-08T19:22:58.319 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-08 19:22:58.134324460 +0000 2024-05-08T19:22:58.319 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-08 19:22:58.134324460 +0000 2024-05-08T19:22:58.319 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-05-08T19:22:58.320 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-08T19:22:58.320 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-08T19:22:58.392 INFO:tasks.workunit:timeout=3h 2024-05-08T19:22:58.392 INFO:tasks.workunit:cleanup=True 2024-05-08T19:22:58.392 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:22:58.449 INFO:tasks.workunit.client.0.smithi047.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-08T19:23:25.032 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:23:25.037 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:23:55.130 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:23:55.137 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:24:21.976 INFO:tasks.workunit.client.1.smithi177.stderr:Updating files: 98% (12114/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-08T19:24:22.353 INFO:tasks.workunit.client.1.smithi177.stderr:Note: switching to 'd21e4f961318b56f0d915caa2490c3711bf13c34'. 2024-05-08T19:24:22.353 INFO:tasks.workunit.client.1.smithi177.stderr: 2024-05-08T19:24:22.353 INFO:tasks.workunit.client.1.smithi177.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T19:24:22.353 INFO:tasks.workunit.client.1.smithi177.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T19:24:22.353 INFO:tasks.workunit.client.1.smithi177.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T19:24:22.353 INFO:tasks.workunit.client.1.smithi177.stderr: 2024-05-08T19:24:22.354 INFO:tasks.workunit.client.1.smithi177.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T19:24:22.354 INFO:tasks.workunit.client.1.smithi177.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T19:24:22.354 INFO:tasks.workunit.client.1.smithi177.stderr: 2024-05-08T19:24:22.354 INFO:tasks.workunit.client.1.smithi177.stderr: git switch -c 2024-05-08T19:24:22.354 INFO:tasks.workunit.client.1.smithi177.stderr: 2024-05-08T19:24:22.354 INFO:tasks.workunit.client.1.smithi177.stderr:Or undo this operation with: 2024-05-08T19:24:22.354 INFO:tasks.workunit.client.1.smithi177.stderr: 2024-05-08T19:24:22.354 INFO:tasks.workunit.client.1.smithi177.stderr: git switch - 2024-05-08T19:24:22.354 INFO:tasks.workunit.client.1.smithi177.stderr: 2024-05-08T19:24:22.354 INFO:tasks.workunit.client.1.smithi177.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T19:24:22.354 INFO:tasks.workunit.client.1.smithi177.stderr: 2024-05-08T19:24:22.354 INFO:tasks.workunit.client.1.smithi177.stderr:HEAD is now at d21e4f96131 Merge PR #57343 into wip-pdonnell-testing-20240508.150423-reef 2024-05-08T19:24:22.359 DEBUG:teuthology.orchestra.run.smithi177:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-05-08T19:24:22.391 INFO:tasks.workunit.client.1.smithi177.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-08T19:24:22.391 INFO:tasks.workunit.client.1.smithi177.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-08T19:24:22.391 INFO:tasks.workunit.client.1.smithi177.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-08T19:24:22.871 INFO:tasks.workunit.client.1.smithi177.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-08T19:24:22.949 INFO:tasks.workunit.client.1.smithi177.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-08T19:24:22.988 INFO:tasks.workunit.client.1.smithi177.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-08T19:24:22.991 INFO:tasks.workunit.client.1.smithi177.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-08T19:24:22.991 INFO:tasks.workunit.client.1.smithi177.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-08T19:24:23.028 INFO:tasks.workunit.client.1.smithi177.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-08T19:24:23.031 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:24:23.031 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-05-08T19:24:23.089 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.1... 2024-05-08T19:24:23.090 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-05-08T19:24:23.090 DEBUG:teuthology.orchestra.run.smithi177:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d21e4f961318b56f0d915caa2490c3711bf13c34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/dbench.sh 2024-05-08T19:24:23.174 INFO:tasks.workunit.client.1.smithi177.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-05-08T19:24:23.174 INFO:tasks.workunit.client.1.smithi177.stdout: 2024-05-08T19:24:23.174 INFO:tasks.workunit.client.1.smithi177.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-05-08T19:24:23.174 INFO:tasks.workunit.client.1.smithi177.stdout:0 of 1 processes prepared for launch 0 sec 2024-05-08T19:24:23.280 INFO:tasks.workunit.client.1.smithi177.stdout:1 of 1 processes prepared for launch 0 sec 2024-05-08T19:24:23.280 INFO:tasks.workunit.client.1.smithi177.stdout:releasing clients 2024-05-08T19:24:23.534 INFO:tasks.workunit.client.0.smithi047.stderr:Updating files: 90% (11051/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-08T19:24:24.279 INFO:tasks.workunit.client.1.smithi177.stdout: 1 3811 39.76 MB/sec warmup 1 sec latency 7.315 ms 2024-05-08T19:24:24.374 INFO:tasks.workunit.client.0.smithi047.stderr:Note: switching to 'd21e4f961318b56f0d915caa2490c3711bf13c34'. 2024-05-08T19:24:24.374 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-08T19:24:24.374 INFO:tasks.workunit.client.0.smithi047.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T19:24:24.374 INFO:tasks.workunit.client.0.smithi047.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T19:24:24.374 INFO:tasks.workunit.client.0.smithi047.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T19:24:24.374 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-08T19:24:24.374 INFO:tasks.workunit.client.0.smithi047.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T19:24:24.374 INFO:tasks.workunit.client.0.smithi047.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T19:24:24.374 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-08T19:24:24.374 INFO:tasks.workunit.client.0.smithi047.stderr: git switch -c 2024-05-08T19:24:24.374 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-08T19:24:24.374 INFO:tasks.workunit.client.0.smithi047.stderr:Or undo this operation with: 2024-05-08T19:24:24.375 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-08T19:24:24.375 INFO:tasks.workunit.client.0.smithi047.stderr: git switch - 2024-05-08T19:24:24.375 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-08T19:24:24.375 INFO:tasks.workunit.client.0.smithi047.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T19:24:24.375 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-08T19:24:24.375 INFO:tasks.workunit.client.0.smithi047.stderr:HEAD is now at d21e4f96131 Merge PR #57343 into wip-pdonnell-testing-20240508.150423-reef 2024-05-08T19:24:24.380 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-08T19:24:24.415 INFO:tasks.workunit.client.0.smithi047.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-08T19:24:24.417 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T19:24:24.417 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-08T19:24:24.969 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-08T19:24:25.056 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-08T19:24:25.099 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T19:24:25.099 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T19:24:25.099 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-08T19:24:25.142 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T19:24:25.146 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:24:25.146 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-08T19:24:25.208 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-05-08T19:24:25.209 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-05-08T19:24:25.209 DEBUG:teuthology.orchestra.run.smithi047:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d21e4f961318b56f0d915caa2490c3711bf13c34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-05-08T19:24:25.213 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:24:25.250 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:24:25.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 7348 29.44 MB/sec warmup 2 sec latency 9.724 ms 2024-05-08T19:24:25.278 INFO:tasks.workunit.client.0.smithi047.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-08T19:24:25.337 INFO:tasks.workunit.client.0.smithi047.stdout: Iozone: Performance Test of File I/O 2024-05-08T19:24:25.337 INFO:tasks.workunit.client.0.smithi047.stdout: Version $Revision: 3.489 $ 2024-05-08T19:24:25.337 INFO:tasks.workunit.client.0.smithi047.stdout: Compiled for 64 bit mode. 2024-05-08T19:24:25.338 INFO:tasks.workunit.client.0.smithi047.stdout: Build: linux-AMD64 2024-05-08T19:24:25.338 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:24:25.338 INFO:tasks.workunit.client.0.smithi047.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-08T19:24:25.338 INFO:tasks.workunit.client.0.smithi047.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-08T19:24:25.338 INFO:tasks.workunit.client.0.smithi047.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-08T19:24:25.338 INFO:tasks.workunit.client.0.smithi047.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-08T19:24:25.338 INFO:tasks.workunit.client.0.smithi047.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-08T19:24:25.338 INFO:tasks.workunit.client.0.smithi047.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-08T19:24:25.338 INFO:tasks.workunit.client.0.smithi047.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-08T19:24:25.338 INFO:tasks.workunit.client.0.smithi047.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-08T19:24:25.338 INFO:tasks.workunit.client.0.smithi047.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-08T19:24:25.338 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:24:25.338 INFO:tasks.workunit.client.0.smithi047.stdout: Run began: Wed May 8 19:24:25 2024 2024-05-08T19:24:25.338 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:24:25.339 INFO:tasks.workunit.client.0.smithi047.stdout: Include close in write timing 2024-05-08T19:24:25.339 INFO:tasks.workunit.client.0.smithi047.stdout: Include fsync in write timing 2024-05-08T19:24:25.339 INFO:tasks.workunit.client.0.smithi047.stdout: File size set to 1048576 kB 2024-05-08T19:24:25.339 INFO:tasks.workunit.client.0.smithi047.stdout: Record Size 16 kB 2024-05-08T19:24:25.339 INFO:tasks.workunit.client.0.smithi047.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-08T19:24:25.339 INFO:tasks.workunit.client.0.smithi047.stdout: Output is in kBytes/sec 2024-05-08T19:24:25.339 INFO:tasks.workunit.client.0.smithi047.stdout: Time Resolution = 0.000001 seconds. 2024-05-08T19:24:25.339 INFO:tasks.workunit.client.0.smithi047.stdout: Processor cache size set to 1024 kBytes. 2024-05-08T19:24:25.339 INFO:tasks.workunit.client.0.smithi047.stdout: Processor cache line size set to 32 bytes. 2024-05-08T19:24:25.339 INFO:tasks.workunit.client.0.smithi047.stdout: File stride size set to 17 * record size. 2024-05-08T19:24:25.339 INFO:tasks.workunit.client.0.smithi047.stdout: Throughput test with 1 process 2024-05-08T19:24:25.339 INFO:tasks.workunit.client.0.smithi047.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-05-08T19:24:26.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 10870 26.00 MB/sec warmup 3 sec latency 7.906 ms 2024-05-08T19:24:27.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 13634 22.72 MB/sec warmup 4 sec latency 68.018 ms 2024-05-08T19:24:28.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 16811 21.11 MB/sec warmup 5 sec latency 16.811 ms 2024-05-08T19:24:29.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 20269 20.73 MB/sec warmup 6 sec latency 7.692 ms 2024-05-08T19:24:30.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 23216 20.16 MB/sec warmup 7 sec latency 26.385 ms 2024-05-08T19:24:31.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 26579 20.02 MB/sec warmup 8 sec latency 7.483 ms 2024-05-08T19:24:32.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 29889 19.89 MB/sec warmup 9 sec latency 11.088 ms 2024-05-08T19:24:33.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 32909 19.39 MB/sec warmup 10 sec latency 27.211 ms 2024-05-08T19:24:34.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 36435 19.37 MB/sec warmup 11 sec latency 12.844 ms 2024-05-08T19:24:35.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 39958 19.34 MB/sec warmup 12 sec latency 11.498 ms 2024-05-08T19:24:36.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 43330 19.29 MB/sec warmup 13 sec latency 24.920 ms 2024-05-08T19:24:36.950 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:24:36.951 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 initial writers = 90314.96 kB/sec 2024-05-08T19:24:36.951 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 initial writers = 90313.38 kB/sec 2024-05-08T19:24:36.951 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 90314.96 kB/sec 2024-05-08T19:24:36.951 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 90314.96 kB/sec 2024-05-08T19:24:36.951 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 90314.96 kB/sec 2024-05-08T19:24:36.951 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-08T19:24:37.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 46824 19.27 MB/sec warmup 14 sec latency 8.786 ms 2024-05-08T19:24:38.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 50260 19.25 MB/sec warmup 15 sec latency 21.992 ms 2024-05-08T19:24:39.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 53030 18.94 MB/sec warmup 16 sec latency 226.203 ms 2024-05-08T19:24:40.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 56235 18.85 MB/sec warmup 17 sec latency 13.970 ms 2024-05-08T19:24:41.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 59745 18.86 MB/sec warmup 18 sec latency 8.954 ms 2024-05-08T19:24:42.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 63095 18.79 MB/sec warmup 19 sec latency 26.770 ms 2024-05-08T19:24:43.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 66864 18.89 MB/sec warmup 20 sec latency 7.109 ms 2024-05-08T19:24:44.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 69511 18.57 MB/sec warmup 21 sec latency 100.440 ms 2024-05-08T19:24:45.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 72183 18.43 MB/sec warmup 22 sec latency 12.688 ms 2024-05-08T19:24:46.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 75278 18.39 MB/sec warmup 23 sec latency 9.794 ms 2024-05-08T19:24:47.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 78544 18.40 MB/sec warmup 24 sec latency 32.707 ms 2024-05-08T19:24:48.281 INFO:tasks.workunit.client.1.smithi177.stdout: 1 81959 18.42 MB/sec warmup 25 sec latency 8.848 ms 2024-05-08T19:24:49.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 84563 18.21 MB/sec warmup 26 sec latency 98.384 ms 2024-05-08T19:24:50.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 87585 18.04 MB/sec warmup 27 sec latency 8.311 ms 2024-05-08T19:24:51.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 90214 18.01 MB/sec warmup 28 sec latency 10.449 ms 2024-05-08T19:24:52.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 92986 17.88 MB/sec warmup 29 sec latency 14.108 ms 2024-05-08T19:24:53.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 96055 17.90 MB/sec warmup 30 sec latency 21.865 ms 2024-05-08T19:24:54.091 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:24:54.092 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 rewriters = 100342.62 kB/sec 2024-05-08T19:24:54.092 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 rewriters = 100339.92 kB/sec 2024-05-08T19:24:54.092 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 100342.62 kB/sec 2024-05-08T19:24:54.092 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 100342.62 kB/sec 2024-05-08T19:24:54.092 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 100342.62 kB/sec 2024-05-08T19:24:54.092 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-08T19:24:54.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 98284 17.58 MB/sec warmup 31 sec latency 63.333 ms 2024-05-08T19:24:55.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 98302 17.03 MB/sec warmup 32 sec latency 619.788 ms 2024-05-08T19:24:55.383 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:24:55.389 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:24:56.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 99350 16.81 MB/sec warmup 33 sec latency 317.590 ms 2024-05-08T19:24:57.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 101756 16.57 MB/sec warmup 34 sec latency 20.012 ms 2024-05-08T19:24:58.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 104097 16.50 MB/sec warmup 35 sec latency 22.690 ms 2024-05-08T19:24:59.275 INFO:tasks.workunit.client.1.smithi177.stdout: 1 107172 16.53 MB/sec warmup 36 sec latency 83.585 ms 2024-05-08T19:25:00.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 110547 16.59 MB/sec warmup 37 sec latency 17.120 ms 2024-05-08T19:25:01.170 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:01.170 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 readers = 7114832.50 kB/sec 2024-05-08T19:25:01.170 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 readers = 7103972.22 kB/sec 2024-05-08T19:25:01.171 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 7114832.50 kB/sec 2024-05-08T19:25:01.171 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 7114832.50 kB/sec 2024-05-08T19:25:01.171 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 7114832.50 kB/sec 2024-05-08T19:25:01.171 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-08T19:25:01.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 113564 16.61 MB/sec warmup 38 sec latency 85.539 ms 2024-05-08T19:25:02.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 116715 16.57 MB/sec warmup 39 sec latency 23.478 ms 2024-05-08T19:25:03.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 119698 16.50 MB/sec warmup 40 sec latency 16.479 ms 2024-05-08T19:25:03.747 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:03.747 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 re-readers = 5690032.00 kB/sec 2024-05-08T19:25:03.747 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 re-readers = 5683458.34 kB/sec 2024-05-08T19:25:03.747 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 5690032.00 kB/sec 2024-05-08T19:25:03.747 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 5690032.00 kB/sec 2024-05-08T19:25:03.747 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 5690032.00 kB/sec 2024-05-08T19:25:03.747 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-08T19:25:04.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 122548 16.50 MB/sec warmup 41 sec latency 33.596 ms 2024-05-08T19:25:05.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 125457 16.49 MB/sec warmup 42 sec latency 11.414 ms 2024-05-08T19:25:06.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 128266 16.50 MB/sec warmup 43 sec latency 84.810 ms 2024-05-08T19:25:07.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 131616 16.56 MB/sec warmup 44 sec latency 17.259 ms 2024-05-08T19:25:08.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 135033 16.61 MB/sec warmup 45 sec latency 18.996 ms 2024-05-08T19:25:09.279 INFO:tasks.workunit.client.1.smithi177.stdout: 1 138169 16.57 MB/sec warmup 46 sec latency 24.774 ms 2024-05-08T19:25:10.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 141269 16.57 MB/sec warmup 47 sec latency 21.334 ms 2024-05-08T19:25:11.278 INFO:tasks.workunit.client.1.smithi177.stdout: 1 142880 16.39 MB/sec warmup 48 sec latency 77.806 ms 2024-05-08T19:25:11.363 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:11.363 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:11.364 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:11.364 INFO:tasks.workunit.client.0.smithi047.stdout:iozone test complete. 2024-05-08T19:25:11.364 INFO:tasks.workunit.client.0.smithi047.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-08T19:25:11.397 INFO:tasks.workunit.client.0.smithi047.stdout: Iozone: Performance Test of File I/O 2024-05-08T19:25:11.397 INFO:tasks.workunit.client.0.smithi047.stdout: Version $Revision: 3.489 $ 2024-05-08T19:25:11.397 INFO:tasks.workunit.client.0.smithi047.stdout: Compiled for 64 bit mode. 2024-05-08T19:25:11.397 INFO:tasks.workunit.client.0.smithi047.stdout: Build: linux-AMD64 2024-05-08T19:25:11.397 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:11.397 INFO:tasks.workunit.client.0.smithi047.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-08T19:25:11.397 INFO:tasks.workunit.client.0.smithi047.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-08T19:25:11.397 INFO:tasks.workunit.client.0.smithi047.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-08T19:25:11.398 INFO:tasks.workunit.client.0.smithi047.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-08T19:25:11.398 INFO:tasks.workunit.client.0.smithi047.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-08T19:25:11.398 INFO:tasks.workunit.client.0.smithi047.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-08T19:25:11.398 INFO:tasks.workunit.client.0.smithi047.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-08T19:25:11.398 INFO:tasks.workunit.client.0.smithi047.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-08T19:25:11.398 INFO:tasks.workunit.client.0.smithi047.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-08T19:25:11.398 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:11.398 INFO:tasks.workunit.client.0.smithi047.stdout: Run began: Wed May 8 19:25:11 2024 2024-05-08T19:25:11.398 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:11.398 INFO:tasks.workunit.client.0.smithi047.stdout: Include close in write timing 2024-05-08T19:25:11.398 INFO:tasks.workunit.client.0.smithi047.stdout: Include fsync in write timing 2024-05-08T19:25:11.398 INFO:tasks.workunit.client.0.smithi047.stdout: File size set to 1048576 kB 2024-05-08T19:25:11.398 INFO:tasks.workunit.client.0.smithi047.stdout: Record Size 1024 kB 2024-05-08T19:25:11.398 INFO:tasks.workunit.client.0.smithi047.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-08T19:25:11.399 INFO:tasks.workunit.client.0.smithi047.stdout: Output is in kBytes/sec 2024-05-08T19:25:11.399 INFO:tasks.workunit.client.0.smithi047.stdout: Time Resolution = 0.000001 seconds. 2024-05-08T19:25:11.399 INFO:tasks.workunit.client.0.smithi047.stdout: Processor cache size set to 1024 kBytes. 2024-05-08T19:25:11.399 INFO:tasks.workunit.client.0.smithi047.stdout: Processor cache line size set to 32 bytes. 2024-05-08T19:25:11.399 INFO:tasks.workunit.client.0.smithi047.stdout: File stride size set to 17 * record size. 2024-05-08T19:25:11.399 INFO:tasks.workunit.client.0.smithi047.stdout: Throughput test with 1 process 2024-05-08T19:25:11.399 INFO:tasks.workunit.client.0.smithi047.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-05-08T19:25:12.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 145750 16.42 MB/sec warmup 49 sec latency 11.454 ms 2024-05-08T19:25:13.284 INFO:tasks.workunit.client.1.smithi177.stdout: 1 147352 16.21 MB/sec warmup 50 sec latency 46.059 ms 2024-05-08T19:25:13.441 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:13.441 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 initial writers = 521221.66 kB/sec 2024-05-08T19:25:13.441 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 initial writers = 521142.37 kB/sec 2024-05-08T19:25:13.442 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 521221.66 kB/sec 2024-05-08T19:25:13.442 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 521221.66 kB/sec 2024-05-08T19:25:13.442 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 521221.66 kB/sec 2024-05-08T19:25:13.442 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-08T19:25:14.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 149915 16.17 MB/sec warmup 51 sec latency 35.053 ms 2024-05-08T19:25:15.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 151558 16.00 MB/sec warmup 52 sec latency 533.542 ms 2024-05-08T19:25:16.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 153261 15.92 MB/sec warmup 53 sec latency 59.150 ms 2024-05-08T19:25:17.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 155426 15.82 MB/sec warmup 54 sec latency 28.274 ms 2024-05-08T19:25:18.268 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:18.268 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 rewriters = 543789.62 kB/sec 2024-05-08T19:25:18.268 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 rewriters = 543719.18 kB/sec 2024-05-08T19:25:18.268 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 543789.62 kB/sec 2024-05-08T19:25:18.268 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 543789.62 kB/sec 2024-05-08T19:25:18.268 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 543789.62 kB/sec 2024-05-08T19:25:18.268 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-08T19:25:18.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 156759 15.68 MB/sec warmup 55 sec latency 27.377 ms 2024-05-08T19:25:19.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 159941 15.74 MB/sec warmup 56 sec latency 14.898 ms 2024-05-08T19:25:20.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 163295 15.78 MB/sec warmup 57 sec latency 26.453 ms 2024-05-08T19:25:21.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 166544 15.78 MB/sec warmup 58 sec latency 11.759 ms 2024-05-08T19:25:22.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 169646 15.80 MB/sec warmup 59 sec latency 29.612 ms 2024-05-08T19:25:22.723 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:22.723 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 readers = 7708814.00 kB/sec 2024-05-08T19:25:22.723 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 readers = 7690037.86 kB/sec 2024-05-08T19:25:22.724 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 7708814.00 kB/sec 2024-05-08T19:25:22.724 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 7708814.00 kB/sec 2024-05-08T19:25:22.724 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 7708814.00 kB/sec 2024-05-08T19:25:22.724 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-08T19:25:23.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 171895 15.73 MB/sec warmup 60 sec latency 94.572 ms 2024-05-08T19:25:24.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 174706 15.72 MB/sec warmup 61 sec latency 12.180 ms 2024-05-08T19:25:25.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 177985 15.76 MB/sec warmup 62 sec latency 13.697 ms 2024-05-08T19:25:25.286 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:25.287 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 re-readers = 5994675.50 kB/sec 2024-05-08T19:25:25.287 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 re-readers = 5984780.58 kB/sec 2024-05-08T19:25:25.287 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 5994675.50 kB/sec 2024-05-08T19:25:25.287 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 5994675.50 kB/sec 2024-05-08T19:25:25.287 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 5994675.50 kB/sec 2024-05-08T19:25:25.287 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-08T19:25:26.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 181166 15.81 MB/sec warmup 63 sec latency 28.121 ms 2024-05-08T19:25:26.420 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:25:26.423 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:25:27.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 184431 15.84 MB/sec warmup 64 sec latency 14.860 ms 2024-05-08T19:25:28.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 186350 15.70 MB/sec warmup 65 sec latency 75.476 ms 2024-05-08T19:25:29.278 INFO:tasks.workunit.client.1.smithi177.stdout: 1 189175 15.71 MB/sec warmup 66 sec latency 23.798 ms 2024-05-08T19:25:30.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 192270 15.73 MB/sec warmup 67 sec latency 57.023 ms 2024-05-08T19:25:31.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 195338 15.77 MB/sec warmup 68 sec latency 25.458 ms 2024-05-08T19:25:32.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 197994 15.72 MB/sec warmup 69 sec latency 100.750 ms 2024-05-08T19:25:32.570 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:32.570 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:32.570 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:32.570 INFO:tasks.workunit.client.0.smithi047.stdout:iozone test complete. 2024-05-08T19:25:32.570 INFO:tasks.workunit.client.0.smithi047.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-08T19:25:32.603 INFO:tasks.workunit.client.0.smithi047.stdout: Iozone: Performance Test of File I/O 2024-05-08T19:25:32.603 INFO:tasks.workunit.client.0.smithi047.stdout: Version $Revision: 3.489 $ 2024-05-08T19:25:32.603 INFO:tasks.workunit.client.0.smithi047.stdout: Compiled for 64 bit mode. 2024-05-08T19:25:32.604 INFO:tasks.workunit.client.0.smithi047.stdout: Build: linux-AMD64 2024-05-08T19:25:32.604 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:32.604 INFO:tasks.workunit.client.0.smithi047.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-08T19:25:32.604 INFO:tasks.workunit.client.0.smithi047.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-08T19:25:32.604 INFO:tasks.workunit.client.0.smithi047.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-08T19:25:32.604 INFO:tasks.workunit.client.0.smithi047.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-08T19:25:32.604 INFO:tasks.workunit.client.0.smithi047.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-08T19:25:32.604 INFO:tasks.workunit.client.0.smithi047.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-08T19:25:32.604 INFO:tasks.workunit.client.0.smithi047.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-08T19:25:32.604 INFO:tasks.workunit.client.0.smithi047.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-08T19:25:32.604 INFO:tasks.workunit.client.0.smithi047.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-08T19:25:32.604 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:32.604 INFO:tasks.workunit.client.0.smithi047.stdout: Run began: Wed May 8 19:25:32 2024 2024-05-08T19:25:32.604 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:32.605 INFO:tasks.workunit.client.0.smithi047.stdout: Include close in write timing 2024-05-08T19:25:32.605 INFO:tasks.workunit.client.0.smithi047.stdout: Include fsync in write timing 2024-05-08T19:25:32.605 INFO:tasks.workunit.client.0.smithi047.stdout: File size set to 10485760 kB 2024-05-08T19:25:32.605 INFO:tasks.workunit.client.0.smithi047.stdout: Record Size 1024 kB 2024-05-08T19:25:32.605 INFO:tasks.workunit.client.0.smithi047.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-08T19:25:32.605 INFO:tasks.workunit.client.0.smithi047.stdout: Output is in kBytes/sec 2024-05-08T19:25:32.605 INFO:tasks.workunit.client.0.smithi047.stdout: Time Resolution = 0.000001 seconds. 2024-05-08T19:25:32.605 INFO:tasks.workunit.client.0.smithi047.stdout: Processor cache size set to 1024 kBytes. 2024-05-08T19:25:32.605 INFO:tasks.workunit.client.0.smithi047.stdout: Processor cache line size set to 32 bytes. 2024-05-08T19:25:32.605 INFO:tasks.workunit.client.0.smithi047.stdout: File stride size set to 17 * record size. 2024-05-08T19:25:32.605 INFO:tasks.workunit.client.0.smithi047.stdout: Throughput test with 1 process 2024-05-08T19:25:32.605 INFO:tasks.workunit.client.0.smithi047.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-05-08T19:25:33.282 INFO:tasks.workunit.client.1.smithi177.stdout: 1 199383 15.60 MB/sec warmup 70 sec latency 80.195 ms 2024-05-08T19:25:34.276 INFO:tasks.workunit.client.1.smithi177.stdout: 1 201845 15.57 MB/sec warmup 71 sec latency 18.447 ms 2024-05-08T19:25:35.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 202923 15.43 MB/sec warmup 72 sec latency 170.486 ms 2024-05-08T19:25:36.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 203254 15.25 MB/sec warmup 73 sec latency 213.508 ms 2024-05-08T19:25:37.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 205523 15.21 MB/sec warmup 74 sec latency 41.276 ms 2024-05-08T19:25:38.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 206632 15.08 MB/sec warmup 75 sec latency 29.919 ms 2024-05-08T19:25:39.278 INFO:tasks.workunit.client.1.smithi177.stdout: 1 209103 15.06 MB/sec warmup 76 sec latency 18.324 ms 2024-05-08T19:25:40.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 210496 14.95 MB/sec warmup 77 sec latency 19.424 ms 2024-05-08T19:25:41.282 INFO:tasks.workunit.client.1.smithi177.stdout: 1 213048 14.97 MB/sec warmup 78 sec latency 20.016 ms 2024-05-08T19:25:42.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 214458 14.85 MB/sec warmup 79 sec latency 21.857 ms 2024-05-08T19:25:43.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 216790 14.84 MB/sec warmup 80 sec latency 29.416 ms 2024-05-08T19:25:44.279 INFO:tasks.workunit.client.1.smithi177.stdout: 1 218800 14.75 MB/sec warmup 81 sec latency 26.411 ms 2024-05-08T19:25:45.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 220343 14.71 MB/sec warmup 82 sec latency 118.460 ms 2024-05-08T19:25:46.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 222107 14.61 MB/sec warmup 83 sec latency 34.112 ms 2024-05-08T19:25:47.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 223953 14.59 MB/sec warmup 84 sec latency 19.575 ms 2024-05-08T19:25:48.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 225955 14.50 MB/sec warmup 85 sec latency 28.629 ms 2024-05-08T19:25:49.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 227744 14.48 MB/sec warmup 86 sec latency 17.377 ms 2024-05-08T19:25:50.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 229970 14.45 MB/sec warmup 87 sec latency 58.786 ms 2024-05-08T19:25:51.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 230922 14.36 MB/sec warmup 88 sec latency 132.895 ms 2024-05-08T19:25:52.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 231783 14.23 MB/sec warmup 89 sec latency 69.668 ms 2024-05-08T19:25:53.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 234388 14.25 MB/sec warmup 90 sec latency 16.962 ms 2024-05-08T19:25:53.651 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:25:53.652 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 initial writers = 498920.16 kB/sec 2024-05-08T19:25:53.652 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 initial writers = 498913.06 kB/sec 2024-05-08T19:25:53.652 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 498920.16 kB/sec 2024-05-08T19:25:53.652 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 498920.16 kB/sec 2024-05-08T19:25:53.652 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 498920.16 kB/sec 2024-05-08T19:25:53.652 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 10485760.00 kB 2024-05-08T19:25:54.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 237134 14.24 MB/sec warmup 91 sec latency 34.288 ms 2024-05-08T19:25:55.279 INFO:tasks.workunit.client.1.smithi177.stdout: 1 240164 14.24 MB/sec warmup 92 sec latency 27.725 ms 2024-05-08T19:25:56.278 INFO:tasks.workunit.client.1.smithi177.stdout: 1 243242 14.27 MB/sec warmup 93 sec latency 17.197 ms 2024-05-08T19:25:56.491 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:25:56.495 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:25:57.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 245975 14.28 MB/sec warmup 94 sec latency 16.238 ms 2024-05-08T19:25:58.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 249213 14.32 MB/sec warmup 95 sec latency 14.927 ms 2024-05-08T19:25:59.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 252576 14.36 MB/sec warmup 96 sec latency 8.717 ms 2024-05-08T19:26:00.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 255952 14.41 MB/sec warmup 97 sec latency 23.592 ms 2024-05-08T19:26:01.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 259354 14.46 MB/sec warmup 98 sec latency 19.134 ms 2024-05-08T19:26:02.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 262791 14.50 MB/sec warmup 99 sec latency 10.668 ms 2024-05-08T19:26:03.277 INFO:tasks.workunit.client.1.smithi177.stdout: 1 265484 14.49 MB/sec warmup 100 sec latency 26.553 ms 2024-05-08T19:26:04.278 INFO:tasks.workunit.client.1.smithi177.stdout: 1 266805 14.41 MB/sec warmup 101 sec latency 18.514 ms 2024-05-08T19:26:05.280 INFO:tasks.workunit.client.1.smithi177.stdout: 1 269051 14.39 MB/sec warmup 102 sec latency 41.314 ms 2024-05-08T19:26:06.278 INFO:tasks.workunit.client.1.smithi177.stdout: 1 270403 14.32 MB/sec warmup 103 sec latency 17.417 ms 2024-05-08T19:26:07.278 INFO:tasks.workunit.client.1.smithi177.stdout: 1 271497 14.23 MB/sec warmup 104 sec latency 257.777 ms 2024-05-08T19:26:08.278 INFO:tasks.workunit.client.1.smithi177.stdout: 1 273488 14.22 MB/sec warmup 105 sec latency 21.542 ms 2024-05-08T19:26:09.278 INFO:tasks.workunit.client.1.smithi177.stdout: 1 275119 14.14 MB/sec warmup 106 sec latency 25.762 ms 2024-05-08T19:26:10.281 INFO:tasks.workunit.client.1.smithi177.stdout: 1 277057 14.14 MB/sec warmup 107 sec latency 22.803 ms 2024-05-08T19:26:11.280 INFO:tasks.workunit.client.1.smithi177.stdout: 1 277673 14.01 MB/sec warmup 108 sec latency 267.977 ms 2024-05-08T19:26:12.280 INFO:tasks.workunit.client.1.smithi177.stdout: 1 278165 13.92 MB/sec warmup 109 sec latency 292.524 ms 2024-05-08T19:26:13.280 INFO:tasks.workunit.client.1.smithi177.stdout: 1 280317 13.91 MB/sec warmup 110 sec latency 35.608 ms 2024-05-08T19:26:14.280 INFO:tasks.workunit.client.1.smithi177.stdout: 1 281311 13.82 MB/sec warmup 111 sec latency 23.131 ms 2024-05-08T19:26:15.286 INFO:tasks.workunit.client.1.smithi177.stdout: 1 283436 13.79 MB/sec warmup 112 sec latency 30.704 ms 2024-05-08T19:26:16.285 INFO:tasks.workunit.client.1.smithi177.stdout: 1 284574 13.73 MB/sec warmup 113 sec latency 26.974 ms 2024-05-08T19:26:17.286 INFO:tasks.workunit.client.1.smithi177.stdout: 1 286393 13.67 MB/sec warmup 114 sec latency 45.755 ms 2024-05-08T19:26:18.286 INFO:tasks.workunit.client.1.smithi177.stdout: 1 287864 13.65 MB/sec warmup 115 sec latency 24.894 ms 2024-05-08T19:26:19.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 289710 13.59 MB/sec warmup 116 sec latency 19.798 ms 2024-05-08T19:26:20.286 INFO:tasks.workunit.client.1.smithi177.stdout: 1 291244 13.58 MB/sec warmup 117 sec latency 22.061 ms 2024-05-08T19:26:21.286 INFO:tasks.workunit.client.1.smithi177.stdout: 1 292300 13.51 MB/sec warmup 118 sec latency 37.885 ms 2024-05-08T19:26:22.286 INFO:tasks.workunit.client.1.smithi177.stdout: 1 294244 13.47 MB/sec warmup 119 sec latency 28.059 ms 2024-05-08T19:26:22.923 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:26:22.923 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 rewriters = 524785.31 kB/sec 2024-05-08T19:26:22.923 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 rewriters = 524776.69 kB/sec 2024-05-08T19:26:22.923 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 524785.31 kB/sec 2024-05-08T19:26:22.923 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 524785.31 kB/sec 2024-05-08T19:26:22.923 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 524785.31 kB/sec 2024-05-08T19:26:22.923 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 10485760.00 kB 2024-05-08T19:26:24.286 INFO:tasks.workunit.client.1.smithi177.stdout: 1 298886 19.00 MB/sec execute 1 sec latency 121.631 ms 2024-05-08T19:26:25.286 INFO:tasks.workunit.client.1.smithi177.stdout: 1 302131 18.70 MB/sec execute 2 sec latency 17.217 ms 2024-05-08T19:26:26.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 305487 18.83 MB/sec execute 3 sec latency 23.846 ms 2024-05-08T19:26:26.987 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:26:26.995 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:26:27.286 INFO:tasks.workunit.client.1.smithi177.stdout: 1 308699 18.55 MB/sec execute 4 sec latency 35.503 ms 2024-05-08T19:26:28.291 INFO:tasks.workunit.client.1.smithi177.stdout: 1 311586 17.64 MB/sec execute 5 sec latency 9.355 ms 2024-05-08T19:26:29.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 313661 16.64 MB/sec execute 6 sec latency 131.327 ms 2024-05-08T19:26:30.292 INFO:tasks.workunit.client.1.smithi177.stdout: 1 316588 16.37 MB/sec execute 7 sec latency 20.198 ms 2024-05-08T19:26:31.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 319848 16.63 MB/sec execute 8 sec latency 16.841 ms 2024-05-08T19:26:32.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 320236 14.88 MB/sec execute 9 sec latency 281.190 ms 2024-05-08T19:26:33.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 323376 15.21 MB/sec execute 10 sec latency 96.210 ms 2024-05-08T19:26:34.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 326560 15.54 MB/sec execute 11 sec latency 41.429 ms 2024-05-08T19:26:35.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 329664 15.47 MB/sec execute 12 sec latency 32.341 ms 2024-05-08T19:26:36.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 332353 15.23 MB/sec execute 13 sec latency 27.351 ms 2024-05-08T19:26:36.941 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:26:36.941 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 readers = 8262046.00 kB/sec 2024-05-08T19:26:36.941 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 readers = 8260601.50 kB/sec 2024-05-08T19:26:36.941 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 8262046.00 kB/sec 2024-05-08T19:26:36.941 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 8262046.00 kB/sec 2024-05-08T19:26:36.942 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 8262046.00 kB/sec 2024-05-08T19:26:36.942 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 10485760.00 kB 2024-05-08T19:26:37.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 334947 15.33 MB/sec execute 14 sec latency 21.096 ms 2024-05-08T19:26:38.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 337889 15.29 MB/sec execute 15 sec latency 15.654 ms 2024-05-08T19:26:39.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 341240 15.50 MB/sec execute 16 sec latency 23.822 ms 2024-05-08T19:26:40.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 344624 15.70 MB/sec execute 17 sec latency 8.344 ms 2024-05-08T19:26:41.031 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:26:41.031 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 re-readers = 6424200.00 kB/sec 2024-05-08T19:26:41.031 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 re-readers = 6423240.37 kB/sec 2024-05-08T19:26:41.031 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 6424200.00 kB/sec 2024-05-08T19:26:41.031 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 6424200.00 kB/sec 2024-05-08T19:26:41.031 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 6424200.00 kB/sec 2024-05-08T19:26:41.031 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 10485760.00 kB 2024-05-08T19:26:41.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 347881 15.87 MB/sec execute 18 sec latency 31.396 ms 2024-05-08T19:26:42.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 351217 15.98 MB/sec execute 19 sec latency 31.581 ms 2024-05-08T19:26:43.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 354156 15.88 MB/sec execute 20 sec latency 24.417 ms 2024-05-08T19:26:44.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 357101 15.77 MB/sec execute 21 sec latency 23.314 ms 2024-05-08T19:26:45.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 359858 15.84 MB/sec execute 22 sec latency 15.710 ms 2024-05-08T19:26:46.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 362675 15.79 MB/sec execute 23 sec latency 16.344 ms 2024-05-08T19:26:47.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 366023 15.91 MB/sec execute 24 sec latency 19.468 ms 2024-05-08T19:26:48.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 369131 16.01 MB/sec execute 25 sec latency 20.587 ms 2024-05-08T19:26:49.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 369696 15.43 MB/sec execute 26 sec latency 22.035 ms 2024-05-08T19:26:50.287 INFO:tasks.workunit.client.1.smithi177.stdout: 1 371262 15.10 MB/sec execute 27 sec latency 27.392 ms 2024-05-08T19:26:50.645 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:26:50.645 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:26:50.647 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-08T19:26:50.647 INFO:tasks.workunit.client.0.smithi047.stdout:iozone test complete. 2024-05-08T19:26:50.648 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T19:26:50.648 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T19:26:50.712 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-05-08T19:26:50.712 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-08T19:26:51.015 DEBUG:teuthology.parallel:result is None 2024-05-08T19:26:51.015 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T19:26:51.052 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T19:26:51.052 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-08T19:26:51.052 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:26:51.052 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T19:26:51.115 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:26:51.116 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T19:26:51.176 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:26:51.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 372491 14.94 MB/sec execute 28 sec latency 558.643 ms 2024-05-08T19:26:51.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.355+0000 7f5a6cf5c700 1 Processor -- start 2024-05-08T19:26:51.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.355+0000 7f5a6cf5c700 1 -- start start 2024-05-08T19:26:51.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.356+0000 7f5a6cf5c700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5a680c0a00 0x7f5a68156930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:51.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.356+0000 7f5a6cf5c700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a68066a70 con 0x7f5a680c6180 2024-05-08T19:26:51.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.356+0000 7f5a6cf5c700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a680c5950 con 0x7f5a68150080 2024-05-08T19:26:51.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.356+0000 7f5a6cf5c700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a68150460 con 0x7f5a680c0a00 2024-05-08T19:26:51.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.356+0000 7f5a66d9d700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5a680c0a00 0x7f5a68156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:51.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.356+0000 7f5a65d9b700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5a680c6180 0x7f5a68156220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59370/0 (socket says 172.21.15.47:59370) 2024-05-08T19:26:51.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.356+0000 7f5a66d9d700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5a680c0a00 0x7f5a68156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60542/0 (socket says 172.21.15.47:60542) 2024-05-08T19:26:51.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.356+0000 7f5a65d9b700 1 -- 172.21.15.47:0/1950539953 learned_addr learned my addr 172.21.15.47:0/1950539953 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:26:51.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.356+0000 7f5a66d9d700 1 -- 172.21.15.47:0/1950539953 >> v1:172.21.15.177:6789/0 conn(0x7f5a68150080 legacy=0x7f5a6806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:51.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.356+0000 7f5a66d9d700 1 -- 172.21.15.47:0/1950539953 >> v1:172.21.15.47:6789/0 conn(0x7f5a680c6180 legacy=0x7f5a68156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:51.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.356+0000 7f5a6559a700 1 -- 172.21.15.47:0/1950539953 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275624807 0 0) 0x7f5a680c5950 con 0x7f5a68150080 2024-05-08T19:26:51.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.356+0000 7f5a66d9d700 1 -- 172.21.15.47:0/1950539953 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a68153370 con 0x7f5a680c0a00 2024-05-08T19:26:51.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.356+0000 7f5a66d9d700 1 --2- 172.21.15.47:0/1950539953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a680c0a00 0x7f5a68156930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009d90 tx=0x7f5a6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a491299fdcdd49 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:51.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.357+0000 7f5a6559a700 1 -- 172.21.15.47:0/1950539953 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6000e070 con 0x7f5a680c0a00 2024-05-08T19:26:51.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.357+0000 7f5a6559a700 1 -- 172.21.15.47:0/1950539953 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6000bad0 con 0x7f5a680c0a00 2024-05-08T19:26:51.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.357+0000 7f5a6559a700 1 -- 172.21.15.47:0/1950539953 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6000be80 con 0x7f5a680c0a00 2024-05-08T19:26:51.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.357+0000 7f5a6cf5c700 1 -- 172.21.15.47:0/1950539953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a680c0a00 msgr2=0x7f5a68156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:51.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.357+0000 7f5a6cf5c700 1 --2- 172.21.15.47:0/1950539953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a680c0a00 0x7f5a68156930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009d90 tx=0x7f5a6000b330 comp rx=0 tx=0).stop 2024-05-08T19:26:51.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.357+0000 7f5a6cf5c700 1 -- 172.21.15.47:0/1950539953 shutdown_connections 2024-05-08T19:26:51.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.357+0000 7f5a6cf5c700 1 --2- 172.21.15.47:0/1950539953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a680c0a00 0x7f5a68156930 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:51.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.357+0000 7f5a6cf5c700 1 -- 172.21.15.47:0/1950539953 >> 172.21.15.47:0/1950539953 conn(0x7f5a680c3280 msgr2=0x7f5a680c3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:51.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.357+0000 7f5a6cf5c700 1 -- 172.21.15.47:0/1950539953 shutdown_connections 2024-05-08T19:26:51.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.357+0000 7f5a6cf5c700 1 -- 172.21.15.47:0/1950539953 wait complete. 2024-05-08T19:26:51.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.359+0000 7f5a6cf5c700 1 Processor -- start 2024-05-08T19:26:51.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.359+0000 7f5a6cf5c700 1 -- start start 2024-05-08T19:26:51.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a6cf5c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a680c0a00 0x7f5a6806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:51.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a6cf5c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a680c6180 0x7f5a680bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:51.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a6cf5c700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a68150080 0x7f5a681ed990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:51.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a6cf5c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a68154140 con 0x7f5a680c0a00 2024-05-08T19:26:51.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a6cf5c700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6806dd80 con 0x7f5a680c6180 2024-05-08T19:26:51.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a6cf5c700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6814c860 con 0x7f5a68150080 2024-05-08T19:26:51.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a6659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a680c0a00 0x7f5a6806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:51.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a6659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a680c0a00 0x7f5a6806f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60558/0 (socket says 172.21.15.47:60558) 2024-05-08T19:26:51.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a6659c700 1 -- 172.21.15.47:0/2377732633 learned_addr learned my addr 172.21.15.47:0/2377732633 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:51.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a65d9b700 1 --2- 172.21.15.47:0/2377732633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a680c6180 0x7f5a680bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:51.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a66d9d700 1 --2- 172.21.15.47:0/2377732633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a68150080 0x7f5a681ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:51.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a6659c700 1 -- 172.21.15.47:0/2377732633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a68150080 msgr2=0x7f5a681ed990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:51.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a6659c700 1 --2- 172.21.15.47:0/2377732633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a68150080 0x7f5a681ed990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:51.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a6659c700 1 -- 172.21.15.47:0/2377732633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a680c6180 msgr2=0x7f5a680bfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:51.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a6659c700 1 --2- 172.21.15.47:0/2377732633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a680c6180 0x7f5a680bfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:51.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a6659c700 1 -- 172.21.15.47:0/2377732633 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a60009a70 con 0x7f5a680c0a00 2024-05-08T19:26:51.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a6659c700 1 --2- 172.21.15.47:0/2377732633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a680c0a00 0x7f5a6806f310 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800c550 tx=0x7f5a5800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:51.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.360+0000 7f5a56ffd700 1 -- 172.21.15.47:0/2377732633 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a580054e0 con 0x7f5a680c0a00 2024-05-08T19:26:51.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.361+0000 7f5a56ffd700 1 -- 172.21.15.47:0/2377732633 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a58003680 con 0x7f5a680c0a00 2024-05-08T19:26:51.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.361+0000 7f5a6cf5c700 1 -- 172.21.15.47:0/2377732633 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6814cb00 con 0x7f5a680c0a00 2024-05-08T19:26:51.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.361+0000 7f5a56ffd700 1 -- 172.21.15.47:0/2377732633 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58003a30 con 0x7f5a680c0a00 2024-05-08T19:26:51.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.361+0000 7f5a6cf5c700 1 -- 172.21.15.47:0/2377732633 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a680c0360 con 0x7f5a680c0a00 2024-05-08T19:26:51.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.362+0000 7f5a6cf5c700 1 -- 172.21.15.47:0/2377732633 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6806daa0 con 0x7f5a680c0a00 2024-05-08T19:26:51.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.362+0000 7f5a56ffd700 1 -- 172.21.15.47:0/2377732633 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5a58003b90 con 0x7f5a680c0a00 2024-05-08T19:26:51.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.362+0000 7f5a56ffd700 1 --2- 172.21.15.47:0/2377732633 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f5a4806ac90 0x7f5a4806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:51.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.363+0000 7f5a56ffd700 1 -- 172.21.15.47:0/2377732633 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5a58088a10 con 0x7f5a680c0a00 2024-05-08T19:26:51.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.363+0000 7f5a65d9b700 1 --2- 172.21.15.47:0/2377732633 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f5a4806ac90 0x7f5a4806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:51.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.363+0000 7f5a65d9b700 1 --2- 172.21.15.47:0/2377732633 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f5a4806ac90 0x7f5a4806d150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5a6806f090 tx=0x7f5a5c004a50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:51.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.367+0000 7f5a56ffd700 1 -- 172.21.15.47:0/2377732633 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5a6806daa0 con 0x7f5a680c0a00 2024-05-08T19:26:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.587+0000 7f5a6cf5c700 1 -- 172.21.15.47:0/2377732633 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a6806daa0 con 0x7f5a680c0a00 2024-05-08T19:26:51.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.588+0000 7f5a56ffd700 1 -- 172.21.15.47:0/2377732633 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f5a6806daa0 con 0x7f5a680c0a00 2024-05-08T19:26:51.580 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:26:51.580 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:23:11.040286+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:26:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.590+0000 7f5a6cf5c700 1 -- 172.21.15.47:0/2377732633 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f5a4806ac90 msgr2=0x7f5a4806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.590+0000 7f5a6cf5c700 1 --2- 172.21.15.47:0/2377732633 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f5a4806ac90 0x7f5a4806d150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5a6806f090 tx=0x7f5a5c004a50 comp rx=0 tx=0).stop 2024-05-08T19:26:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.590+0000 7f5a6cf5c700 1 -- 172.21.15.47:0/2377732633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a680c0a00 msgr2=0x7f5a6806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.590+0000 7f5a6cf5c700 1 --2- 172.21.15.47:0/2377732633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a680c0a00 0x7f5a6806f310 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800c550 tx=0x7f5a5800c860 comp rx=0 tx=0).stop 2024-05-08T19:26:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.590+0000 7f5a6cf5c700 1 -- 172.21.15.47:0/2377732633 shutdown_connections 2024-05-08T19:26:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.590+0000 7f5a6cf5c700 1 --2- 172.21.15.47:0/2377732633 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f5a4806ac90 0x7f5a4806d150 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.590+0000 7f5a6cf5c700 1 --2- 172.21.15.47:0/2377732633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a680c0a00 0x7f5a6806f310 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.590+0000 7f5a6cf5c700 1 --2- 172.21.15.47:0/2377732633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a68150080 0x7f5a681ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.590+0000 7f5a6cf5c700 1 --2- 172.21.15.47:0/2377732633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a680c6180 0x7f5a680bfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.590+0000 7f5a6cf5c700 1 -- 172.21.15.47:0/2377732633 >> 172.21.15.47:0/2377732633 conn(0x7f5a680c3280 msgr2=0x7f5a6806b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.590+0000 7f5a6cf5c700 1 -- 172.21.15.47:0/2377732633 shutdown_connections 2024-05-08T19:26:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.590+0000 7f5a6cf5c700 1 -- 172.21.15.47:0/2377732633 wait complete. 2024-05-08T19:26:51.595 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T19:22:15.923832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T19:22:18.529792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T19:22:19.389797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T19:22:22.474001+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T19:26:51.595 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T19:26:51.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.750+0000 7f4efc24f700 1 Processor -- start 2024-05-08T19:26:51.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.750+0000 7f4efc24f700 1 -- start start 2024-05-08T19:26:51.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.750+0000 7f4efc24f700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4ef40c1520 0x7f4ef40c1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:51.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.751+0000 7f4efc24f700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef406d570 con 0x7f4ef41555d0 2024-05-08T19:26:51.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.751+0000 7f4efc24f700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef406c980 con 0x7f4ef40c5ff0 2024-05-08T19:26:51.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.751+0000 7f4efc24f700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef40c77b0 con 0x7f4ef40c1520 2024-05-08T19:26:51.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.751+0000 7f4ef97ea700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4ef41555d0 0x7f4ef4070b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59372/0 (socket says 172.21.15.47:59372) 2024-05-08T19:26:51.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.751+0000 7f4ef97ea700 1 -- 172.21.15.47:0/2915513305 learned_addr learned my addr 172.21.15.47:0/2915513305 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:26:51.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.751+0000 7f4ef9feb700 1 --2- 172.21.15.47:0/2915513305 >> v2:172.21.15.177:3300/0 conn(0x7f4ef40c1520 0x7f4ef40c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:51.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.751+0000 7f4ef8fe9700 1 -- 172.21.15.47:0/2915513305 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405755185 0 0) 0x7f4ef406d570 con 0x7f4ef41555d0 2024-05-08T19:26:51.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.751+0000 7f4ef8fe9700 1 -- 172.21.15.47:0/2915513305 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ee00035b0 con 0x7f4ef41555d0 2024-05-08T19:26:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.751+0000 7f4ef8fe9700 1 -- 172.21.15.47:0/2915513305 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036103719 0 0) 0x7f4ef406c980 con 0x7f4ef40c5ff0 2024-05-08T19:26:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.751+0000 7f4ef8fe9700 1 -- 172.21.15.47:0/2915513305 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef406d570 con 0x7f4ef40c5ff0 2024-05-08T19:26:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.751+0000 7f4ef9feb700 1 -- 172.21.15.47:0/2915513305 >> v1:172.21.15.177:6789/0 conn(0x7f4ef40c5ff0 legacy=0x7f4ef40c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.751+0000 7f4ef9feb700 1 -- 172.21.15.47:0/2915513305 >> v1:172.21.15.47:6789/0 conn(0x7f4ef41555d0 legacy=0x7f4ef4070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.751+0000 7f4ef9feb700 1 -- 172.21.15.47:0/2915513305 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef406da00 con 0x7f4ef40c1520 2024-05-08T19:26:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.751+0000 7f4ef9feb700 1 --2- 172.21.15.47:0/2915513305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef40c1520 0x7f4ef40c1900 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009840 tx=0x7f4ef0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4358f0b9fae81cb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.752+0000 7f4ef8fe9700 1 -- 172.21.15.47:0/2915513305 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0011830 con 0x7f4ef40c1520 2024-05-08T19:26:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.752+0000 7f4ef8fe9700 1 -- 172.21.15.47:0/2915513305 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef0011990 con 0x7f4ef40c1520 2024-05-08T19:26:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.752+0000 7f4ef8fe9700 1 -- 172.21.15.47:0/2915513305 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0011d20 con 0x7f4ef40c1520 2024-05-08T19:26:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.752+0000 7f4efc24f700 1 -- 172.21.15.47:0/2915513305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef40c1520 msgr2=0x7f4ef40c1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.752+0000 7f4efc24f700 1 --2- 172.21.15.47:0/2915513305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef40c1520 0x7f4ef40c1900 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009840 tx=0x7f4ef0009b50 comp rx=0 tx=0).stop 2024-05-08T19:26:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.752+0000 7f4efc24f700 1 -- 172.21.15.47:0/2915513305 shutdown_connections 2024-05-08T19:26:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.752+0000 7f4efc24f700 1 --2- 172.21.15.47:0/2915513305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef40c1520 0x7f4ef40c1900 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.752+0000 7f4efc24f700 1 -- 172.21.15.47:0/2915513305 >> 172.21.15.47:0/2915513305 conn(0x7f4ef40a9ea0 msgr2=0x7f4ef40aa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:51.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.752+0000 7f4efc24f700 1 -- 172.21.15.47:0/2915513305 shutdown_connections 2024-05-08T19:26:51.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.752+0000 7f4efc24f700 1 -- 172.21.15.47:0/2915513305 wait complete. 2024-05-08T19:26:51.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.754+0000 7f4efc24f700 1 Processor -- start 2024-05-08T19:26:51.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.754+0000 7f4efc24f700 1 -- start start 2024-05-08T19:26:51.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4efc24f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ef40c1520 0x7f4ef40a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:51.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4efc24f700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ef40c5ff0 0x7f4ef40a7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:51.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4efc24f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef41555d0 0x7f4ef41582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:51.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4efc24f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4155eb0 con 0x7f4ef40c1520 2024-05-08T19:26:51.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4efc24f700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40a7980 con 0x7f4ef41555d0 2024-05-08T19:26:51.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4efc24f700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef414f250 con 0x7f4ef40c5ff0 2024-05-08T19:26:51.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4ef9feb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ef40c1520 0x7f4ef40a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:51.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4ef9feb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ef40c1520 0x7f4ef40a6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60574/0 (socket says 172.21.15.47:60574) 2024-05-08T19:26:51.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4ef9feb700 1 -- 172.21.15.47:0/3982189203 learned_addr learned my addr 172.21.15.47:0/3982189203 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:51.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4efa7ec700 1 --2- 172.21.15.47:0/3982189203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef41555d0 0x7f4ef41582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:51.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4ef97ea700 1 --2- 172.21.15.47:0/3982189203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ef40c5ff0 0x7f4ef40a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:51.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4ef9feb700 1 -- 172.21.15.47:0/3982189203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ef40c5ff0 msgr2=0x7f4ef40a7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:51.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4ef9feb700 1 --2- 172.21.15.47:0/3982189203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ef40c5ff0 0x7f4ef40a7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:51.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4ef9feb700 1 -- 172.21.15.47:0/3982189203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef41555d0 msgr2=0x7f4ef41582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:51.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4ef9feb700 1 --2- 172.21.15.47:0/3982189203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef41555d0 0x7f4ef41582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:51.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4ef9feb700 1 -- 172.21.15.47:0/3982189203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef00094a0 con 0x7f4ef40c1520 2024-05-08T19:26:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.755+0000 7f4ef9feb700 1 --2- 172.21.15.47:0/3982189203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ef40c1520 0x7f4ef40a6f00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009b90 tx=0x7f4ef0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.756+0000 7f4eea7fc700 1 -- 172.21.15.47:0/3982189203 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef001a8f0 con 0x7f4ef40c1520 2024-05-08T19:26:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.756+0000 7f4eea7fc700 1 -- 172.21.15.47:0/3982189203 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef001aa50 con 0x7f4ef40c1520 2024-05-08T19:26:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.756+0000 7f4efc24f700 1 -- 172.21.15.47:0/3982189203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef41eb010 con 0x7f4ef40c1520 2024-05-08T19:26:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.756+0000 7f4eea7fc700 1 -- 172.21.15.47:0/3982189203 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef001ae00 con 0x7f4ef40c1520 2024-05-08T19:26:51.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.756+0000 7f4efc24f700 1 -- 172.21.15.47:0/3982189203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef4155ad0 con 0x7f4ef40c1520 2024-05-08T19:26:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.757+0000 7f4efc24f700 1 -- 172.21.15.47:0/3982189203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef4067350 con 0x7f4ef40c1520 2024-05-08T19:26:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.757+0000 7f4eea7fc700 1 -- 172.21.15.47:0/3982189203 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4ef002d450 con 0x7f4ef40c1520 2024-05-08T19:26:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.757+0000 7f4eea7fc700 1 --2- 172.21.15.47:0/3982189203 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f4ed806ac90 0x7f4ed806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.758+0000 7f4eea7fc700 1 -- 172.21.15.47:0/3982189203 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4ef008a8d0 con 0x7f4ef40c1520 2024-05-08T19:26:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.758+0000 7f4ef97ea700 1 --2- 172.21.15.47:0/3982189203 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f4ed806ac90 0x7f4ed806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.758+0000 7f4ef97ea700 1 --2- 172.21.15.47:0/3982189203 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f4ed806ac90 0x7f4ed806d150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4ef41546c0 tx=0x7f4ee4007dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:51.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:51.762+0000 7f4eea7fc700 1 -- 172.21.15.47:0/3982189203 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4ef0055780 con 0x7f4ef40c1520 2024-05-08T19:26:52.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.043+0000 7f4efc24f700 1 -- 172.21.15.47:0/3982189203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ef404ec60 con 0x7f4ef40c1520 2024-05-08T19:26:52.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.045+0000 7f4eea7fc700 1 -- 172.21.15.47:0/3982189203 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ef0088e60 con 0x7f4ef40c1520 2024-05-08T19:26:52.045 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-08T19:26:52.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.049+0000 7f4efc24f700 1 -- 172.21.15.47:0/3982189203 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f4ed806ac90 msgr2=0x7f4ed806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:52.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.049+0000 7f4efc24f700 1 --2- 172.21.15.47:0/3982189203 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f4ed806ac90 0x7f4ed806d150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4ef41546c0 tx=0x7f4ee4007dc0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.049+0000 7f4efc24f700 1 -- 172.21.15.47:0/3982189203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ef40c1520 msgr2=0x7f4ef40a6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:52.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.049+0000 7f4efc24f700 1 --2- 172.21.15.47:0/3982189203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ef40c1520 0x7f4ef40a6f00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009b90 tx=0x7f4ef0004750 comp rx=0 tx=0).stop 2024-05-08T19:26:52.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.050+0000 7f4efc24f700 1 -- 172.21.15.47:0/3982189203 shutdown_connections 2024-05-08T19:26:52.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.050+0000 7f4efc24f700 1 --2- 172.21.15.47:0/3982189203 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f4ed806ac90 0x7f4ed806d150 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.050+0000 7f4efc24f700 1 --2- 172.21.15.47:0/3982189203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ef40c1520 0x7f4ef40a6f00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.050+0000 7f4efc24f700 1 --2- 172.21.15.47:0/3982189203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef41555d0 0x7f4ef41582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.050+0000 7f4efc24f700 1 --2- 172.21.15.47:0/3982189203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ef40c5ff0 0x7f4ef40a7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.050+0000 7f4efc24f700 1 -- 172.21.15.47:0/3982189203 >> 172.21.15.47:0/3982189203 conn(0x7f4ef40a9ea0 msgr2=0x7f4ef406fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:52.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.050+0000 7f4efc24f700 1 -- 172.21.15.47:0/3982189203 shutdown_connections 2024-05-08T19:26:52.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.050+0000 7f4efc24f700 1 -- 172.21.15.47:0/3982189203 wait complete. 2024-05-08T19:26:52.070 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T19:26:52.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 373919 14.65 MB/sec execute 29 sec latency 364.915 ms 2024-05-08T19:26:52.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.348+0000 7f56870b0700 1 Processor -- start 2024-05-08T19:26:52.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.348+0000 7f56870b0700 1 -- start start 2024-05-08T19:26:52.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.349+0000 7f56870b0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f56800aab40 0x7f56800ac250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.349+0000 7f56870b0700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f568014eee0 0x7f56800c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.349+0000 7f56870b0700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56800c2880 con 0x7f56800a84b0 2024-05-08T19:26:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.349+0000 7f56870b0700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56800ab450 con 0x7f56800aab40 2024-05-08T19:26:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.349+0000 7f56870b0700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56800c2b60 con 0x7f568014eee0 2024-05-08T19:26:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.350+0000 7f568564d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f568014eee0 0x7f56800c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.350+0000 7f568564d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f568014eee0 0x7f56800c2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:44842/0 (socket says 172.21.15.47:44842) 2024-05-08T19:26:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.350+0000 7f568564d700 1 -- 172.21.15.47:0/1455385447 learned_addr learned my addr 172.21.15.47:0/1455385447 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.351+0000 7f568564d700 1 -- 172.21.15.47:0/1455385447 >> v2:172.21.15.177:3300/0 conn(0x7f56800aab40 msgr2=0x7f56800ac250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T19:26:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.351+0000 7f568564d700 1 --2- 172.21.15.47:0/1455385447 >> v2:172.21.15.177:3300/0 conn(0x7f56800aab40 0x7f56800ac250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.351+0000 7f568564d700 1 -- 172.21.15.47:0/1455385447 >> v1:172.21.15.177:6789/0 conn(0x7f56800a84b0 legacy=0x7f56800a9ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T19:26:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.351+0000 7f568564d700 1 -- 172.21.15.47:0/1455385447 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56801526e0 con 0x7f568014eee0 2024-05-08T19:26:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.357+0000 7f568564d700 1 --2- 172.21.15.47:0/1455385447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f568014eee0 0x7f56800c2ff0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5678009e50 tx=0x7f567800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76d87d3e22acb012 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.357+0000 7f567f7fe700 1 -- 172.21.15.47:0/1455385447 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567800e070 con 0x7f568014eee0 2024-05-08T19:26:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.358+0000 7f567f7fe700 1 -- 172.21.15.47:0/1455385447 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5678003a20 con 0x7f568014eee0 2024-05-08T19:26:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.358+0000 7f567f7fe700 1 -- 172.21.15.47:0/1455385447 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678003dd0 con 0x7f568014eee0 2024-05-08T19:26:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.358+0000 7f56870b0700 1 -- 172.21.15.47:0/1455385447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f568014eee0 msgr2=0x7f56800c2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.358+0000 7f56870b0700 1 --2- 172.21.15.47:0/1455385447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f568014eee0 0x7f56800c2ff0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5678009e50 tx=0x7f567800b330 comp rx=0 tx=0).stop 2024-05-08T19:26:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.358+0000 7f56870b0700 1 -- 172.21.15.47:0/1455385447 shutdown_connections 2024-05-08T19:26:52.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.358+0000 7f56870b0700 1 --2- 172.21.15.47:0/1455385447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f568014eee0 0x7f56800c2ff0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.358+0000 7f56870b0700 1 --2- 172.21.15.47:0/1455385447 >> v2:172.21.15.177:3300/0 conn(0x7f56800aab40 0x7f56800ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.358+0000 7f56870b0700 1 -- 172.21.15.47:0/1455385447 >> 172.21.15.47:0/1455385447 conn(0x7f56800c3c20 msgr2=0x7f56800c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.359+0000 7f56870b0700 1 -- 172.21.15.47:0/1455385447 shutdown_connections 2024-05-08T19:26:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.359+0000 7f56870b0700 1 -- 172.21.15.47:0/1455385447 wait complete. 2024-05-08T19:26:52.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.360+0000 7f56870b0700 1 Processor -- start 2024-05-08T19:26:52.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.360+0000 7f56870b0700 1 -- start start 2024-05-08T19:26:52.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.361+0000 7f56870b0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56800a84b0 0x7f568013f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:52.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.361+0000 7f56870b0700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56800aab40 0x7f568013d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:52.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.361+0000 7f56870b0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568014eee0 0x7f568013dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:52.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.361+0000 7f56870b0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5680140450 con 0x7f568014eee0 2024-05-08T19:26:52.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.361+0000 7f56870b0700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5680155cb0 con 0x7f56800a84b0 2024-05-08T19:26:52.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.361+0000 7f56870b0700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5680153700 con 0x7f56800aab40 2024-05-08T19:26:52.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.361+0000 7f568564d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568014eee0 0x7f568013dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:52.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.361+0000 7f568564d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568014eee0 0x7f568013dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60578/0 (socket says 172.21.15.47:60578) 2024-05-08T19:26:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.361+0000 7f568564d700 1 -- 172.21.15.47:0/615767135 learned_addr learned my addr 172.21.15.47:0/615767135 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.361+0000 7f567ffff700 1 --2- 172.21.15.47:0/615767135 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56800aab40 0x7f568013d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.361+0000 7f5684e4c700 1 --2- 172.21.15.47:0/615767135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56800a84b0 0x7f568013f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.362+0000 7f568564d700 1 -- 172.21.15.47:0/615767135 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56800aab40 msgr2=0x7f568013d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.362+0000 7f568564d700 1 --2- 172.21.15.47:0/615767135 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56800aab40 0x7f568013d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.362+0000 7f568564d700 1 -- 172.21.15.47:0/615767135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56800a84b0 msgr2=0x7f568013f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.362+0000 7f568564d700 1 --2- 172.21.15.47:0/615767135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56800a84b0 0x7f568013f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.362+0000 7f568564d700 1 -- 172.21.15.47:0/615767135 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5678009b30 con 0x7f568014eee0 2024-05-08T19:26:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.362+0000 7f568564d700 1 --2- 172.21.15.47:0/615767135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568014eee0 0x7f568013dd90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f567800b730 tx=0x7f5678004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.362+0000 7f567d7fa700 1 -- 172.21.15.47:0/615767135 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678004440 con 0x7f568014eee0 2024-05-08T19:26:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.362+0000 7f567d7fa700 1 -- 172.21.15.47:0/615767135 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56780045a0 con 0x7f568014eee0 2024-05-08T19:26:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.362+0000 7f56870b0700 1 -- 172.21.15.47:0/615767135 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56801559d0 con 0x7f568014eee0 2024-05-08T19:26:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.362+0000 7f567d7fa700 1 -- 172.21.15.47:0/615767135 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678004950 con 0x7f568014eee0 2024-05-08T19:26:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.362+0000 7f56870b0700 1 -- 172.21.15.47:0/615767135 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568013fe90 con 0x7f568014eee0 2024-05-08T19:26:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.363+0000 7f56870b0700 1 -- 172.21.15.47:0/615767135 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56801405b0 con 0x7f568014eee0 2024-05-08T19:26:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.364+0000 7f567d7fa700 1 -- 172.21.15.47:0/615767135 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5678027450 con 0x7f568014eee0 2024-05-08T19:26:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.364+0000 7f567d7fa700 1 --2- 172.21.15.47:0/615767135 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f566c06ac90 0x7f566c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.364+0000 7f567d7fa700 1 -- 172.21.15.47:0/615767135 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f567808b480 con 0x7f568014eee0 2024-05-08T19:26:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.365+0000 7f5684e4c700 1 --2- 172.21.15.47:0/615767135 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f566c06ac90 0x7f566c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.365+0000 7f5684e4c700 1 --2- 172.21.15.47:0/615767135 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f566c06ac90 0x7f566c06d150 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5670006fd0 tx=0x7f5670009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.369+0000 7f567d7fa700 1 -- 172.21.15.47:0/615767135 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f56801405b0 con 0x7f568014eee0 2024-05-08T19:26:52.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.579+0000 7f56870b0700 1 -- 172.21.15.47:0/615767135 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56801405b0 con 0x7f568014eee0 2024-05-08T19:26:52.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.579+0000 7f567d7fa700 1 -- 172.21.15.47:0/615767135 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56801405b0 con 0x7f568014eee0 2024-05-08T19:26:52.571 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-08T19:26:52.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.582+0000 7f56870b0700 1 -- 172.21.15.47:0/615767135 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f566c06ac90 msgr2=0x7f566c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:52.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.582+0000 7f56870b0700 1 --2- 172.21.15.47:0/615767135 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f566c06ac90 0x7f566c06d150 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5670006fd0 tx=0x7f5670009190 comp rx=0 tx=0).stop 2024-05-08T19:26:52.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.582+0000 7f56870b0700 1 -- 172.21.15.47:0/615767135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568014eee0 msgr2=0x7f568013dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:52.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.582+0000 7f56870b0700 1 --2- 172.21.15.47:0/615767135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568014eee0 0x7f568013dd90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f567800b730 tx=0x7f5678004ad0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.582+0000 7f56870b0700 1 -- 172.21.15.47:0/615767135 shutdown_connections 2024-05-08T19:26:52.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.582+0000 7f56870b0700 1 --2- 172.21.15.47:0/615767135 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f566c06ac90 0x7f566c06d150 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.582+0000 7f56870b0700 1 --2- 172.21.15.47:0/615767135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568014eee0 0x7f568013dd90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.582+0000 7f56870b0700 1 --2- 172.21.15.47:0/615767135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56800a84b0 0x7f568013f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.582+0000 7f56870b0700 1 --2- 172.21.15.47:0/615767135 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f56800aab40 0x7f568013d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.582+0000 7f56870b0700 1 -- 172.21.15.47:0/615767135 >> 172.21.15.47:0/615767135 conn(0x7f56800c3c20 msgr2=0x7f56800c2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:52.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.582+0000 7f56870b0700 1 -- 172.21.15.47:0/615767135 shutdown_connections 2024-05-08T19:26:52.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.582+0000 7f56870b0700 1 -- 172.21.15.47:0/615767135 wait complete. 2024-05-08T19:26:52.587 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T19:26:52.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.730+0000 7fbd2ac6d700 1 Processor -- start 2024-05-08T19:26:52.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.730+0000 7fbd2ac6d700 1 -- start start 2024-05-08T19:26:52.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.731+0000 7fbd2ac6d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd24152140 0x7fbd2406a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:52.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.731+0000 7fbd2ac6d700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd24152520 con 0x7fbd240720d0 2024-05-08T19:26:52.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.732+0000 7fbd2ac6d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2406b700 con 0x7fbd24072590 2024-05-08T19:26:52.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.732+0000 7fbd2ac6d700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd24154b70 con 0x7fbd24152140 2024-05-08T19:26:52.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.732+0000 7fbd2920a700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbd240720d0 0x7fbd2415f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59384/0 (socket says 172.21.15.47:59384) 2024-05-08T19:26:52.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.732+0000 7fbd2920a700 1 -- 172.21.15.47:0/2400740526 learned_addr learned my addr 172.21.15.47:0/2400740526 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:26:52.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.732+0000 7fbd28a09700 1 --2- 172.21.15.47:0/2400740526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd24152140 0x7fbd2406a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:52.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.732+0000 7fbd28a09700 1 -- 172.21.15.47:0/2400740526 >> v1:172.21.15.177:6789/0 conn(0x7fbd24072590 legacy=0x7fbd24154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:52.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.732+0000 7fbd28a09700 1 -- 172.21.15.47:0/2400740526 >> v1:172.21.15.47:6789/0 conn(0x7fbd240720d0 legacy=0x7fbd2415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:52.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.732+0000 7fbd28a09700 1 -- 172.21.15.47:0/2400740526 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd240a9840 con 0x7fbd24152140 2024-05-08T19:26:52.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.732+0000 7fbd28a09700 1 --2- 172.21.15.47:0/2400740526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd24152140 0x7fbd2406a9c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009870 tx=0x7fbd18009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c508c8487311c8e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:52.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.733+0000 7fbd237fe700 1 -- 172.21.15.47:0/2400740526 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18004230 con 0x7fbd24152140 2024-05-08T19:26:52.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.733+0000 7fbd237fe700 1 -- 172.21.15.47:0/2400740526 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd18004390 con 0x7fbd24152140 2024-05-08T19:26:52.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.733+0000 7fbd237fe700 1 -- 172.21.15.47:0/2400740526 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180036a0 con 0x7fbd24152140 2024-05-08T19:26:52.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.733+0000 7fbd2ac6d700 1 -- 172.21.15.47:0/2400740526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd24152140 msgr2=0x7fbd2406a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:52.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.733+0000 7fbd2ac6d700 1 --2- 172.21.15.47:0/2400740526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd24152140 0x7fbd2406a9c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009870 tx=0x7fbd18009b80 comp rx=0 tx=0).stop 2024-05-08T19:26:52.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.733+0000 7fbd2ac6d700 1 -- 172.21.15.47:0/2400740526 shutdown_connections 2024-05-08T19:26:52.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.733+0000 7fbd2ac6d700 1 --2- 172.21.15.47:0/2400740526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd24152140 0x7fbd2406a9c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.733+0000 7fbd2ac6d700 1 -- 172.21.15.47:0/2400740526 >> 172.21.15.47:0/2400740526 conn(0x7fbd240c7230 msgr2=0x7fbd240c7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:52.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.733+0000 7fbd2ac6d700 1 -- 172.21.15.47:0/2400740526 shutdown_connections 2024-05-08T19:26:52.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.733+0000 7fbd2ac6d700 1 -- 172.21.15.47:0/2400740526 wait complete. 2024-05-08T19:26:52.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.734+0000 7fbd2ac6d700 1 Processor -- start 2024-05-08T19:26:52.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.735+0000 7fbd2ac6d700 1 -- start start 2024-05-08T19:26:52.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.735+0000 7fbd2ac6d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd240720d0 0x7fbd2406ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:52.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.735+0000 7fbd2ac6d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd24072590 0x7fbd24147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:52.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.735+0000 7fbd2ac6d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd24152140 0x7fbd241483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:52.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.735+0000 7fbd2ac6d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240c5680 con 0x7fbd24072590 2024-05-08T19:26:52.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.735+0000 7fbd2ac6d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240ab180 con 0x7fbd24152140 2024-05-08T19:26:52.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.735+0000 7fbd2ac6d700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240c5e90 con 0x7fbd240720d0 2024-05-08T19:26:52.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.735+0000 7fbd23fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd24072590 0x7fbd24147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:52.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.736+0000 7fbd23fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd24072590 0x7fbd24147ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60594/0 (socket says 172.21.15.47:60594) 2024-05-08T19:26:52.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.736+0000 7fbd23fff700 1 -- 172.21.15.47:0/2407912451 learned_addr learned my addr 172.21.15.47:0/2407912451 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:52.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.736+0000 7fbd28a09700 1 --2- 172.21.15.47:0/2407912451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd240720d0 0x7fbd2406ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:52.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.736+0000 7fbd2920a700 1 --2- 172.21.15.47:0/2407912451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd24152140 0x7fbd241483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:52.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.736+0000 7fbd23fff700 1 -- 172.21.15.47:0/2407912451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd240720d0 msgr2=0x7fbd2406ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:52.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.736+0000 7fbd23fff700 1 --2- 172.21.15.47:0/2407912451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd240720d0 0x7fbd2406ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.736+0000 7fbd23fff700 1 -- 172.21.15.47:0/2407912451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd24152140 msgr2=0x7fbd241483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:52.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.736+0000 7fbd23fff700 1 --2- 172.21.15.47:0/2407912451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd24152140 0x7fbd241483e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:52.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.736+0000 7fbd23fff700 1 -- 172.21.15.47:0/2407912451 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd180094a0 con 0x7fbd24072590 2024-05-08T19:26:52.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.736+0000 7fbd23fff700 1 --2- 172.21.15.47:0/2407912451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd24072590 0x7fbd24147ea0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000c780 tx=0x7fbd1000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:52.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.736+0000 7fbd217fa700 1 -- 172.21.15.47:0/2407912451 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd100054e0 con 0x7fbd24072590 2024-05-08T19:26:52.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.736+0000 7fbd217fa700 1 -- 172.21.15.47:0/2407912451 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd10003680 con 0x7fbd24072590 2024-05-08T19:26:52.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.736+0000 7fbd2ac6d700 1 -- 172.21.15.47:0/2407912451 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd240c58d0 con 0x7fbd24072590 2024-05-08T19:26:52.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.736+0000 7fbd217fa700 1 -- 172.21.15.47:0/2407912451 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10003a30 con 0x7fbd24072590 2024-05-08T19:26:52.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.736+0000 7fbd2ac6d700 1 -- 172.21.15.47:0/2407912451 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd240aae10 con 0x7fbd24072590 2024-05-08T19:26:52.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.737+0000 7fbd2ac6d700 1 -- 172.21.15.47:0/2407912451 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd240aac70 con 0x7fbd24072590 2024-05-08T19:26:52.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.738+0000 7fbd217fa700 1 -- 172.21.15.47:0/2407912451 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbd10003b90 con 0x7fbd24072590 2024-05-08T19:26:52.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.738+0000 7fbd217fa700 1 --2- 172.21.15.47:0/2407912451 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fbd0806ac90 0x7fbd0806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:52.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.738+0000 7fbd217fa700 1 -- 172.21.15.47:0/2407912451 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbd10088ab0 con 0x7fbd24072590 2024-05-08T19:26:52.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.738+0000 7fbd28a09700 1 --2- 172.21.15.47:0/2407912451 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fbd0806ac90 0x7fbd0806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:52.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.739+0000 7fbd28a09700 1 --2- 172.21.15.47:0/2407912451 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fbd0806ac90 0x7fbd0806d150 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbd2406ddf0 tx=0x7fbd18008000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:52.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.742+0000 7fbd217fa700 1 -- 172.21.15.47:0/2407912451 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbd240aac70 con 0x7fbd24072590 2024-05-08T19:26:52.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.964+0000 7fbd2ac6d700 1 -- 172.21.15.47:0/2407912451 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd240aac70 con 0x7fbd24072590 2024-05-08T19:26:52.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.964+0000 7fbd217fa700 1 -- 172.21.15.47:0/2407912451 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd240aac70 con 0x7fbd24072590 2024-05-08T19:26:52.957 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-08T19:26:52.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.966+0000 7fbd2ac6d700 1 -- 172.21.15.47:0/2407912451 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fbd0806ac90 msgr2=0x7fbd0806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:52.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.966+0000 7fbd2ac6d700 1 --2- 172.21.15.47:0/2407912451 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fbd0806ac90 0x7fbd0806d150 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbd2406ddf0 tx=0x7fbd18008000 comp rx=0 tx=0).stop 2024-05-08T19:26:53.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.966+0000 7fbd2ac6d700 1 -- 172.21.15.47:0/2407912451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd24072590 msgr2=0x7fbd24147ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:53.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.966+0000 7fbd2ac6d700 1 --2- 172.21.15.47:0/2407912451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd24072590 0x7fbd24147ea0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000c780 tx=0x7fbd1000ca90 comp rx=0 tx=0).stop 2024-05-08T19:26:53.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.966+0000 7fbd2ac6d700 1 -- 172.21.15.47:0/2407912451 shutdown_connections 2024-05-08T19:26:53.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.966+0000 7fbd2ac6d700 1 --2- 172.21.15.47:0/2407912451 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fbd0806ac90 0x7fbd0806d150 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.966+0000 7fbd2ac6d700 1 --2- 172.21.15.47:0/2407912451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd24152140 0x7fbd241483e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.966+0000 7fbd2ac6d700 1 --2- 172.21.15.47:0/2407912451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd240720d0 0x7fbd2406ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.966+0000 7fbd2ac6d700 1 --2- 172.21.15.47:0/2407912451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd24072590 0x7fbd24147ea0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.966+0000 7fbd2ac6d700 1 -- 172.21.15.47:0/2407912451 >> 172.21.15.47:0/2407912451 conn(0x7fbd240c7230 msgr2=0x7fbd2414dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:53.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.966+0000 7fbd2ac6d700 1 -- 172.21.15.47:0/2407912451 shutdown_connections 2024-05-08T19:26:53.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:52.966+0000 7fbd2ac6d700 1 -- 172.21.15.47:0/2407912451 wait complete. 2024-05-08T19:26:53.009 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T19:26:53.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.221+0000 7feb5d940700 1 Processor -- start 2024-05-08T19:26:53.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.221+0000 7feb5d940700 1 -- start start 2024-05-08T19:26:53.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.223+0000 7feb5d940700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7feb5806b9d0 0x7feb58072b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:53.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.223+0000 7feb5d940700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb580c60a0 0x7feb5806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:53.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.223+0000 7feb5d940700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7feb580c47d0 0x7feb581526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:53.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.223+0000 7feb5d940700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb581599b0 con 0x7feb580c47d0 2024-05-08T19:26:53.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.223+0000 7feb5d940700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb58072050 con 0x7feb5806b9d0 2024-05-08T19:26:53.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.223+0000 7feb5d940700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb58072330 con 0x7feb580c60a0 2024-05-08T19:26:53.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.225+0000 7feb56ffd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7feb5806b9d0 0x7feb58072b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:53.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.225+0000 7feb56ffd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7feb5806b9d0 0x7feb58072b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:48536/0 (socket says 172.21.15.47:48536) 2024-05-08T19:26:53.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.225+0000 7feb56ffd700 1 -- 172.21.15.47:0/4074395841 learned_addr learned my addr 172.21.15.47:0/4074395841 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:53.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.225+0000 7feb577fe700 1 --2- 172.21.15.47:0/4074395841 >> v2:172.21.15.47:3300/0 conn(0x7feb580c47d0 0x7feb581526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:53.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.225+0000 7feb56ffd700 1 -- 172.21.15.47:0/4074395841 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb580c60a0 msgr2=0x7feb5806bdb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T19:26:53.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.225+0000 7feb56ffd700 1 --2- 172.21.15.47:0/4074395841 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb580c60a0 0x7feb5806bdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.225+0000 7feb56ffd700 1 -- 172.21.15.47:0/4074395841 >> v2:172.21.15.47:3300/0 conn(0x7feb580c47d0 msgr2=0x7feb581526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:26:53.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.225+0000 7feb56ffd700 1 --2- 172.21.15.47:0/4074395841 >> v2:172.21.15.47:3300/0 conn(0x7feb580c47d0 0x7feb581526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.225+0000 7feb56ffd700 1 -- 172.21.15.47:0/4074395841 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb58072610 con 0x7feb5806b9d0 2024-05-08T19:26:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.226+0000 7feb56ffd700 1 --2- 172.21.15.47:0/4074395841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb5806b9d0 0x7feb58072b30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feb58070b80 tx=0x7feb4c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca1adb43a9fa4bcf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.226+0000 7feb55ffb700 1 -- 172.21.15.47:0/4074395841 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c011830 con 0x7feb5806b9d0 2024-05-08T19:26:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.226+0000 7feb55ffb700 1 -- 172.21.15.47:0/4074395841 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c011990 con 0x7feb5806b9d0 2024-05-08T19:26:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.227+0000 7feb55ffb700 1 -- 172.21.15.47:0/4074395841 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c011d20 con 0x7feb5806b9d0 2024-05-08T19:26:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.227+0000 7feb5d940700 1 -- 172.21.15.47:0/4074395841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb5806b9d0 msgr2=0x7feb58072b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.227+0000 7feb5d940700 1 --2- 172.21.15.47:0/4074395841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb5806b9d0 0x7feb58072b30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feb58070b80 tx=0x7feb4c009bd0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.227+0000 7feb5d940700 1 -- 172.21.15.47:0/4074395841 shutdown_connections 2024-05-08T19:26:53.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.227+0000 7feb5d940700 1 --2- 172.21.15.47:0/4074395841 >> v2:172.21.15.47:3300/0 conn(0x7feb580c47d0 0x7feb581526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.227+0000 7feb5d940700 1 --2- 172.21.15.47:0/4074395841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb5806b9d0 0x7feb58072b30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.227+0000 7feb5d940700 1 --2- 172.21.15.47:0/4074395841 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb580c60a0 0x7feb5806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.227+0000 7feb5d940700 1 -- 172.21.15.47:0/4074395841 >> 172.21.15.47:0/4074395841 conn(0x7feb580c33d0 msgr2=0x7feb580c37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:53.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.228+0000 7feb5d940700 1 -- 172.21.15.47:0/4074395841 shutdown_connections 2024-05-08T19:26:53.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.229+0000 7feb5d940700 1 -- 172.21.15.47:0/4074395841 wait complete. 2024-05-08T19:26:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.231+0000 7feb5d940700 1 Processor -- start 2024-05-08T19:26:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.233+0000 7feb5d940700 1 -- start start 2024-05-08T19:26:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.234+0000 7feb5d940700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb5806b9d0 0x7feb5815cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.234+0000 7feb5d940700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb580c47d0 0x7feb5815c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.234+0000 7feb5d940700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb580c60a0 0x7feb58145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.234+0000 7feb5d940700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5815af30 con 0x7feb580c60a0 2024-05-08T19:26:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.234+0000 7feb5d940700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb58143b50 con 0x7feb580c47d0 2024-05-08T19:26:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.234+0000 7feb5d940700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb580c1800 con 0x7feb5806b9d0 2024-05-08T19:26:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.234+0000 7feb56ffd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb5806b9d0 0x7feb5815cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.234+0000 7feb56ffd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb5806b9d0 0x7feb5815cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:44882/0 (socket says 172.21.15.47:44882) 2024-05-08T19:26:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.234+0000 7feb56ffd700 1 -- 172.21.15.47:0/1835730322 learned_addr learned my addr 172.21.15.47:0/1835730322 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.235+0000 7feb56ffd700 1 -- 172.21.15.47:0/1835730322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb580c47d0 msgr2=0x7feb5815c7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T19:26:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.235+0000 7feb56ffd700 1 --2- 172.21.15.47:0/1835730322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb580c47d0 0x7feb5815c7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.235+0000 7feb56ffd700 1 -- 172.21.15.47:0/1835730322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb580c60a0 msgr2=0x7feb58145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.235+0000 7feb56ffd700 1 --2- 172.21.15.47:0/1835730322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb580c60a0 0x7feb58145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.235+0000 7feb56ffd700 1 -- 172.21.15.47:0/1835730322 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c009550 con 0x7feb5806b9d0 2024-05-08T19:26:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.236+0000 7feb56ffd700 1 --2- 172.21.15.47:0/1835730322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb5806b9d0 0x7feb5815cec0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009c10 tx=0x7feb4c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.236+0000 7feb3ffff700 1 -- 172.21.15.47:0/1835730322 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c0036a0 con 0x7feb5806b9d0 2024-05-08T19:26:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.236+0000 7feb3ffff700 1 -- 172.21.15.47:0/1835730322 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c01e070 con 0x7feb5806b9d0 2024-05-08T19:26:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.236+0000 7feb3ffff700 1 -- 172.21.15.47:0/1835730322 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c003a00 con 0x7feb5806b9d0 2024-05-08T19:26:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.236+0000 7feb5d940700 1 -- 172.21.15.47:0/1835730322 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb580c2f70 con 0x7feb5806b9d0 2024-05-08T19:26:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.237+0000 7feb5d940700 1 -- 172.21.15.47:0/1835730322 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5806e310 con 0x7feb5806b9d0 2024-05-08T19:26:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.238+0000 7feb5d940700 1 -- 172.21.15.47:0/1835730322 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5804ec60 con 0x7feb5806b9d0 2024-05-08T19:26:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.242+0000 7feb3ffff700 1 -- 172.21.15.47:0/1835730322 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feb4c003b60 con 0x7feb5806b9d0 2024-05-08T19:26:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.242+0000 7feb3ffff700 1 --2- 172.21.15.47:0/1835730322 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7feb4406acc0 0x7feb4406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.243+0000 7feb3ffff700 1 -- 172.21.15.47:0/1835730322 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feb4c089f00 con 0x7feb5806b9d0 2024-05-08T19:26:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.243+0000 7feb567fc700 1 --2- 172.21.15.47:0/1835730322 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7feb4406acc0 0x7feb4406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.246+0000 7feb567fc700 1 --2- 172.21.15.47:0/1835730322 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7feb4406acc0 0x7feb4406d180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb580ab840 tx=0x7feb50009250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.246+0000 7feb3ffff700 1 -- 172.21.15.47:0/1835730322 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7feb4c08f060 con 0x7feb5806b9d0 2024-05-08T19:26:53.290 INFO:tasks.workunit.client.1.smithi177.stdout: 1 375788 14.48 MB/sec execute 30 sec latency 583.503 ms 2024-05-08T19:26:53.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.656+0000 7feb5d940700 1 -- 172.21.15.47:0/1835730322 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7feb580c0a40 con 0x7feb5806b9d0 2024-05-08T19:26:53.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.656+0000 7feb3ffff700 1 -- 172.21.15.47:0/1835730322 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7feb4c0200a0 con 0x7feb5806b9d0 2024-05-08T19:26:53.648 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-08T19:26:53.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.659+0000 7feb5d940700 1 -- 172.21.15.47:0/1835730322 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7feb4406acc0 msgr2=0x7feb4406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:53.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.659+0000 7feb5d940700 1 --2- 172.21.15.47:0/1835730322 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7feb4406acc0 0x7feb4406d180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb580ab840 tx=0x7feb50009250 comp rx=0 tx=0).stop 2024-05-08T19:26:53.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.659+0000 7feb5d940700 1 -- 172.21.15.47:0/1835730322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb5806b9d0 msgr2=0x7feb5815cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:53.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.659+0000 7feb5d940700 1 --2- 172.21.15.47:0/1835730322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb5806b9d0 0x7feb5815cec0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009c10 tx=0x7feb4c004750 comp rx=0 tx=0).stop 2024-05-08T19:26:53.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.659+0000 7feb5d940700 1 -- 172.21.15.47:0/1835730322 shutdown_connections 2024-05-08T19:26:53.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.659+0000 7feb5d940700 1 --2- 172.21.15.47:0/1835730322 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7feb4406acc0 0x7feb4406d180 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.659+0000 7feb5d940700 1 --2- 172.21.15.47:0/1835730322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb580c60a0 0x7feb58145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.659+0000 7feb5d940700 1 --2- 172.21.15.47:0/1835730322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb5806b9d0 0x7feb5815cec0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.659+0000 7feb5d940700 1 --2- 172.21.15.47:0/1835730322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb580c47d0 0x7feb5815c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.659+0000 7feb5d940700 1 -- 172.21.15.47:0/1835730322 >> 172.21.15.47:0/1835730322 conn(0x7feb580c33d0 msgr2=0x7feb580c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:53.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.659+0000 7feb5d940700 1 -- 172.21.15.47:0/1835730322 shutdown_connections 2024-05-08T19:26:53.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.659+0000 7feb5d940700 1 -- 172.21.15.47:0/1835730322 wait complete. 2024-05-08T19:26:53.664 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T19:26:53.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.805+0000 7f45a7888700 1 Processor -- start 2024-05-08T19:26:53.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.805+0000 7f45a7888700 1 -- start start 2024-05-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.806+0000 7f45a7888700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f45a006b5f0 0x7f45a006e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.806+0000 7f45a7888700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45a006ec70 0x7f45a015f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.806+0000 7f45a7888700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a01554f0 con 0x7f45a0152160 2024-05-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.806+0000 7f45a7888700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a00a8850 con 0x7f45a006b5f0 2024-05-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.806+0000 7f45a7888700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a0152540 con 0x7f45a006ec70 2024-05-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.806+0000 7f45a4e23700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f45a006b5f0 0x7f45a006e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.806+0000 7f45a4e23700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f45a006b5f0 0x7f45a006e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60608/0 (socket says 172.21.15.47:60608) 2024-05-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.806+0000 7f45a4e23700 1 -- 172.21.15.47:0/2056056136 learned_addr learned my addr 172.21.15.47:0/2056056136 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.806+0000 7f45a5e25700 1 --2- 172.21.15.47:0/2056056136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45a006ec70 0x7f45a015f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.806+0000 7f45a4e23700 1 -- 172.21.15.47:0/2056056136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45a006ec70 msgr2=0x7f45a015f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:26:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.806+0000 7f45a4e23700 1 --2- 172.21.15.47:0/2056056136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45a006ec70 0x7f45a015f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.806+0000 7f45a4e23700 1 -- 172.21.15.47:0/2056056136 >> v1:172.21.15.177:6789/0 conn(0x7f45a0152160 legacy=0x7f45a006a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:53.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.806+0000 7f45a4e23700 1 -- 172.21.15.47:0/2056056136 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a006f120 con 0x7f45a006b5f0 2024-05-08T19:26:53.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.807+0000 7f45a4e23700 1 --2- 172.21.15.47:0/2056056136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a006b5f0 0x7f45a006e730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f459c0098f0 tx=0x7f459c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a260e35e84816dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:53.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.807+0000 7f4597fff700 1 -- 172.21.15.47:0/2056056136 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c011830 con 0x7f45a006b5f0 2024-05-08T19:26:53.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.807+0000 7f4597fff700 1 -- 172.21.15.47:0/2056056136 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c011990 con 0x7f45a006b5f0 2024-05-08T19:26:53.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.807+0000 7f4597fff700 1 -- 172.21.15.47:0/2056056136 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c011d20 con 0x7f45a006b5f0 2024-05-08T19:26:53.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.807+0000 7f45a7888700 1 -- 172.21.15.47:0/2056056136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a006b5f0 msgr2=0x7f45a006e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:53.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.807+0000 7f45a7888700 1 --2- 172.21.15.47:0/2056056136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a006b5f0 0x7f45a006e730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f459c0098f0 tx=0x7f459c009c00 comp rx=0 tx=0).stop 2024-05-08T19:26:53.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.807+0000 7f45a7888700 1 -- 172.21.15.47:0/2056056136 shutdown_connections 2024-05-08T19:26:53.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.807+0000 7f45a7888700 1 --2- 172.21.15.47:0/2056056136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45a006ec70 0x7f45a015f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.807+0000 7f45a7888700 1 --2- 172.21.15.47:0/2056056136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a006b5f0 0x7f45a006e730 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.807+0000 7f45a7888700 1 -- 172.21.15.47:0/2056056136 >> 172.21.15.47:0/2056056136 conn(0x7f45a00c71c0 msgr2=0x7f45a00c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.808+0000 7f45a7888700 1 -- 172.21.15.47:0/2056056136 shutdown_connections 2024-05-08T19:26:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.808+0000 7f45a7888700 1 -- 172.21.15.47:0/2056056136 wait complete. 2024-05-08T19:26:53.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.809+0000 7f45a7888700 1 Processor -- start 2024-05-08T19:26:53.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.809+0000 7f45a7888700 1 -- start start 2024-05-08T19:26:53.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.809+0000 7f45a7888700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45a006b5f0 0x7f45a01498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:53.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.809+0000 7f45a7888700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a006ec70 0x7f45a00c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:53.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.809+0000 7f45a7888700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45a0152160 0x7f45a0144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:53.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.809+0000 7f45a7888700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a01574e0 con 0x7f45a006ec70 2024-05-08T19:26:53.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.809+0000 7f45a7888700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a00c6930 con 0x7f45a006b5f0 2024-05-08T19:26:53.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.809+0000 7f45a7888700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a00c6c10 con 0x7f45a0152160 2024-05-08T19:26:53.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f45a4e23700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a006ec70 0x7f45a00c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:53.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f45a4e23700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a006ec70 0x7f45a00c5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60610/0 (socket says 172.21.15.47:60610) 2024-05-08T19:26:53.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f45a4e23700 1 -- 172.21.15.47:0/1461619637 learned_addr learned my addr 172.21.15.47:0/1461619637 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:53.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f45a5624700 1 --2- 172.21.15.47:0/1461619637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45a006b5f0 0x7f45a01498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:53.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f45a5e25700 1 --2- 172.21.15.47:0/1461619637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45a0152160 0x7f45a0144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:53.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f45a4e23700 1 -- 172.21.15.47:0/1461619637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45a0152160 msgr2=0x7f45a0144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:53.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f45a4e23700 1 --2- 172.21.15.47:0/1461619637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45a0152160 0x7f45a0144a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f45a4e23700 1 -- 172.21.15.47:0/1461619637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45a006b5f0 msgr2=0x7f45a01498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:53.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f45a4e23700 1 --2- 172.21.15.47:0/1461619637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45a006b5f0 0x7f45a01498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:53.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f45a4e23700 1 -- 172.21.15.47:0/1461619637 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c009550 con 0x7f45a006ec70 2024-05-08T19:26:53.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f45a4e23700 1 --2- 172.21.15.47:0/1461619637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a006ec70 0x7f45a00c5980 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f459c000c00 tx=0x7f459c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:53.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f4595ffb700 1 -- 172.21.15.47:0/1461619637 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c004380 con 0x7f45a006ec70 2024-05-08T19:26:53.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f4595ffb700 1 -- 172.21.15.47:0/1461619637 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c01f070 con 0x7f45a006ec70 2024-05-08T19:26:53.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f45a7888700 1 -- 172.21.15.47:0/1461619637 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a0157750 con 0x7f45a006ec70 2024-05-08T19:26:53.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f4595ffb700 1 -- 172.21.15.47:0/1461619637 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c0036a0 con 0x7f45a006ec70 2024-05-08T19:26:53.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.810+0000 7f45a7888700 1 -- 172.21.15.47:0/1461619637 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a0149e30 con 0x7f45a006ec70 2024-05-08T19:26:53.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.811+0000 7f45a7888700 1 -- 172.21.15.47:0/1461619637 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a0157c70 con 0x7f45a006ec70 2024-05-08T19:26:53.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.812+0000 7f4595ffb700 1 -- 172.21.15.47:0/1461619637 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f459c021030 con 0x7f45a006ec70 2024-05-08T19:26:53.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.812+0000 7f4595ffb700 1 --2- 172.21.15.47:0/1461619637 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f458406ac90 0x7f458406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:53.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.812+0000 7f4595ffb700 1 -- 172.21.15.47:0/1461619637 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f459c08a980 con 0x7f45a006ec70 2024-05-08T19:26:53.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.812+0000 7f45a5624700 1 --2- 172.21.15.47:0/1461619637 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f458406ac90 0x7f458406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:53.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.813+0000 7f45a5624700 1 --2- 172.21.15.47:0/1461619637 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f458406ac90 0x7f458406d150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4590007fd0 tx=0x7f4590009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:53.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:53.817+0000 7f4595ffb700 1 -- 172.21.15.47:0/1461619637 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f45a0157c70 con 0x7f45a006ec70 2024-05-08T19:26:54.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.081+0000 7f45a7888700 1 -- 172.21.15.47:0/1461619637 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f45a0157c70 con 0x7f45a006ec70 2024-05-08T19:26:54.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.081+0000 7f4595ffb700 1 -- 172.21.15.47:0/1461619637 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f45a0157c70 con 0x7f45a006ec70 2024-05-08T19:26:54.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.084+0000 7f45a7888700 1 -- 172.21.15.47:0/1461619637 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f458406ac90 msgr2=0x7f458406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:54.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.084+0000 7f45a7888700 1 --2- 172.21.15.47:0/1461619637 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f458406ac90 0x7f458406d150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4590007fd0 tx=0x7f4590009040 comp rx=0 tx=0).stop 2024-05-08T19:26:54.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.084+0000 7f45a7888700 1 -- 172.21.15.47:0/1461619637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a006ec70 msgr2=0x7f45a00c5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:54.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.084+0000 7f45a7888700 1 --2- 172.21.15.47:0/1461619637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a006ec70 0x7f45a00c5980 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f459c000c00 tx=0x7f459c004750 comp rx=0 tx=0).stop 2024-05-08T19:26:54.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.084+0000 7f45a7888700 1 -- 172.21.15.47:0/1461619637 shutdown_connections 2024-05-08T19:26:54.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.084+0000 7f45a7888700 1 --2- 172.21.15.47:0/1461619637 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f458406ac90 0x7f458406d150 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.084+0000 7f45a7888700 1 --2- 172.21.15.47:0/1461619637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45a0152160 0x7f45a0144a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.084+0000 7f45a7888700 1 --2- 172.21.15.47:0/1461619637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45a006b5f0 0x7f45a01498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.084+0000 7f45a7888700 1 --2- 172.21.15.47:0/1461619637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a006ec70 0x7f45a00c5980 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.084+0000 7f45a7888700 1 -- 172.21.15.47:0/1461619637 >> 172.21.15.47:0/1461619637 conn(0x7f45a00c71c0 msgr2=0x7f45a006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:54.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.084+0000 7f45a7888700 1 -- 172.21.15.47:0/1461619637 shutdown_connections 2024-05-08T19:26:54.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.084+0000 7f45a7888700 1 -- 172.21.15.47:0/1461619637 wait complete. 2024-05-08T19:26:54.077 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-08T19:26:54.090 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-08T19:26:54.090 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T19:26:54.109 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:26:54.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.287+0000 7f2b2cace700 1 Processor -- start 2024-05-08T19:26:54.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.287+0000 7f2b2cace700 1 -- start start 2024-05-08T19:26:54.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b2cace700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b28150040 0x7f2b280c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b2cace700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2b280c2a80 0x7f2b281528f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b2cace700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b28155e00 con 0x7f2b2814fc60 2024-05-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b2cace700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b281560e0 con 0x7f2b280c2a80 2024-05-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b2cace700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b281563c0 con 0x7f2b28150040 2024-05-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b26d9d700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2b280c2a80 0x7f2b281528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b26d9d700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2b280c2a80 0x7f2b281528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60622/0 (socket says 172.21.15.47:60622) 2024-05-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b2659c700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2b2814fc60 0x7f2b280c4a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59396/0 (socket says 172.21.15.47:59396) 2024-05-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b26d9d700 1 -- 172.21.15.47:0/2198254966 learned_addr learned my addr 172.21.15.47:0/2198254966 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b25d9b700 1 --2- 172.21.15.47:0/2198254966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b28150040 0x7f2b280c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b26d9d700 1 -- 172.21.15.47:0/2198254966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b28150040 msgr2=0x7f2b280c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b26d9d700 1 --2- 172.21.15.47:0/2198254966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b28150040 0x7f2b280c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b26d9d700 1 -- 172.21.15.47:0/2198254966 >> v1:172.21.15.47:6789/0 conn(0x7f2b2814fc60 legacy=0x7f2b280c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b26d9d700 1 -- 172.21.15.47:0/2198254966 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b281566a0 con 0x7f2b280c2a80 2024-05-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b2559a700 1 -- 172.21.15.47:0/2198254966 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761610977 0 0) 0x7f2b28155e00 con 0x7f2b2814fc60 2024-05-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b26d9d700 1 --2- 172.21.15.47:0/2198254966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b280c2a80 0x7f2b281528f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009e50 tx=0x7f2b2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8bc37ba5700950 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b2559a700 1 -- 172.21.15.47:0/2198254966 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000e070 con 0x7f2b280c2a80 2024-05-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b2559a700 1 -- 172.21.15.47:0/2198254966 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2000b910 con 0x7f2b280c2a80 2024-05-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.288+0000 7f2b2559a700 1 -- 172.21.15.47:0/2198254966 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000bcc0 con 0x7f2b280c2a80 2024-05-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.289+0000 7f2b2cace700 1 -- 172.21.15.47:0/2198254966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b280c2a80 msgr2=0x7f2b281528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.289+0000 7f2b2cace700 1 --2- 172.21.15.47:0/2198254966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b280c2a80 0x7f2b281528f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009e50 tx=0x7f2b2000b330 comp rx=0 tx=0).stop 2024-05-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.289+0000 7f2b2cace700 1 -- 172.21.15.47:0/2198254966 shutdown_connections 2024-05-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.289+0000 7f2b2cace700 1 --2- 172.21.15.47:0/2198254966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b280c2a80 0x7f2b281528f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.289+0000 7f2b2cace700 1 --2- 172.21.15.47:0/2198254966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b28150040 0x7f2b280c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.289+0000 7f2b2cace700 1 -- 172.21.15.47:0/2198254966 >> 172.21.15.47:0/2198254966 conn(0x7f2b28072dd0 msgr2=0x7f2b2806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.289+0000 7f2b2cace700 1 -- 172.21.15.47:0/2198254966 shutdown_connections 2024-05-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.289+0000 7f2b2cace700 1 -- 172.21.15.47:0/2198254966 wait complete. 2024-05-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.290+0000 7f2b2cace700 1 Processor -- start 2024-05-08T19:26:54.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.291+0000 7f2b2cace700 1 -- start start 2024-05-08T19:26:54.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.291+0000 7f2b2cace700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b280c2a80 0x7f2b280c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:54.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.291+0000 7f2b2cace700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b2814fc60 0x7f2b28148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:54.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.291+0000 7f2b2cace700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b28150040 0x7f2b281487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:54.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.291+0000 7f2b2cace700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2814d090 con 0x7f2b28150040 2024-05-08T19:26:54.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.291+0000 7f2b2cace700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28152610 con 0x7f2b280c2a80 2024-05-08T19:26:54.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.291+0000 7f2b2cace700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28151850 con 0x7f2b2814fc60 2024-05-08T19:26:54.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.291+0000 7f2b26d9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b28150040 0x7f2b281487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:54.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.291+0000 7f2b26d9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b28150040 0x7f2b281487b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60634/0 (socket says 172.21.15.47:60634) 2024-05-08T19:26:54.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.291+0000 7f2b26d9d700 1 -- 172.21.15.47:0/3258123497 learned_addr learned my addr 172.21.15.47:0/3258123497 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:54.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.291+0000 7f2b25d9b700 1 --2- 172.21.15.47:0/3258123497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b2814fc60 0x7f2b28148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:54.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.291+0000 7f2b2659c700 1 --2- 172.21.15.47:0/3258123497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b280c2a80 0x7f2b280c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:54.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.292+0000 7f2b26d9d700 1 -- 172.21.15.47:0/3258123497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b2814fc60 msgr2=0x7f2b28148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:54.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.292+0000 7f2b26d9d700 1 --2- 172.21.15.47:0/3258123497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b2814fc60 0x7f2b28148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.292+0000 7f2b26d9d700 1 -- 172.21.15.47:0/3258123497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b280c2a80 msgr2=0x7f2b280c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:54.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.292+0000 7f2b26d9d700 1 --2- 172.21.15.47:0/3258123497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b280c2a80 0x7f2b280c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.292+0000 7f2b26d9d700 1 -- 172.21.15.47:0/3258123497 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b20009b30 con 0x7f2b28150040 2024-05-08T19:26:54.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.292+0000 7f2b26d9d700 1 --2- 172.21.15.47:0/3258123497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b28150040 0x7f2b281487b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000b680 tx=0x7f2b20004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:54.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.292+0000 7f2b1effd700 1 -- 172.21.15.47:0/3258123497 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b20004960 con 0x7f2b28150040 2024-05-08T19:26:54.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.292+0000 7f2b1effd700 1 -- 172.21.15.47:0/3258123497 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b200092e0 con 0x7f2b28150040 2024-05-08T19:26:54.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.292+0000 7f2b2cace700 1 -- 172.21.15.47:0/3258123497 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b28151b30 con 0x7f2b28150040 2024-05-08T19:26:54.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.292+0000 7f2b1effd700 1 -- 172.21.15.47:0/3258123497 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2001c640 con 0x7f2b28150040 2024-05-08T19:26:54.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.292+0000 7f2b2cace700 1 -- 172.21.15.47:0/3258123497 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b281520f0 con 0x7f2b28150040 2024-05-08T19:26:54.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.293+0000 7f2b2cace700 1 -- 172.21.15.47:0/3258123497 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b28152310 con 0x7f2b28150040 2024-05-08T19:26:54.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.293+0000 7f2b1effd700 1 -- 172.21.15.47:0/3258123497 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2b2001c7a0 con 0x7f2b28150040 2024-05-08T19:26:54.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.294+0000 7f2b1effd700 1 --2- 172.21.15.47:0/3258123497 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f2b0806ac90 0x7f2b0806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:54.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.294+0000 7f2b1effd700 1 -- 172.21.15.47:0/3258123497 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2b2008afe0 con 0x7f2b28150040 2024-05-08T19:26:54.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.294+0000 7f2b2659c700 1 --2- 172.21.15.47:0/3258123497 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f2b0806ac90 0x7f2b0806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:54.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.294+0000 7f2b2659c700 1 --2- 172.21.15.47:0/3258123497 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f2b0806ac90 0x7f2b0806d150 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2b10000f60 tx=0x7f2b10007be0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:54.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.298+0000 7f2b1effd700 1 -- 172.21.15.47:0/3258123497 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2b20055e90 con 0x7f2b28150040 2024-05-08T19:26:54.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 377255 14.23 MB/sec execute 31 sec latency 23.009 ms 2024-05-08T19:26:54.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.515+0000 7f2b2cace700 1 -- 172.21.15.47:0/3258123497 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b2804ec60 con 0x7f2b28150040 2024-05-08T19:26:54.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.517+0000 7f2b1effd700 1 -- 172.21.15.47:0/3258123497 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f2b200594b0 con 0x7f2b28150040 2024-05-08T19:26:54.509 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:26:54.509 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:23:11.040286+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:26:54.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.519+0000 7f2b2cace700 1 -- 172.21.15.47:0/3258123497 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f2b0806ac90 msgr2=0x7f2b0806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:54.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.519+0000 7f2b2cace700 1 --2- 172.21.15.47:0/3258123497 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f2b0806ac90 0x7f2b0806d150 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2b10000f60 tx=0x7f2b10007be0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.519+0000 7f2b2cace700 1 -- 172.21.15.47:0/3258123497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b28150040 msgr2=0x7f2b281487b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:54.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.519+0000 7f2b2cace700 1 --2- 172.21.15.47:0/3258123497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b28150040 0x7f2b281487b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000b680 tx=0x7f2b20004ad0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.519+0000 7f2b2cace700 1 -- 172.21.15.47:0/3258123497 shutdown_connections 2024-05-08T19:26:54.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.519+0000 7f2b2cace700 1 --2- 172.21.15.47:0/3258123497 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f2b0806ac90 0x7f2b0806d150 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.519+0000 7f2b2cace700 1 --2- 172.21.15.47:0/3258123497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b28150040 0x7f2b281487b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.519+0000 7f2b2cace700 1 --2- 172.21.15.47:0/3258123497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b280c2a80 0x7f2b280c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.519+0000 7f2b2cace700 1 --2- 172.21.15.47:0/3258123497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b2814fc60 0x7f2b28148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.519+0000 7f2b2cace700 1 -- 172.21.15.47:0/3258123497 >> 172.21.15.47:0/3258123497 conn(0x7f2b28072dd0 msgr2=0x7f2b2814d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:54.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.519+0000 7f2b2cace700 1 -- 172.21.15.47:0/3258123497 shutdown_connections 2024-05-08T19:26:54.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.519+0000 7f2b2cace700 1 -- 172.21.15.47:0/3258123497 wait complete. 2024-05-08T19:26:54.528 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T19:22:15.923832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T19:22:18.529792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T19:22:19.389797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T19:22:22.474001+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T19:26:54.528 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T19:26:54.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.670+0000 7faed0f8e700 1 Processor -- start 2024-05-08T19:26:54.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.670+0000 7faed0f8e700 1 -- start start 2024-05-08T19:26:54.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.670+0000 7faed0f8e700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7faecc070470 0x7faecc0c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:54.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.670+0000 7faed0f8e700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faecc0c2fc0 con 0x7faecc0c62b0 2024-05-08T19:26:54.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.670+0000 7faed0f8e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faecc152610 con 0x7faecc152230 2024-05-08T19:26:54.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.671+0000 7faed0f8e700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faecc0c3e20 con 0x7faecc070470 2024-05-08T19:26:54.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.671+0000 7faec9d9b700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7faecc070470 0x7faecc0c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:54.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.671+0000 7faecad9d700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7faecc0c62b0 0x7faecc0c14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59406/0 (socket says 172.21.15.47:59406) 2024-05-08T19:26:54.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.671+0000 7faec9d9b700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7faecc070470 0x7faecc0c2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60642/0 (socket says 172.21.15.47:60642) 2024-05-08T19:26:54.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.671+0000 7faecad9d700 1 -- 172.21.15.47:0/3930832760 learned_addr learned my addr 172.21.15.47:0/3930832760 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:26:54.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.671+0000 7faec9d9b700 1 -- 172.21.15.47:0/3930832760 >> v1:172.21.15.177:6789/0 conn(0x7faecc152230 legacy=0x7faecc0c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:54.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.671+0000 7faec9d9b700 1 -- 172.21.15.47:0/3930832760 >> v1:172.21.15.47:6789/0 conn(0x7faecc0c62b0 legacy=0x7faecc0c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.671+0000 7faec9d9b700 1 -- 172.21.15.47:0/3930832760 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc0702a0 con 0x7faecc070470 2024-05-08T19:26:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.671+0000 7faec959a700 1 -- 172.21.15.47:0/3930832760 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880358177 0 0) 0x7faecc0c2fc0 con 0x7faecc0c62b0 2024-05-08T19:26:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.671+0000 7faec9d9b700 1 --2- 172.21.15.47:0/3930832760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faecc070470 0x7faecc0c2a80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faec0009840 tx=0x7faec0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f92797cf4b00c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.671+0000 7faec959a700 1 -- 172.21.15.47:0/3930832760 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0011830 con 0x7faecc070470 2024-05-08T19:26:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.671+0000 7faec959a700 1 -- 172.21.15.47:0/3930832760 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec0011990 con 0x7faecc070470 2024-05-08T19:26:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.671+0000 7faec959a700 1 -- 172.21.15.47:0/3930832760 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0011d20 con 0x7faecc070470 2024-05-08T19:26:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.672+0000 7faed0f8e700 1 -- 172.21.15.47:0/3930832760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faecc070470 msgr2=0x7faecc0c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.672+0000 7faed0f8e700 1 --2- 172.21.15.47:0/3930832760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faecc070470 0x7faecc0c2a80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faec0009840 tx=0x7faec0009b50 comp rx=0 tx=0).stop 2024-05-08T19:26:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.672+0000 7faed0f8e700 1 -- 172.21.15.47:0/3930832760 shutdown_connections 2024-05-08T19:26:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.672+0000 7faed0f8e700 1 --2- 172.21.15.47:0/3930832760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faecc070470 0x7faecc0c2a80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.672+0000 7faed0f8e700 1 -- 172.21.15.47:0/3930832760 >> 172.21.15.47:0/3930832760 conn(0x7faecc06b1b0 msgr2=0x7faecc0a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.672+0000 7faed0f8e700 1 -- 172.21.15.47:0/3930832760 shutdown_connections 2024-05-08T19:26:54.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.672+0000 7faed0f8e700 1 -- 172.21.15.47:0/3930832760 wait complete. 2024-05-08T19:26:54.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.673+0000 7faed0f8e700 1 Processor -- start 2024-05-08T19:26:54.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.673+0000 7faed0f8e700 1 -- start start 2024-05-08T19:26:54.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.674+0000 7faed0f8e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faecc070470 0x7faecc0ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:54.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.674+0000 7faed0f8e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faecc0c62b0 0x7faecc06ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:54.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.674+0000 7faed0f8e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faecc152230 0x7faecc148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:54.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.674+0000 7faed0f8e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc157cf0 con 0x7faecc070470 2024-05-08T19:26:54.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.674+0000 7faed0f8e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc158d10 con 0x7faecc152230 2024-05-08T19:26:54.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.674+0000 7faed0f8e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0abba0 con 0x7faecc0c62b0 2024-05-08T19:26:54.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.674+0000 7faeca59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faecc070470 0x7faecc0ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:54.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.674+0000 7faeca59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faecc070470 0x7faecc0ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60644/0 (socket says 172.21.15.47:60644) 2024-05-08T19:26:54.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.674+0000 7faeca59c700 1 -- 172.21.15.47:0/2200970099 learned_addr learned my addr 172.21.15.47:0/2200970099 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:54.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.674+0000 7faecad9d700 1 --2- 172.21.15.47:0/2200970099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faecc152230 0x7faecc148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:54.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.674+0000 7faec9d9b700 1 --2- 172.21.15.47:0/2200970099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faecc0c62b0 0x7faecc06ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:54.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.675+0000 7faeca59c700 1 -- 172.21.15.47:0/2200970099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faecc0c62b0 msgr2=0x7faecc06ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:54.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.675+0000 7faeca59c700 1 --2- 172.21.15.47:0/2200970099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faecc0c62b0 0x7faecc06ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.675+0000 7faeca59c700 1 -- 172.21.15.47:0/2200970099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faecc152230 msgr2=0x7faecc148240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:54.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.675+0000 7faeca59c700 1 --2- 172.21.15.47:0/2200970099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faecc152230 0x7faecc148240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.675+0000 7faeca59c700 1 -- 172.21.15.47:0/2200970099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec00094a0 con 0x7faecc070470 2024-05-08T19:26:54.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.675+0000 7faeca59c700 1 --2- 172.21.15.47:0/2200970099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faecc070470 0x7faecc0ab660 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faebc00c450 tx=0x7faebc00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:54.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.675+0000 7faebaffd700 1 -- 172.21.15.47:0/2200970099 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc0052d0 con 0x7faecc070470 2024-05-08T19:26:54.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.675+0000 7faebaffd700 1 -- 172.21.15.47:0/2200970099 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc005430 con 0x7faecc070470 2024-05-08T19:26:54.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.675+0000 7faed0f8e700 1 -- 172.21.15.47:0/2200970099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faecc158750 con 0x7faecc070470 2024-05-08T19:26:54.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.675+0000 7faebaffd700 1 -- 172.21.15.47:0/2200970099 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc0038c0 con 0x7faecc070470 2024-05-08T19:26:54.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.675+0000 7faed0f8e700 1 -- 172.21.15.47:0/2200970099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faecc157980 con 0x7faecc070470 2024-05-08T19:26:54.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.676+0000 7faed0f8e700 1 -- 172.21.15.47:0/2200970099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faecc04ec60 con 0x7faecc070470 2024-05-08T19:26:54.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.676+0000 7faebaffd700 1 -- 172.21.15.47:0/2200970099 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faebc003a20 con 0x7faecc070470 2024-05-08T19:26:54.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.677+0000 7faebaffd700 1 --2- 172.21.15.47:0/2200970099 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7faeac06ac90 0x7faeac06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:54.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.677+0000 7faebaffd700 1 -- 172.21.15.47:0/2200970099 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faebc088970 con 0x7faecc070470 2024-05-08T19:26:54.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.677+0000 7faec9d9b700 1 --2- 172.21.15.47:0/2200970099 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7faeac06ac90 0x7faeac06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:54.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.678+0000 7faec9d9b700 1 --2- 172.21.15.47:0/2200970099 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7faeac06ac90 0x7faeac06d150 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faec0009840 tx=0x7faec001c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:54.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.682+0000 7faebaffd700 1 -- 172.21.15.47:0/2200970099 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7faebc053820 con 0x7faecc070470 2024-05-08T19:26:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.894+0000 7faed0f8e700 1 -- 172.21.15.47:0/2200970099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faecc0c6090 con 0x7faecc070470 2024-05-08T19:26:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.895+0000 7faebaffd700 1 -- 172.21.15.47:0/2200970099 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7faebc017020 con 0x7faecc070470 2024-05-08T19:26:54.887 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-08T19:26:54.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.897+0000 7faed0f8e700 1 -- 172.21.15.47:0/2200970099 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7faeac06ac90 msgr2=0x7faeac06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:54.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.897+0000 7faed0f8e700 1 --2- 172.21.15.47:0/2200970099 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7faeac06ac90 0x7faeac06d150 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faec0009840 tx=0x7faec001c040 comp rx=0 tx=0).stop 2024-05-08T19:26:54.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.897+0000 7faed0f8e700 1 -- 172.21.15.47:0/2200970099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faecc070470 msgr2=0x7faecc0ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:54.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.897+0000 7faed0f8e700 1 --2- 172.21.15.47:0/2200970099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faecc070470 0x7faecc0ab660 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faebc00c450 tx=0x7faebc00c760 comp rx=0 tx=0).stop 2024-05-08T19:26:54.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.897+0000 7faed0f8e700 1 -- 172.21.15.47:0/2200970099 shutdown_connections 2024-05-08T19:26:54.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.897+0000 7faed0f8e700 1 --2- 172.21.15.47:0/2200970099 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7faeac06ac90 0x7faeac06d150 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.897+0000 7faed0f8e700 1 --2- 172.21.15.47:0/2200970099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faecc070470 0x7faecc0ab660 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.897+0000 7faed0f8e700 1 --2- 172.21.15.47:0/2200970099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faecc152230 0x7faecc148240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.897+0000 7faed0f8e700 1 --2- 172.21.15.47:0/2200970099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faecc0c62b0 0x7faecc06ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:54.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.897+0000 7faed0f8e700 1 -- 172.21.15.47:0/2200970099 >> 172.21.15.47:0/2200970099 conn(0x7faecc06b1b0 msgr2=0x7faecc06ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:54.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.897+0000 7faed0f8e700 1 -- 172.21.15.47:0/2200970099 shutdown_connections 2024-05-08T19:26:54.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:54.897+0000 7faed0f8e700 1 -- 172.21.15.47:0/2200970099 wait complete. 2024-05-08T19:26:54.902 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T19:26:55.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.048+0000 7f104028e700 1 Processor -- start 2024-05-08T19:26:55.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.048+0000 7f104028e700 1 -- start start 2024-05-08T19:26:55.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.049+0000 7f104028e700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f10380c2be0 0x7f10381526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.049+0000 7f104028e700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10380ab720 con 0x7f10380c4f60 2024-05-08T19:26:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.049+0000 7f104028e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10380aba00 con 0x7f10380aae80 2024-05-08T19:26:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.049+0000 7f104028e700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10380abce0 con 0x7f10380c2be0 2024-05-08T19:26:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.049+0000 7f103e02a700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f10380c2be0 0x7f10381526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.049+0000 7f103e82b700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f10380c4f60 0x7f10380c53f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59412/0 (socket says 172.21.15.47:59412) 2024-05-08T19:26:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.049+0000 7f103e82b700 1 -- 172.21.15.47:0/3429008142 learned_addr learned my addr 172.21.15.47:0/3429008142 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:26:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.050+0000 7f103e02a700 1 -- 172.21.15.47:0/3429008142 >> v1:172.21.15.177:6789/0 conn(0x7f10380aae80 legacy=0x7f103806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.050+0000 7f103e02a700 1 -- 172.21.15.47:0/3429008142 >> v1:172.21.15.47:6789/0 conn(0x7f10380c4f60 legacy=0x7f10380c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.050+0000 7f103e02a700 1 -- 172.21.15.47:0/3429008142 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10380c4760 con 0x7f10380c2be0 2024-05-08T19:26:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.050+0000 7f103d028700 1 -- 172.21.15.47:0/3429008142 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379157637 0 0) 0x7f10380ab720 con 0x7f10380c4f60 2024-05-08T19:26:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.050+0000 7f103e02a700 1 --2- 172.21.15.47:0/3429008142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10380c2be0 0x7f10381526f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1028009840 tx=0x7f1028009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd2fe1397041b37 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:55.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.050+0000 7f103d028700 1 -- 172.21.15.47:0/3429008142 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1028011830 con 0x7f10380c2be0 2024-05-08T19:26:55.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.050+0000 7f103d028700 1 -- 172.21.15.47:0/3429008142 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1028011990 con 0x7f10380c2be0 2024-05-08T19:26:55.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.050+0000 7f103d028700 1 -- 172.21.15.47:0/3429008142 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1028011d20 con 0x7f10380c2be0 2024-05-08T19:26:55.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.051+0000 7f104028e700 1 -- 172.21.15.47:0/3429008142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10380c2be0 msgr2=0x7f10381526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.051+0000 7f104028e700 1 --2- 172.21.15.47:0/3429008142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10380c2be0 0x7f10381526f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1028009840 tx=0x7f1028009b50 comp rx=0 tx=0).stop 2024-05-08T19:26:55.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.051+0000 7f104028e700 1 -- 172.21.15.47:0/3429008142 shutdown_connections 2024-05-08T19:26:55.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.051+0000 7f104028e700 1 --2- 172.21.15.47:0/3429008142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10380c2be0 0x7f10381526f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.051+0000 7f104028e700 1 -- 172.21.15.47:0/3429008142 >> 172.21.15.47:0/3429008142 conn(0x7f10380c3360 msgr2=0x7f10380c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:55.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.051+0000 7f104028e700 1 -- 172.21.15.47:0/3429008142 shutdown_connections 2024-05-08T19:26:55.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.051+0000 7f104028e700 1 -- 172.21.15.47:0/3429008142 wait complete. 2024-05-08T19:26:55.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.052+0000 7f104028e700 1 Processor -- start 2024-05-08T19:26:55.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.052+0000 7f104028e700 1 -- start start 2024-05-08T19:26:55.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.052+0000 7f104028e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10380aae80 0x7f10380a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.052+0000 7f104028e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10380c2be0 0x7f1038070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.052+0000 7f104028e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10380c4f60 0x7f10380713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f104028e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1038071900 con 0x7f10380aae80 2024-05-08T19:26:55.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f104028e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10380a60d0 con 0x7f10380c2be0 2024-05-08T19:26:55.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f104028e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103814d650 con 0x7f10380c4f60 2024-05-08T19:26:55.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f103e02a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10380aae80 0x7f10380a7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f103e02a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10380aae80 0x7f10380a7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60664/0 (socket says 172.21.15.47:60664) 2024-05-08T19:26:55.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f103e02a700 1 -- 172.21.15.47:0/3079688278 learned_addr learned my addr 172.21.15.47:0/3079688278 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:55.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f103d829700 1 --2- 172.21.15.47:0/3079688278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10380c2be0 0x7f1038070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f103e82b700 1 --2- 172.21.15.47:0/3079688278 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10380c4f60 0x7f10380713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f103e02a700 1 -- 172.21.15.47:0/3079688278 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10380c4f60 msgr2=0x7f10380713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f103e02a700 1 --2- 172.21.15.47:0/3079688278 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10380c4f60 0x7f10380713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f103e02a700 1 -- 172.21.15.47:0/3079688278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10380c2be0 msgr2=0x7f1038070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f103e02a700 1 --2- 172.21.15.47:0/3079688278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10380c2be0 0x7f1038070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f103e02a700 1 -- 172.21.15.47:0/3079688278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10280094a0 con 0x7f10380aae80 2024-05-08T19:26:55.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f103e02a700 1 --2- 172.21.15.47:0/3079688278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10380aae80 0x7f10380a7730 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f10280090b0 tx=0x7f1028004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:55.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f102effd700 1 -- 172.21.15.47:0/3079688278 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102801a7e0 con 0x7f10380aae80 2024-05-08T19:26:55.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f102effd700 1 -- 172.21.15.47:0/3079688278 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102801a940 con 0x7f10380aae80 2024-05-08T19:26:55.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f102effd700 1 -- 172.21.15.47:0/3079688278 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102801acb0 con 0x7f10380aae80 2024-05-08T19:26:55.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f104028e700 1 -- 172.21.15.47:0/3079688278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10381ea000 con 0x7f10380aae80 2024-05-08T19:26:55.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.053+0000 7f104028e700 1 -- 172.21.15.47:0/3079688278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10381ea5c0 con 0x7f10380aae80 2024-05-08T19:26:55.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.054+0000 7f104028e700 1 -- 172.21.15.47:0/3079688278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1038155ca0 con 0x7f10380aae80 2024-05-08T19:26:55.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.055+0000 7f102effd700 1 -- 172.21.15.47:0/3079688278 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1028022070 con 0x7f10380aae80 2024-05-08T19:26:55.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.055+0000 7f102effd700 1 --2- 172.21.15.47:0/3079688278 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f101c06ac90 0x7f101c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.055+0000 7f102effd700 1 -- 172.21.15.47:0/3079688278 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f102808a8b0 con 0x7f10380aae80 2024-05-08T19:26:55.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.055+0000 7f103d829700 1 --2- 172.21.15.47:0/3079688278 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f101c06ac90 0x7f101c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.056+0000 7f103d829700 1 --2- 172.21.15.47:0/3079688278 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f101c06ac90 0x7f101c06d150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f10381dbd10 tx=0x7f1034009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:55.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.060+0000 7f102effd700 1 -- 172.21.15.47:0/3079688278 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1038155ca0 con 0x7f10380aae80 2024-05-08T19:26:55.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.269+0000 7f104028e700 1 -- 172.21.15.47:0/3079688278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1038155ca0 con 0x7f10380aae80 2024-05-08T19:26:55.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.270+0000 7f102effd700 1 -- 172.21.15.47:0/3079688278 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1028015020 con 0x7f10380aae80 2024-05-08T19:26:55.262 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-08T19:26:55.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.272+0000 7f104028e700 1 -- 172.21.15.47:0/3079688278 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f101c06ac90 msgr2=0x7f101c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.272+0000 7f104028e700 1 --2- 172.21.15.47:0/3079688278 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f101c06ac90 0x7f101c06d150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f10381dbd10 tx=0x7f1034009040 comp rx=0 tx=0).stop 2024-05-08T19:26:55.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.272+0000 7f104028e700 1 -- 172.21.15.47:0/3079688278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10380aae80 msgr2=0x7f10380a7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.272+0000 7f104028e700 1 --2- 172.21.15.47:0/3079688278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10380aae80 0x7f10380a7730 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f10280090b0 tx=0x7f1028004750 comp rx=0 tx=0).stop 2024-05-08T19:26:55.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.272+0000 7f104028e700 1 -- 172.21.15.47:0/3079688278 shutdown_connections 2024-05-08T19:26:55.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.272+0000 7f104028e700 1 --2- 172.21.15.47:0/3079688278 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f101c06ac90 0x7f101c06d150 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.272+0000 7f104028e700 1 --2- 172.21.15.47:0/3079688278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10380aae80 0x7f10380a7730 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.272+0000 7f104028e700 1 --2- 172.21.15.47:0/3079688278 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10380c4f60 0x7f10380713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.272+0000 7f104028e700 1 --2- 172.21.15.47:0/3079688278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10380c2be0 0x7f1038070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.272+0000 7f104028e700 1 -- 172.21.15.47:0/3079688278 >> 172.21.15.47:0/3079688278 conn(0x7f10380c3360 msgr2=0x7f103806e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:55.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.272+0000 7f104028e700 1 -- 172.21.15.47:0/3079688278 shutdown_connections 2024-05-08T19:26:55.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.272+0000 7f104028e700 1 -- 172.21.15.47:0/3079688278 wait complete. 2024-05-08T19:26:55.281 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T19:26:55.295 INFO:tasks.workunit.client.1.smithi177.stdout: 1 380284 14.32 MB/sec execute 32 sec latency 14.067 ms 2024-05-08T19:26:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.440+0000 7f49d27eb700 1 Processor -- start 2024-05-08T19:26:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.440+0000 7f49d27eb700 1 -- start start 2024-05-08T19:26:55.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.441+0000 7f49d27eb700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f49cc14f0c0 0x7f49cc0a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.441+0000 7f49d27eb700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f49cc0c2b80 0x7f49cc06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.441+0000 7f49d27eb700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49cc0c29c0 con 0x7f49cc06bf10 2024-05-08T19:26:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.441+0000 7f49d27eb700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49cc072aa0 con 0x7f49cc14f0c0 2024-05-08T19:26:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.441+0000 7f49d27eb700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49cc14f4a0 con 0x7f49cc0c2b80 2024-05-08T19:26:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.441+0000 7f49cbfff700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f49cc14f0c0 0x7f49cc0a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.441+0000 7f49d0d88700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f49cc06bf10 0x7f49cc070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59424/0 (socket says 172.21.15.47:59424) 2024-05-08T19:26:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.441+0000 7f49d0d88700 1 -- 172.21.15.47:0/2151559039 learned_addr learned my addr 172.21.15.47:0/2151559039 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:26:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.441+0000 7f49cb7fe700 1 --2- 172.21.15.47:0/2151559039 >> v2:172.21.15.177:3300/0 conn(0x7f49cc0c2b80 0x7f49cc06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.441+0000 7f49cbfff700 1 -- 172.21.15.47:0/2151559039 >> v2:172.21.15.177:3300/0 conn(0x7f49cc0c2b80 msgr2=0x7f49cc06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:26:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.441+0000 7f49cbfff700 1 --2- 172.21.15.47:0/2151559039 >> v2:172.21.15.177:3300/0 conn(0x7f49cc0c2b80 0x7f49cc06b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.441+0000 7f49cbfff700 1 -- 172.21.15.47:0/2151559039 >> v1:172.21.15.47:6789/0 conn(0x7f49cc06bf10 legacy=0x7f49cc070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.441+0000 7f49cbfff700 1 -- 172.21.15.47:0/2151559039 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc152630 con 0x7f49cc14f0c0 2024-05-08T19:26:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.441+0000 7f49caffd700 1 -- 172.21.15.47:0/2151559039 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882284779 0 0) 0x7f49cc0c29c0 con 0x7f49cc06bf10 2024-05-08T19:26:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.442+0000 7f49cbfff700 1 --2- 172.21.15.47:0/2151559039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49cc14f0c0 0x7f49cc0a5e40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f49cc155eb0 tx=0x7f49b400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ee9f1c1265fc4d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.442+0000 7f49caffd700 1 -- 172.21.15.47:0/2151559039 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b400dc70 con 0x7f49cc14f0c0 2024-05-08T19:26:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.442+0000 7f49caffd700 1 -- 172.21.15.47:0/2151559039 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b400ddd0 con 0x7f49cc14f0c0 2024-05-08T19:26:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.442+0000 7f49caffd700 1 -- 172.21.15.47:0/2151559039 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4010690 con 0x7f49cc14f0c0 2024-05-08T19:26:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.442+0000 7f49d27eb700 1 -- 172.21.15.47:0/2151559039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49cc14f0c0 msgr2=0x7f49cc0a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.442+0000 7f49d27eb700 1 --2- 172.21.15.47:0/2151559039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49cc14f0c0 0x7f49cc0a5e40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f49cc155eb0 tx=0x7f49b400bdc0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.442+0000 7f49d27eb700 1 -- 172.21.15.47:0/2151559039 shutdown_connections 2024-05-08T19:26:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.442+0000 7f49d27eb700 1 --2- 172.21.15.47:0/2151559039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49cc14f0c0 0x7f49cc0a5e40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.442+0000 7f49d27eb700 1 --2- 172.21.15.47:0/2151559039 >> v2:172.21.15.177:3300/0 conn(0x7f49cc0c2b80 0x7f49cc06b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.442+0000 7f49d27eb700 1 -- 172.21.15.47:0/2151559039 >> 172.21.15.47:0/2151559039 conn(0x7f49cc0c3360 msgr2=0x7f49cc0c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.442+0000 7f49d27eb700 1 -- 172.21.15.47:0/2151559039 shutdown_connections 2024-05-08T19:26:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.442+0000 7f49d27eb700 1 -- 172.21.15.47:0/2151559039 wait complete. 2024-05-08T19:26:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.444+0000 7f49d27eb700 1 Processor -- start 2024-05-08T19:26:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.444+0000 7f49d27eb700 1 -- start start 2024-05-08T19:26:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49d27eb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49cc06bf10 0x7f49cc1e9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49d27eb700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49cc0c2b80 0x7f49cc0c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49d27eb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49cc14f0c0 0x7f49cc148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49d27eb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc1495f0 con 0x7f49cc14f0c0 2024-05-08T19:26:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49d27eb700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc1508b0 con 0x7f49cc06bf10 2024-05-08T19:26:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49d27eb700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc148e10 con 0x7f49cc0c2b80 2024-05-08T19:26:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49d0d88700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49cc14f0c0 0x7f49cc148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49d0d88700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49cc14f0c0 0x7f49cc148280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60678/0 (socket says 172.21.15.47:60678) 2024-05-08T19:26:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49d0d88700 1 -- 172.21.15.47:0/658754681 learned_addr learned my addr 172.21.15.47:0/658754681 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49cbfff700 1 --2- 172.21.15.47:0/658754681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49cc06bf10 0x7f49cc1e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49cb7fe700 1 --2- 172.21.15.47:0/658754681 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49cc0c2b80 0x7f49cc0c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49d0d88700 1 -- 172.21.15.47:0/658754681 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49cc0c2b80 msgr2=0x7f49cc0c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49d0d88700 1 --2- 172.21.15.47:0/658754681 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49cc0c2b80 0x7f49cc0c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49d0d88700 1 -- 172.21.15.47:0/658754681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49cc06bf10 msgr2=0x7f49cc1e9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49d0d88700 1 --2- 172.21.15.47:0/658754681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49cc06bf10 0x7f49cc1e9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49d0d88700 1 -- 172.21.15.47:0/658754681 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b400b740 con 0x7f49cc14f0c0 2024-05-08T19:26:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.445+0000 7f49d0d88700 1 --2- 172.21.15.47:0/658754681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49cc14f0c0 0x7f49cc148280 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f49c400cb90 tx=0x7f49c400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.446+0000 7f49c8ff9700 1 -- 172.21.15.47:0/658754681 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c400aa60 con 0x7f49cc14f0c0 2024-05-08T19:26:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.446+0000 7f49c8ff9700 1 -- 172.21.15.47:0/658754681 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c400abc0 con 0x7f49cc14f0c0 2024-05-08T19:26:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.446+0000 7f49d27eb700 1 -- 172.21.15.47:0/658754681 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49cc150b00 con 0x7f49cc14f0c0 2024-05-08T19:26:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.446+0000 7f49c8ff9700 1 -- 172.21.15.47:0/658754681 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c40070d0 con 0x7f49cc14f0c0 2024-05-08T19:26:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.446+0000 7f49d27eb700 1 -- 172.21.15.47:0/658754681 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49cc1490d0 con 0x7f49cc14f0c0 2024-05-08T19:26:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.447+0000 7f49d27eb700 1 -- 172.21.15.47:0/658754681 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49cc1492f0 con 0x7f49cc14f0c0 2024-05-08T19:26:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.447+0000 7f49c8ff9700 1 -- 172.21.15.47:0/658754681 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f49c4007230 con 0x7f49cc14f0c0 2024-05-08T19:26:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.447+0000 7f49c8ff9700 1 --2- 172.21.15.47:0/658754681 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f49ac06acc0 0x7f49ac06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.448+0000 7f49c8ff9700 1 -- 172.21.15.47:0/658754681 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f49c4089050 con 0x7f49cc14f0c0 2024-05-08T19:26:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.448+0000 7f49cbfff700 1 --2- 172.21.15.47:0/658754681 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f49ac06acc0 0x7f49ac06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.448+0000 7f49cbfff700 1 --2- 172.21.15.47:0/658754681 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f49ac06acc0 0x7f49ac06d180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f49b400be00 tx=0x7f49b4013000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.452+0000 7f49c8ff9700 1 -- 172.21.15.47:0/658754681 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f49c4053f00 con 0x7f49cc14f0c0 2024-05-08T19:26:55.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.657+0000 7f49d27eb700 1 -- 172.21.15.47:0/658754681 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49cc04ec60 con 0x7f49cc14f0c0 2024-05-08T19:26:55.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.658+0000 7f49c8ff9700 1 -- 172.21.15.47:0/658754681 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f49c4018020 con 0x7f49cc14f0c0 2024-05-08T19:26:55.650 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-08T19:26:55.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.660+0000 7f49d27eb700 1 -- 172.21.15.47:0/658754681 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f49ac06acc0 msgr2=0x7f49ac06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.660+0000 7f49d27eb700 1 --2- 172.21.15.47:0/658754681 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f49ac06acc0 0x7f49ac06d180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f49b400be00 tx=0x7f49b4013000 comp rx=0 tx=0).stop 2024-05-08T19:26:55.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.660+0000 7f49d27eb700 1 -- 172.21.15.47:0/658754681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49cc14f0c0 msgr2=0x7f49cc148280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.660+0000 7f49d27eb700 1 --2- 172.21.15.47:0/658754681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49cc14f0c0 0x7f49cc148280 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f49c400cb90 tx=0x7f49c400cea0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.660+0000 7f49d27eb700 1 -- 172.21.15.47:0/658754681 shutdown_connections 2024-05-08T19:26:55.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.660+0000 7f49d27eb700 1 --2- 172.21.15.47:0/658754681 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f49ac06acc0 0x7f49ac06d180 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.660+0000 7f49d27eb700 1 --2- 172.21.15.47:0/658754681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49cc14f0c0 0x7f49cc148280 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.660+0000 7f49d27eb700 1 --2- 172.21.15.47:0/658754681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49cc06bf10 0x7f49cc1e9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.660+0000 7f49d27eb700 1 --2- 172.21.15.47:0/658754681 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49cc0c2b80 0x7f49cc0c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.660+0000 7f49d27eb700 1 -- 172.21.15.47:0/658754681 >> 172.21.15.47:0/658754681 conn(0x7f49cc0c3360 msgr2=0x7f49cc0c2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:55.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.660+0000 7f49d27eb700 1 -- 172.21.15.47:0/658754681 shutdown_connections 2024-05-08T19:26:55.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.660+0000 7f49d27eb700 1 -- 172.21.15.47:0/658754681 wait complete. 2024-05-08T19:26:55.665 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T19:26:55.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.806+0000 7fe395e46700 1 Processor -- start 2024-05-08T19:26:55.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.806+0000 7fe395e46700 1 -- start start 2024-05-08T19:26:55.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.807+0000 7fe395e46700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe390072360 0x7fe3901554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.807+0000 7fe395e46700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe3900bfeb0 0x7fe3900c0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.807+0000 7fe395e46700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3900c19c0 con 0x7fe390072d20 2024-05-08T19:26:55.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.807+0000 7fe395e46700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe390155a00 con 0x7fe390072360 2024-05-08T19:26:55.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.807+0000 7fe395e46700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe390066780 con 0x7fe3900bfeb0 2024-05-08T19:26:55.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.807+0000 7fe38f7fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe390072360 0x7fe3901554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.807+0000 7fe38f7fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe390072360 0x7fe3901554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60694/0 (socket says 172.21.15.47:60694) 2024-05-08T19:26:55.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.807+0000 7fe38f7fe700 1 -- 172.21.15.47:0/2154646961 learned_addr learned my addr 172.21.15.47:0/2154646961 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:55.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.807+0000 7fe38ffff700 1 --2- 172.21.15.47:0/2154646961 >> v2:172.21.15.177:3300/0 conn(0x7fe3900bfeb0 0x7fe3900c0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.807+0000 7fe38f7fe700 1 -- 172.21.15.47:0/2154646961 >> v2:172.21.15.177:3300/0 conn(0x7fe3900bfeb0 msgr2=0x7fe3900c0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:26:55.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.807+0000 7fe38f7fe700 1 --2- 172.21.15.47:0/2154646961 >> v2:172.21.15.177:3300/0 conn(0x7fe3900bfeb0 0x7fe3900c0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.807+0000 7fe38f7fe700 1 -- 172.21.15.47:0/2154646961 >> v1:172.21.15.177:6789/0 conn(0x7fe390072d20 legacy=0x7fe39006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.807+0000 7fe38f7fe700 1 -- 172.21.15.47:0/2154646961 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe390066a60 con 0x7fe390072360 2024-05-08T19:26:55.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.807+0000 7fe38f7fe700 1 --2- 172.21.15.47:0/2154646961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390072360 0x7fe3901554c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe3800098f0 tx=0x7fe380009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b99a1939818d557 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:55.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.808+0000 7fe38e7fc700 1 -- 172.21.15.47:0/2154646961 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380011830 con 0x7fe390072360 2024-05-08T19:26:55.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.808+0000 7fe38e7fc700 1 -- 172.21.15.47:0/2154646961 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe380011990 con 0x7fe390072360 2024-05-08T19:26:55.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.808+0000 7fe38e7fc700 1 -- 172.21.15.47:0/2154646961 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380011d20 con 0x7fe390072360 2024-05-08T19:26:55.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.808+0000 7fe395e46700 1 -- 172.21.15.47:0/2154646961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390072360 msgr2=0x7fe3901554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.808+0000 7fe395e46700 1 --2- 172.21.15.47:0/2154646961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390072360 0x7fe3901554c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe3800098f0 tx=0x7fe380009c00 comp rx=0 tx=0).stop 2024-05-08T19:26:55.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.808+0000 7fe395e46700 1 -- 172.21.15.47:0/2154646961 shutdown_connections 2024-05-08T19:26:55.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.808+0000 7fe395e46700 1 --2- 172.21.15.47:0/2154646961 >> v2:172.21.15.177:3300/0 conn(0x7fe3900bfeb0 0x7fe3900c0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.808+0000 7fe395e46700 1 --2- 172.21.15.47:0/2154646961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390072360 0x7fe3901554c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.808+0000 7fe395e46700 1 -- 172.21.15.47:0/2154646961 >> 172.21.15.47:0/2154646961 conn(0x7fe3900c33d0 msgr2=0x7fe3900c37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:55.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.808+0000 7fe395e46700 1 -- 172.21.15.47:0/2154646961 shutdown_connections 2024-05-08T19:26:55.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.808+0000 7fe395e46700 1 -- 172.21.15.47:0/2154646961 wait complete. 2024-05-08T19:26:55.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.809+0000 7fe395e46700 1 Processor -- start 2024-05-08T19:26:55.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.810+0000 7fe395e46700 1 -- start start 2024-05-08T19:26:55.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.810+0000 7fe395e46700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe390072360 0x7fe390146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.810+0000 7fe395e46700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390072d20 0x7fe3900ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.810+0000 7fe395e46700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3900bfeb0 0x7fe390153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.810+0000 7fe395e46700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe390147180 con 0x7fe390072d20 2024-05-08T19:26:55.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.810+0000 7fe395e46700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe390149350 con 0x7fe390072360 2024-05-08T19:26:55.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.810+0000 7fe395e46700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe390146960 con 0x7fe3900bfeb0 2024-05-08T19:26:55.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.810+0000 7fe38effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390072d20 0x7fe3900ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.810+0000 7fe38effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390072d20 0x7fe3900ab310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60706/0 (socket says 172.21.15.47:60706) 2024-05-08T19:26:55.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.810+0000 7fe38effd700 1 -- 172.21.15.47:0/3590041946 learned_addr learned my addr 172.21.15.47:0/3590041946 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:55.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.810+0000 7fe38f7fe700 1 --2- 172.21.15.47:0/3590041946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe390072360 0x7fe390146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.811+0000 7fe38ffff700 1 --2- 172.21.15.47:0/3590041946 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3900bfeb0 0x7fe390153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.811+0000 7fe38effd700 1 -- 172.21.15.47:0/3590041946 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3900bfeb0 msgr2=0x7fe390153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.811+0000 7fe38effd700 1 --2- 172.21.15.47:0/3590041946 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3900bfeb0 0x7fe390153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.811+0000 7fe38effd700 1 -- 172.21.15.47:0/3590041946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe390072360 msgr2=0x7fe390146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:55.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.811+0000 7fe38effd700 1 --2- 172.21.15.47:0/3590041946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe390072360 0x7fe390146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:55.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.811+0000 7fe38effd700 1 -- 172.21.15.47:0/3590041946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe380009550 con 0x7fe390072d20 2024-05-08T19:26:55.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.811+0000 7fe38effd700 1 --2- 172.21.15.47:0/3590041946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390072d20 0x7fe3900ab310 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe38400c4e0 tx=0x7fe38400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:55.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.811+0000 7fe377fff700 1 -- 172.21.15.47:0/3590041946 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3840052d0 con 0x7fe390072d20 2024-05-08T19:26:55.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.811+0000 7fe377fff700 1 -- 172.21.15.47:0/3590041946 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe384005430 con 0x7fe390072d20 2024-05-08T19:26:55.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.811+0000 7fe395e46700 1 -- 172.21.15.47:0/3590041946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe390152d40 con 0x7fe390072d20 2024-05-08T19:26:55.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.811+0000 7fe377fff700 1 -- 172.21.15.47:0/3590041946 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3840038c0 con 0x7fe390072d20 2024-05-08T19:26:55.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.811+0000 7fe395e46700 1 -- 172.21.15.47:0/3590041946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3900ab850 con 0x7fe390072d20 2024-05-08T19:26:55.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.812+0000 7fe395e46700 1 -- 172.21.15.47:0/3590041946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3901494c0 con 0x7fe390072d20 2024-05-08T19:26:55.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.813+0000 7fe377fff700 1 -- 172.21.15.47:0/3590041946 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe384003a20 con 0x7fe390072d20 2024-05-08T19:26:55.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.813+0000 7fe377fff700 1 --2- 172.21.15.47:0/3590041946 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe37c06ac90 0x7fe37c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:55.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.813+0000 7fe377fff700 1 -- 172.21.15.47:0/3590041946 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe3840889f0 con 0x7fe390072d20 2024-05-08T19:26:55.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.813+0000 7fe38f7fe700 1 --2- 172.21.15.47:0/3590041946 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe37c06ac90 0x7fe37c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:55.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.814+0000 7fe38f7fe700 1 --2- 172.21.15.47:0/3590041946 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe37c06ac90 0x7fe37c06d150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe380009130 tx=0x7fe380008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:55.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:55.818+0000 7fe377fff700 1 -- 172.21.15.47:0/3590041946 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe3840538a0 con 0x7fe390072d20 2024-05-08T19:26:56.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.053+0000 7fe395e46700 1 -- 172.21.15.47:0/3590041946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe39004ec60 con 0x7fe390072d20 2024-05-08T19:26:56.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.054+0000 7fe377fff700 1 -- 172.21.15.47:0/3590041946 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe384017020 con 0x7fe390072d20 2024-05-08T19:26:56.046 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-08T19:26:56.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.056+0000 7fe395e46700 1 -- 172.21.15.47:0/3590041946 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe37c06ac90 msgr2=0x7fe37c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:56.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.056+0000 7fe395e46700 1 --2- 172.21.15.47:0/3590041946 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe37c06ac90 0x7fe37c06d150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe380009130 tx=0x7fe380008030 comp rx=0 tx=0).stop 2024-05-08T19:26:56.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.056+0000 7fe395e46700 1 -- 172.21.15.47:0/3590041946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390072d20 msgr2=0x7fe3900ab310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.056+0000 7fe395e46700 1 --2- 172.21.15.47:0/3590041946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390072d20 0x7fe3900ab310 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe38400c4e0 tx=0x7fe38400c7f0 comp rx=0 tx=0).stop 2024-05-08T19:26:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.056+0000 7fe395e46700 1 -- 172.21.15.47:0/3590041946 shutdown_connections 2024-05-08T19:26:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.056+0000 7fe395e46700 1 --2- 172.21.15.47:0/3590041946 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe37c06ac90 0x7fe37c06d150 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.056+0000 7fe395e46700 1 --2- 172.21.15.47:0/3590041946 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3900bfeb0 0x7fe390153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.056+0000 7fe395e46700 1 --2- 172.21.15.47:0/3590041946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe390072360 0x7fe390146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.056+0000 7fe395e46700 1 --2- 172.21.15.47:0/3590041946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390072d20 0x7fe3900ab310 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.056+0000 7fe395e46700 1 -- 172.21.15.47:0/3590041946 >> 172.21.15.47:0/3590041946 conn(0x7fe3900c33d0 msgr2=0x7fe390071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.056+0000 7fe395e46700 1 -- 172.21.15.47:0/3590041946 shutdown_connections 2024-05-08T19:26:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.056+0000 7fe395e46700 1 -- 172.21.15.47:0/3590041946 wait complete. 2024-05-08T19:26:56.071 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T19:26:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.210+0000 7f8b9fb46700 1 Processor -- start 2024-05-08T19:26:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.210+0000 7f8b9fb46700 1 -- start start 2024-05-08T19:26:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.211+0000 7f8b9fb46700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8b980abfa0 0x7f8b980c2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.211+0000 7f8b9fb46700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b9806dfb0 0x7f8b981542f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.211+0000 7f8b9fb46700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b98070670 con 0x7f8b98151560 2024-05-08T19:26:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.211+0000 7f8b9fb46700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b98150d80 con 0x7f8b980abfa0 2024-05-08T19:26:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.211+0000 7f8b9fb46700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98070910 con 0x7f8b9806dfb0 2024-05-08T19:26:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.211+0000 7f8b9d8e2700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8b980abfa0 0x7f8b980c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.211+0000 7f8b9e0e3700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8b98151560 0x7f8b980c1330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59440/0 (socket says 172.21.15.47:59440) 2024-05-08T19:26:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.211+0000 7f8b9e0e3700 1 -- 172.21.15.47:0/1445907387 learned_addr learned my addr 172.21.15.47:0/1445907387 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:26:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.211+0000 7f8b9d8e2700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8b980abfa0 0x7f8b980c2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60722/0 (socket says 172.21.15.47:60722) 2024-05-08T19:26:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.211+0000 7f8b9d0e1700 1 --2- 172.21.15.47:0/1445907387 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b9806dfb0 0x7f8b981542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.212+0000 7f8b9d8e2700 1 -- 172.21.15.47:0/1445907387 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b9806dfb0 msgr2=0x7f8b981542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:26:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.212+0000 7f8b9d8e2700 1 --2- 172.21.15.47:0/1445907387 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b9806dfb0 0x7f8b981542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.212+0000 7f8b9d8e2700 1 -- 172.21.15.47:0/1445907387 >> v1:172.21.15.47:6789/0 conn(0x7f8b98151560 legacy=0x7f8b980c1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.212+0000 7f8b9d8e2700 1 -- 172.21.15.47:0/1445907387 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b98070bf0 con 0x7f8b980abfa0 2024-05-08T19:26:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.212+0000 7f8b9c8e0700 1 -- 172.21.15.47:0/1445907387 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456259574 0 0) 0x7f8b98070670 con 0x7f8b98151560 2024-05-08T19:26:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.212+0000 7f8b9d0e1700 1 --2- 172.21.15.47:0/1445907387 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b9806dfb0 0x7f8b981542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:26:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.212+0000 7f8b9d8e2700 1 --2- 172.21.15.47:0/1445907387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b980abfa0 0x7f8b980c2490 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009840 tx=0x7f8b88009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66ed50bd3112fbb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.212+0000 7f8b9c8e0700 1 -- 172.21.15.47:0/1445907387 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88011830 con 0x7f8b980abfa0 2024-05-08T19:26:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.212+0000 7f8b9c8e0700 1 -- 172.21.15.47:0/1445907387 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b88011990 con 0x7f8b980abfa0 2024-05-08T19:26:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.212+0000 7f8b9c8e0700 1 -- 172.21.15.47:0/1445907387 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88011d20 con 0x7f8b980abfa0 2024-05-08T19:26:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.213+0000 7f8b9fb46700 1 -- 172.21.15.47:0/1445907387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b980abfa0 msgr2=0x7f8b980c2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.213+0000 7f8b9fb46700 1 --2- 172.21.15.47:0/1445907387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b980abfa0 0x7f8b980c2490 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009840 tx=0x7f8b88009b50 comp rx=0 tx=0).stop 2024-05-08T19:26:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.213+0000 7f8b9fb46700 1 -- 172.21.15.47:0/1445907387 shutdown_connections 2024-05-08T19:26:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.213+0000 7f8b9fb46700 1 --2- 172.21.15.47:0/1445907387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b980abfa0 0x7f8b980c2490 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.213+0000 7f8b9fb46700 1 --2- 172.21.15.47:0/1445907387 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b9806dfb0 0x7f8b981542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.213+0000 7f8b9fb46700 1 -- 172.21.15.47:0/1445907387 >> 172.21.15.47:0/1445907387 conn(0x7f8b9806a9c0 msgr2=0x7f8b9806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.213+0000 7f8b9fb46700 1 -- 172.21.15.47:0/1445907387 shutdown_connections 2024-05-08T19:26:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.213+0000 7f8b9fb46700 1 -- 172.21.15.47:0/1445907387 wait complete. 2024-05-08T19:26:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.214+0000 7f8b9fb46700 1 Processor -- start 2024-05-08T19:26:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.214+0000 7f8b9fb46700 1 -- start start 2024-05-08T19:26:56.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9fb46700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b9806dfb0 0x7f8b98138fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:56.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9fb46700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b980abfa0 0x7f8b981eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:56.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9fb46700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b98151560 0x7f8b981edf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:56.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9fb46700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980c5e10 con 0x7f8b98151560 2024-05-08T19:26:56.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9fb46700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b981ed580 con 0x7f8b9806dfb0 2024-05-08T19:26:56.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9fb46700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98137530 con 0x7f8b980abfa0 2024-05-08T19:26:56.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9e0e3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b98151560 0x7f8b981edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:56.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9e0e3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b98151560 0x7f8b981edf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60734/0 (socket says 172.21.15.47:60734) 2024-05-08T19:26:56.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9e0e3700 1 -- 172.21.15.47:0/3910219344 learned_addr learned my addr 172.21.15.47:0/3910219344 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:26:56.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9d0e1700 1 --2- 172.21.15.47:0/3910219344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b980abfa0 0x7f8b981eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:56.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9d8e2700 1 --2- 172.21.15.47:0/3910219344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b9806dfb0 0x7f8b98138fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:56.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9e0e3700 1 -- 172.21.15.47:0/3910219344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b980abfa0 msgr2=0x7f8b981eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:56.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9e0e3700 1 --2- 172.21.15.47:0/3910219344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b980abfa0 0x7f8b981eda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:56.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9e0e3700 1 -- 172.21.15.47:0/3910219344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b9806dfb0 msgr2=0x7f8b98138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:56.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9e0e3700 1 --2- 172.21.15.47:0/3910219344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b9806dfb0 0x7f8b98138fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:56.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9e0e3700 1 -- 172.21.15.47:0/3910219344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b940094a0 con 0x7f8b98151560 2024-05-08T19:26:56.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9e0e3700 1 --2- 172.21.15.47:0/3910219344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b98151560 0x7f8b981edf50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000cc70 tx=0x7f8b9000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:56.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b8e7fc700 1 -- 172.21.15.47:0/3910219344 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9000aac0 con 0x7f8b98151560 2024-05-08T19:26:56.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b8e7fc700 1 -- 172.21.15.47:0/3910219344 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9000ac40 con 0x7f8b98151560 2024-05-08T19:26:56.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b9fb46700 1 -- 172.21.15.47:0/3910219344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b880094a0 con 0x7f8b98151560 2024-05-08T19:26:56.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.215+0000 7f8b8e7fc700 1 -- 172.21.15.47:0/3910219344 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900070d0 con 0x7f8b98151560 2024-05-08T19:26:56.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.216+0000 7f8b9fb46700 1 -- 172.21.15.47:0/3910219344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b980c5570 con 0x7f8b98151560 2024-05-08T19:26:56.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.216+0000 7f8b9fb46700 1 -- 172.21.15.47:0/3910219344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b98074260 con 0x7f8b98151560 2024-05-08T19:26:56.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.217+0000 7f8b8e7fc700 1 -- 172.21.15.47:0/3910219344 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8b90007250 con 0x7f8b98151560 2024-05-08T19:26:56.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.217+0000 7f8b8e7fc700 1 --2- 172.21.15.47:0/3910219344 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f8b7c06ac90 0x7f8b7c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:26:56.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.217+0000 7f8b8e7fc700 1 -- 172.21.15.47:0/3910219344 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8b90089070 con 0x7f8b98151560 2024-05-08T19:26:56.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.217+0000 7f8b9d8e2700 1 --2- 172.21.15.47:0/3910219344 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f8b7c06ac90 0x7f8b7c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:26:56.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.218+0000 7f8b9d8e2700 1 --2- 172.21.15.47:0/3910219344 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f8b7c06ac90 0x7f8b7c06d150 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8b880090b0 tx=0x7f8b88008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:26:56.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.222+0000 7f8b8e7fc700 1 -- 172.21.15.47:0/3910219344 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8b90053f20 con 0x7f8b98151560 2024-05-08T19:26:56.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 383349 14.45 MB/sec execute 33 sec latency 33.901 ms 2024-05-08T19:26:56.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.446+0000 7f8b9fb46700 1 -- 172.21.15.47:0/3910219344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8b9804ec60 con 0x7f8b98151560 2024-05-08T19:26:56.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.447+0000 7f8b8e7fc700 1 -- 172.21.15.47:0/3910219344 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8b90018080 con 0x7f8b98151560 2024-05-08T19:26:56.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.449+0000 7f8b9fb46700 1 -- 172.21.15.47:0/3910219344 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f8b7c06ac90 msgr2=0x7f8b7c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:56.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.449+0000 7f8b9fb46700 1 --2- 172.21.15.47:0/3910219344 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f8b7c06ac90 0x7f8b7c06d150 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8b880090b0 tx=0x7f8b88008030 comp rx=0 tx=0).stop 2024-05-08T19:26:56.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.449+0000 7f8b9fb46700 1 -- 172.21.15.47:0/3910219344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b98151560 msgr2=0x7f8b981edf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:26:56.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.449+0000 7f8b9fb46700 1 --2- 172.21.15.47:0/3910219344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b98151560 0x7f8b981edf50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000cc70 tx=0x7f8b9000cf80 comp rx=0 tx=0).stop 2024-05-08T19:26:56.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.449+0000 7f8b9fb46700 1 -- 172.21.15.47:0/3910219344 shutdown_connections 2024-05-08T19:26:56.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.449+0000 7f8b9fb46700 1 --2- 172.21.15.47:0/3910219344 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f8b7c06ac90 0x7f8b7c06d150 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:56.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.449+0000 7f8b9fb46700 1 --2- 172.21.15.47:0/3910219344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b98151560 0x7f8b981edf50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:56.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.449+0000 7f8b9fb46700 1 --2- 172.21.15.47:0/3910219344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b9806dfb0 0x7f8b98138fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:56.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.449+0000 7f8b9fb46700 1 --2- 172.21.15.47:0/3910219344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b980abfa0 0x7f8b981eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:26:56.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.449+0000 7f8b9fb46700 1 -- 172.21.15.47:0/3910219344 >> 172.21.15.47:0/3910219344 conn(0x7f8b9806a9c0 msgr2=0x7f8b9806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:26:56.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.449+0000 7f8b9fb46700 1 -- 172.21.15.47:0/3910219344 shutdown_connections 2024-05-08T19:26:56.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:26:56.449+0000 7f8b9fb46700 1 -- 172.21.15.47:0/3910219344 wait complete. 2024-05-08T19:26:56.443 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-08T19:26:56.454 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi047.front.sepia.ceph.com... 2024-05-08T19:26:56.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:26:56.454 DEBUG:teuthology.orchestra.run.smithi047:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-08T19:26:56.499 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:26:56.500 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[56975]: fuse finished with error 0 and tester_r 0 2024-05-08T19:26:57.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 385891 14.36 MB/sec execute 34 sec latency 31.071 ms 2024-05-08T19:26:57.627 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:26:57.631 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:26:58.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 388148 14.33 MB/sec execute 35 sec latency 51.842 ms 2024-05-08T19:26:59.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 391020 14.33 MB/sec execute 36 sec latency 10.119 ms 2024-05-08T19:27:00.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 394315 14.45 MB/sec execute 37 sec latency 14.342 ms 2024-05-08T19:27:01.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 397526 14.56 MB/sec execute 38 sec latency 24.164 ms 2024-05-08T19:27:02.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 399679 14.38 MB/sec execute 39 sec latency 132.622 ms 2024-05-08T19:27:02.602 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-05-08T19:27:02.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:27:02.602 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T19:27:02.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:27:02.620 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-08T19:27:02.679 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T19:27:02.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:27:02.680 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T19:27:02.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:27:02.766 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-05-08T19:27:02.840 DEBUG:teuthology.parallel:result is None 2024-05-08T19:27:03.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 402046 14.37 MB/sec execute 40 sec latency 15.552 ms 2024-05-08T19:27:04.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 405123 14.44 MB/sec execute 41 sec latency 33.108 ms 2024-05-08T19:27:05.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 408380 14.55 MB/sec execute 42 sec latency 10.681 ms 2024-05-08T19:27:06.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 411747 14.65 MB/sec execute 43 sec latency 23.220 ms 2024-05-08T19:27:07.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 415045 14.72 MB/sec execute 44 sec latency 37.880 ms 2024-05-08T19:27:08.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 418011 14.71 MB/sec execute 45 sec latency 90.566 ms 2024-05-08T19:27:09.291 INFO:tasks.workunit.client.1.smithi177.stdout: 1 420646 14.65 MB/sec execute 46 sec latency 21.656 ms 2024-05-08T19:27:10.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 423065 14.65 MB/sec execute 47 sec latency 11.930 ms 2024-05-08T19:27:11.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 426272 14.72 MB/sec execute 48 sec latency 16.208 ms 2024-05-08T19:27:12.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 429464 14.81 MB/sec execute 49 sec latency 23.783 ms 2024-05-08T19:27:13.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 429638 14.52 MB/sec execute 50 sec latency 364.401 ms 2024-05-08T19:27:14.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 432558 14.51 MB/sec execute 51 sec latency 44.449 ms 2024-05-08T19:27:15.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 434388 14.43 MB/sec execute 52 sec latency 31.294 ms 2024-05-08T19:27:16.290 INFO:tasks.workunit.client.1.smithi177.stdout: 1 437303 14.43 MB/sec execute 53 sec latency 34.562 ms 2024-05-08T19:27:17.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 440532 14.51 MB/sec execute 54 sec latency 25.848 ms 2024-05-08T19:27:18.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 443728 14.58 MB/sec execute 55 sec latency 27.979 ms 2024-05-08T19:27:19.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 446956 14.64 MB/sec execute 56 sec latency 67.933 ms 2024-05-08T19:27:20.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 449944 14.63 MB/sec execute 57 sec latency 69.316 ms 2024-05-08T19:27:21.288 INFO:tasks.workunit.client.1.smithi177.stdout: 1 452271 14.58 MB/sec execute 58 sec latency 17.951 ms 2024-05-08T19:27:22.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 455221 14.60 MB/sec execute 59 sec latency 16.833 ms 2024-05-08T19:27:23.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 458344 14.65 MB/sec execute 60 sec latency 11.731 ms 2024-05-08T19:27:24.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 460006 14.84 MB/sec execute 61 sec latency 171.507 ms 2024-05-08T19:27:25.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 463124 14.86 MB/sec execute 62 sec latency 11.355 ms 2024-05-08T19:27:26.294 INFO:tasks.workunit.client.1.smithi177.stdout: 1 466629 14.92 MB/sec execute 63 sec latency 7.871 ms 2024-05-08T19:27:27.294 INFO:tasks.workunit.client.1.smithi177.stdout: 1 469773 14.96 MB/sec execute 64 sec latency 24.567 ms 2024-05-08T19:27:27.971 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:27:27.974 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:27:28.290 INFO:tasks.workunit.client.1.smithi177.stdout: 1 473206 15.02 MB/sec execute 65 sec latency 8.945 ms 2024-05-08T19:27:29.291 INFO:tasks.workunit.client.1.smithi177.stdout: 1 476529 15.08 MB/sec execute 66 sec latency 19.382 ms 2024-05-08T19:27:30.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 479667 15.12 MB/sec execute 67 sec latency 81.299 ms 2024-05-08T19:27:31.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 482843 15.12 MB/sec execute 68 sec latency 8.332 ms 2024-05-08T19:27:32.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 485827 15.10 MB/sec execute 69 sec latency 6.256 ms 2024-05-08T19:27:33.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 488676 15.12 MB/sec execute 70 sec latency 34.143 ms 2024-05-08T19:27:34.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 489197 14.93 MB/sec execute 71 sec latency 406.279 ms 2024-05-08T19:27:35.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 491089 14.90 MB/sec execute 72 sec latency 71.443 ms 2024-05-08T19:27:36.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 494090 14.94 MB/sec execute 73 sec latency 37.429 ms 2024-05-08T19:27:37.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 497238 14.94 MB/sec execute 74 sec latency 22.130 ms 2024-05-08T19:27:38.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 500010 14.91 MB/sec execute 75 sec latency 25.917 ms 2024-05-08T19:27:39.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 503288 14.95 MB/sec execute 76 sec latency 26.255 ms 2024-05-08T19:27:40.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 505311 14.92 MB/sec execute 77 sec latency 75.459 ms 2024-05-08T19:27:41.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 508755 14.97 MB/sec execute 78 sec latency 14.890 ms 2024-05-08T19:27:42.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 512139 15.02 MB/sec execute 79 sec latency 28.937 ms 2024-05-08T19:27:43.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 515488 15.07 MB/sec execute 80 sec latency 33.232 ms 2024-05-08T19:27:44.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 518896 15.12 MB/sec execute 81 sec latency 7.402 ms 2024-05-08T19:27:45.289 INFO:tasks.workunit.client.1.smithi177.stdout: 1 522021 15.12 MB/sec execute 82 sec latency 38.114 ms 2024-05-08T19:27:46.291 INFO:tasks.workunit.client.1.smithi177.stdout: 1 523863 15.05 MB/sec execute 83 sec latency 129.068 ms 2024-05-08T19:27:47.291 INFO:tasks.workunit.client.1.smithi177.stdout: 1 526810 15.06 MB/sec execute 84 sec latency 21.455 ms 2024-05-08T19:27:48.290 INFO:tasks.workunit.client.1.smithi177.stdout: 1 530049 15.09 MB/sec execute 85 sec latency 23.739 ms 2024-05-08T19:27:49.290 INFO:tasks.workunit.client.1.smithi177.stdout: 1 533428 15.13 MB/sec execute 86 sec latency 36.242 ms 2024-05-08T19:27:50.290 INFO:tasks.workunit.client.1.smithi177.stdout: 1 536675 15.18 MB/sec execute 87 sec latency 26.164 ms 2024-05-08T19:27:51.292 INFO:tasks.workunit.client.1.smithi177.stdout: 1 539732 15.17 MB/sec execute 88 sec latency 16.034 ms 2024-05-08T19:27:52.290 INFO:tasks.workunit.client.1.smithi177.stdout: 1 541755 15.11 MB/sec execute 89 sec latency 80.150 ms 2024-05-08T19:27:53.290 INFO:tasks.workunit.client.1.smithi177.stdout: 1 544464 15.11 MB/sec execute 90 sec latency 17.829 ms 2024-05-08T19:27:54.290 INFO:tasks.workunit.client.1.smithi177.stdout: 1 547734 15.14 MB/sec execute 91 sec latency 12.332 ms 2024-05-08T19:27:55.290 INFO:tasks.workunit.client.1.smithi177.stdout: 1 550915 15.18 MB/sec execute 92 sec latency 22.635 ms 2024-05-08T19:27:56.290 INFO:tasks.workunit.client.1.smithi177.stdout: 1 554237 15.21 MB/sec execute 93 sec latency 19.200 ms 2024-05-08T19:27:57.290 INFO:tasks.workunit.client.1.smithi177.stdout: 1 556722 15.15 MB/sec execute 94 sec latency 75.336 ms 2024-05-08T19:27:58.061 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:27:58.063 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:27:58.290 INFO:tasks.workunit.client.1.smithi177.stdout: 1 559264 15.16 MB/sec execute 95 sec latency 51.798 ms 2024-05-08T19:27:59.292 INFO:tasks.workunit.client.1.smithi177.stdout: 1 561684 15.15 MB/sec execute 96 sec latency 267.316 ms 2024-05-08T19:28:00.292 INFO:tasks.workunit.client.1.smithi177.stdout: 1 562056 15.00 MB/sec execute 97 sec latency 308.239 ms 2024-05-08T19:28:01.292 INFO:tasks.workunit.client.1.smithi177.stdout: 1 563708 14.92 MB/sec execute 98 sec latency 76.238 ms 2024-05-08T19:28:02.293 INFO:tasks.workunit.client.1.smithi177.stdout: 1 566303 14.94 MB/sec execute 99 sec latency 17.228 ms 2024-05-08T19:28:03.292 INFO:tasks.workunit.client.1.smithi177.stdout: 1 569218 14.93 MB/sec execute 100 sec latency 17.194 ms 2024-05-08T19:28:04.292 INFO:tasks.workunit.client.1.smithi177.stdout: 1 572443 14.97 MB/sec execute 101 sec latency 34.025 ms 2024-05-08T19:28:05.292 INFO:tasks.workunit.client.1.smithi177.stdout: 1 575753 15.01 MB/sec execute 102 sec latency 22.109 ms 2024-05-08T19:28:06.293 INFO:tasks.workunit.client.1.smithi177.stdout: 1 579118 15.04 MB/sec execute 103 sec latency 16.860 ms 2024-05-08T19:28:07.292 INFO:tasks.workunit.client.1.smithi177.stdout: 1 582271 15.04 MB/sec execute 104 sec latency 29.332 ms 2024-05-08T19:28:08.294 INFO:tasks.workunit.client.1.smithi177.stdout: 1 584225 15.00 MB/sec execute 105 sec latency 108.879 ms 2024-05-08T19:28:09.294 INFO:tasks.workunit.client.1.smithi177.stdout: 1 587292 15.00 MB/sec execute 106 sec latency 18.973 ms 2024-05-08T19:28:10.294 INFO:tasks.workunit.client.1.smithi177.stdout: 1 590412 15.03 MB/sec execute 107 sec latency 29.226 ms 2024-05-08T19:28:11.294 INFO:tasks.workunit.client.1.smithi177.stdout: 1 593605 15.06 MB/sec execute 108 sec latency 12.090 ms 2024-05-08T19:28:12.295 INFO:tasks.workunit.client.1.smithi177.stdout: 1 596869 15.09 MB/sec execute 109 sec latency 27.556 ms 2024-05-08T19:28:13.294 INFO:tasks.workunit.client.1.smithi177.stdout: 1 599685 15.08 MB/sec execute 110 sec latency 13.954 ms 2024-05-08T19:28:14.296 INFO:tasks.workunit.client.1.smithi177.stdout: 1 601665 15.04 MB/sec execute 111 sec latency 121.039 ms 2024-05-08T19:28:15.297 INFO:tasks.workunit.client.1.smithi177.stdout: 1 604567 15.04 MB/sec execute 112 sec latency 13.729 ms 2024-05-08T19:28:16.297 INFO:tasks.workunit.client.1.smithi177.stdout: 1 607624 15.07 MB/sec execute 113 sec latency 93.369 ms 2024-05-08T19:28:17.297 INFO:tasks.workunit.client.1.smithi177.stdout: 1 610703 15.07 MB/sec execute 114 sec latency 14.241 ms 2024-05-08T19:28:18.297 INFO:tasks.workunit.client.1.smithi177.stdout: 1 613395 15.04 MB/sec execute 115 sec latency 34.815 ms 2024-05-08T19:28:19.297 INFO:tasks.workunit.client.1.smithi177.stdout: 1 615862 15.05 MB/sec execute 116 sec latency 89.955 ms 2024-05-08T19:28:20.297 INFO:tasks.workunit.client.1.smithi177.stdout: 1 619076 15.06 MB/sec execute 117 sec latency 19.014 ms 2024-05-08T19:28:21.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 622272 15.08 MB/sec execute 118 sec latency 23.657 ms 2024-05-08T19:28:22.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 625549 15.11 MB/sec execute 119 sec latency 20.282 ms 2024-05-08T19:28:23.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 628929 15.15 MB/sec execute 120 sec latency 17.578 ms 2024-05-08T19:28:24.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 631396 15.11 MB/sec execute 121 sec latency 78.075 ms 2024-05-08T19:28:25.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 634040 15.10 MB/sec execute 122 sec latency 11.958 ms 2024-05-08T19:28:26.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 636768 15.11 MB/sec execute 123 sec latency 17.451 ms 2024-05-08T19:28:27.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 640001 15.12 MB/sec execute 124 sec latency 8.032 ms 2024-05-08T19:28:28.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 643195 15.15 MB/sec execute 125 sec latency 44.174 ms 2024-05-08T19:28:28.430 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:28:28.433 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:28:29.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 646491 15.18 MB/sec execute 126 sec latency 57.719 ms 2024-05-08T19:28:30.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 647082 15.07 MB/sec execute 127 sec latency 607.282 ms 2024-05-08T19:28:31.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 648740 15.00 MB/sec execute 128 sec latency 879.426 ms 2024-05-08T19:28:32.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 649651 14.94 MB/sec execute 129 sec latency 52.501 ms 2024-05-08T19:28:33.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 652340 14.92 MB/sec execute 130 sec latency 18.504 ms 2024-05-08T19:28:34.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 655099 14.94 MB/sec execute 131 sec latency 20.680 ms 2024-05-08T19:28:35.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 657805 14.93 MB/sec execute 132 sec latency 31.870 ms 2024-05-08T19:28:36.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 660868 14.96 MB/sec execute 133 sec latency 70.860 ms 2024-05-08T19:28:37.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 664066 14.98 MB/sec execute 134 sec latency 13.265 ms 2024-05-08T19:28:38.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 666831 14.96 MB/sec execute 135 sec latency 27.071 ms 2024-05-08T19:28:39.298 INFO:tasks.workunit.client.1.smithi177.stdout: 1 669538 14.95 MB/sec execute 136 sec latency 15.215 ms 2024-05-08T19:28:40.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 672152 14.95 MB/sec execute 137 sec latency 30.933 ms 2024-05-08T19:28:41.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 675134 14.97 MB/sec execute 138 sec latency 75.427 ms 2024-05-08T19:28:42.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 678383 14.99 MB/sec execute 139 sec latency 10.859 ms 2024-05-08T19:28:43.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 681281 14.99 MB/sec execute 140 sec latency 35.631 ms 2024-05-08T19:28:44.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 683751 14.96 MB/sec execute 141 sec latency 12.908 ms 2024-05-08T19:28:45.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 686379 14.96 MB/sec execute 142 sec latency 23.820 ms 2024-05-08T19:28:46.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 689548 14.99 MB/sec execute 143 sec latency 26.996 ms 2024-05-08T19:28:47.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 692755 15.01 MB/sec execute 144 sec latency 18.667 ms 2024-05-08T19:28:48.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 695666 15.00 MB/sec execute 145 sec latency 18.076 ms 2024-05-08T19:28:49.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 698495 14.99 MB/sec execute 146 sec latency 11.971 ms 2024-05-08T19:28:50.300 INFO:tasks.workunit.client.1.smithi177.stdout: 1 700967 15.00 MB/sec execute 147 sec latency 21.398 ms 2024-05-08T19:28:51.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 703848 15.00 MB/sec execute 148 sec latency 23.354 ms 2024-05-08T19:28:52.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 706992 15.02 MB/sec execute 149 sec latency 23.488 ms 2024-05-08T19:28:53.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 710307 15.04 MB/sec execute 150 sec latency 8.088 ms 2024-05-08T19:28:54.299 INFO:tasks.workunit.client.1.smithi177.stdout: 1 713220 15.03 MB/sec execute 151 sec latency 25.608 ms 2024-05-08T19:28:55.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 716089 15.02 MB/sec execute 152 sec latency 19.440 ms 2024-05-08T19:28:56.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 716112 14.93 MB/sec execute 153 sec latency 455.592 ms 2024-05-08T19:28:57.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 716782 14.87 MB/sec execute 154 sec latency 98.665 ms 2024-05-08T19:28:58.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 719791 14.86 MB/sec execute 155 sec latency 12.723 ms 2024-05-08T19:28:58.836 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:28:58.838 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:28:59.048 INFO:tasks.ceph.mds.b.smithi177.stderr:2024-05-08T19:28:59.057+0000 7f0ad5def700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53066) UID: 0 2024-05-08T19:28:59.048 INFO:tasks.ceph.mds.d.smithi177.stderr:2024-05-08T19:28:59.057+0000 7fb2033aa700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53066) UID: 0 2024-05-08T19:28:59.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 722077 14.85 MB/sec execute 156 sec latency 32.001 ms 2024-05-08T19:29:00.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 725023 14.87 MB/sec execute 157 sec latency 34.255 ms 2024-05-08T19:29:01.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 728086 14.88 MB/sec execute 158 sec latency 37.539 ms 2024-05-08T19:29:02.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 730431 14.85 MB/sec execute 159 sec latency 23.197 ms 2024-05-08T19:29:03.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 732286 14.83 MB/sec execute 160 sec latency 81.816 ms 2024-05-08T19:29:04.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 735254 14.85 MB/sec execute 161 sec latency 54.002 ms 2024-05-08T19:29:05.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 737911 14.83 MB/sec execute 162 sec latency 14.520 ms 2024-05-08T19:29:06.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 739770 14.80 MB/sec execute 163 sec latency 22.183 ms 2024-05-08T19:29:07.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 742562 14.81 MB/sec execute 164 sec latency 29.477 ms 2024-05-08T19:29:08.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 745490 14.81 MB/sec execute 165 sec latency 67.315 ms 2024-05-08T19:29:09.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 748036 14.79 MB/sec execute 166 sec latency 22.593 ms 2024-05-08T19:29:10.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 750525 14.79 MB/sec execute 167 sec latency 7.671 ms 2024-05-08T19:29:11.305 INFO:tasks.workunit.client.1.smithi177.stdout: 1 753307 14.80 MB/sec execute 168 sec latency 49.647 ms 2024-05-08T19:29:12.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 756440 14.82 MB/sec execute 169 sec latency 19.986 ms 2024-05-08T19:29:13.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 759197 14.81 MB/sec execute 170 sec latency 27.227 ms 2024-05-08T19:29:14.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 761740 14.80 MB/sec execute 171 sec latency 26.554 ms 2024-05-08T19:29:15.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 764564 14.80 MB/sec execute 172 sec latency 13.272 ms 2024-05-08T19:29:16.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 767667 14.82 MB/sec execute 173 sec latency 18.503 ms 2024-05-08T19:29:17.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 770828 14.84 MB/sec execute 174 sec latency 16.770 ms 2024-05-08T19:29:18.305 INFO:tasks.workunit.client.1.smithi177.stdout: 1 773887 14.84 MB/sec execute 175 sec latency 34.048 ms 2024-05-08T19:29:19.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 776457 14.82 MB/sec execute 176 sec latency 27.376 ms 2024-05-08T19:29:20.305 INFO:tasks.workunit.client.1.smithi177.stdout: 1 778191 14.81 MB/sec execute 177 sec latency 251.627 ms 2024-05-08T19:29:21.305 INFO:tasks.workunit.client.1.smithi177.stdout: 1 781246 14.82 MB/sec execute 178 sec latency 36.004 ms 2024-05-08T19:29:22.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 783912 14.81 MB/sec execute 179 sec latency 17.049 ms 2024-05-08T19:29:23.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 786211 14.80 MB/sec execute 180 sec latency 20.508 ms 2024-05-08T19:29:24.304 INFO:tasks.workunit.client.1.smithi177.stdout: 1 789019 14.80 MB/sec execute 181 sec latency 14.678 ms 2024-05-08T19:29:25.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 791881 14.81 MB/sec execute 182 sec latency 119.154 ms 2024-05-08T19:29:26.305 INFO:tasks.workunit.client.1.smithi177.stdout: 1 792884 14.75 MB/sec execute 183 sec latency 292.886 ms 2024-05-08T19:29:27.305 INFO:tasks.workunit.client.1.smithi177.stdout: 1 793548 14.69 MB/sec execute 184 sec latency 405.777 ms 2024-05-08T19:29:28.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 794978 14.65 MB/sec execute 185 sec latency 67.123 ms 2024-05-08T19:29:29.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 796393 14.61 MB/sec execute 186 sec latency 38.876 ms 2024-05-08T19:29:30.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 799190 14.63 MB/sec execute 187 sec latency 39.931 ms 2024-05-08T19:29:31.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 801287 14.59 MB/sec execute 188 sec latency 27.456 ms 2024-05-08T19:29:32.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 803295 14.58 MB/sec execute 189 sec latency 17.743 ms 2024-05-08T19:29:33.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 806534 14.60 MB/sec execute 190 sec latency 25.436 ms 2024-05-08T19:29:34.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 809734 14.62 MB/sec execute 191 sec latency 27.991 ms 2024-05-08T19:29:35.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 812475 14.61 MB/sec execute 192 sec latency 11.589 ms 2024-05-08T19:29:36.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 814653 14.60 MB/sec execute 193 sec latency 65.121 ms 2024-05-08T19:29:37.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 817202 14.59 MB/sec execute 194 sec latency 116.608 ms 2024-05-08T19:29:38.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 820347 14.61 MB/sec execute 195 sec latency 17.979 ms 2024-05-08T19:29:39.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 822718 14.58 MB/sec execute 196 sec latency 35.189 ms 2024-05-08T19:29:40.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 825119 14.59 MB/sec execute 197 sec latency 45.278 ms 2024-05-08T19:29:41.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 827894 14.59 MB/sec execute 198 sec latency 14.192 ms 2024-05-08T19:29:42.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 829099 14.54 MB/sec execute 199 sec latency 274.216 ms 2024-05-08T19:29:43.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 831028 14.54 MB/sec execute 200 sec latency 49.315 ms 2024-05-08T19:29:44.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 833985 14.53 MB/sec execute 201 sec latency 19.766 ms 2024-05-08T19:29:45.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 836421 14.52 MB/sec execute 202 sec latency 59.160 ms 2024-05-08T19:29:46.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 838896 14.52 MB/sec execute 203 sec latency 8.210 ms 2024-05-08T19:29:47.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 841840 14.53 MB/sec execute 204 sec latency 56.460 ms 2024-05-08T19:29:48.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 845025 14.55 MB/sec execute 205 sec latency 48.200 ms 2024-05-08T19:29:49.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 847919 14.54 MB/sec execute 206 sec latency 10.902 ms 2024-05-08T19:29:50.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 850231 14.53 MB/sec execute 207 sec latency 27.131 ms 2024-05-08T19:29:51.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 852923 14.53 MB/sec execute 208 sec latency 25.701 ms 2024-05-08T19:29:52.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 856045 14.55 MB/sec execute 209 sec latency 26.511 ms 2024-05-08T19:29:53.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 859206 14.57 MB/sec execute 210 sec latency 32.710 ms 2024-05-08T19:29:54.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 861681 14.54 MB/sec execute 211 sec latency 9.527 ms 2024-05-08T19:29:55.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 863668 14.53 MB/sec execute 212 sec latency 27.885 ms 2024-05-08T19:29:56.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 866712 14.55 MB/sec execute 213 sec latency 11.662 ms 2024-05-08T19:29:57.306 INFO:tasks.workunit.client.1.smithi177.stdout: 1 869502 14.54 MB/sec execute 214 sec latency 28.643 ms 2024-05-08T19:29:58.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 871751 14.53 MB/sec execute 215 sec latency 45.713 ms 2024-05-08T19:29:59.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 873757 14.52 MB/sec execute 216 sec latency 209.718 ms 2024-05-08T19:30:00.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 876382 14.51 MB/sec execute 217 sec latency 30.378 ms 2024-05-08T19:30:01.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 878446 14.50 MB/sec execute 218 sec latency 17.966 ms 2024-05-08T19:30:02.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 881142 14.50 MB/sec execute 219 sec latency 17.812 ms 2024-05-08T19:30:03.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 881276 14.44 MB/sec execute 220 sec latency 295.215 ms 2024-05-08T19:30:04.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 883059 14.40 MB/sec execute 221 sec latency 65.651 ms 2024-05-08T19:30:05.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 884932 14.39 MB/sec execute 222 sec latency 37.025 ms 2024-05-08T19:30:06.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 888106 14.41 MB/sec execute 223 sec latency 20.302 ms 2024-05-08T19:30:07.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 891197 14.43 MB/sec execute 224 sec latency 39.541 ms 2024-05-08T19:30:08.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 894040 14.42 MB/sec execute 225 sec latency 17.690 ms 2024-05-08T19:30:09.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 896092 14.41 MB/sec execute 226 sec latency 75.974 ms 2024-05-08T19:30:10.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 898944 14.41 MB/sec execute 227 sec latency 7.615 ms 2024-05-08T19:30:11.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 902048 14.43 MB/sec execute 228 sec latency 50.326 ms 2024-05-08T19:30:12.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 904745 14.42 MB/sec execute 229 sec latency 60.402 ms 2024-05-08T19:30:13.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 907116 14.41 MB/sec execute 230 sec latency 20.514 ms 2024-05-08T19:30:14.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 909648 14.41 MB/sec execute 231 sec latency 25.618 ms 2024-05-08T19:30:15.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 912814 14.43 MB/sec execute 232 sec latency 35.147 ms 2024-05-08T19:30:16.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 916044 14.44 MB/sec execute 233 sec latency 12.912 ms 2024-05-08T19:30:17.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 917601 14.48 MB/sec execute 234 sec latency 50.331 ms 2024-05-08T19:30:18.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 920914 14.50 MB/sec execute 235 sec latency 8.528 ms 2024-05-08T19:30:19.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 924080 14.52 MB/sec execute 236 sec latency 44.103 ms 2024-05-08T19:30:20.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 926709 14.51 MB/sec execute 237 sec latency 42.154 ms 2024-05-08T19:30:21.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 928144 14.48 MB/sec execute 238 sec latency 200.465 ms 2024-05-08T19:30:22.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 931567 14.50 MB/sec execute 239 sec latency 10.984 ms 2024-05-08T19:30:23.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 933601 14.48 MB/sec execute 240 sec latency 161.027 ms 2024-05-08T19:30:24.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 933880 14.43 MB/sec execute 241 sec latency 256.317 ms 2024-05-08T19:30:25.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 935535 14.40 MB/sec execute 242 sec latency 54.826 ms 2024-05-08T19:30:26.307 INFO:tasks.workunit.client.1.smithi177.stdout: 1 938310 14.41 MB/sec execute 243 sec latency 58.788 ms 2024-05-08T19:30:27.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 940942 14.41 MB/sec execute 244 sec latency 47.157 ms 2024-05-08T19:30:28.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 943258 14.40 MB/sec execute 245 sec latency 12.121 ms 2024-05-08T19:30:29.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 945914 14.40 MB/sec execute 246 sec latency 35.075 ms 2024-05-08T19:30:30.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 949009 14.41 MB/sec execute 247 sec latency 28.845 ms 2024-05-08T19:30:31.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 951572 14.40 MB/sec execute 248 sec latency 72.036 ms 2024-05-08T19:30:32.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 954534 14.40 MB/sec execute 249 sec latency 17.462 ms 2024-05-08T19:30:33.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 956907 14.40 MB/sec execute 250 sec latency 37.966 ms 2024-05-08T19:30:34.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 959897 14.41 MB/sec execute 251 sec latency 18.605 ms 2024-05-08T19:30:35.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 963128 14.43 MB/sec execute 252 sec latency 24.276 ms 2024-05-08T19:30:36.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 966208 14.43 MB/sec execute 253 sec latency 23.531 ms 2024-05-08T19:30:37.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 968269 14.41 MB/sec execute 254 sec latency 82.395 ms 2024-05-08T19:30:38.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 970997 14.42 MB/sec execute 255 sec latency 10.012 ms 2024-05-08T19:30:39.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 974051 14.43 MB/sec execute 256 sec latency 12.661 ms 2024-05-08T19:30:40.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 976739 14.43 MB/sec execute 257 sec latency 46.905 ms 2024-05-08T19:30:41.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 978655 14.41 MB/sec execute 258 sec latency 28.860 ms 2024-05-08T19:30:42.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 981040 14.41 MB/sec execute 259 sec latency 17.540 ms 2024-05-08T19:30:43.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 983473 14.40 MB/sec execute 260 sec latency 72.735 ms 2024-05-08T19:30:44.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 985216 14.38 MB/sec execute 261 sec latency 54.644 ms 2024-05-08T19:30:45.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 987971 14.39 MB/sec execute 262 sec latency 26.748 ms 2024-05-08T19:30:46.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 990288 14.37 MB/sec execute 263 sec latency 21.643 ms 2024-05-08T19:30:47.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 992684 14.37 MB/sec execute 264 sec latency 22.574 ms 2024-05-08T19:30:48.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 995349 14.37 MB/sec execute 265 sec latency 86.331 ms 2024-05-08T19:30:49.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 998535 14.39 MB/sec execute 266 sec latency 26.531 ms 2024-05-08T19:30:50.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1001216 14.38 MB/sec execute 267 sec latency 30.010 ms 2024-05-08T19:30:51.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1003523 14.37 MB/sec execute 268 sec latency 13.182 ms 2024-05-08T19:30:52.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1006326 14.37 MB/sec execute 269 sec latency 25.222 ms 2024-05-08T19:30:53.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1009401 14.39 MB/sec execute 270 sec latency 26.595 ms 2024-05-08T19:30:54.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1012581 14.40 MB/sec execute 271 sec latency 33.768 ms 2024-05-08T19:30:55.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1015383 14.39 MB/sec execute 272 sec latency 15.312 ms 2024-05-08T19:30:56.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1017754 14.39 MB/sec execute 273 sec latency 41.394 ms 2024-05-08T19:30:57.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1020553 14.39 MB/sec execute 274 sec latency 28.126 ms 2024-05-08T19:30:58.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1023815 14.41 MB/sec execute 275 sec latency 11.027 ms 2024-05-08T19:30:59.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1026307 14.40 MB/sec execute 276 sec latency 88.033 ms 2024-05-08T19:31:00.308 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1028194 14.39 MB/sec execute 277 sec latency 35.596 ms 2024-05-08T19:31:01.309 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1030996 14.39 MB/sec execute 278 sec latency 28.810 ms 2024-05-08T19:31:02.309 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1034055 14.40 MB/sec execute 279 sec latency 11.008 ms 2024-05-08T19:31:03.309 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1036603 14.39 MB/sec execute 280 sec latency 45.253 ms 2024-05-08T19:31:04.309 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1038086 14.37 MB/sec execute 281 sec latency 80.231 ms 2024-05-08T19:31:05.309 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1039521 14.34 MB/sec execute 282 sec latency 261.490 ms 2024-05-08T19:31:06.309 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1041814 14.34 MB/sec execute 283 sec latency 10.829 ms 2024-05-08T19:31:07.309 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1044881 14.35 MB/sec execute 284 sec latency 50.347 ms 2024-05-08T19:31:08.309 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1047974 14.36 MB/sec execute 285 sec latency 24.606 ms 2024-05-08T19:31:09.309 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1048944 14.32 MB/sec execute 286 sec latency 372.183 ms 2024-05-08T19:31:10.309 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1049023 14.28 MB/sec execute 287 sec latency 575.486 ms 2024-05-08T19:31:11.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1051706 14.29 MB/sec execute 288 sec latency 96.003 ms 2024-05-08T19:31:12.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1052091 14.24 MB/sec execute 289 sec latency 40.986 ms 2024-05-08T19:31:13.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1055302 14.25 MB/sec execute 290 sec latency 35.451 ms 2024-05-08T19:31:14.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1058066 14.25 MB/sec execute 291 sec latency 24.888 ms 2024-05-08T19:31:15.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1060291 14.24 MB/sec execute 292 sec latency 47.705 ms 2024-05-08T19:31:16.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1062948 14.24 MB/sec execute 293 sec latency 43.556 ms 2024-05-08T19:31:17.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1066227 14.25 MB/sec execute 294 sec latency 18.663 ms 2024-05-08T19:31:18.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1069387 14.27 MB/sec execute 295 sec latency 23.257 ms 2024-05-08T19:31:19.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1072151 14.27 MB/sec execute 296 sec latency 24.173 ms 2024-05-08T19:31:20.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1074922 14.26 MB/sec execute 297 sec latency 36.892 ms 2024-05-08T19:31:21.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1077211 14.26 MB/sec execute 298 sec latency 41.707 ms 2024-05-08T19:31:22.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1080306 14.27 MB/sec execute 299 sec latency 24.812 ms 2024-05-08T19:31:23.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1083413 14.28 MB/sec execute 300 sec latency 24.273 ms 2024-05-08T19:31:24.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1085979 14.27 MB/sec execute 301 sec latency 34.404 ms 2024-05-08T19:31:25.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1088386 14.27 MB/sec execute 302 sec latency 20.540 ms 2024-05-08T19:31:26.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1091080 14.27 MB/sec execute 303 sec latency 42.587 ms 2024-05-08T19:31:27.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1093496 14.27 MB/sec execute 304 sec latency 197.464 ms 2024-05-08T19:31:28.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1096255 14.26 MB/sec execute 305 sec latency 20.051 ms 2024-05-08T19:31:29.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1098659 14.26 MB/sec execute 306 sec latency 10.557 ms 2024-05-08T19:31:30.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1101804 14.27 MB/sec execute 307 sec latency 25.817 ms 2024-05-08T19:31:31.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1104829 14.29 MB/sec execute 308 sec latency 34.146 ms 2024-05-08T19:31:32.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1107102 14.27 MB/sec execute 309 sec latency 84.549 ms 2024-05-08T19:31:33.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1109418 14.27 MB/sec execute 310 sec latency 8.470 ms 2024-05-08T19:31:34.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1112256 14.27 MB/sec execute 311 sec latency 64.159 ms 2024-05-08T19:31:35.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1115310 14.28 MB/sec execute 312 sec latency 19.119 ms 2024-05-08T19:31:36.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1117729 14.27 MB/sec execute 313 sec latency 40.156 ms 2024-05-08T19:31:37.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1119786 14.26 MB/sec execute 314 sec latency 71.406 ms 2024-05-08T19:31:38.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1122944 14.28 MB/sec execute 315 sec latency 32.490 ms 2024-05-08T19:31:39.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1126207 14.29 MB/sec execute 316 sec latency 28.187 ms 2024-05-08T19:31:40.311 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1128987 14.29 MB/sec execute 317 sec latency 40.047 ms 2024-05-08T19:31:40.724 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:31:40.727 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:31:41.310 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1131931 14.28 MB/sec execute 318 sec latency 35.279 ms 2024-05-08T19:31:42.311 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1134236 14.28 MB/sec execute 319 sec latency 30.429 ms 2024-05-08T19:31:43.311 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1137335 14.29 MB/sec execute 320 sec latency 19.072 ms 2024-05-08T19:31:44.311 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1140490 14.31 MB/sec execute 321 sec latency 34.439 ms 2024-05-08T19:31:45.313 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1141194 14.27 MB/sec execute 322 sec latency 545.457 ms 2024-05-08T19:31:46.313 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1141260 14.22 MB/sec execute 323 sec latency 350.759 ms 2024-05-08T19:31:47.313 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1143537 14.22 MB/sec execute 324 sec latency 271.745 ms 2024-05-08T19:31:48.313 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1144478 14.19 MB/sec execute 325 sec latency 32.418 ms 2024-05-08T19:31:49.313 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1147616 14.20 MB/sec execute 326 sec latency 27.373 ms 2024-05-08T19:31:50.313 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1150820 14.21 MB/sec execute 327 sec latency 29.500 ms 2024-05-08T19:31:51.314 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1153333 14.20 MB/sec execute 328 sec latency 33.367 ms 2024-05-08T19:31:52.314 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1155794 14.21 MB/sec execute 329 sec latency 56.764 ms 2024-05-08T19:31:53.314 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1158727 14.21 MB/sec execute 330 sec latency 15.003 ms 2024-05-08T19:31:54.314 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1161783 14.22 MB/sec execute 331 sec latency 79.601 ms 2024-05-08T19:31:55.314 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1164663 14.22 MB/sec execute 332 sec latency 29.720 ms 2024-05-08T19:31:56.314 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1167313 14.21 MB/sec execute 333 sec latency 50.514 ms 2024-05-08T19:31:57.314 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1169480 14.21 MB/sec execute 334 sec latency 29.522 ms 2024-05-08T19:31:58.314 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1172580 14.22 MB/sec execute 335 sec latency 19.543 ms 2024-05-08T19:31:59.314 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1175772 14.23 MB/sec execute 336 sec latency 26.023 ms 2024-05-08T19:32:00.314 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1178154 14.22 MB/sec execute 337 sec latency 48.065 ms 2024-05-08T19:32:01.314 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1180308 14.22 MB/sec execute 338 sec latency 31.546 ms 2024-05-08T19:32:02.314 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1183529 14.23 MB/sec execute 339 sec latency 13.265 ms 2024-05-08T19:32:03.314 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1186740 14.24 MB/sec execute 340 sec latency 35.329 ms 2024-05-08T19:32:04.314 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1190067 14.25 MB/sec execute 341 sec latency 23.313 ms 2024-05-08T19:32:05.314 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1193150 14.25 MB/sec execute 342 sec latency 37.077 ms 2024-05-08T19:32:06.316 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1194063 14.23 MB/sec execute 343 sec latency 365.596 ms 2024-05-08T19:32:07.316 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1195771 14.20 MB/sec execute 344 sec latency 302.798 ms 2024-05-08T19:32:08.316 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1197322 14.20 MB/sec execute 345 sec latency 70.531 ms 2024-05-08T19:32:09.316 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1200545 14.21 MB/sec execute 346 sec latency 31.475 ms 2024-05-08T19:32:10.316 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1203296 14.20 MB/sec execute 347 sec latency 74.487 ms 2024-05-08T19:32:10.857 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:32:10.859 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:32:11.316 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1205200 14.19 MB/sec execute 348 sec latency 56.263 ms 2024-05-08T19:32:12.316 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1208257 14.20 MB/sec execute 349 sec latency 41.044 ms 2024-05-08T19:32:13.316 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1211478 14.21 MB/sec execute 350 sec latency 45.147 ms 2024-05-08T19:32:14.316 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1214735 14.22 MB/sec execute 351 sec latency 26.512 ms 2024-05-08T19:32:15.316 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1217264 14.21 MB/sec execute 352 sec latency 25.022 ms 2024-05-08T19:32:16.316 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1219094 14.20 MB/sec execute 353 sec latency 76.126 ms 2024-05-08T19:32:17.316 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1222016 14.21 MB/sec execute 354 sec latency 21.760 ms 2024-05-08T19:32:18.316 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1224221 14.20 MB/sec execute 355 sec latency 22.946 ms 2024-05-08T19:32:19.316 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1226101 14.19 MB/sec execute 356 sec latency 40.626 ms 2024-05-08T19:32:20.316 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1229079 14.20 MB/sec execute 357 sec latency 44.256 ms 2024-05-08T19:32:21.327 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1230296 14.18 MB/sec execute 358 sec latency 139.276 ms 2024-05-08T19:32:22.328 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1232371 14.17 MB/sec execute 359 sec latency 165.634 ms 2024-05-08T19:32:23.327 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1233215 14.14 MB/sec execute 360 sec latency 39.811 ms 2024-05-08T19:32:24.328 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1236330 14.15 MB/sec execute 361 sec latency 19.511 ms 2024-05-08T19:32:25.327 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1239229 14.15 MB/sec execute 362 sec latency 16.425 ms 2024-05-08T19:32:26.328 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1241574 14.14 MB/sec execute 363 sec latency 26.187 ms 2024-05-08T19:32:27.328 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1243777 14.14 MB/sec execute 364 sec latency 45.833 ms 2024-05-08T19:32:28.329 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1246858 14.15 MB/sec execute 365 sec latency 99.607 ms 2024-05-08T19:32:29.329 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1249942 14.15 MB/sec execute 366 sec latency 17.954 ms 2024-05-08T19:32:30.330 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1252697 14.15 MB/sec execute 367 sec latency 24.058 ms 2024-05-08T19:32:31.330 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1255315 14.16 MB/sec execute 368 sec latency 29.879 ms 2024-05-08T19:32:32.330 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1258016 14.16 MB/sec execute 369 sec latency 19.688 ms 2024-05-08T19:32:33.331 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1261032 14.17 MB/sec execute 370 sec latency 112.200 ms 2024-05-08T19:32:34.331 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1263961 14.17 MB/sec execute 371 sec latency 25.010 ms 2024-05-08T19:32:35.331 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1266740 14.16 MB/sec execute 372 sec latency 31.229 ms 2024-05-08T19:32:36.331 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1268981 14.16 MB/sec execute 373 sec latency 53.209 ms 2024-05-08T19:32:37.334 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1272065 14.17 MB/sec execute 374 sec latency 41.574 ms 2024-05-08T19:32:38.334 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1275073 14.18 MB/sec execute 375 sec latency 77.506 ms 2024-05-08T19:32:39.333 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1277703 14.17 MB/sec execute 376 sec latency 37.675 ms 2024-05-08T19:32:40.334 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1279998 14.17 MB/sec execute 377 sec latency 52.836 ms 2024-05-08T19:32:41.109 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:32:41.112 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:32:41.334 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1282760 14.17 MB/sec execute 378 sec latency 33.486 ms 2024-05-08T19:32:42.334 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1285838 14.18 MB/sec execute 379 sec latency 49.536 ms 2024-05-08T19:32:43.334 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1288921 14.19 MB/sec execute 380 sec latency 12.325 ms 2024-05-08T19:32:44.334 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1291458 14.18 MB/sec execute 381 sec latency 84.464 ms 2024-05-08T19:32:45.334 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1293770 14.18 MB/sec execute 382 sec latency 44.145 ms 2024-05-08T19:32:46.334 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1296990 14.19 MB/sec execute 383 sec latency 28.903 ms 2024-05-08T19:32:47.334 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1300226 14.20 MB/sec execute 384 sec latency 33.050 ms 2024-05-08T19:32:48.334 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1303502 14.21 MB/sec execute 385 sec latency 20.421 ms 2024-05-08T19:32:49.334 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1305842 14.20 MB/sec execute 386 sec latency 68.796 ms 2024-05-08T19:32:50.334 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1308015 14.19 MB/sec execute 387 sec latency 133.891 ms 2024-05-08T19:32:51.334 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1310850 14.20 MB/sec execute 388 sec latency 43.794 ms 2024-05-08T19:32:52.335 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1311982 14.18 MB/sec execute 389 sec latency 353.607 ms 2024-05-08T19:32:53.335 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1312924 14.15 MB/sec execute 390 sec latency 579.729 ms 2024-05-08T19:32:54.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1313816 14.13 MB/sec execute 391 sec latency 82.391 ms 2024-05-08T19:32:55.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1314910 14.11 MB/sec execute 392 sec latency 53.483 ms 2024-05-08T19:32:56.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1317853 14.12 MB/sec execute 393 sec latency 93.974 ms 2024-05-08T19:32:57.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1320872 14.12 MB/sec execute 394 sec latency 9.555 ms 2024-05-08T19:32:58.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1323579 14.11 MB/sec execute 395 sec latency 19.157 ms 2024-05-08T19:32:59.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1326156 14.12 MB/sec execute 396 sec latency 27.613 ms 2024-05-08T19:33:00.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1329106 14.12 MB/sec execute 397 sec latency 17.831 ms 2024-05-08T19:33:01.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1332286 14.13 MB/sec execute 398 sec latency 36.322 ms 2024-05-08T19:33:02.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1335551 14.14 MB/sec execute 399 sec latency 28.795 ms 2024-05-08T19:33:03.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1338621 14.15 MB/sec execute 400 sec latency 19.689 ms 2024-05-08T19:33:04.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1341299 14.14 MB/sec execute 401 sec latency 27.041 ms 2024-05-08T19:33:05.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1344029 14.15 MB/sec execute 402 sec latency 24.568 ms 2024-05-08T19:33:06.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1346718 14.15 MB/sec execute 403 sec latency 48.198 ms 2024-05-08T19:33:07.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1349871 14.16 MB/sec execute 404 sec latency 44.361 ms 2024-05-08T19:33:08.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1352837 14.16 MB/sec execute 405 sec latency 60.362 ms 2024-05-08T19:33:09.337 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1355419 14.15 MB/sec execute 406 sec latency 15.453 ms 2024-05-08T19:33:10.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1357456 14.15 MB/sec execute 407 sec latency 23.002 ms 2024-05-08T19:33:11.202 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:33:11.205 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:33:11.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1360361 14.16 MB/sec execute 408 sec latency 47.642 ms 2024-05-08T19:33:12.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1361564 14.14 MB/sec execute 409 sec latency 301.547 ms 2024-05-08T19:33:13.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1364374 14.14 MB/sec execute 410 sec latency 29.388 ms 2024-05-08T19:33:14.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1367583 14.15 MB/sec execute 411 sec latency 37.711 ms 2024-05-08T19:33:15.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1370865 14.16 MB/sec execute 412 sec latency 28.436 ms 2024-05-08T19:33:16.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1373657 14.16 MB/sec execute 413 sec latency 43.529 ms 2024-05-08T19:33:17.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1375703 14.19 MB/sec execute 414 sec latency 78.643 ms 2024-05-08T19:33:18.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1378900 14.20 MB/sec execute 415 sec latency 12.596 ms 2024-05-08T19:33:19.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1381939 14.20 MB/sec execute 416 sec latency 11.853 ms 2024-05-08T19:33:20.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1384114 14.19 MB/sec execute 417 sec latency 61.577 ms 2024-05-08T19:33:21.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1386604 14.20 MB/sec execute 418 sec latency 13.044 ms 2024-05-08T19:33:22.337 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1389630 14.20 MB/sec execute 419 sec latency 9.319 ms 2024-05-08T19:33:23.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1391993 14.20 MB/sec execute 420 sec latency 46.896 ms 2024-05-08T19:33:24.336 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1394692 14.20 MB/sec execute 421 sec latency 22.493 ms 2024-05-08T19:33:25.337 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1397766 14.21 MB/sec execute 422 sec latency 8.855 ms 2024-05-08T19:33:26.337 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1400774 14.21 MB/sec execute 423 sec latency 49.312 ms 2024-05-08T19:33:27.337 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1403913 14.22 MB/sec execute 424 sec latency 55.719 ms 2024-05-08T19:33:28.337 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1404636 14.19 MB/sec execute 425 sec latency 535.600 ms 2024-05-08T19:33:29.337 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1404834 14.16 MB/sec execute 426 sec latency 536.414 ms 2024-05-08T19:33:30.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1406057 14.14 MB/sec execute 427 sec latency 65.360 ms 2024-05-08T19:33:31.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1407365 14.13 MB/sec execute 428 sec latency 40.174 ms 2024-05-08T19:33:32.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1410303 14.13 MB/sec execute 429 sec latency 10.286 ms 2024-05-08T19:33:33.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1412232 14.12 MB/sec execute 430 sec latency 55.576 ms 2024-05-08T19:33:34.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1414643 14.12 MB/sec execute 431 sec latency 70.286 ms 2024-05-08T19:33:35.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1417614 14.13 MB/sec execute 432 sec latency 35.007 ms 2024-05-08T19:33:36.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1419998 14.12 MB/sec execute 433 sec latency 24.821 ms 2024-05-08T19:33:37.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1422063 14.11 MB/sec execute 434 sec latency 36.713 ms 2024-05-08T19:33:38.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1425007 14.12 MB/sec execute 435 sec latency 27.120 ms 2024-05-08T19:33:39.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1427488 14.11 MB/sec execute 436 sec latency 71.370 ms 2024-05-08T19:33:40.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1429449 14.11 MB/sec execute 437 sec latency 25.382 ms 2024-05-08T19:33:41.272 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:33:41.275 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:33:41.314 INFO:tasks.ceph.mds.d.smithi177.stderr:2024-05-08T19:33:41.322+0000 7fb2033aa700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53229) UID: 0 2024-05-08T19:33:41.314 INFO:tasks.ceph.mds.b.smithi177.stderr:2024-05-08T19:33:41.322+0000 7f0ad5def700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53229) UID: 0 2024-05-08T19:33:41.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1432356 14.11 MB/sec execute 438 sec latency 17.675 ms 2024-05-08T19:33:42.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1434984 14.11 MB/sec execute 439 sec latency 51.246 ms 2024-05-08T19:33:43.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1436796 14.10 MB/sec execute 440 sec latency 37.903 ms 2024-05-08T19:33:44.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1439374 14.10 MB/sec execute 441 sec latency 26.222 ms 2024-05-08T19:33:45.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1442112 14.10 MB/sec execute 442 sec latency 58.462 ms 2024-05-08T19:33:46.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1444841 14.10 MB/sec execute 443 sec latency 9.157 ms 2024-05-08T19:33:47.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1446780 14.10 MB/sec execute 444 sec latency 59.590 ms 2024-05-08T19:33:48.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1449813 14.10 MB/sec execute 445 sec latency 67.101 ms 2024-05-08T19:33:49.338 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1450273 14.07 MB/sec execute 446 sec latency 496.826 ms 2024-05-08T19:33:50.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1450762 14.05 MB/sec execute 447 sec latency 118.832 ms 2024-05-08T19:33:51.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1453390 14.05 MB/sec execute 448 sec latency 30.551 ms 2024-05-08T19:33:52.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1455548 14.04 MB/sec execute 449 sec latency 22.361 ms 2024-05-08T19:33:53.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1457412 14.03 MB/sec execute 450 sec latency 27.046 ms 2024-05-08T19:33:54.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1460194 14.04 MB/sec execute 451 sec latency 44.500 ms 2024-05-08T19:33:55.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1461876 14.03 MB/sec execute 452 sec latency 32.626 ms 2024-05-08T19:33:56.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1464180 14.03 MB/sec execute 453 sec latency 60.581 ms 2024-05-08T19:33:57.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1466931 14.02 MB/sec execute 454 sec latency 45.286 ms 2024-05-08T19:33:58.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1469279 14.02 MB/sec execute 455 sec latency 19.833 ms 2024-05-08T19:33:59.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1471722 14.02 MB/sec execute 456 sec latency 8.696 ms 2024-05-08T19:34:00.344 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1474681 14.03 MB/sec execute 457 sec latency 31.104 ms 2024-05-08T19:34:01.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1476841 14.01 MB/sec execute 458 sec latency 57.676 ms 2024-05-08T19:34:02.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1478920 14.01 MB/sec execute 459 sec latency 9.527 ms 2024-05-08T19:34:03.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1481937 14.02 MB/sec execute 460 sec latency 27.411 ms 2024-05-08T19:34:04.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1485020 14.03 MB/sec execute 461 sec latency 26.386 ms 2024-05-08T19:34:05.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1487517 14.02 MB/sec execute 462 sec latency 16.387 ms 2024-05-08T19:34:06.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1489378 14.01 MB/sec execute 463 sec latency 82.309 ms 2024-05-08T19:34:07.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1492431 14.02 MB/sec execute 464 sec latency 36.045 ms 2024-05-08T19:34:08.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1494713 14.01 MB/sec execute 465 sec latency 45.397 ms 2024-05-08T19:34:09.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1496492 14.00 MB/sec execute 466 sec latency 27.472 ms 2024-05-08T19:34:10.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1499355 14.01 MB/sec execute 467 sec latency 28.232 ms 2024-05-08T19:34:11.343 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1501113 14.00 MB/sec execute 468 sec latency 19.168 ms 2024-05-08T19:34:12.344 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1503237 14.00 MB/sec execute 469 sec latency 24.748 ms 2024-05-08T19:34:13.344 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1505638 13.99 MB/sec execute 470 sec latency 34.647 ms 2024-05-08T19:34:14.344 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1507221 13.98 MB/sec execute 471 sec latency 32.818 ms 2024-05-08T19:34:15.649 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1510086 13.99 MB/sec execute 472 sec latency 22.012 ms 2024-05-08T19:34:16.509 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1512343 13.97 MB/sec execute 473 sec latency 34.865 ms 2024-05-08T19:34:17.344 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1514283 13.97 MB/sec execute 474 sec latency 28.144 ms 2024-05-08T19:34:18.347 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1516300 13.96 MB/sec execute 475 sec latency 167.134 ms 2024-05-08T19:34:19.344 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1518002 13.95 MB/sec execute 476 sec latency 15.431 ms 2024-05-08T19:34:20.344 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1518150 13.93 MB/sec execute 477 sec latency 407.022 ms 2024-05-08T19:34:21.347 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1519003 13.90 MB/sec execute 478 sec latency 226.527 ms 2024-05-08T19:34:22.345 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1520451 13.90 MB/sec execute 479 sec latency 77.215 ms 2024-05-08T19:34:23.345 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1522353 13.88 MB/sec execute 480 sec latency 36.502 ms 2024-05-08T19:34:24.345 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1524770 13.89 MB/sec execute 481 sec latency 31.686 ms 2024-05-08T19:34:25.345 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1527240 13.88 MB/sec execute 482 sec latency 65.162 ms 2024-05-08T19:34:26.345 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1529959 13.88 MB/sec execute 483 sec latency 20.187 ms 2024-05-08T19:34:27.345 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1532061 13.88 MB/sec execute 484 sec latency 30.707 ms 2024-05-08T19:34:28.345 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1535080 13.89 MB/sec execute 485 sec latency 26.384 ms 2024-05-08T19:34:29.345 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1537967 13.89 MB/sec execute 486 sec latency 40.295 ms 2024-05-08T19:34:30.345 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1540109 13.88 MB/sec execute 487 sec latency 16.587 ms 2024-05-08T19:34:31.345 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1542565 13.88 MB/sec execute 488 sec latency 27.584 ms 2024-05-08T19:34:32.345 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1545681 13.89 MB/sec execute 489 sec latency 38.558 ms 2024-05-08T19:34:33.345 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1548668 13.89 MB/sec execute 490 sec latency 26.411 ms 2024-05-08T19:34:34.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1549990 13.88 MB/sec execute 491 sec latency 237.066 ms 2024-05-08T19:34:35.345 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1553132 13.89 MB/sec execute 492 sec latency 16.651 ms 2024-05-08T19:34:36.345 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1556230 13.90 MB/sec execute 493 sec latency 29.756 ms 2024-05-08T19:34:37.345 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1558925 13.89 MB/sec execute 494 sec latency 49.666 ms 2024-05-08T19:34:38.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1561380 13.89 MB/sec execute 495 sec latency 11.734 ms 2024-05-08T19:34:39.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1563755 13.89 MB/sec execute 496 sec latency 44.390 ms 2024-05-08T19:34:40.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1566571 13.90 MB/sec execute 497 sec latency 79.498 ms 2024-05-08T19:34:41.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1569058 13.89 MB/sec execute 498 sec latency 30.311 ms 2024-05-08T19:34:42.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1571412 13.89 MB/sec execute 499 sec latency 29.101 ms 2024-05-08T19:34:43.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1574392 13.89 MB/sec execute 500 sec latency 38.731 ms 2024-05-08T19:34:44.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1577444 13.90 MB/sec execute 501 sec latency 45.622 ms 2024-05-08T19:34:45.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1579820 13.89 MB/sec execute 502 sec latency 68.366 ms 2024-05-08T19:34:46.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1582267 13.90 MB/sec execute 503 sec latency 36.399 ms 2024-05-08T19:34:47.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1585050 13.90 MB/sec execute 504 sec latency 22.344 ms 2024-05-08T19:34:48.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1588106 13.91 MB/sec execute 505 sec latency 38.904 ms 2024-05-08T19:34:49.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1590691 13.90 MB/sec execute 506 sec latency 53.196 ms 2024-05-08T19:34:50.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1593063 13.90 MB/sec execute 507 sec latency 15.484 ms 2024-05-08T19:34:51.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1595730 13.90 MB/sec execute 508 sec latency 26.574 ms 2024-05-08T19:34:52.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1598791 13.91 MB/sec execute 509 sec latency 34.817 ms 2024-05-08T19:34:53.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1601340 13.90 MB/sec execute 510 sec latency 25.702 ms 2024-05-08T19:34:54.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1603308 13.90 MB/sec execute 511 sec latency 25.280 ms 2024-05-08T19:34:55.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1606020 13.90 MB/sec execute 512 sec latency 65.454 ms 2024-05-08T19:34:56.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1607616 13.89 MB/sec execute 513 sec latency 89.145 ms 2024-05-08T19:34:57.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1609969 13.89 MB/sec execute 514 sec latency 26.354 ms 2024-05-08T19:34:58.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1612998 13.90 MB/sec execute 515 sec latency 26.774 ms 2024-05-08T19:34:59.346 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1615651 13.89 MB/sec execute 516 sec latency 50.620 ms 2024-05-08T19:35:00.354 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1617830 13.89 MB/sec execute 517 sec latency 29.384 ms 2024-05-08T19:35:01.347 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1619539 13.88 MB/sec execute 518 sec latency 172.846 ms 2024-05-08T19:35:02.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1620553 13.86 MB/sec execute 519 sec latency 295.877 ms 2024-05-08T19:35:03.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1623621 13.87 MB/sec execute 520 sec latency 29.189 ms 2024-05-08T19:35:04.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1626557 13.87 MB/sec execute 521 sec latency 20.988 ms 2024-05-08T19:35:05.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1629112 13.87 MB/sec execute 522 sec latency 61.275 ms 2024-05-08T19:35:06.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1629507 13.85 MB/sec execute 523 sec latency 459.038 ms 2024-05-08T19:35:07.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1629830 13.83 MB/sec execute 524 sec latency 989.453 ms 2024-05-08T19:35:08.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1631019 13.81 MB/sec execute 525 sec latency 62.475 ms 2024-05-08T19:35:09.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1631336 13.79 MB/sec execute 526 sec latency 57.917 ms 2024-05-08T19:35:10.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1634278 13.80 MB/sec execute 527 sec latency 43.574 ms 2024-05-08T19:35:11.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1636491 13.79 MB/sec execute 528 sec latency 61.638 ms 2024-05-08T19:35:12.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1638428 13.78 MB/sec execute 529 sec latency 30.335 ms 2024-05-08T19:35:13.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1641384 13.79 MB/sec execute 530 sec latency 33.431 ms 2024-05-08T19:35:14.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1644083 13.79 MB/sec execute 531 sec latency 37.478 ms 2024-05-08T19:35:15.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1646127 13.79 MB/sec execute 532 sec latency 64.668 ms 2024-05-08T19:35:16.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1648916 13.79 MB/sec execute 533 sec latency 27.574 ms 2024-05-08T19:35:17.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1652004 13.80 MB/sec execute 534 sec latency 33.256 ms 2024-05-08T19:35:18.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1654626 13.79 MB/sec execute 535 sec latency 78.110 ms 2024-05-08T19:35:19.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1656187 13.78 MB/sec execute 536 sec latency 142.140 ms 2024-05-08T19:35:20.348 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1659142 13.79 MB/sec execute 537 sec latency 37.043 ms 2024-05-08T19:35:21.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1661598 13.78 MB/sec execute 538 sec latency 27.609 ms 2024-05-08T19:35:22.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1663585 13.78 MB/sec execute 539 sec latency 18.616 ms 2024-05-08T19:35:23.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1666415 13.78 MB/sec execute 540 sec latency 46.708 ms 2024-05-08T19:35:24.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1669101 13.78 MB/sec execute 541 sec latency 60.971 ms 2024-05-08T19:35:25.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1671598 13.78 MB/sec execute 542 sec latency 27.218 ms 2024-05-08T19:35:26.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1673808 13.78 MB/sec execute 543 sec latency 33.286 ms 2024-05-08T19:35:27.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1676847 13.79 MB/sec execute 544 sec latency 40.014 ms 2024-05-08T19:35:28.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1679544 13.79 MB/sec execute 545 sec latency 44.919 ms 2024-05-08T19:35:29.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1681585 13.78 MB/sec execute 546 sec latency 54.514 ms 2024-05-08T19:35:30.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1684333 13.78 MB/sec execute 547 sec latency 40.370 ms 2024-05-08T19:35:31.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1687310 13.79 MB/sec execute 548 sec latency 22.058 ms 2024-05-08T19:35:32.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1689436 13.78 MB/sec execute 549 sec latency 29.805 ms 2024-05-08T19:35:33.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1691527 13.78 MB/sec execute 550 sec latency 9.735 ms 2024-05-08T19:35:34.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1694395 13.78 MB/sec execute 551 sec latency 48.858 ms 2024-05-08T19:35:35.349 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1695462 13.77 MB/sec execute 552 sec latency 160.503 ms 2024-05-08T19:35:36.352 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1698087 13.77 MB/sec execute 553 sec latency 104.459 ms 2024-05-08T19:35:37.351 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1698095 13.75 MB/sec execute 554 sec latency 406.487 ms 2024-05-08T19:35:38.351 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1699253 13.73 MB/sec execute 555 sec latency 195.763 ms 2024-05-08T19:35:39.351 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1700545 13.72 MB/sec execute 556 sec latency 49.544 ms 2024-05-08T19:35:40.351 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1702192 13.71 MB/sec execute 557 sec latency 58.861 ms 2024-05-08T19:35:41.351 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1705290 13.72 MB/sec execute 558 sec latency 16.583 ms 2024-05-08T19:35:42.351 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1708279 13.72 MB/sec execute 559 sec latency 25.014 ms 2024-05-08T19:35:43.352 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1710795 13.71 MB/sec execute 560 sec latency 28.208 ms 2024-05-08T19:35:44.352 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1712916 13.71 MB/sec execute 561 sec latency 12.591 ms 2024-05-08T19:35:45.352 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1716001 13.72 MB/sec execute 562 sec latency 48.063 ms 2024-05-08T19:35:46.352 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1718820 13.72 MB/sec execute 563 sec latency 64.569 ms 2024-05-08T19:35:47.352 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1720551 13.71 MB/sec execute 564 sec latency 50.042 ms 2024-05-08T19:35:48.352 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1723223 13.72 MB/sec execute 565 sec latency 28.104 ms 2024-05-08T19:35:49.352 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1725991 13.72 MB/sec execute 566 sec latency 33.807 ms 2024-05-08T19:35:50.352 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1728016 13.71 MB/sec execute 567 sec latency 39.568 ms 2024-05-08T19:35:51.352 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1730328 13.71 MB/sec execute 568 sec latency 83.906 ms 2024-05-08T19:35:52.354 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1730887 13.69 MB/sec execute 569 sec latency 180.308 ms 2024-05-08T19:35:53.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1733286 13.69 MB/sec execute 570 sec latency 70.129 ms 2024-05-08T19:35:54.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1735650 13.68 MB/sec execute 571 sec latency 40.541 ms 2024-05-08T19:35:55.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1738044 13.68 MB/sec execute 572 sec latency 24.662 ms 2024-05-08T19:35:56.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1741094 13.69 MB/sec execute 573 sec latency 26.652 ms 2024-05-08T19:35:57.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1744278 13.70 MB/sec execute 574 sec latency 35.922 ms 2024-05-08T19:35:58.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1747122 13.70 MB/sec execute 575 sec latency 32.165 ms 2024-05-08T19:35:59.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1749442 13.70 MB/sec execute 576 sec latency 31.200 ms 2024-05-08T19:36:00.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1751767 13.70 MB/sec execute 577 sec latency 11.082 ms 2024-05-08T19:36:01.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1754878 13.70 MB/sec execute 578 sec latency 31.842 ms 2024-05-08T19:36:02.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1757166 13.69 MB/sec execute 579 sec latency 61.691 ms 2024-05-08T19:36:03.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1759023 13.69 MB/sec execute 580 sec latency 154.795 ms 2024-05-08T19:36:04.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1762176 13.70 MB/sec execute 581 sec latency 23.271 ms 2024-05-08T19:36:05.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1765264 13.71 MB/sec execute 582 sec latency 34.521 ms 2024-05-08T19:36:06.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1767694 13.70 MB/sec execute 583 sec latency 32.476 ms 2024-05-08T19:36:07.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1770202 13.70 MB/sec execute 584 sec latency 33.903 ms 2024-05-08T19:36:08.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1772888 13.70 MB/sec execute 585 sec latency 71.500 ms 2024-05-08T19:36:09.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1776006 13.71 MB/sec execute 586 sec latency 31.656 ms 2024-05-08T19:36:10.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1778767 13.71 MB/sec execute 587 sec latency 50.408 ms 2024-05-08T19:36:11.353 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1781118 13.71 MB/sec execute 588 sec latency 23.432 ms 2024-05-08T19:36:12.354 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1783353 13.71 MB/sec execute 589 sec latency 228.583 ms 2024-05-08T19:36:13.354 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1783720 13.69 MB/sec execute 590 sec latency 339.646 ms 2024-05-08T19:36:14.354 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1784089 13.67 MB/sec execute 591 sec latency 73.583 ms 2024-05-08T19:36:15.354 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1787200 13.67 MB/sec execute 592 sec latency 30.417 ms 2024-05-08T19:36:16.354 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1790215 13.68 MB/sec execute 593 sec latency 42.585 ms 2024-05-08T19:36:17.354 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1792631 13.67 MB/sec execute 594 sec latency 38.955 ms 2024-05-08T19:36:18.355 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1794594 13.67 MB/sec execute 595 sec latency 69.328 ms 2024-05-08T19:36:19.355 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1797637 13.68 MB/sec execute 596 sec latency 27.203 ms 2024-05-08T19:36:20.355 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1800720 13.68 MB/sec execute 597 sec latency 31.255 ms 2024-05-08T19:36:21.355 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1803096 13.67 MB/sec execute 598 sec latency 34.085 ms 2024-05-08T19:36:22.355 INFO:tasks.workunit.client.1.smithi177.stdout: 1 1805168 13.67 MB/sec execute 599 sec latency 37.664 ms 2024-05-08T19:36:23.355 INFO:tasks.workunit.client.1.smithi177.stdout: 1 cleanup 600 sec 2024-05-08T19:36:23.526 INFO:tasks.workunit.client.1.smithi177.stdout: 0 cleanup 600 sec 2024-05-08T19:36:23.526 INFO:tasks.workunit.client.1.smithi177.stdout: 2024-05-08T19:36:23.526 INFO:tasks.workunit.client.1.smithi177.stdout: Operation Count AvgLat MaxLat 2024-05-08T19:36:23.526 INFO:tasks.workunit.client.1.smithi177.stdout: ---------------------------------------- 2024-05-08T19:36:23.526 INFO:tasks.workunit.client.1.smithi177.stdout: NTCreateX 261527 0.780 575.476 2024-05-08T19:36:23.527 INFO:tasks.workunit.client.1.smithi177.stdout: Close 192104 0.002 18.306 2024-05-08T19:36:23.527 INFO:tasks.workunit.client.1.smithi177.stdout: Rename 11075 3.920 989.444 2024-05-08T19:36:23.527 INFO:tasks.workunit.client.1.smithi177.stdout: Unlink 52797 1.330 308.229 2024-05-08T19:36:23.527 INFO:tasks.workunit.client.1.smithi177.stdout: Deltree 6 65.041 135.565 2024-05-08T19:36:23.527 INFO:tasks.workunit.client.1.smithi177.stdout: Mkdir 3 0.005 0.006 2024-05-08T19:36:23.527 INFO:tasks.workunit.client.1.smithi177.stdout: Qpathinfo 237063 0.618 579.721 2024-05-08T19:36:23.527 INFO:tasks.workunit.client.1.smithi177.stdout: Qfileinfo 41530 0.001 0.018 2024-05-08T19:36:23.527 INFO:tasks.workunit.client.1.smithi177.stdout: Qfsinfo 43462 0.139 22.039 2024-05-08T19:36:23.527 INFO:tasks.workunit.client.1.smithi177.stdout: Sfileinfo 21296 0.016 4.570 2024-05-08T19:36:23.527 INFO:tasks.workunit.client.1.smithi177.stdout: Find 91640 0.086 64.560 2024-05-08T19:36:23.527 INFO:tasks.workunit.client.1.smithi177.stdout: WriteX 130282 0.016 353.598 2024-05-08T19:36:23.527 INFO:tasks.workunit.client.1.smithi177.stdout: ReadX 410056 0.018 327.148 2024-05-08T19:36:23.527 INFO:tasks.workunit.client.1.smithi177.stdout: LockX 852 0.822 18.670 2024-05-08T19:36:23.527 INFO:tasks.workunit.client.1.smithi177.stdout: UnlockX 852 0.657 11.013 2024-05-08T19:36:23.528 INFO:tasks.workunit.client.1.smithi177.stdout: Flush 18314 5.880 879.418 2024-05-08T19:36:23.528 INFO:tasks.workunit.client.1.smithi177.stdout: 2024-05-08T19:36:23.528 INFO:tasks.workunit.client.1.smithi177.stdout:Throughput 13.6724 MB/sec 1 clients 1 procs max_latency=989.453 ms 2024-05-08T19:36:23.550 INFO:tasks.workunit.client.1.smithi177.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-05-08T19:36:23.550 INFO:tasks.workunit.client.1.smithi177.stdout: 2024-05-08T19:36:23.550 INFO:tasks.workunit.client.1.smithi177.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-05-08T19:36:23.551 INFO:tasks.workunit.client.1.smithi177.stdout:8 of 10 processes prepared for launch 0 sec 2024-05-08T19:36:23.651 INFO:tasks.workunit.client.1.smithi177.stdout:10 of 10 processes prepared for launch 0 sec 2024-05-08T19:36:23.651 INFO:tasks.workunit.client.1.smithi177.stdout:releasing clients 2024-05-08T19:36:23.986 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:36:23.989 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:36:24.651 INFO:tasks.workunit.client.1.smithi177.stdout: 10 324 117.97 MB/sec warmup 1 sec latency 266.696 ms 2024-05-08T19:36:25.652 INFO:tasks.workunit.client.1.smithi177.stdout: 10 724 106.19 MB/sec warmup 2 sec latency 81.965 ms 2024-05-08T19:36:26.655 INFO:tasks.workunit.client.1.smithi177.stdout: 10 1101 76.45 MB/sec warmup 3 sec latency 72.369 ms 2024-05-08T19:36:27.652 INFO:tasks.workunit.client.1.smithi177.stdout: 10 1589 65.34 MB/sec warmup 4 sec latency 272.704 ms 2024-05-08T19:36:28.652 INFO:tasks.workunit.client.1.smithi177.stdout: 10 1621 52.34 MB/sec warmup 5 sec latency 1212.543 ms 2024-05-08T19:36:29.655 INFO:tasks.workunit.client.1.smithi177.stdout: 10 2236 45.11 MB/sec warmup 6 sec latency 256.000 ms 2024-05-08T19:36:30.655 INFO:tasks.workunit.client.1.smithi177.stdout: 10 2581 41.71 MB/sec warmup 7 sec latency 88.474 ms 2024-05-08T19:36:31.655 INFO:tasks.workunit.client.1.smithi177.stdout: 10 3270 43.40 MB/sec warmup 8 sec latency 41.428 ms 2024-05-08T19:36:32.656 INFO:tasks.workunit.client.1.smithi177.stdout: 10 3720 43.48 MB/sec warmup 9 sec latency 90.936 ms 2024-05-08T19:36:33.656 INFO:tasks.workunit.client.1.smithi177.stdout: 10 3909 39.93 MB/sec warmup 10 sec latency 97.400 ms 2024-05-08T19:36:34.657 INFO:tasks.workunit.client.1.smithi177.stdout: 10 4070 36.42 MB/sec warmup 11 sec latency 172.540 ms 2024-05-08T19:36:35.657 INFO:tasks.workunit.client.1.smithi177.stdout: 10 4291 33.64 MB/sec warmup 12 sec latency 147.580 ms 2024-05-08T19:36:36.656 INFO:tasks.workunit.client.1.smithi177.stdout: 10 4609 31.99 MB/sec warmup 13 sec latency 123.835 ms 2024-05-08T19:36:37.657 INFO:tasks.workunit.client.1.smithi177.stdout: 10 5250 32.18 MB/sec warmup 14 sec latency 48.733 ms 2024-05-08T19:36:38.657 INFO:tasks.workunit.client.1.smithi177.stdout: 10 6045 31.76 MB/sec warmup 15 sec latency 44.592 ms 2024-05-08T19:36:39.658 INFO:tasks.workunit.client.1.smithi177.stdout: 10 6646 33.13 MB/sec warmup 16 sec latency 109.936 ms 2024-05-08T19:36:40.657 INFO:tasks.workunit.client.1.smithi177.stdout: 10 7137 33.74 MB/sec warmup 17 sec latency 120.499 ms 2024-05-08T19:36:41.658 INFO:tasks.workunit.client.1.smithi177.stdout: 10 7379 32.72 MB/sec warmup 18 sec latency 92.530 ms 2024-05-08T19:36:42.658 INFO:tasks.workunit.client.1.smithi177.stdout: 10 7554 31.14 MB/sec warmup 19 sec latency 122.295 ms 2024-05-08T19:36:43.658 INFO:tasks.workunit.client.1.smithi177.stdout: 10 7586 29.60 MB/sec warmup 20 sec latency 830.312 ms 2024-05-08T19:36:44.658 INFO:tasks.workunit.client.1.smithi177.stdout: 10 7671 28.22 MB/sec warmup 21 sec latency 898.910 ms 2024-05-08T19:36:45.666 INFO:tasks.workunit.client.1.smithi177.stdout: 10 7796 27.01 MB/sec warmup 22 sec latency 217.827 ms 2024-05-08T19:36:46.659 INFO:tasks.workunit.client.1.smithi177.stdout: 10 7994 26.06 MB/sec warmup 23 sec latency 133.706 ms 2024-05-08T19:36:47.659 INFO:tasks.workunit.client.1.smithi177.stdout: 10 8430 26.11 MB/sec warmup 24 sec latency 95.737 ms 2024-05-08T19:36:48.659 INFO:tasks.workunit.client.1.smithi177.stdout: 10 9280 26.18 MB/sec warmup 25 sec latency 54.599 ms 2024-05-08T19:36:49.659 INFO:tasks.workunit.client.1.smithi177.stdout: 10 9914 26.89 MB/sec warmup 26 sec latency 42.234 ms 2024-05-08T19:36:50.661 INFO:tasks.workunit.client.1.smithi177.stdout: 10 10471 27.47 MB/sec warmup 27 sec latency 124.239 ms 2024-05-08T19:36:51.661 INFO:tasks.workunit.client.1.smithi177.stdout: 10 10831 27.63 MB/sec warmup 28 sec latency 124.509 ms 2024-05-08T19:36:52.664 INFO:tasks.workunit.client.1.smithi177.stdout: 10 11018 26.97 MB/sec warmup 29 sec latency 113.270 ms 2024-05-08T19:36:53.663 INFO:tasks.workunit.client.1.smithi177.stdout: 10 11205 26.11 MB/sec warmup 30 sec latency 152.343 ms 2024-05-08T19:36:54.135 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:36:54.138 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:36:54.663 INFO:tasks.workunit.client.1.smithi177.stdout: 10 11439 25.40 MB/sec warmup 31 sec latency 196.255 ms 2024-05-08T19:36:55.663 INFO:tasks.workunit.client.1.smithi177.stdout: 10 11897 25.35 MB/sec warmup 32 sec latency 55.373 ms 2024-05-08T19:36:56.663 INFO:tasks.workunit.client.1.smithi177.stdout: 10 12772 25.58 MB/sec warmup 33 sec latency 43.904 ms 2024-05-08T19:36:57.663 INFO:tasks.workunit.client.1.smithi177.stdout: 10 13439 26.08 MB/sec warmup 34 sec latency 47.659 ms 2024-05-08T19:36:58.664 INFO:tasks.workunit.client.1.smithi177.stdout: 10 14085 26.87 MB/sec warmup 35 sec latency 107.846 ms 2024-05-08T19:36:59.664 INFO:tasks.workunit.client.1.smithi177.stdout: 10 14415 26.88 MB/sec warmup 36 sec latency 104.583 ms 2024-05-08T19:37:00.664 INFO:tasks.workunit.client.1.smithi177.stdout: 10 14610 26.31 MB/sec warmup 37 sec latency 81.946 ms 2024-05-08T19:37:01.664 INFO:tasks.workunit.client.1.smithi177.stdout: 10 14813 25.66 MB/sec warmup 38 sec latency 92.001 ms 2024-05-08T19:37:02.664 INFO:tasks.workunit.client.1.smithi177.stdout: 10 15103 25.23 MB/sec warmup 39 sec latency 111.320 ms 2024-05-08T19:37:03.664 INFO:tasks.workunit.client.1.smithi177.stdout: 10 15669 25.49 MB/sec warmup 40 sec latency 68.182 ms 2024-05-08T19:37:04.664 INFO:tasks.workunit.client.1.smithi177.stdout: 10 16465 25.37 MB/sec warmup 41 sec latency 51.224 ms 2024-05-08T19:37:05.664 INFO:tasks.workunit.client.1.smithi177.stdout: 10 17093 25.94 MB/sec warmup 42 sec latency 36.558 ms 2024-05-08T19:37:06.666 INFO:tasks.workunit.client.1.smithi177.stdout: 10 17687 26.47 MB/sec warmup 43 sec latency 69.963 ms 2024-05-08T19:37:07.664 INFO:tasks.workunit.client.1.smithi177.stdout: 10 17970 26.34 MB/sec warmup 44 sec latency 82.292 ms 2024-05-08T19:37:08.667 INFO:tasks.workunit.client.1.smithi177.stdout: 10 18148 25.88 MB/sec warmup 45 sec latency 68.613 ms 2024-05-08T19:37:09.667 INFO:tasks.workunit.client.1.smithi177.stdout: 10 18360 25.35 MB/sec warmup 46 sec latency 80.853 ms 2024-05-08T19:37:10.670 INFO:tasks.workunit.client.1.smithi177.stdout: 10 18653 24.98 MB/sec warmup 47 sec latency 68.484 ms 2024-05-08T19:37:11.670 INFO:tasks.workunit.client.1.smithi177.stdout: 10 19034 24.97 MB/sec warmup 48 sec latency 102.991 ms 2024-05-08T19:37:12.670 INFO:tasks.workunit.client.1.smithi177.stdout: 10 19887 25.09 MB/sec warmup 49 sec latency 42.098 ms 2024-05-08T19:37:13.670 INFO:tasks.workunit.client.1.smithi177.stdout: 10 20417 25.15 MB/sec warmup 50 sec latency 179.894 ms 2024-05-08T19:37:14.673 INFO:tasks.workunit.client.1.smithi177.stdout: 10 20440 24.77 MB/sec warmup 51 sec latency 1145.648 ms 2024-05-08T19:37:15.671 INFO:tasks.workunit.client.1.smithi177.stdout: 10 20463 24.36 MB/sec warmup 52 sec latency 1937.258 ms 2024-05-08T19:37:16.671 INFO:tasks.workunit.client.1.smithi177.stdout: 10 20621 24.08 MB/sec warmup 53 sec latency 1125.004 ms 2024-05-08T19:37:17.673 INFO:tasks.workunit.client.1.smithi177.stdout: 10 20982 24.15 MB/sec warmup 54 sec latency 118.396 ms 2024-05-08T19:37:18.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 21258 24.18 MB/sec warmup 55 sec latency 119.752 ms 2024-05-08T19:37:19.673 INFO:tasks.workunit.client.1.smithi177.stdout: 10 21460 23.98 MB/sec warmup 56 sec latency 98.187 ms 2024-05-08T19:37:20.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 21687 23.79 MB/sec warmup 57 sec latency 96.542 ms 2024-05-08T19:37:21.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 21858 23.40 MB/sec warmup 58 sec latency 117.785 ms 2024-05-08T19:37:22.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 22094 23.07 MB/sec warmup 59 sec latency 199.898 ms 2024-05-08T19:37:23.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 22446 22.94 MB/sec warmup 60 sec latency 118.690 ms 2024-05-08T19:37:24.244 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:37:24.247 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:37:24.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 23092 23.09 MB/sec warmup 61 sec latency 98.368 ms 2024-05-08T19:37:25.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 23744 23.13 MB/sec warmup 62 sec latency 83.520 ms 2024-05-08T19:37:26.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 24439 23.59 MB/sec warmup 63 sec latency 54.209 ms 2024-05-08T19:37:27.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 24963 23.96 MB/sec warmup 64 sec latency 43.987 ms 2024-05-08T19:37:28.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 25176 23.77 MB/sec warmup 65 sec latency 160.559 ms 2024-05-08T19:37:29.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 25208 23.42 MB/sec warmup 66 sec latency 596.564 ms 2024-05-08T19:37:30.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 25323 23.10 MB/sec warmup 67 sec latency 376.652 ms 2024-05-08T19:37:31.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 25444 22.78 MB/sec warmup 68 sec latency 276.755 ms 2024-05-08T19:37:32.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 25657 22.51 MB/sec warmup 69 sec latency 105.509 ms 2024-05-08T19:37:33.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 25996 22.41 MB/sec warmup 70 sec latency 104.872 ms 2024-05-08T19:37:34.674 INFO:tasks.workunit.client.1.smithi177.stdout: 10 26513 22.37 MB/sec warmup 71 sec latency 110.358 ms 2024-05-08T19:37:35.675 INFO:tasks.workunit.client.1.smithi177.stdout: 10 27154 22.46 MB/sec warmup 72 sec latency 115.485 ms 2024-05-08T19:37:36.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 27803 22.72 MB/sec warmup 73 sec latency 112.586 ms 2024-05-08T19:37:37.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 28378 23.11 MB/sec warmup 74 sec latency 55.795 ms 2024-05-08T19:37:38.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 28667 23.10 MB/sec warmup 75 sec latency 121.948 ms 2024-05-08T19:37:39.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 28874 22.88 MB/sec warmup 76 sec latency 93.222 ms 2024-05-08T19:37:40.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 29092 22.62 MB/sec warmup 77 sec latency 63.570 ms 2024-05-08T19:37:41.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 29359 22.45 MB/sec warmup 78 sec latency 177.104 ms 2024-05-08T19:37:42.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 29868 22.54 MB/sec warmup 79 sec latency 133.160 ms 2024-05-08T19:37:43.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 30709 22.58 MB/sec warmup 80 sec latency 41.623 ms 2024-05-08T19:37:44.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 31325 22.91 MB/sec warmup 81 sec latency 40.620 ms 2024-05-08T19:37:45.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 31856 23.16 MB/sec warmup 82 sec latency 78.229 ms 2024-05-08T19:37:46.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 32172 23.16 MB/sec warmup 83 sec latency 99.206 ms 2024-05-08T19:37:47.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 32364 22.96 MB/sec warmup 84 sec latency 80.684 ms 2024-05-08T19:37:48.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 32558 22.72 MB/sec warmup 85 sec latency 171.146 ms 2024-05-08T19:37:49.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 32693 22.49 MB/sec warmup 86 sec latency 364.833 ms 2024-05-08T19:37:50.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 32702 22.23 MB/sec warmup 87 sec latency 1328.836 ms 2024-05-08T19:37:51.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 32906 22.05 MB/sec warmup 88 sec latency 1143.688 ms 2024-05-08T19:37:52.676 INFO:tasks.workunit.client.1.smithi177.stdout: 10 33161 21.97 MB/sec warmup 89 sec latency 156.658 ms 2024-05-08T19:37:53.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 33444 21.97 MB/sec warmup 90 sec latency 133.910 ms 2024-05-08T19:37:54.621 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:37:54.624 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:37:54.660 INFO:tasks.ceph.mds.d.smithi177.stderr:2024-05-08T19:37:54.669+0000 7fb2033aa700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53370) UID: 0 2024-05-08T19:37:54.660 INFO:tasks.ceph.mds.b.smithi177.stderr:2024-05-08T19:37:54.669+0000 7f0ad5def700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53370) UID: 0 2024-05-08T19:37:54.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 34203 21.95 MB/sec warmup 91 sec latency 93.733 ms 2024-05-08T19:37:55.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 34782 22.19 MB/sec warmup 92 sec latency 44.651 ms 2024-05-08T19:37:56.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 35448 22.58 MB/sec warmup 93 sec latency 43.191 ms 2024-05-08T19:37:57.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 35712 22.49 MB/sec warmup 94 sec latency 98.455 ms 2024-05-08T19:37:58.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 35920 22.32 MB/sec warmup 95 sec latency 84.578 ms 2024-05-08T19:37:59.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 36112 22.11 MB/sec warmup 96 sec latency 165.872 ms 2024-05-08T19:38:00.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 36386 21.96 MB/sec warmup 97 sec latency 156.299 ms 2024-05-08T19:38:01.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 36855 22.00 MB/sec warmup 98 sec latency 74.162 ms 2024-05-08T19:38:02.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 37406 21.98 MB/sec warmup 99 sec latency 116.542 ms 2024-05-08T19:38:03.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 38031 22.06 MB/sec warmup 100 sec latency 46.696 ms 2024-05-08T19:38:04.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 38611 22.31 MB/sec warmup 101 sec latency 93.121 ms 2024-05-08T19:38:05.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 39067 22.50 MB/sec warmup 102 sec latency 68.143 ms 2024-05-08T19:38:06.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 39316 22.42 MB/sec warmup 103 sec latency 81.580 ms 2024-05-08T19:38:07.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 39471 22.23 MB/sec warmup 104 sec latency 128.387 ms 2024-05-08T19:38:08.679 INFO:tasks.workunit.client.1.smithi177.stdout: 10 39661 22.04 MB/sec warmup 105 sec latency 160.270 ms 2024-05-08T19:38:09.679 INFO:tasks.workunit.client.1.smithi177.stdout: 10 39913 21.92 MB/sec warmup 106 sec latency 124.389 ms 2024-05-08T19:38:10.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 40251 21.84 MB/sec warmup 107 sec latency 116.769 ms 2024-05-08T19:38:11.678 INFO:tasks.workunit.client.1.smithi177.stdout: 10 40921 21.92 MB/sec warmup 108 sec latency 60.862 ms 2024-05-08T19:38:12.679 INFO:tasks.workunit.client.1.smithi177.stdout: 10 41596 21.99 MB/sec warmup 109 sec latency 93.885 ms 2024-05-08T19:38:13.679 INFO:tasks.workunit.client.1.smithi177.stdout: 10 42132 22.22 MB/sec warmup 110 sec latency 144.221 ms 2024-05-08T19:38:14.679 INFO:tasks.workunit.client.1.smithi177.stdout: 10 42576 22.34 MB/sec warmup 111 sec latency 105.989 ms 2024-05-08T19:38:15.680 INFO:tasks.workunit.client.1.smithi177.stdout: 10 42687 22.21 MB/sec warmup 112 sec latency 759.336 ms 2024-05-08T19:38:16.680 INFO:tasks.workunit.client.1.smithi177.stdout: 10 42694 22.02 MB/sec warmup 113 sec latency 1648.486 ms 2024-05-08T19:38:17.680 INFO:tasks.workunit.client.1.smithi177.stdout: 10 42734 21.85 MB/sec warmup 114 sec latency 1901.400 ms 2024-05-08T19:38:18.680 INFO:tasks.workunit.client.1.smithi177.stdout: 10 42888 21.74 MB/sec warmup 115 sec latency 121.206 ms 2024-05-08T19:38:19.686 INFO:tasks.workunit.client.1.smithi177.stdout: 10 42969 21.57 MB/sec warmup 116 sec latency 155.347 ms 2024-05-08T19:38:20.686 INFO:tasks.workunit.client.1.smithi177.stdout: 10 43045 21.40 MB/sec warmup 117 sec latency 163.088 ms 2024-05-08T19:38:21.686 INFO:tasks.workunit.client.1.smithi177.stdout: 10 43211 21.24 MB/sec warmup 118 sec latency 104.151 ms 2024-05-08T19:38:22.686 INFO:tasks.workunit.client.1.smithi177.stdout: 10 43435 21.12 MB/sec warmup 119 sec latency 177.164 ms 2024-05-08T19:38:24.686 INFO:tasks.workunit.client.1.smithi177.stdout: 10 44192 31.81 MB/sec execute 1 sec latency 179.456 ms 2024-05-08T19:38:25.686 INFO:tasks.workunit.client.1.smithi177.stdout: 10 44910 27.43 MB/sec execute 2 sec latency 47.643 ms 2024-05-08T19:38:26.686 INFO:tasks.workunit.client.1.smithi177.stdout: 10 45361 28.05 MB/sec execute 3 sec latency 100.036 ms 2024-05-08T19:38:27.686 INFO:tasks.workunit.client.1.smithi177.stdout: 10 45848 31.03 MB/sec execute 4 sec latency 109.817 ms 2024-05-08T19:38:28.686 INFO:tasks.workunit.client.1.smithi177.stdout: 10 46245 31.67 MB/sec execute 5 sec latency 81.111 ms 2024-05-08T19:38:29.686 INFO:tasks.workunit.client.1.smithi177.stdout: 10 46443 28.48 MB/sec execute 6 sec latency 118.859 ms 2024-05-08T19:38:30.686 INFO:tasks.workunit.client.1.smithi177.stdout: 10 46622 24.94 MB/sec execute 7 sec latency 95.804 ms 2024-05-08T19:38:31.686 INFO:tasks.workunit.client.1.smithi177.stdout: 10 46757 21.99 MB/sec execute 8 sec latency 351.258 ms 2024-05-08T19:38:32.686 INFO:tasks.workunit.client.1.smithi177.stdout: 10 46966 20.15 MB/sec execute 9 sec latency 191.907 ms 2024-05-08T19:38:33.687 INFO:tasks.workunit.client.1.smithi177.stdout: 10 47302 19.58 MB/sec execute 10 sec latency 101.934 ms 2024-05-08T19:38:34.687 INFO:tasks.workunit.client.1.smithi177.stdout: 10 47892 20.38 MB/sec execute 11 sec latency 42.881 ms 2024-05-08T19:38:35.686 INFO:tasks.workunit.client.1.smithi177.stdout: 10 48328 20.01 MB/sec execute 12 sec latency 300.027 ms 2024-05-08T19:38:36.687 INFO:tasks.workunit.client.1.smithi177.stdout: 10 48341 18.49 MB/sec execute 13 sec latency 1083.173 ms 2024-05-08T19:38:37.687 INFO:tasks.workunit.client.1.smithi177.stdout: 10 48647 18.40 MB/sec execute 14 sec latency 403.847 ms 2024-05-08T19:38:38.689 INFO:tasks.workunit.client.1.smithi177.stdout: 10 48919 18.55 MB/sec execute 15 sec latency 138.228 ms 2024-05-08T19:38:39.688 INFO:tasks.workunit.client.1.smithi177.stdout: 10 49433 20.15 MB/sec execute 16 sec latency 129.431 ms 2024-05-08T19:38:40.689 INFO:tasks.workunit.client.1.smithi177.stdout: 10 49792 20.74 MB/sec execute 17 sec latency 85.358 ms 2024-05-08T19:38:41.689 INFO:tasks.workunit.client.1.smithi177.stdout: 10 49994 20.16 MB/sec execute 18 sec latency 140.936 ms 2024-05-08T19:38:42.689 INFO:tasks.workunit.client.1.smithi177.stdout: 10 50169 19.22 MB/sec execute 19 sec latency 107.728 ms 2024-05-08T19:38:43.689 INFO:tasks.workunit.client.1.smithi177.stdout: 10 50359 18.42 MB/sec execute 20 sec latency 159.917 ms 2024-05-08T19:38:44.689 INFO:tasks.workunit.client.1.smithi177.stdout: 10 50587 17.86 MB/sec execute 21 sec latency 284.813 ms 2024-05-08T19:38:45.689 INFO:tasks.workunit.client.1.smithi177.stdout: 10 51068 18.32 MB/sec execute 22 sec latency 50.640 ms 2024-05-08T19:38:46.689 INFO:tasks.workunit.client.1.smithi177.stdout: 10 51778 18.57 MB/sec execute 23 sec latency 42.596 ms 2024-05-08T19:38:47.689 INFO:tasks.workunit.client.1.smithi177.stdout: 10 52426 19.61 MB/sec execute 24 sec latency 40.062 ms 2024-05-08T19:38:48.689 INFO:tasks.workunit.client.1.smithi177.stdout: 10 52878 20.14 MB/sec execute 25 sec latency 125.926 ms 2024-05-08T19:38:49.689 INFO:tasks.workunit.client.1.smithi177.stdout: 10 53276 20.75 MB/sec execute 26 sec latency 94.491 ms 2024-05-08T19:38:50.689 INFO:tasks.workunit.client.1.smithi177.stdout: 10 53518 20.46 MB/sec execute 27 sec latency 80.638 ms 2024-05-08T19:38:51.690 INFO:tasks.workunit.client.1.smithi177.stdout: 10 53547 19.79 MB/sec execute 28 sec latency 899.395 ms 2024-05-08T19:38:52.689 INFO:tasks.workunit.client.1.smithi177.stdout: 10 53581 19.11 MB/sec execute 29 sec latency 1021.089 ms 2024-05-08T19:38:53.693 INFO:tasks.workunit.client.1.smithi177.stdout: 10 53728 18.56 MB/sec execute 30 sec latency 142.488 ms 2024-05-08T19:38:54.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 53813 18.00 MB/sec execute 31 sec latency 201.233 ms 2024-05-08T19:38:55.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 53941 17.51 MB/sec execute 32 sec latency 199.963 ms 2024-05-08T19:38:56.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 54300 17.48 MB/sec execute 33 sec latency 88.821 ms 2024-05-08T19:38:57.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 54722 17.55 MB/sec execute 34 sec latency 133.963 ms 2024-05-08T19:38:58.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 55351 17.70 MB/sec execute 35 sec latency 95.125 ms 2024-05-08T19:38:59.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 55962 18.42 MB/sec execute 36 sec latency 58.098 ms 2024-05-08T19:39:00.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 56544 19.12 MB/sec execute 37 sec latency 44.381 ms 2024-05-08T19:39:01.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 56848 19.22 MB/sec execute 38 sec latency 137.984 ms 2024-05-08T19:39:02.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 57065 19.01 MB/sec execute 39 sec latency 122.662 ms 2024-05-08T19:39:03.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 57255 18.67 MB/sec execute 40 sec latency 140.571 ms 2024-05-08T19:39:04.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 57467 18.31 MB/sec execute 41 sec latency 113.201 ms 2024-05-08T19:39:05.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 57773 18.16 MB/sec execute 42 sec latency 150.678 ms 2024-05-08T19:39:06.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 58273 18.35 MB/sec execute 43 sec latency 80.295 ms 2024-05-08T19:39:07.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 58953 18.47 MB/sec execute 44 sec latency 47.157 ms 2024-05-08T19:39:08.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 59544 19.05 MB/sec execute 45 sec latency 98.309 ms 2024-05-08T19:39:09.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 60141 19.64 MB/sec execute 46 sec latency 44.934 ms 2024-05-08T19:39:10.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 60405 19.63 MB/sec execute 47 sec latency 124.727 ms 2024-05-08T19:39:11.691 INFO:tasks.workunit.client.1.smithi177.stdout: 10 60630 19.43 MB/sec execute 48 sec latency 65.844 ms 2024-05-08T19:39:12.692 INFO:tasks.workunit.client.1.smithi177.stdout: 10 60647 19.03 MB/sec execute 49 sec latency 933.229 ms 2024-05-08T19:39:13.692 INFO:tasks.workunit.client.1.smithi177.stdout: 10 60658 18.67 MB/sec execute 50 sec latency 1435.997 ms 2024-05-08T19:39:14.692 INFO:tasks.workunit.client.1.smithi177.stdout: 10 60813 18.38 MB/sec execute 51 sec latency 324.399 ms 2024-05-08T19:39:15.692 INFO:tasks.workunit.client.1.smithi177.stdout: 10 60940 18.09 MB/sec execute 52 sec latency 212.106 ms 2024-05-08T19:39:16.693 INFO:tasks.workunit.client.1.smithi177.stdout: 10 61046 17.79 MB/sec execute 53 sec latency 141.922 ms 2024-05-08T19:39:17.693 INFO:tasks.workunit.client.1.smithi177.stdout: 10 61262 17.64 MB/sec execute 54 sec latency 120.076 ms 2024-05-08T19:39:18.697 INFO:tasks.workunit.client.1.smithi177.stdout: 10 61666 17.77 MB/sec execute 55 sec latency 136.010 ms 2024-05-08T19:39:19.695 INFO:tasks.workunit.client.1.smithi177.stdout: 10 62375 17.77 MB/sec execute 56 sec latency 148.847 ms 2024-05-08T19:39:20.695 INFO:tasks.workunit.client.1.smithi177.stdout: 10 62917 18.24 MB/sec execute 57 sec latency 52.865 ms 2024-05-08T19:39:21.695 INFO:tasks.workunit.client.1.smithi177.stdout: 10 63491 18.47 MB/sec execute 58 sec latency 85.415 ms 2024-05-08T19:39:22.695 INFO:tasks.workunit.client.1.smithi177.stdout: 10 63852 18.73 MB/sec execute 59 sec latency 127.181 ms 2024-05-08T19:39:23.695 INFO:tasks.workunit.client.1.smithi177.stdout: 10 64113 18.70 MB/sec execute 60 sec latency 113.395 ms 2024-05-08T19:39:24.695 INFO:tasks.workunit.client.1.smithi177.stdout: 10 64306 18.50 MB/sec execute 61 sec latency 136.768 ms 2024-05-08T19:39:25.695 INFO:tasks.workunit.client.1.smithi177.stdout: 10 64460 18.24 MB/sec execute 62 sec latency 246.038 ms 2024-05-08T19:39:26.695 INFO:tasks.workunit.client.1.smithi177.stdout: 10 64723 18.08 MB/sec execute 63 sec latency 79.189 ms 2024-05-08T19:39:27.695 INFO:tasks.workunit.client.1.smithi177.stdout: 10 65195 18.21 MB/sec execute 64 sec latency 46.845 ms 2024-05-08T19:39:28.695 INFO:tasks.workunit.client.1.smithi177.stdout: 10 65892 18.24 MB/sec execute 65 sec latency 50.100 ms 2024-05-08T19:39:29.696 INFO:tasks.workunit.client.1.smithi177.stdout: 10 66356 18.54 MB/sec execute 66 sec latency 140.118 ms 2024-05-08T19:39:30.696 INFO:tasks.workunit.client.1.smithi177.stdout: 10 66919 18.85 MB/sec execute 67 sec latency 127.699 ms 2024-05-08T19:39:31.695 INFO:tasks.workunit.client.1.smithi177.stdout: 10 67306 18.96 MB/sec execute 68 sec latency 124.146 ms 2024-05-08T19:39:32.696 INFO:tasks.workunit.client.1.smithi177.stdout: 10 67444 18.83 MB/sec execute 69 sec latency 476.363 ms 2024-05-08T19:39:33.696 INFO:tasks.workunit.client.1.smithi177.stdout: 10 67452 18.56 MB/sec execute 70 sec latency 1047.372 ms 2024-05-08T19:39:34.696 INFO:tasks.workunit.client.1.smithi177.stdout: 10 67565 18.40 MB/sec execute 71 sec latency 799.655 ms 2024-05-08T19:39:35.699 INFO:tasks.workunit.client.1.smithi177.stdout: 10 67667 18.19 MB/sec execute 72 sec latency 130.203 ms 2024-05-08T19:39:36.701 INFO:tasks.workunit.client.1.smithi177.stdout: 10 67784 18.00 MB/sec execute 73 sec latency 130.655 ms 2024-05-08T19:39:37.701 INFO:tasks.workunit.client.1.smithi177.stdout: 10 67998 17.85 MB/sec execute 74 sec latency 146.952 ms 2024-05-08T19:39:38.702 INFO:tasks.workunit.client.1.smithi177.stdout: 10 68146 17.68 MB/sec execute 75 sec latency 227.396 ms 2024-05-08T19:39:39.702 INFO:tasks.workunit.client.1.smithi177.stdout: 10 68522 17.65 MB/sec execute 76 sec latency 57.425 ms 2024-05-08T19:39:40.702 INFO:tasks.workunit.client.1.smithi177.stdout: 10 69083 17.75 MB/sec execute 77 sec latency 61.171 ms 2024-05-08T19:39:41.703 INFO:tasks.workunit.client.1.smithi177.stdout: 10 69622 17.78 MB/sec execute 78 sec latency 92.304 ms 2024-05-08T19:39:42.703 INFO:tasks.workunit.client.1.smithi177.stdout: 10 70135 18.14 MB/sec execute 79 sec latency 94.199 ms 2024-05-08T19:39:43.703 INFO:tasks.workunit.client.1.smithi177.stdout: 10 70617 18.28 MB/sec execute 80 sec latency 125.815 ms 2024-05-08T19:39:44.703 INFO:tasks.workunit.client.1.smithi177.stdout: 10 70915 18.32 MB/sec execute 81 sec latency 168.496 ms 2024-05-08T19:39:45.703 INFO:tasks.workunit.client.1.smithi177.stdout: 10 71168 18.29 MB/sec execute 82 sec latency 82.670 ms 2024-05-08T19:39:46.704 INFO:tasks.workunit.client.1.smithi177.stdout: 10 71388 18.15 MB/sec execute 83 sec latency 88.278 ms 2024-05-08T19:39:47.705 INFO:tasks.workunit.client.1.smithi177.stdout: 10 71581 18.01 MB/sec execute 84 sec latency 212.675 ms 2024-05-08T19:39:48.705 INFO:tasks.workunit.client.1.smithi177.stdout: 10 71863 17.95 MB/sec execute 85 sec latency 125.344 ms 2024-05-08T19:39:49.705 INFO:tasks.workunit.client.1.smithi177.stdout: 10 72425 18.09 MB/sec execute 86 sec latency 37.412 ms 2024-05-08T19:39:50.705 INFO:tasks.workunit.client.1.smithi177.stdout: 10 73090 18.09 MB/sec execute 87 sec latency 60.369 ms 2024-05-08T19:39:51.709 INFO:tasks.workunit.client.1.smithi177.stdout: 10 73222 17.96 MB/sec execute 88 sec latency 469.494 ms 2024-05-08T19:39:52.705 INFO:tasks.workunit.client.1.smithi177.stdout: 10 73667 18.23 MB/sec execute 89 sec latency 500.434 ms 2024-05-08T19:39:53.705 INFO:tasks.workunit.client.1.smithi177.stdout: 10 74221 18.45 MB/sec execute 90 sec latency 98.623 ms 2024-05-08T19:39:54.706 INFO:tasks.workunit.client.1.smithi177.stdout: 10 74516 18.42 MB/sec execute 91 sec latency 174.172 ms 2024-05-08T19:39:55.705 INFO:tasks.workunit.client.1.smithi177.stdout: 10 74768 18.39 MB/sec execute 92 sec latency 108.256 ms 2024-05-08T19:39:56.705 INFO:tasks.workunit.client.1.smithi177.stdout: 10 75040 18.30 MB/sec execute 93 sec latency 69.147 ms 2024-05-08T19:39:57.705 INFO:tasks.workunit.client.1.smithi177.stdout: 10 75240 18.17 MB/sec execute 94 sec latency 133.190 ms 2024-05-08T19:39:58.705 INFO:tasks.workunit.client.1.smithi177.stdout: 10 75290 17.99 MB/sec execute 95 sec latency 872.149 ms 2024-05-08T19:39:59.705 INFO:tasks.workunit.client.1.smithi177.stdout: 10 75296 17.81 MB/sec execute 96 sec latency 1528.599 ms 2024-05-08T19:40:00.705 INFO:tasks.workunit.client.1.smithi177.stdout: 10 75506 17.73 MB/sec execute 97 sec latency 1448.526 ms 2024-05-08T19:40:01.705 INFO:tasks.workunit.client.1.smithi177.stdout: 10 75641 17.64 MB/sec execute 98 sec latency 255.171 ms 2024-05-08T19:40:02.705 INFO:tasks.workunit.client.1.smithi177.stdout: 10 75820 17.55 MB/sec execute 99 sec latency 168.190 ms 2024-05-08T19:40:03.706 INFO:tasks.workunit.client.1.smithi177.stdout: 10 76256 17.53 MB/sec execute 100 sec latency 112.668 ms 2024-05-08T19:40:04.709 INFO:tasks.workunit.client.1.smithi177.stdout: 10 76756 17.54 MB/sec execute 101 sec latency 128.475 ms 2024-05-08T19:40:05.707 INFO:tasks.workunit.client.1.smithi177.stdout: 10 77266 17.78 MB/sec execute 102 sec latency 87.915 ms 2024-05-08T19:40:06.707 INFO:tasks.workunit.client.1.smithi177.stdout: 10 77841 17.97 MB/sec execute 103 sec latency 56.853 ms 2024-05-08T19:40:07.707 INFO:tasks.workunit.client.1.smithi177.stdout: 10 78109 17.99 MB/sec execute 104 sec latency 148.601 ms 2024-05-08T19:40:08.707 INFO:tasks.workunit.client.1.smithi177.stdout: 10 78368 17.95 MB/sec execute 105 sec latency 89.848 ms 2024-05-08T19:40:09.707 INFO:tasks.workunit.client.1.smithi177.stdout: 10 78610 17.87 MB/sec execute 106 sec latency 98.964 ms 2024-05-08T19:40:10.707 INFO:tasks.workunit.client.1.smithi177.stdout: 10 78847 17.79 MB/sec execute 107 sec latency 110.325 ms 2024-05-08T19:40:11.714 INFO:tasks.workunit.client.1.smithi177.stdout: 10 79168 17.75 MB/sec execute 108 sec latency 128.650 ms 2024-05-08T19:40:12.711 INFO:tasks.workunit.client.1.smithi177.stdout: 10 79800 17.83 MB/sec execute 109 sec latency 54.248 ms 2024-05-08T19:40:13.711 INFO:tasks.workunit.client.1.smithi177.stdout: 10 80056 17.76 MB/sec execute 110 sec latency 534.444 ms 2024-05-08T19:40:14.718 INFO:tasks.workunit.client.1.smithi177.stdout: 10 80080 17.61 MB/sec execute 111 sec latency 1007.693 ms 2024-05-08T19:40:15.712 INFO:tasks.workunit.client.1.smithi177.stdout: 10 80585 17.74 MB/sec execute 112 sec latency 252.545 ms 2024-05-08T19:40:16.713 INFO:tasks.workunit.client.1.smithi177.stdout: 10 80863 17.74 MB/sec execute 113 sec latency 97.160 ms 2024-05-08T19:40:17.713 INFO:tasks.workunit.client.1.smithi177.stdout: 10 81371 17.89 MB/sec execute 114 sec latency 100.302 ms 2024-05-08T19:40:18.713 INFO:tasks.workunit.client.1.smithi177.stdout: 10 81690 17.96 MB/sec execute 115 sec latency 107.126 ms 2024-05-08T19:40:19.713 INFO:tasks.workunit.client.1.smithi177.stdout: 10 81928 17.90 MB/sec execute 116 sec latency 95.242 ms 2024-05-08T19:40:20.713 INFO:tasks.workunit.client.1.smithi177.stdout: 10 82148 17.83 MB/sec execute 117 sec latency 118.406 ms 2024-05-08T19:40:21.713 INFO:tasks.workunit.client.1.smithi177.stdout: 10 82338 17.74 MB/sec execute 118 sec latency 190.176 ms 2024-05-08T19:40:22.713 INFO:tasks.workunit.client.1.smithi177.stdout: 10 82609 17.66 MB/sec execute 119 sec latency 149.478 ms 2024-05-08T19:40:23.714 INFO:tasks.workunit.client.1.smithi177.stdout: 10 83016 17.70 MB/sec execute 120 sec latency 120.786 ms 2024-05-08T19:40:24.714 INFO:tasks.workunit.client.1.smithi177.stdout: 10 83654 17.73 MB/sec execute 121 sec latency 49.186 ms 2024-05-08T19:40:25.714 INFO:tasks.workunit.client.1.smithi177.stdout: 10 84151 17.87 MB/sec execute 122 sec latency 87.582 ms 2024-05-08T19:40:26.714 INFO:tasks.workunit.client.1.smithi177.stdout: 10 84712 18.08 MB/sec execute 123 sec latency 70.354 ms 2024-05-08T19:40:27.714 INFO:tasks.workunit.client.1.smithi177.stdout: 10 85101 18.13 MB/sec execute 124 sec latency 146.743 ms 2024-05-08T19:40:28.714 INFO:tasks.workunit.client.1.smithi177.stdout: 10 85388 18.12 MB/sec execute 125 sec latency 92.898 ms 2024-05-08T19:40:29.714 INFO:tasks.workunit.client.1.smithi177.stdout: 10 85645 18.07 MB/sec execute 126 sec latency 127.207 ms 2024-05-08T19:40:30.714 INFO:tasks.workunit.client.1.smithi177.stdout: 10 85921 18.00 MB/sec execute 127 sec latency 105.473 ms 2024-05-08T19:40:31.714 INFO:tasks.workunit.client.1.smithi177.stdout: 10 86271 17.96 MB/sec execute 128 sec latency 132.207 ms 2024-05-08T19:40:32.715 INFO:tasks.workunit.client.1.smithi177.stdout: 10 86815 18.00 MB/sec execute 129 sec latency 89.737 ms 2024-05-08T19:40:33.715 INFO:tasks.workunit.client.1.smithi177.stdout: 10 87380 18.05 MB/sec execute 130 sec latency 65.722 ms 2024-05-08T19:40:34.718 INFO:tasks.workunit.client.1.smithi177.stdout: 10 87989 18.27 MB/sec execute 131 sec latency 51.324 ms 2024-05-08T19:40:35.715 INFO:tasks.workunit.client.1.smithi177.stdout: 10 88560 18.42 MB/sec execute 132 sec latency 84.889 ms 2024-05-08T19:40:36.715 INFO:tasks.workunit.client.1.smithi177.stdout: 10 88814 18.40 MB/sec execute 133 sec latency 89.796 ms 2024-05-08T19:40:37.715 INFO:tasks.workunit.client.1.smithi177.stdout: 10 89080 18.35 MB/sec execute 134 sec latency 111.153 ms 2024-05-08T19:40:38.715 INFO:tasks.workunit.client.1.smithi177.stdout: 10 89283 18.29 MB/sec execute 135 sec latency 152.988 ms 2024-05-08T19:40:39.718 INFO:tasks.workunit.client.1.smithi177.stdout: 10 89315 18.16 MB/sec execute 136 sec latency 877.428 ms 2024-05-08T19:40:40.720 INFO:tasks.workunit.client.1.smithi177.stdout: 10 89328 18.04 MB/sec execute 137 sec latency 1718.591 ms 2024-05-08T19:40:41.720 INFO:tasks.workunit.client.1.smithi177.stdout: 10 89454 17.93 MB/sec execute 138 sec latency 937.535 ms 2024-05-08T19:40:42.720 INFO:tasks.workunit.client.1.smithi177.stdout: 10 89681 17.87 MB/sec execute 139 sec latency 112.487 ms 2024-05-08T19:40:43.720 INFO:tasks.workunit.client.1.smithi177.stdout: 10 89880 17.84 MB/sec execute 140 sec latency 166.649 ms 2024-05-08T19:40:44.721 INFO:tasks.workunit.client.1.smithi177.stdout: 10 90096 17.76 MB/sec execute 141 sec latency 114.399 ms 2024-05-08T19:40:45.721 INFO:tasks.workunit.client.1.smithi177.stdout: 10 90634 17.78 MB/sec execute 142 sec latency 133.528 ms 2024-05-08T19:40:46.721 INFO:tasks.workunit.client.1.smithi177.stdout: 10 91043 17.81 MB/sec execute 143 sec latency 118.919 ms 2024-05-08T19:40:47.721 INFO:tasks.workunit.client.1.smithi177.stdout: 10 91620 17.94 MB/sec execute 144 sec latency 47.552 ms 2024-05-08T19:40:48.721 INFO:tasks.workunit.client.1.smithi177.stdout: 10 92038 18.06 MB/sec execute 145 sec latency 139.455 ms 2024-05-08T19:40:49.721 INFO:tasks.workunit.client.1.smithi177.stdout: 10 92409 18.11 MB/sec execute 146 sec latency 95.702 ms 2024-05-08T19:40:50.721 INFO:tasks.workunit.client.1.smithi177.stdout: 10 92672 18.06 MB/sec execute 147 sec latency 126.043 ms 2024-05-08T19:40:51.721 INFO:tasks.workunit.client.1.smithi177.stdout: 10 92915 17.99 MB/sec execute 148 sec latency 145.089 ms 2024-05-08T19:40:52.721 INFO:tasks.workunit.client.1.smithi177.stdout: 10 93250 17.98 MB/sec execute 149 sec latency 112.260 ms 2024-05-08T19:40:53.721 INFO:tasks.workunit.client.1.smithi177.stdout: 10 93764 17.99 MB/sec execute 150 sec latency 50.908 ms 2024-05-08T19:40:54.722 INFO:tasks.workunit.client.1.smithi177.stdout: 10 94249 18.00 MB/sec execute 151 sec latency 136.872 ms 2024-05-08T19:40:55.722 INFO:tasks.workunit.client.1.smithi177.stdout: 10 94864 18.17 MB/sec execute 152 sec latency 75.224 ms 2024-05-08T19:40:56.721 INFO:tasks.workunit.client.1.smithi177.stdout: 10 95461 18.30 MB/sec execute 153 sec latency 78.095 ms 2024-05-08T19:40:57.654 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:40:57.657 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:40:57.722 INFO:tasks.workunit.client.1.smithi177.stdout: 10 95789 18.33 MB/sec execute 154 sec latency 108.400 ms 2024-05-08T19:40:58.723 INFO:tasks.workunit.client.1.smithi177.stdout: 10 96158 18.35 MB/sec execute 155 sec latency 45.924 ms 2024-05-08T19:40:59.724 INFO:tasks.workunit.client.1.smithi177.stdout: 10 96300 18.27 MB/sec execute 156 sec latency 307.097 ms 2024-05-08T19:41:00.724 INFO:tasks.workunit.client.1.smithi177.stdout: 10 96308 18.15 MB/sec execute 157 sec latency 1111.970 ms 2024-05-08T19:41:01.724 INFO:tasks.workunit.client.1.smithi177.stdout: 10 96375 18.05 MB/sec execute 158 sec latency 1171.594 ms 2024-05-08T19:41:02.724 INFO:tasks.workunit.client.1.smithi177.stdout: 10 96573 17.99 MB/sec execute 159 sec latency 153.284 ms 2024-05-08T19:41:03.725 INFO:tasks.workunit.client.1.smithi177.stdout: 10 96695 17.90 MB/sec execute 160 sec latency 171.244 ms 2024-05-08T19:41:04.725 INFO:tasks.workunit.client.1.smithi177.stdout: 10 96960 17.88 MB/sec execute 161 sec latency 112.103 ms 2024-05-08T19:41:05.725 INFO:tasks.workunit.client.1.smithi177.stdout: 10 97391 17.84 MB/sec execute 162 sec latency 93.935 ms 2024-05-08T19:41:06.725 INFO:tasks.workunit.client.1.smithi177.stdout: 10 97810 17.84 MB/sec execute 163 sec latency 176.846 ms 2024-05-08T19:41:07.725 INFO:tasks.workunit.client.1.smithi177.stdout: 10 98429 18.02 MB/sec execute 164 sec latency 39.793 ms 2024-05-08T19:41:08.725 INFO:tasks.workunit.client.1.smithi177.stdout: 10 98962 18.10 MB/sec execute 165 sec latency 104.351 ms 2024-05-08T19:41:09.725 INFO:tasks.workunit.client.1.smithi177.stdout: 10 99342 18.18 MB/sec execute 166 sec latency 84.528 ms 2024-05-08T19:41:10.725 INFO:tasks.workunit.client.1.smithi177.stdout: 10 99614 18.15 MB/sec execute 167 sec latency 101.154 ms 2024-05-08T19:41:11.725 INFO:tasks.workunit.client.1.smithi177.stdout: 10 99834 18.10 MB/sec execute 168 sec latency 183.244 ms 2024-05-08T19:41:12.725 INFO:tasks.workunit.client.1.smithi177.stdout: 10 100090 18.05 MB/sec execute 169 sec latency 131.194 ms 2024-05-08T19:41:13.725 INFO:tasks.workunit.client.1.smithi177.stdout: 10 100449 18.02 MB/sec execute 170 sec latency 114.589 ms 2024-05-08T19:41:14.725 INFO:tasks.workunit.client.1.smithi177.stdout: 10 100969 18.04 MB/sec execute 171 sec latency 106.639 ms 2024-05-08T19:41:15.726 INFO:tasks.workunit.client.1.smithi177.stdout: 10 101587 18.12 MB/sec execute 172 sec latency 107.495 ms 2024-05-08T19:41:16.725 INFO:tasks.workunit.client.1.smithi177.stdout: 10 102208 18.27 MB/sec execute 173 sec latency 110.150 ms 2024-05-08T19:41:17.726 INFO:tasks.workunit.client.1.smithi177.stdout: 10 102708 18.35 MB/sec execute 174 sec latency 105.496 ms 2024-05-08T19:41:18.725 INFO:tasks.workunit.client.1.smithi177.stdout: 10 103013 18.36 MB/sec execute 175 sec latency 119.915 ms 2024-05-08T19:41:19.725 INFO:tasks.workunit.client.1.smithi177.stdout: 10 103295 18.35 MB/sec execute 176 sec latency 116.281 ms 2024-05-08T19:41:20.726 INFO:tasks.workunit.client.1.smithi177.stdout: 10 103330 18.25 MB/sec execute 177 sec latency 978.706 ms 2024-05-08T19:41:21.726 INFO:tasks.workunit.client.1.smithi177.stdout: 10 103339 18.15 MB/sec execute 178 sec latency 1349.714 ms 2024-05-08T19:41:22.727 INFO:tasks.workunit.client.1.smithi177.stdout: 10 103454 18.07 MB/sec execute 179 sec latency 778.981 ms 2024-05-08T19:41:23.727 INFO:tasks.workunit.client.1.smithi177.stdout: 10 103578 17.99 MB/sec execute 180 sec latency 157.248 ms 2024-05-08T19:41:24.727 INFO:tasks.workunit.client.1.smithi177.stdout: 10 103795 17.94 MB/sec execute 181 sec latency 127.144 ms 2024-05-08T19:41:25.727 INFO:tasks.workunit.client.1.smithi177.stdout: 10 104162 17.94 MB/sec execute 182 sec latency 156.938 ms 2024-05-08T19:41:26.727 INFO:tasks.workunit.client.1.smithi177.stdout: 10 104784 17.94 MB/sec execute 183 sec latency 55.033 ms 2024-05-08T19:41:27.727 INFO:tasks.workunit.client.1.smithi177.stdout: 10 105276 18.04 MB/sec execute 184 sec latency 83.945 ms 2024-05-08T19:41:28.475 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:41:28.478 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:41:28.547 INFO:tasks.ceph.mds.d.smithi177.stderr:2024-05-08T19:41:28.556+0000 7fb2033aa700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53458) UID: 0 2024-05-08T19:41:28.547 INFO:tasks.ceph.mds.b.smithi177.stderr:2024-05-08T19:41:28.556+0000 7f0ad5def700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53458) UID: 0 2024-05-08T19:41:28.727 INFO:tasks.workunit.client.1.smithi177.stdout: 10 105896 18.14 MB/sec execute 185 sec latency 84.101 ms 2024-05-08T19:41:29.727 INFO:tasks.workunit.client.1.smithi177.stdout: 10 106252 18.20 MB/sec execute 186 sec latency 163.470 ms 2024-05-08T19:41:30.727 INFO:tasks.workunit.client.1.smithi177.stdout: 10 106574 18.21 MB/sec execute 187 sec latency 100.142 ms 2024-05-08T19:41:31.727 INFO:tasks.workunit.client.1.smithi177.stdout: 10 106793 18.18 MB/sec execute 188 sec latency 205.229 ms 2024-05-08T19:41:32.727 INFO:tasks.workunit.client.1.smithi177.stdout: 10 107029 18.13 MB/sec execute 189 sec latency 113.294 ms 2024-05-08T19:41:33.728 INFO:tasks.workunit.client.1.smithi177.stdout: 10 107300 18.10 MB/sec execute 190 sec latency 113.347 ms 2024-05-08T19:41:34.728 INFO:tasks.workunit.client.1.smithi177.stdout: 10 107672 18.07 MB/sec execute 191 sec latency 128.413 ms 2024-05-08T19:41:35.728 INFO:tasks.workunit.client.1.smithi177.stdout: 10 108190 18.08 MB/sec execute 192 sec latency 51.936 ms 2024-05-08T19:41:36.728 INFO:tasks.workunit.client.1.smithi177.stdout: 10 108774 18.16 MB/sec execute 193 sec latency 55.331 ms 2024-05-08T19:41:37.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 109304 18.25 MB/sec execute 194 sec latency 108.035 ms 2024-05-08T19:41:38.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 109734 18.31 MB/sec execute 195 sec latency 121.408 ms 2024-05-08T19:41:39.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 110060 18.34 MB/sec execute 196 sec latency 111.970 ms 2024-05-08T19:41:40.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 110328 18.32 MB/sec execute 197 sec latency 169.604 ms 2024-05-08T19:41:41.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 110521 18.26 MB/sec execute 198 sec latency 198.707 ms 2024-05-08T19:41:42.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 110823 18.23 MB/sec execute 199 sec latency 59.876 ms 2024-05-08T19:41:43.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 111184 18.22 MB/sec execute 200 sec latency 102.559 ms 2024-05-08T19:41:44.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 111732 18.22 MB/sec execute 201 sec latency 43.971 ms 2024-05-08T19:41:45.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 112263 18.31 MB/sec execute 202 sec latency 110.291 ms 2024-05-08T19:41:46.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 112831 18.40 MB/sec execute 203 sec latency 123.338 ms 2024-05-08T19:41:47.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 113269 18.44 MB/sec execute 204 sec latency 104.698 ms 2024-05-08T19:41:48.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 113584 18.46 MB/sec execute 205 sec latency 77.352 ms 2024-05-08T19:41:49.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 113800 18.42 MB/sec execute 206 sec latency 184.463 ms 2024-05-08T19:41:50.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 114046 18.39 MB/sec execute 207 sec latency 63.859 ms 2024-05-08T19:41:51.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 114233 18.33 MB/sec execute 208 sec latency 151.657 ms 2024-05-08T19:41:52.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 114642 18.35 MB/sec execute 209 sec latency 49.152 ms 2024-05-08T19:41:53.731 INFO:tasks.workunit.client.1.smithi177.stdout: 10 115160 18.32 MB/sec execute 210 sec latency 49.672 ms 2024-05-08T19:41:54.732 INFO:tasks.workunit.client.1.smithi177.stdout: 10 115539 18.34 MB/sec execute 211 sec latency 99.820 ms 2024-05-08T19:41:55.734 INFO:tasks.workunit.client.1.smithi177.stdout: 10 116020 18.39 MB/sec execute 212 sec latency 157.588 ms 2024-05-08T19:41:56.734 INFO:tasks.workunit.client.1.smithi177.stdout: 10 116060 18.32 MB/sec execute 213 sec latency 856.715 ms 2024-05-08T19:41:57.736 INFO:tasks.workunit.client.1.smithi177.stdout: 10 116068 18.24 MB/sec execute 214 sec latency 1744.811 ms 2024-05-08T19:41:58.736 INFO:tasks.workunit.client.1.smithi177.stdout: 10 116072 18.15 MB/sec execute 215 sec latency 1423.112 ms 2024-05-08T19:41:59.736 INFO:tasks.workunit.client.1.smithi177.stdout: 10 116193 18.11 MB/sec execute 216 sec latency 1866.703 ms 2024-05-08T19:42:00.736 INFO:tasks.workunit.client.1.smithi177.stdout: 10 116402 18.08 MB/sec execute 217 sec latency 134.540 ms 2024-05-08T19:42:01.736 INFO:tasks.workunit.client.1.smithi177.stdout: 10 116615 18.06 MB/sec execute 218 sec latency 159.907 ms 2024-05-08T19:42:02.736 INFO:tasks.workunit.client.1.smithi177.stdout: 10 116844 18.06 MB/sec execute 219 sec latency 127.430 ms 2024-05-08T19:42:03.736 INFO:tasks.workunit.client.1.smithi177.stdout: 10 116964 18.00 MB/sec execute 220 sec latency 163.651 ms 2024-05-08T19:42:04.736 INFO:tasks.workunit.client.1.smithi177.stdout: 10 117230 18.01 MB/sec execute 221 sec latency 122.814 ms 2024-05-08T19:42:05.736 INFO:tasks.workunit.client.1.smithi177.stdout: 10 117477 17.97 MB/sec execute 222 sec latency 170.971 ms 2024-05-08T19:42:06.741 INFO:tasks.workunit.client.1.smithi177.stdout: 10 117685 17.94 MB/sec execute 223 sec latency 248.772 ms 2024-05-08T19:42:07.741 INFO:tasks.workunit.client.1.smithi177.stdout: 10 117998 17.91 MB/sec execute 224 sec latency 115.376 ms 2024-05-08T19:42:08.741 INFO:tasks.workunit.client.1.smithi177.stdout: 10 118387 17.92 MB/sec execute 225 sec latency 180.137 ms 2024-05-08T19:42:09.741 INFO:tasks.workunit.client.1.smithi177.stdout: 10 118952 17.93 MB/sec execute 226 sec latency 102.252 ms 2024-05-08T19:42:10.741 INFO:tasks.workunit.client.1.smithi177.stdout: 10 119379 17.99 MB/sec execute 227 sec latency 125.108 ms 2024-05-08T19:42:11.751 INFO:tasks.workunit.client.1.smithi177.stdout: 10 119533 17.95 MB/sec execute 228 sec latency 734.382 ms 2024-05-08T19:42:12.750 INFO:tasks.workunit.client.1.smithi177.stdout: 10 119784 17.93 MB/sec execute 229 sec latency 809.383 ms 2024-05-08T19:42:13.750 INFO:tasks.workunit.client.1.smithi177.stdout: 10 120033 17.94 MB/sec execute 230 sec latency 133.632 ms 2024-05-08T19:42:14.750 INFO:tasks.workunit.client.1.smithi177.stdout: 10 120419 17.96 MB/sec execute 231 sec latency 125.405 ms 2024-05-08T19:42:15.750 INFO:tasks.workunit.client.1.smithi177.stdout: 10 120752 17.96 MB/sec execute 232 sec latency 93.896 ms 2024-05-08T19:42:16.750 INFO:tasks.workunit.client.1.smithi177.stdout: 10 121033 17.94 MB/sec execute 233 sec latency 118.749 ms 2024-05-08T19:42:17.750 INFO:tasks.workunit.client.1.smithi177.stdout: 10 121210 17.91 MB/sec execute 234 sec latency 184.213 ms 2024-05-08T19:42:18.750 INFO:tasks.workunit.client.1.smithi177.stdout: 10 121515 17.89 MB/sec execute 235 sec latency 123.298 ms 2024-05-08T19:42:19.752 INFO:tasks.workunit.client.1.smithi177.stdout: 10 121923 17.89 MB/sec execute 236 sec latency 116.098 ms 2024-05-08T19:42:20.752 INFO:tasks.workunit.client.1.smithi177.stdout: 10 122389 17.88 MB/sec execute 237 sec latency 231.167 ms 2024-05-08T19:42:21.752 INFO:tasks.workunit.client.1.smithi177.stdout: 10 122681 17.86 MB/sec execute 238 sec latency 96.272 ms 2024-05-08T19:42:22.752 INFO:tasks.workunit.client.1.smithi177.stdout: 10 123248 17.97 MB/sec execute 239 sec latency 97.006 ms 2024-05-08T19:42:23.752 INFO:tasks.workunit.client.1.smithi177.stdout: 10 123745 18.02 MB/sec execute 240 sec latency 99.600 ms 2024-05-08T19:42:24.752 INFO:tasks.workunit.client.1.smithi177.stdout: 10 124085 18.03 MB/sec execute 241 sec latency 70.048 ms 2024-05-08T19:42:25.752 INFO:tasks.workunit.client.1.smithi177.stdout: 10 124422 18.04 MB/sec execute 242 sec latency 99.624 ms 2024-05-08T19:42:26.752 INFO:tasks.workunit.client.1.smithi177.stdout: 10 124692 18.02 MB/sec execute 243 sec latency 109.088 ms 2024-05-08T19:42:27.752 INFO:tasks.workunit.client.1.smithi177.stdout: 10 124914 17.99 MB/sec execute 244 sec latency 153.076 ms 2024-05-08T19:42:28.752 INFO:tasks.workunit.client.1.smithi177.stdout: 10 125209 17.97 MB/sec execute 245 sec latency 137.936 ms 2024-05-08T19:42:29.753 INFO:tasks.workunit.client.1.smithi177.stdout: 10 125705 17.96 MB/sec execute 246 sec latency 59.934 ms 2024-05-08T19:42:30.753 INFO:tasks.workunit.client.1.smithi177.stdout: 10 126152 17.96 MB/sec execute 247 sec latency 48.077 ms 2024-05-08T19:42:31.753 INFO:tasks.workunit.client.1.smithi177.stdout: 10 126664 18.05 MB/sec execute 248 sec latency 53.804 ms 2024-05-08T19:42:32.757 INFO:tasks.workunit.client.1.smithi177.stdout: 10 127208 18.12 MB/sec execute 249 sec latency 83.347 ms 2024-05-08T19:42:33.756 INFO:tasks.workunit.client.1.smithi177.stdout: 10 127467 18.10 MB/sec execute 250 sec latency 166.538 ms 2024-05-08T19:42:34.756 INFO:tasks.workunit.client.1.smithi177.stdout: 10 127825 18.12 MB/sec execute 251 sec latency 177.769 ms 2024-05-08T19:42:35.756 INFO:tasks.workunit.client.1.smithi177.stdout: 10 128124 18.12 MB/sec execute 252 sec latency 79.754 ms 2024-05-08T19:42:36.758 INFO:tasks.workunit.client.1.smithi177.stdout: 10 128277 18.07 MB/sec execute 253 sec latency 215.176 ms 2024-05-08T19:42:37.760 INFO:tasks.workunit.client.1.smithi177.stdout: 10 128283 18.00 MB/sec execute 254 sec latency 1217.929 ms 2024-05-08T19:42:38.764 INFO:tasks.workunit.client.1.smithi177.stdout: 10 128292 17.93 MB/sec execute 255 sec latency 1925.251 ms 2024-05-08T19:42:39.766 INFO:tasks.workunit.client.1.smithi177.stdout: 10 128386 17.87 MB/sec execute 256 sec latency 1052.620 ms 2024-05-08T19:42:40.765 INFO:tasks.workunit.client.1.smithi177.stdout: 10 128553 17.84 MB/sec execute 257 sec latency 128.149 ms 2024-05-08T19:42:41.765 INFO:tasks.workunit.client.1.smithi177.stdout: 10 128657 17.78 MB/sec execute 258 sec latency 209.364 ms 2024-05-08T19:42:42.765 INFO:tasks.workunit.client.1.smithi177.stdout: 10 128994 17.77 MB/sec execute 259 sec latency 129.438 ms 2024-05-08T19:42:43.766 INFO:tasks.workunit.client.1.smithi177.stdout: 10 129444 17.75 MB/sec execute 260 sec latency 235.569 ms 2024-05-08T19:42:44.765 INFO:tasks.workunit.client.1.smithi177.stdout: 10 129867 17.80 MB/sec execute 261 sec latency 48.697 ms 2024-05-08T19:42:45.766 INFO:tasks.workunit.client.1.smithi177.stdout: 10 130281 17.84 MB/sec execute 262 sec latency 267.167 ms 2024-05-08T19:42:46.765 INFO:tasks.workunit.client.1.smithi177.stdout: 10 130869 17.90 MB/sec execute 263 sec latency 73.207 ms 2024-05-08T19:42:47.772 INFO:tasks.workunit.client.1.smithi177.stdout: 10 131209 17.93 MB/sec execute 264 sec latency 96.047 ms 2024-05-08T19:42:48.772 INFO:tasks.workunit.client.1.smithi177.stdout: 10 131520 17.92 MB/sec execute 265 sec latency 113.502 ms 2024-05-08T19:42:49.772 INFO:tasks.workunit.client.1.smithi177.stdout: 10 131759 17.90 MB/sec execute 266 sec latency 104.152 ms 2024-05-08T19:42:50.772 INFO:tasks.workunit.client.1.smithi177.stdout: 10 131945 17.86 MB/sec execute 267 sec latency 183.738 ms 2024-05-08T19:42:51.772 INFO:tasks.workunit.client.1.smithi177.stdout: 10 132257 17.85 MB/sec execute 268 sec latency 110.964 ms 2024-05-08T19:42:52.772 INFO:tasks.workunit.client.1.smithi177.stdout: 10 132763 17.84 MB/sec execute 269 sec latency 63.132 ms 2024-05-08T19:42:53.772 INFO:tasks.workunit.client.1.smithi177.stdout: 10 133222 17.85 MB/sec execute 270 sec latency 78.855 ms 2024-05-08T19:42:54.772 INFO:tasks.workunit.client.1.smithi177.stdout: 10 133677 17.91 MB/sec execute 271 sec latency 166.310 ms 2024-05-08T19:42:55.772 INFO:tasks.workunit.client.1.smithi177.stdout: 10 134201 17.95 MB/sec execute 272 sec latency 76.791 ms 2024-05-08T19:42:56.772 INFO:tasks.workunit.client.1.smithi177.stdout: 10 134514 17.96 MB/sec execute 273 sec latency 124.073 ms 2024-05-08T19:42:57.774 INFO:tasks.workunit.client.1.smithi177.stdout: 10 134589 17.92 MB/sec execute 274 sec latency 692.030 ms 2024-05-08T19:42:58.774 INFO:tasks.workunit.client.1.smithi177.stdout: 10 134599 17.86 MB/sec execute 275 sec latency 1386.647 ms 2024-05-08T19:42:59.774 INFO:tasks.workunit.client.1.smithi177.stdout: 10 134754 17.84 MB/sec execute 276 sec latency 527.564 ms 2024-05-08T19:43:00.774 INFO:tasks.workunit.client.1.smithi177.stdout: 10 134908 17.80 MB/sec execute 277 sec latency 117.734 ms 2024-05-08T19:43:01.774 INFO:tasks.workunit.client.1.smithi177.stdout: 10 135123 17.79 MB/sec execute 278 sec latency 151.245 ms 2024-05-08T19:43:02.774 INFO:tasks.workunit.client.1.smithi177.stdout: 10 135304 17.75 MB/sec execute 279 sec latency 354.716 ms 2024-05-08T19:43:03.774 INFO:tasks.workunit.client.1.smithi177.stdout: 10 135546 17.72 MB/sec execute 280 sec latency 142.731 ms 2024-05-08T19:43:04.774 INFO:tasks.workunit.client.1.smithi177.stdout: 10 135828 17.71 MB/sec execute 281 sec latency 149.976 ms 2024-05-08T19:43:05.774 INFO:tasks.workunit.client.1.smithi177.stdout: 10 136300 17.70 MB/sec execute 282 sec latency 112.511 ms 2024-05-08T19:43:06.779 INFO:tasks.workunit.client.1.smithi177.stdout: 10 136687 17.69 MB/sec execute 283 sec latency 121.148 ms 2024-05-08T19:43:07.778 INFO:tasks.workunit.client.1.smithi177.stdout: 10 137270 17.79 MB/sec execute 284 sec latency 58.409 ms 2024-05-08T19:43:08.778 INFO:tasks.workunit.client.1.smithi177.stdout: 10 137846 17.83 MB/sec execute 285 sec latency 101.339 ms 2024-05-08T19:43:09.781 INFO:tasks.workunit.client.1.smithi177.stdout: 10 138179 17.85 MB/sec execute 286 sec latency 126.873 ms 2024-05-08T19:43:10.780 INFO:tasks.workunit.client.1.smithi177.stdout: 10 138512 17.85 MB/sec execute 287 sec latency 123.731 ms 2024-05-08T19:43:11.780 INFO:tasks.workunit.client.1.smithi177.stdout: 10 138761 17.85 MB/sec execute 288 sec latency 205.012 ms 2024-05-08T19:43:12.780 INFO:tasks.workunit.client.1.smithi177.stdout: 10 138931 17.80 MB/sec execute 289 sec latency 194.458 ms 2024-05-08T19:43:13.781 INFO:tasks.workunit.client.1.smithi177.stdout: 10 139209 17.79 MB/sec execute 290 sec latency 105.901 ms 2024-05-08T19:43:14.780 INFO:tasks.workunit.client.1.smithi177.stdout: 10 139652 17.79 MB/sec execute 291 sec latency 50.241 ms 2024-05-08T19:43:15.780 INFO:tasks.workunit.client.1.smithi177.stdout: 10 140024 17.76 MB/sec execute 292 sec latency 128.025 ms 2024-05-08T19:43:16.780 INFO:tasks.workunit.client.1.smithi177.stdout: 10 140399 17.77 MB/sec execute 293 sec latency 156.158 ms 2024-05-08T19:43:17.783 INFO:tasks.workunit.client.1.smithi177.stdout: 10 140801 17.83 MB/sec execute 294 sec latency 303.748 ms 2024-05-08T19:43:18.784 INFO:tasks.workunit.client.1.smithi177.stdout: 10 140821 17.77 MB/sec execute 295 sec latency 1167.177 ms 2024-05-08T19:43:19.784 INFO:tasks.workunit.client.1.smithi177.stdout: 10 140973 17.74 MB/sec execute 296 sec latency 1001.980 ms 2024-05-08T19:43:20.784 INFO:tasks.workunit.client.1.smithi177.stdout: 10 141244 17.73 MB/sec execute 297 sec latency 175.650 ms 2024-05-08T19:43:21.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 141399 17.69 MB/sec execute 298 sec latency 353.043 ms 2024-05-08T19:43:22.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 141635 17.68 MB/sec execute 299 sec latency 122.642 ms 2024-05-08T19:43:23.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 141934 17.70 MB/sec execute 300 sec latency 122.759 ms 2024-05-08T19:43:24.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 142242 17.71 MB/sec execute 301 sec latency 149.795 ms 2024-05-08T19:43:25.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 142447 17.67 MB/sec execute 302 sec latency 131.141 ms 2024-05-08T19:43:26.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 142684 17.65 MB/sec execute 303 sec latency 168.620 ms 2024-05-08T19:43:27.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 143071 17.64 MB/sec execute 304 sec latency 55.921 ms 2024-05-08T19:43:28.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 143461 17.63 MB/sec execute 305 sec latency 139.676 ms 2024-05-08T19:43:29.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 143825 17.61 MB/sec execute 306 sec latency 147.298 ms 2024-05-08T19:43:30.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 144367 17.69 MB/sec execute 307 sec latency 54.230 ms 2024-05-08T19:43:31.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 144829 17.72 MB/sec execute 308 sec latency 136.340 ms 2024-05-08T19:43:32.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 145251 17.75 MB/sec execute 309 sec latency 108.753 ms 2024-05-08T19:43:33.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 145616 17.77 MB/sec execute 310 sec latency 99.318 ms 2024-05-08T19:43:34.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 145843 17.76 MB/sec execute 311 sec latency 194.354 ms 2024-05-08T19:43:35.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 146091 17.73 MB/sec execute 312 sec latency 103.221 ms 2024-05-08T19:43:36.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 146418 17.73 MB/sec execute 313 sec latency 79.281 ms 2024-05-08T19:43:37.786 INFO:tasks.workunit.client.1.smithi177.stdout: 10 146705 17.69 MB/sec execute 314 sec latency 176.493 ms 2024-05-08T19:43:38.787 INFO:tasks.workunit.client.1.smithi177.stdout: 10 146856 17.65 MB/sec execute 315 sec latency 754.074 ms 2024-05-08T19:43:39.787 INFO:tasks.workunit.client.1.smithi177.stdout: 10 146875 17.59 MB/sec execute 316 sec latency 1233.365 ms 2024-05-08T19:43:40.787 INFO:tasks.workunit.client.1.smithi177.stdout: 10 147010 17.56 MB/sec execute 317 sec latency 527.715 ms 2024-05-08T19:43:41.788 INFO:tasks.workunit.client.1.smithi177.stdout: 10 147186 17.54 MB/sec execute 318 sec latency 240.008 ms 2024-05-08T19:43:42.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 147328 17.49 MB/sec execute 319 sec latency 204.126 ms 2024-05-08T19:43:43.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 147865 17.56 MB/sec execute 320 sec latency 112.375 ms 2024-05-08T19:43:44.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 148360 17.59 MB/sec execute 321 sec latency 155.906 ms 2024-05-08T19:43:45.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 148730 17.61 MB/sec execute 322 sec latency 106.290 ms 2024-05-08T19:43:46.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 149044 17.63 MB/sec execute 323 sec latency 125.158 ms 2024-05-08T19:43:47.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 149323 17.63 MB/sec execute 324 sec latency 115.743 ms 2024-05-08T19:43:48.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 149490 17.59 MB/sec execute 325 sec latency 269.335 ms 2024-05-08T19:43:49.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 149702 17.56 MB/sec execute 326 sec latency 137.765 ms 2024-05-08T19:43:50.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 149981 17.55 MB/sec execute 327 sec latency 124.071 ms 2024-05-08T19:43:51.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 150245 17.52 MB/sec execute 328 sec latency 265.249 ms 2024-05-08T19:43:52.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 150636 17.51 MB/sec execute 329 sec latency 162.109 ms 2024-05-08T19:43:53.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 151208 17.58 MB/sec execute 330 sec latency 48.533 ms 2024-05-08T19:43:54.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 151864 17.62 MB/sec execute 331 sec latency 57.142 ms 2024-05-08T19:43:55.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 152149 17.62 MB/sec execute 332 sec latency 125.113 ms 2024-05-08T19:43:56.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 152505 17.66 MB/sec execute 333 sec latency 112.762 ms 2024-05-08T19:43:57.789 INFO:tasks.workunit.client.1.smithi177.stdout: 10 152766 17.66 MB/sec execute 334 sec latency 108.675 ms 2024-05-08T19:43:58.790 INFO:tasks.workunit.client.1.smithi177.stdout: 10 152918 17.63 MB/sec execute 335 sec latency 327.733 ms 2024-05-08T19:43:59.792 INFO:tasks.workunit.client.1.smithi177.stdout: 10 152933 17.58 MB/sec execute 336 sec latency 1330.037 ms 2024-05-08T19:44:00.792 INFO:tasks.workunit.client.1.smithi177.stdout: 10 152960 17.53 MB/sec execute 337 sec latency 1483.590 ms 2024-05-08T19:44:01.792 INFO:tasks.workunit.client.1.smithi177.stdout: 10 153093 17.49 MB/sec execute 338 sec latency 290.629 ms 2024-05-08T19:44:02.792 INFO:tasks.workunit.client.1.smithi177.stdout: 10 153193 17.44 MB/sec execute 339 sec latency 157.500 ms 2024-05-08T19:44:03.792 INFO:tasks.workunit.client.1.smithi177.stdout: 10 153458 17.43 MB/sec execute 340 sec latency 130.639 ms 2024-05-08T19:44:04.792 INFO:tasks.workunit.client.1.smithi177.stdout: 10 153785 17.41 MB/sec execute 341 sec latency 146.696 ms 2024-05-08T19:44:05.792 INFO:tasks.workunit.client.1.smithi177.stdout: 10 154158 17.40 MB/sec execute 342 sec latency 161.715 ms 2024-05-08T19:44:06.792 INFO:tasks.workunit.client.1.smithi177.stdout: 10 154625 17.42 MB/sec execute 343 sec latency 69.415 ms 2024-05-08T19:44:07.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 155203 17.48 MB/sec execute 344 sec latency 66.016 ms 2024-05-08T19:44:08.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 155627 17.50 MB/sec execute 345 sec latency 130.705 ms 2024-05-08T19:44:09.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 155982 17.54 MB/sec execute 346 sec latency 84.850 ms 2024-05-08T19:44:10.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 156244 17.53 MB/sec execute 347 sec latency 126.065 ms 2024-05-08T19:44:11.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 156479 17.52 MB/sec execute 348 sec latency 184.269 ms 2024-05-08T19:44:12.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 156663 17.49 MB/sec execute 349 sec latency 113.012 ms 2024-05-08T19:44:13.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 156918 17.47 MB/sec execute 350 sec latency 157.198 ms 2024-05-08T19:44:14.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 157321 17.46 MB/sec execute 351 sec latency 129.572 ms 2024-05-08T19:44:15.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 157826 17.47 MB/sec execute 352 sec latency 122.302 ms 2024-05-08T19:44:16.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 158505 17.54 MB/sec execute 353 sec latency 60.234 ms 2024-05-08T19:44:17.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 159098 17.59 MB/sec execute 354 sec latency 79.574 ms 2024-05-08T19:44:18.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 159503 17.63 MB/sec execute 355 sec latency 76.327 ms 2024-05-08T19:44:19.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 159617 17.59 MB/sec execute 356 sec latency 851.005 ms 2024-05-08T19:44:20.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 159631 17.55 MB/sec execute 357 sec latency 1456.015 ms 2024-05-08T19:44:21.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 159832 17.54 MB/sec execute 358 sec latency 455.051 ms 2024-05-08T19:44:22.793 INFO:tasks.workunit.client.1.smithi177.stdout: 10 159952 17.50 MB/sec execute 359 sec latency 138.688 ms 2024-05-08T19:44:23.795 INFO:tasks.workunit.client.1.smithi177.stdout: 10 160090 17.47 MB/sec execute 360 sec latency 129.074 ms 2024-05-08T19:44:24.795 INFO:tasks.workunit.client.1.smithi177.stdout: 10 160267 17.44 MB/sec execute 361 sec latency 120.012 ms 2024-05-08T19:44:25.795 INFO:tasks.workunit.client.1.smithi177.stdout: 10 160605 17.44 MB/sec execute 362 sec latency 115.829 ms 2024-05-08T19:44:26.795 INFO:tasks.workunit.client.1.smithi177.stdout: 10 160892 17.41 MB/sec execute 363 sec latency 158.276 ms 2024-05-08T19:44:27.795 INFO:tasks.workunit.client.1.smithi177.stdout: 10 161296 17.40 MB/sec execute 364 sec latency 160.720 ms 2024-05-08T19:44:28.795 INFO:tasks.workunit.client.1.smithi177.stdout: 10 161920 17.47 MB/sec execute 365 sec latency 63.296 ms 2024-05-08T19:44:29.795 INFO:tasks.workunit.client.1.smithi177.stdout: 10 162638 17.53 MB/sec execute 366 sec latency 45.791 ms 2024-05-08T19:44:30.795 INFO:tasks.workunit.client.1.smithi177.stdout: 10 162981 17.55 MB/sec execute 367 sec latency 126.331 ms 2024-05-08T19:44:31.795 INFO:tasks.workunit.client.1.smithi177.stdout: 10 163319 17.56 MB/sec execute 368 sec latency 147.961 ms 2024-05-08T19:44:32.795 INFO:tasks.workunit.client.1.smithi177.stdout: 10 163576 17.56 MB/sec execute 369 sec latency 204.753 ms 2024-05-08T19:44:33.795 INFO:tasks.workunit.client.1.smithi177.stdout: 10 163851 17.54 MB/sec execute 370 sec latency 85.674 ms 2024-05-08T19:44:34.796 INFO:tasks.workunit.client.1.smithi177.stdout: 10 164174 17.53 MB/sec execute 371 sec latency 92.961 ms 2024-05-08T19:44:35.796 INFO:tasks.workunit.client.1.smithi177.stdout: 10 164651 17.52 MB/sec execute 372 sec latency 134.528 ms 2024-05-08T19:44:36.796 INFO:tasks.workunit.client.1.smithi177.stdout: 10 165130 17.56 MB/sec execute 373 sec latency 75.404 ms 2024-05-08T19:44:37.796 INFO:tasks.workunit.client.1.smithi177.stdout: 10 165712 17.60 MB/sec execute 374 sec latency 129.901 ms 2024-05-08T19:44:38.796 INFO:tasks.workunit.client.1.smithi177.stdout: 10 166276 17.63 MB/sec execute 375 sec latency 103.400 ms 2024-05-08T19:44:39.803 INFO:tasks.workunit.client.1.smithi177.stdout: 10 166516 17.63 MB/sec execute 376 sec latency 374.224 ms 2024-05-08T19:44:40.804 INFO:tasks.workunit.client.1.smithi177.stdout: 10 166551 17.60 MB/sec execute 377 sec latency 1255.869 ms 2024-05-08T19:44:41.805 INFO:tasks.workunit.client.1.smithi177.stdout: 10 166562 17.55 MB/sec execute 378 sec latency 730.486 ms 2024-05-08T19:44:42.804 INFO:tasks.workunit.client.1.smithi177.stdout: 10 166839 17.55 MB/sec execute 379 sec latency 747.685 ms 2024-05-08T19:44:43.074 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:44:43.095 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:44:43.804 INFO:tasks.workunit.client.1.smithi177.stdout: 10 166969 17.52 MB/sec execute 380 sec latency 188.040 ms 2024-05-08T19:44:44.804 INFO:tasks.workunit.client.1.smithi177.stdout: 10 167141 17.50 MB/sec execute 381 sec latency 148.689 ms 2024-05-08T19:44:45.804 INFO:tasks.workunit.client.1.smithi177.stdout: 10 167391 17.49 MB/sec execute 382 sec latency 119.728 ms 2024-05-08T19:44:46.804 INFO:tasks.workunit.client.1.smithi177.stdout: 10 167741 17.48 MB/sec execute 383 sec latency 104.746 ms 2024-05-08T19:44:47.804 INFO:tasks.workunit.client.1.smithi177.stdout: 10 168161 17.46 MB/sec execute 384 sec latency 137.710 ms 2024-05-08T19:44:48.805 INFO:tasks.workunit.client.1.smithi177.stdout: 10 168560 17.49 MB/sec execute 385 sec latency 157.691 ms 2024-05-08T19:44:49.805 INFO:tasks.workunit.client.1.smithi177.stdout: 10 169247 17.55 MB/sec execute 386 sec latency 120.134 ms 2024-05-08T19:44:50.805 INFO:tasks.workunit.client.1.smithi177.stdout: 10 169750 17.57 MB/sec execute 387 sec latency 112.673 ms 2024-05-08T19:44:51.805 INFO:tasks.workunit.client.1.smithi177.stdout: 10 170123 17.59 MB/sec execute 388 sec latency 95.546 ms 2024-05-08T19:44:52.806 INFO:tasks.workunit.client.1.smithi177.stdout: 10 170460 17.60 MB/sec execute 389 sec latency 100.124 ms 2024-05-08T19:44:53.806 INFO:tasks.workunit.client.1.smithi177.stdout: 10 170694 17.59 MB/sec execute 390 sec latency 140.013 ms 2024-05-08T19:44:54.806 INFO:tasks.workunit.client.1.smithi177.stdout: 10 170929 17.57 MB/sec execute 391 sec latency 121.737 ms 2024-05-08T19:44:55.806 INFO:tasks.workunit.client.1.smithi177.stdout: 10 171355 17.57 MB/sec execute 392 sec latency 39.595 ms 2024-05-08T19:44:56.806 INFO:tasks.workunit.client.1.smithi177.stdout: 10 171728 17.55 MB/sec execute 393 sec latency 129.460 ms 2024-05-08T19:44:57.806 INFO:tasks.workunit.client.1.smithi177.stdout: 10 171956 17.54 MB/sec execute 394 sec latency 267.590 ms 2024-05-08T19:44:58.806 INFO:tasks.workunit.client.1.smithi177.stdout: 10 172549 17.60 MB/sec execute 395 sec latency 82.408 ms 2024-05-08T19:44:59.806 INFO:tasks.workunit.client.1.smithi177.stdout: 10 173150 17.62 MB/sec execute 396 sec latency 112.707 ms 2024-05-08T19:45:00.808 INFO:tasks.workunit.client.1.smithi177.stdout: 10 173239 17.59 MB/sec execute 397 sec latency 862.565 ms 2024-05-08T19:45:01.810 INFO:tasks.workunit.client.1.smithi177.stdout: 10 173244 17.55 MB/sec execute 398 sec latency 1477.636 ms 2024-05-08T19:45:02.808 INFO:tasks.workunit.client.1.smithi177.stdout: 10 173479 17.55 MB/sec execute 399 sec latency 1078.097 ms 2024-05-08T19:45:03.808 INFO:tasks.workunit.client.1.smithi177.stdout: 10 173657 17.54 MB/sec execute 400 sec latency 145.979 ms 2024-05-08T19:45:04.808 INFO:tasks.workunit.client.1.smithi177.stdout: 10 173869 17.53 MB/sec execute 401 sec latency 128.729 ms 2024-05-08T19:45:05.811 INFO:tasks.workunit.client.1.smithi177.stdout: 10 174185 17.54 MB/sec execute 402 sec latency 81.901 ms 2024-05-08T19:45:06.811 INFO:tasks.workunit.client.1.smithi177.stdout: 10 174322 17.51 MB/sec execute 403 sec latency 182.181 ms 2024-05-08T19:45:07.811 INFO:tasks.workunit.client.1.smithi177.stdout: 10 174658 17.51 MB/sec execute 404 sec latency 40.121 ms 2024-05-08T19:45:08.811 INFO:tasks.workunit.client.1.smithi177.stdout: 10 175014 17.48 MB/sec execute 405 sec latency 154.318 ms 2024-05-08T19:45:09.811 INFO:tasks.workunit.client.1.smithi177.stdout: 10 175302 17.46 MB/sec execute 406 sec latency 282.503 ms 2024-05-08T19:45:10.811 INFO:tasks.workunit.client.1.smithi177.stdout: 10 175763 17.50 MB/sec execute 407 sec latency 125.570 ms 2024-05-08T19:45:11.811 INFO:tasks.workunit.client.1.smithi177.stdout: 10 176312 17.53 MB/sec execute 408 sec latency 91.105 ms 2024-05-08T19:45:12.812 INFO:tasks.workunit.client.1.smithi177.stdout: 10 176820 17.55 MB/sec execute 409 sec latency 98.050 ms 2024-05-08T19:45:13.450 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:45:13.453 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:45:13.812 INFO:tasks.workunit.client.1.smithi177.stdout: 10 177154 17.57 MB/sec execute 410 sec latency 145.130 ms 2024-05-08T19:45:14.812 INFO:tasks.workunit.client.1.smithi177.stdout: 10 177516 17.58 MB/sec execute 411 sec latency 94.674 ms 2024-05-08T19:45:15.812 INFO:tasks.workunit.client.1.smithi177.stdout: 10 177651 17.57 MB/sec execute 412 sec latency 554.144 ms 2024-05-08T19:45:16.812 INFO:tasks.workunit.client.1.smithi177.stdout: 10 177668 17.53 MB/sec execute 413 sec latency 1103.856 ms 2024-05-08T19:45:17.812 INFO:tasks.workunit.client.1.smithi177.stdout: 10 177884 17.51 MB/sec execute 414 sec latency 785.900 ms 2024-05-08T19:45:18.818 INFO:tasks.workunit.client.1.smithi177.stdout: 10 177999 17.48 MB/sec execute 415 sec latency 174.459 ms 2024-05-08T19:45:19.818 INFO:tasks.workunit.client.1.smithi177.stdout: 10 178237 17.46 MB/sec execute 416 sec latency 134.264 ms 2024-05-08T19:45:20.821 INFO:tasks.workunit.client.1.smithi177.stdout: 10 178590 17.44 MB/sec execute 417 sec latency 157.222 ms 2024-05-08T19:45:21.825 INFO:tasks.workunit.client.1.smithi177.stdout: 10 178887 17.42 MB/sec execute 418 sec latency 135.018 ms 2024-05-08T19:45:22.825 INFO:tasks.workunit.client.1.smithi177.stdout: 10 179417 17.47 MB/sec execute 419 sec latency 111.601 ms 2024-05-08T19:45:23.825 INFO:tasks.workunit.client.1.smithi177.stdout: 10 180049 17.50 MB/sec execute 420 sec latency 92.235 ms 2024-05-08T19:45:24.825 INFO:tasks.workunit.client.1.smithi177.stdout: 10 180445 17.52 MB/sec execute 421 sec latency 124.075 ms 2024-05-08T19:45:25.825 INFO:tasks.workunit.client.1.smithi177.stdout: 10 180857 17.55 MB/sec execute 422 sec latency 109.942 ms 2024-05-08T19:45:26.825 INFO:tasks.workunit.client.1.smithi177.stdout: 10 181141 17.55 MB/sec execute 423 sec latency 188.855 ms 2024-05-08T19:45:27.825 INFO:tasks.workunit.client.1.smithi177.stdout: 10 181434 17.55 MB/sec execute 424 sec latency 78.177 ms 2024-05-08T19:45:28.825 INFO:tasks.workunit.client.1.smithi177.stdout: 10 181749 17.54 MB/sec execute 425 sec latency 106.071 ms 2024-05-08T19:45:29.825 INFO:tasks.workunit.client.1.smithi177.stdout: 10 182149 17.52 MB/sec execute 426 sec latency 94.386 ms 2024-05-08T19:45:30.826 INFO:tasks.workunit.client.1.smithi177.stdout: 10 182508 17.52 MB/sec execute 427 sec latency 126.099 ms 2024-05-08T19:45:31.826 INFO:tasks.workunit.client.1.smithi177.stdout: 10 182990 17.55 MB/sec execute 428 sec latency 90.438 ms 2024-05-08T19:45:32.826 INFO:tasks.workunit.client.1.smithi177.stdout: 10 183637 17.59 MB/sec execute 429 sec latency 92.355 ms 2024-05-08T19:45:33.826 INFO:tasks.workunit.client.1.smithi177.stdout: 10 184080 17.60 MB/sec execute 430 sec latency 107.854 ms 2024-05-08T19:45:34.829 INFO:tasks.workunit.client.1.smithi177.stdout: 10 184589 17.65 MB/sec execute 431 sec latency 58.594 ms 2024-05-08T19:45:35.829 INFO:tasks.workunit.client.1.smithi177.stdout: 10 184839 17.65 MB/sec execute 432 sec latency 125.330 ms 2024-05-08T19:45:36.831 INFO:tasks.workunit.client.1.smithi177.stdout: 10 184845 17.61 MB/sec execute 433 sec latency 1084.683 ms 2024-05-08T19:45:37.832 INFO:tasks.workunit.client.1.smithi177.stdout: 10 184857 17.57 MB/sec execute 434 sec latency 1917.057 ms 2024-05-08T19:45:38.831 INFO:tasks.workunit.client.1.smithi177.stdout: 10 185072 17.55 MB/sec execute 435 sec latency 402.136 ms 2024-05-08T19:45:39.831 INFO:tasks.workunit.client.1.smithi177.stdout: 10 185225 17.52 MB/sec execute 436 sec latency 154.617 ms 2024-05-08T19:45:40.831 INFO:tasks.workunit.client.1.smithi177.stdout: 10 185368 17.50 MB/sec execute 437 sec latency 134.673 ms 2024-05-08T19:45:41.832 INFO:tasks.workunit.client.1.smithi177.stdout: 10 185555 17.47 MB/sec execute 438 sec latency 282.764 ms 2024-05-08T19:45:42.832 INFO:tasks.workunit.client.1.smithi177.stdout: 10 185818 17.45 MB/sec execute 439 sec latency 274.350 ms 2024-05-08T19:45:43.732 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:45:43.735 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:45:43.779 INFO:tasks.ceph.mds.d.smithi177.stderr:2024-05-08T19:45:43.788+0000 7fb2033aa700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53563) UID: 0 2024-05-08T19:45:43.779 INFO:tasks.ceph.mds.b.smithi177.stderr:2024-05-08T19:45:43.788+0000 7f0ad5def700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53563) UID: 0 2024-05-08T19:45:43.831 INFO:tasks.workunit.client.1.smithi177.stdout: 10 186183 17.45 MB/sec execute 440 sec latency 171.483 ms 2024-05-08T19:45:44.832 INFO:tasks.workunit.client.1.smithi177.stdout: 10 186808 17.50 MB/sec execute 441 sec latency 53.550 ms 2024-05-08T19:45:45.832 INFO:tasks.workunit.client.1.smithi177.stdout: 10 187404 17.53 MB/sec execute 442 sec latency 53.764 ms 2024-05-08T19:45:46.832 INFO:tasks.workunit.client.1.smithi177.stdout: 10 187768 17.55 MB/sec execute 443 sec latency 170.274 ms 2024-05-08T19:45:47.836 INFO:tasks.workunit.client.1.smithi177.stdout: 10 188125 17.57 MB/sec execute 444 sec latency 75.540 ms 2024-05-08T19:45:48.835 INFO:tasks.workunit.client.1.smithi177.stdout: 10 188414 17.57 MB/sec execute 445 sec latency 90.177 ms 2024-05-08T19:45:49.835 INFO:tasks.workunit.client.1.smithi177.stdout: 10 188624 17.55 MB/sec execute 446 sec latency 108.589 ms 2024-05-08T19:45:50.835 INFO:tasks.workunit.client.1.smithi177.stdout: 10 188906 17.54 MB/sec execute 447 sec latency 120.278 ms 2024-05-08T19:45:51.837 INFO:tasks.workunit.client.1.smithi177.stdout: 10 188996 17.50 MB/sec execute 448 sec latency 746.659 ms 2024-05-08T19:45:52.838 INFO:tasks.workunit.client.1.smithi177.stdout: 10 189017 17.46 MB/sec execute 449 sec latency 1178.761 ms 2024-05-08T19:45:53.837 INFO:tasks.workunit.client.1.smithi177.stdout: 10 189161 17.43 MB/sec execute 450 sec latency 296.526 ms 2024-05-08T19:45:54.837 INFO:tasks.workunit.client.1.smithi177.stdout: 10 189348 17.40 MB/sec execute 451 sec latency 217.046 ms 2024-05-08T19:45:55.837 INFO:tasks.workunit.client.1.smithi177.stdout: 10 189817 17.42 MB/sec execute 452 sec latency 92.092 ms 2024-05-08T19:45:56.838 INFO:tasks.workunit.client.1.smithi177.stdout: 10 190508 17.47 MB/sec execute 453 sec latency 54.648 ms 2024-05-08T19:45:57.838 INFO:tasks.workunit.client.1.smithi177.stdout: 10 191073 17.51 MB/sec execute 454 sec latency 38.670 ms 2024-05-08T19:45:58.838 INFO:tasks.workunit.client.1.smithi177.stdout: 10 191408 17.53 MB/sec execute 455 sec latency 143.459 ms 2024-05-08T19:45:59.838 INFO:tasks.workunit.client.1.smithi177.stdout: 10 191803 17.55 MB/sec execute 456 sec latency 66.233 ms 2024-05-08T19:46:00.838 INFO:tasks.workunit.client.1.smithi177.stdout: 10 191967 17.53 MB/sec execute 457 sec latency 145.935 ms 2024-05-08T19:46:01.838 INFO:tasks.workunit.client.1.smithi177.stdout: 10 192174 17.50 MB/sec execute 458 sec latency 133.857 ms 2024-05-08T19:46:02.838 INFO:tasks.workunit.client.1.smithi177.stdout: 10 192434 17.49 MB/sec execute 459 sec latency 105.851 ms 2024-05-08T19:46:03.838 INFO:tasks.workunit.client.1.smithi177.stdout: 10 192734 17.47 MB/sec execute 460 sec latency 161.333 ms 2024-05-08T19:46:04.838 INFO:tasks.workunit.client.1.smithi177.stdout: 10 193036 17.45 MB/sec execute 461 sec latency 170.867 ms 2024-05-08T19:46:05.838 INFO:tasks.workunit.client.1.smithi177.stdout: 10 193637 17.51 MB/sec execute 462 sec latency 43.042 ms 2024-05-08T19:46:06.839 INFO:tasks.workunit.client.1.smithi177.stdout: 10 194328 17.54 MB/sec execute 463 sec latency 60.767 ms 2024-05-08T19:46:07.839 INFO:tasks.workunit.client.1.smithi177.stdout: 10 194584 17.53 MB/sec execute 464 sec latency 142.808 ms 2024-05-08T19:46:08.838 INFO:tasks.workunit.client.1.smithi177.stdout: 10 194966 17.56 MB/sec execute 465 sec latency 77.328 ms 2024-05-08T19:46:09.838 INFO:tasks.workunit.client.1.smithi177.stdout: 10 195249 17.56 MB/sec execute 466 sec latency 213.292 ms 2024-05-08T19:46:10.838 INFO:tasks.workunit.client.1.smithi177.stdout: 10 195460 17.56 MB/sec execute 467 sec latency 136.518 ms 2024-05-08T19:46:11.839 INFO:tasks.workunit.client.1.smithi177.stdout: 10 195601 17.53 MB/sec execute 468 sec latency 219.133 ms 2024-05-08T19:46:12.846 INFO:tasks.workunit.client.1.smithi177.stdout: 10 195617 17.49 MB/sec execute 469 sec latency 963.024 ms 2024-05-08T19:46:13.846 INFO:tasks.workunit.client.1.smithi177.stdout: 10 195633 17.46 MB/sec execute 470 sec latency 1367.730 ms 2024-05-08T19:46:14.846 INFO:tasks.workunit.client.1.smithi177.stdout: 10 195806 17.44 MB/sec execute 471 sec latency 211.981 ms 2024-05-08T19:46:15.848 INFO:tasks.workunit.client.1.smithi177.stdout: 10 195930 17.41 MB/sec execute 472 sec latency 159.510 ms 2024-05-08T19:46:16.850 INFO:tasks.workunit.client.1.smithi177.stdout: 10 196055 17.38 MB/sec execute 473 sec latency 192.360 ms 2024-05-08T19:46:17.850 INFO:tasks.workunit.client.1.smithi177.stdout: 10 196439 17.37 MB/sec execute 474 sec latency 191.462 ms 2024-05-08T19:46:18.851 INFO:tasks.workunit.client.1.smithi177.stdout: 10 196584 17.34 MB/sec execute 475 sec latency 185.187 ms 2024-05-08T19:46:19.851 INFO:tasks.workunit.client.1.smithi177.stdout: 10 197090 17.38 MB/sec execute 476 sec latency 53.731 ms 2024-05-08T19:46:20.851 INFO:tasks.workunit.client.1.smithi177.stdout: 10 197651 17.40 MB/sec execute 477 sec latency 74.275 ms 2024-05-08T19:46:21.852 INFO:tasks.workunit.client.1.smithi177.stdout: 10 198052 17.40 MB/sec execute 478 sec latency 122.258 ms 2024-05-08T19:46:22.852 INFO:tasks.workunit.client.1.smithi177.stdout: 10 198424 17.44 MB/sec execute 479 sec latency 121.367 ms 2024-05-08T19:46:23.851 INFO:tasks.workunit.client.1.smithi177.stdout: 10 198758 17.45 MB/sec execute 480 sec latency 84.186 ms 2024-05-08T19:46:24.852 INFO:tasks.workunit.client.1.smithi177.stdout: 10 198967 17.44 MB/sec execute 481 sec latency 162.676 ms 2024-05-08T19:46:25.852 INFO:tasks.workunit.client.1.smithi177.stdout: 10 199179 17.42 MB/sec execute 482 sec latency 105.323 ms 2024-05-08T19:46:26.852 INFO:tasks.workunit.client.1.smithi177.stdout: 10 199453 17.42 MB/sec execute 483 sec latency 119.055 ms 2024-05-08T19:46:27.852 INFO:tasks.workunit.client.1.smithi177.stdout: 10 199520 17.38 MB/sec execute 484 sec latency 477.407 ms 2024-05-08T19:46:28.852 INFO:tasks.workunit.client.1.smithi177.stdout: 10 199586 17.35 MB/sec execute 485 sec latency 945.859 ms 2024-05-08T19:46:29.856 INFO:tasks.workunit.client.1.smithi177.stdout: 10 199890 17.32 MB/sec execute 486 sec latency 261.867 ms 2024-05-08T19:46:30.859 INFO:tasks.workunit.client.1.smithi177.stdout: 10 199985 17.30 MB/sec execute 487 sec latency 313.226 ms 2024-05-08T19:46:31.859 INFO:tasks.workunit.client.1.smithi177.stdout: 10 200268 17.28 MB/sec execute 488 sec latency 189.202 ms 2024-05-08T19:46:32.859 INFO:tasks.workunit.client.1.smithi177.stdout: 10 200852 17.33 MB/sec execute 489 sec latency 47.634 ms 2024-05-08T19:46:33.859 INFO:tasks.workunit.client.1.smithi177.stdout: 10 201508 17.36 MB/sec execute 490 sec latency 59.237 ms 2024-05-08T19:46:34.859 INFO:tasks.workunit.client.1.smithi177.stdout: 10 201829 17.37 MB/sec execute 491 sec latency 150.043 ms 2024-05-08T19:46:35.859 INFO:tasks.workunit.client.1.smithi177.stdout: 10 202262 17.40 MB/sec execute 492 sec latency 89.657 ms 2024-05-08T19:46:36.859 INFO:tasks.workunit.client.1.smithi177.stdout: 10 202482 17.40 MB/sec execute 493 sec latency 238.812 ms 2024-05-08T19:46:37.859 INFO:tasks.workunit.client.1.smithi177.stdout: 10 202724 17.38 MB/sec execute 494 sec latency 92.873 ms 2024-05-08T19:46:38.859 INFO:tasks.workunit.client.1.smithi177.stdout: 10 203011 17.38 MB/sec execute 495 sec latency 125.807 ms 2024-05-08T19:46:39.859 INFO:tasks.workunit.client.1.smithi177.stdout: 10 203470 17.36 MB/sec execute 496 sec latency 51.754 ms 2024-05-08T19:46:40.859 INFO:tasks.workunit.client.1.smithi177.stdout: 10 203763 17.35 MB/sec execute 497 sec latency 124.985 ms 2024-05-08T19:46:41.860 INFO:tasks.workunit.client.1.smithi177.stdout: 10 204331 17.40 MB/sec execute 498 sec latency 51.679 ms 2024-05-08T19:46:42.860 INFO:tasks.workunit.client.1.smithi177.stdout: 10 205011 17.42 MB/sec execute 499 sec latency 59.977 ms 2024-05-08T19:46:43.860 INFO:tasks.workunit.client.1.smithi177.stdout: 10 205328 17.43 MB/sec execute 500 sec latency 105.779 ms 2024-05-08T19:46:44.860 INFO:tasks.workunit.client.1.smithi177.stdout: 10 205743 17.46 MB/sec execute 501 sec latency 103.574 ms 2024-05-08T19:46:45.860 INFO:tasks.workunit.client.1.smithi177.stdout: 10 206048 17.47 MB/sec execute 502 sec latency 154.190 ms 2024-05-08T19:46:46.860 INFO:tasks.workunit.client.1.smithi177.stdout: 10 206250 17.45 MB/sec execute 503 sec latency 128.599 ms 2024-05-08T19:46:47.869 INFO:tasks.workunit.client.1.smithi177.stdout: 10 206393 17.43 MB/sec execute 504 sec latency 430.909 ms 2024-05-08T19:46:48.866 INFO:tasks.workunit.client.1.smithi177.stdout: 10 206399 17.39 MB/sec execute 505 sec latency 1034.526 ms 2024-05-08T19:46:49.866 INFO:tasks.workunit.client.1.smithi177.stdout: 10 206414 17.36 MB/sec execute 506 sec latency 1467.358 ms 2024-05-08T19:46:50.879 INFO:tasks.workunit.client.1.smithi177.stdout: 10 206664 17.35 MB/sec execute 507 sec latency 164.997 ms 2024-05-08T19:46:51.872 INFO:tasks.workunit.client.1.smithi177.stdout: 10 206788 17.32 MB/sec execute 508 sec latency 153.407 ms 2024-05-08T19:46:52.874 INFO:tasks.workunit.client.1.smithi177.stdout: 10 206958 17.29 MB/sec execute 509 sec latency 247.588 ms 2024-05-08T19:46:53.874 INFO:tasks.workunit.client.1.smithi177.stdout: 10 207139 17.27 MB/sec execute 510 sec latency 165.294 ms 2024-05-08T19:46:54.874 INFO:tasks.workunit.client.1.smithi177.stdout: 10 207603 17.29 MB/sec execute 511 sec latency 107.033 ms 2024-05-08T19:46:55.874 INFO:tasks.workunit.client.1.smithi177.stdout: 10 208243 17.32 MB/sec execute 512 sec latency 47.568 ms 2024-05-08T19:46:56.874 INFO:tasks.workunit.client.1.smithi177.stdout: 10 208679 17.33 MB/sec execute 513 sec latency 109.886 ms 2024-05-08T19:46:57.874 INFO:tasks.workunit.client.1.smithi177.stdout: 10 209108 17.37 MB/sec execute 514 sec latency 91.098 ms 2024-05-08T19:46:58.874 INFO:tasks.workunit.client.1.smithi177.stdout: 10 209405 17.37 MB/sec execute 515 sec latency 170.272 ms 2024-05-08T19:46:59.874 INFO:tasks.workunit.client.1.smithi177.stdout: 10 209643 17.37 MB/sec execute 516 sec latency 152.965 ms 2024-05-08T19:47:00.875 INFO:tasks.workunit.client.1.smithi177.stdout: 10 209902 17.36 MB/sec execute 517 sec latency 113.804 ms 2024-05-08T19:47:01.874 INFO:tasks.workunit.client.1.smithi177.stdout: 10 210221 17.35 MB/sec execute 518 sec latency 119.482 ms 2024-05-08T19:47:02.874 INFO:tasks.workunit.client.1.smithi177.stdout: 10 210484 17.33 MB/sec execute 519 sec latency 191.757 ms 2024-05-08T19:47:03.874 INFO:tasks.workunit.client.1.smithi177.stdout: 10 210499 17.29 MB/sec execute 520 sec latency 1105.002 ms 2024-05-08T19:47:04.875 INFO:tasks.workunit.client.1.smithi177.stdout: 10 210591 17.26 MB/sec execute 521 sec latency 1360.749 ms 2024-05-08T19:47:05.876 INFO:tasks.workunit.client.1.smithi177.stdout: 10 210795 17.24 MB/sec execute 522 sec latency 161.766 ms 2024-05-08T19:47:06.876 INFO:tasks.workunit.client.1.smithi177.stdout: 10 211164 17.26 MB/sec execute 523 sec latency 123.061 ms 2024-05-08T19:47:07.877 INFO:tasks.workunit.client.1.smithi177.stdout: 10 211828 17.30 MB/sec execute 524 sec latency 47.622 ms 2024-05-08T19:47:08.877 INFO:tasks.workunit.client.1.smithi177.stdout: 10 212251 17.30 MB/sec execute 525 sec latency 88.504 ms 2024-05-08T19:47:09.877 INFO:tasks.workunit.client.1.smithi177.stdout: 10 212655 17.34 MB/sec execute 526 sec latency 98.933 ms 2024-05-08T19:47:10.878 INFO:tasks.workunit.client.1.smithi177.stdout: 10 212939 17.34 MB/sec execute 527 sec latency 122.822 ms 2024-05-08T19:47:11.877 INFO:tasks.workunit.client.1.smithi177.stdout: 10 213200 17.34 MB/sec execute 528 sec latency 218.483 ms 2024-05-08T19:47:12.877 INFO:tasks.workunit.client.1.smithi177.stdout: 10 213462 17.33 MB/sec execute 529 sec latency 120.693 ms 2024-05-08T19:47:13.877 INFO:tasks.workunit.client.1.smithi177.stdout: 10 213761 17.32 MB/sec execute 530 sec latency 91.147 ms 2024-05-08T19:47:14.877 INFO:tasks.workunit.client.1.smithi177.stdout: 10 214232 17.31 MB/sec execute 531 sec latency 44.222 ms 2024-05-08T19:47:15.877 INFO:tasks.workunit.client.1.smithi177.stdout: 10 214542 17.30 MB/sec execute 532 sec latency 134.821 ms 2024-05-08T19:47:16.878 INFO:tasks.workunit.client.1.smithi177.stdout: 10 215146 17.35 MB/sec execute 533 sec latency 43.146 ms 2024-05-08T19:47:17.877 INFO:tasks.workunit.client.1.smithi177.stdout: 10 215714 17.36 MB/sec execute 534 sec latency 162.368 ms 2024-05-08T19:47:18.877 INFO:tasks.workunit.client.1.smithi177.stdout: 10 216071 17.37 MB/sec execute 535 sec latency 65.951 ms 2024-05-08T19:47:19.877 INFO:tasks.workunit.client.1.smithi177.stdout: 10 216406 17.39 MB/sec execute 536 sec latency 165.636 ms 2024-05-08T19:47:20.877 INFO:tasks.workunit.client.1.smithi177.stdout: 10 216730 17.39 MB/sec execute 537 sec latency 191.283 ms 2024-05-08T19:47:21.877 INFO:tasks.workunit.client.1.smithi177.stdout: 10 216988 17.39 MB/sec execute 538 sec latency 133.773 ms 2024-05-08T19:47:22.877 INFO:tasks.workunit.client.1.smithi177.stdout: 10 217338 17.38 MB/sec execute 539 sec latency 130.280 ms 2024-05-08T19:47:23.879 INFO:tasks.workunit.client.1.smithi177.stdout: 10 217503 17.36 MB/sec execute 540 sec latency 464.736 ms 2024-05-08T19:47:24.880 INFO:tasks.workunit.client.1.smithi177.stdout: 10 217512 17.33 MB/sec execute 541 sec latency 1069.614 ms 2024-05-08T19:47:25.885 INFO:tasks.workunit.client.1.smithi177.stdout: 10 217514 17.29 MB/sec execute 542 sec latency 1254.081 ms 2024-05-08T19:47:26.885 INFO:tasks.workunit.client.1.smithi177.stdout: 10 217802 17.28 MB/sec execute 543 sec latency 1292.385 ms 2024-05-08T19:47:27.892 INFO:tasks.workunit.client.1.smithi177.stdout: 10 217931 17.26 MB/sec execute 544 sec latency 186.659 ms 2024-05-08T19:47:28.893 INFO:tasks.workunit.client.1.smithi177.stdout: 10 218051 17.23 MB/sec execute 545 sec latency 159.232 ms 2024-05-08T19:47:29.893 INFO:tasks.workunit.client.1.smithi177.stdout: 10 218342 17.25 MB/sec execute 546 sec latency 196.601 ms 2024-05-08T19:47:30.893 INFO:tasks.workunit.client.1.smithi177.stdout: 10 218954 17.28 MB/sec execute 547 sec latency 70.565 ms 2024-05-08T19:47:31.893 INFO:tasks.workunit.client.1.smithi177.stdout: 10 219383 17.28 MB/sec execute 548 sec latency 117.514 ms 2024-05-08T19:47:32.893 INFO:tasks.workunit.client.1.smithi177.stdout: 10 219715 17.29 MB/sec execute 549 sec latency 107.649 ms 2024-05-08T19:47:33.893 INFO:tasks.workunit.client.1.smithi177.stdout: 10 220086 17.30 MB/sec execute 550 sec latency 191.699 ms 2024-05-08T19:47:34.894 INFO:tasks.workunit.client.1.smithi177.stdout: 10 220341 17.31 MB/sec execute 551 sec latency 206.080 ms 2024-05-08T19:47:35.894 INFO:tasks.workunit.client.1.smithi177.stdout: 10 220613 17.30 MB/sec execute 552 sec latency 186.928 ms 2024-05-08T19:47:36.897 INFO:tasks.workunit.client.1.smithi177.stdout: 10 220916 17.29 MB/sec execute 553 sec latency 118.521 ms 2024-05-08T19:47:37.897 INFO:tasks.workunit.client.1.smithi177.stdout: 10 221309 17.27 MB/sec execute 554 sec latency 114.916 ms 2024-05-08T19:47:38.898 INFO:tasks.workunit.client.1.smithi177.stdout: 10 221590 17.27 MB/sec execute 555 sec latency 151.975 ms 2024-05-08T19:47:39.897 INFO:tasks.workunit.client.1.smithi177.stdout: 10 222126 17.30 MB/sec execute 556 sec latency 76.389 ms 2024-05-08T19:47:40.897 INFO:tasks.workunit.client.1.smithi177.stdout: 10 222669 17.33 MB/sec execute 557 sec latency 123.475 ms 2024-05-08T19:47:41.897 INFO:tasks.workunit.client.1.smithi177.stdout: 10 223099 17.34 MB/sec execute 558 sec latency 92.487 ms 2024-05-08T19:47:42.901 INFO:tasks.workunit.client.1.smithi177.stdout: 10 223457 17.35 MB/sec execute 559 sec latency 99.555 ms 2024-05-08T19:47:43.908 INFO:tasks.workunit.client.1.smithi177.stdout: 10 223745 17.35 MB/sec execute 560 sec latency 120.410 ms 2024-05-08T19:47:44.908 INFO:tasks.workunit.client.1.smithi177.stdout: 10 223755 17.32 MB/sec execute 561 sec latency 1107.328 ms 2024-05-08T19:47:45.905 INFO:tasks.workunit.client.1.smithi177.stdout: 10 223775 17.29 MB/sec execute 562 sec latency 1547.484 ms 2024-05-08T19:47:46.905 INFO:tasks.workunit.client.1.smithi177.stdout: 10 224017 17.29 MB/sec execute 563 sec latency 1107.799 ms 2024-05-08T19:47:47.909 INFO:tasks.workunit.client.1.smithi177.stdout: 10 224161 17.27 MB/sec execute 564 sec latency 173.743 ms 2024-05-08T19:47:48.907 INFO:tasks.workunit.client.1.smithi177.stdout: 10 224271 17.25 MB/sec execute 565 sec latency 196.426 ms 2024-05-08T19:47:49.907 INFO:tasks.workunit.client.1.smithi177.stdout: 10 224539 17.23 MB/sec execute 566 sec latency 152.602 ms 2024-05-08T19:47:50.907 INFO:tasks.workunit.client.1.smithi177.stdout: 10 224886 17.22 MB/sec execute 567 sec latency 78.473 ms 2024-05-08T19:47:51.907 INFO:tasks.workunit.client.1.smithi177.stdout: 10 225036 17.20 MB/sec execute 568 sec latency 192.818 ms 2024-05-08T19:47:52.907 INFO:tasks.workunit.client.1.smithi177.stdout: 10 225406 17.21 MB/sec execute 569 sec latency 217.371 ms 2024-05-08T19:47:53.911 INFO:tasks.workunit.client.1.smithi177.stdout: 10 225892 17.24 MB/sec execute 570 sec latency 92.695 ms 2024-05-08T19:47:54.909 INFO:tasks.workunit.client.1.smithi177.stdout: 10 226431 17.24 MB/sec execute 571 sec latency 119.312 ms 2024-05-08T19:47:55.910 INFO:tasks.workunit.client.1.smithi177.stdout: 10 226756 17.26 MB/sec execute 572 sec latency 93.163 ms 2024-05-08T19:47:56.910 INFO:tasks.workunit.client.1.smithi177.stdout: 10 227181 17.28 MB/sec execute 573 sec latency 104.098 ms 2024-05-08T19:47:57.917 INFO:tasks.workunit.client.1.smithi177.stdout: 10 227433 17.28 MB/sec execute 574 sec latency 141.696 ms 2024-05-08T19:47:58.917 INFO:tasks.workunit.client.1.smithi177.stdout: 10 227642 17.27 MB/sec execute 575 sec latency 135.217 ms 2024-05-08T19:47:59.920 INFO:tasks.workunit.client.1.smithi177.stdout: 10 227984 17.26 MB/sec execute 576 sec latency 122.713 ms 2024-05-08T19:48:00.917 INFO:tasks.workunit.client.1.smithi177.stdout: 10 228407 17.25 MB/sec execute 577 sec latency 65.753 ms 2024-05-08T19:48:01.917 INFO:tasks.workunit.client.1.smithi177.stdout: 10 228583 17.24 MB/sec execute 578 sec latency 122.608 ms 2024-05-08T19:48:02.917 INFO:tasks.workunit.client.1.smithi177.stdout: 10 229072 17.26 MB/sec execute 579 sec latency 121.182 ms 2024-05-08T19:48:03.923 INFO:tasks.workunit.client.1.smithi177.stdout: 10 229676 17.29 MB/sec execute 580 sec latency 76.355 ms 2024-05-08T19:48:04.923 INFO:tasks.workunit.client.1.smithi177.stdout: 10 230114 17.29 MB/sec execute 581 sec latency 76.450 ms 2024-05-08T19:48:05.923 INFO:tasks.workunit.client.1.smithi177.stdout: 10 230499 17.32 MB/sec execute 582 sec latency 128.781 ms 2024-05-08T19:48:06.926 INFO:tasks.workunit.client.1.smithi177.stdout: 10 230845 17.32 MB/sec execute 583 sec latency 121.501 ms 2024-05-08T19:48:07.927 INFO:tasks.workunit.client.1.smithi177.stdout: 10 231155 17.33 MB/sec execute 584 sec latency 121.056 ms 2024-05-08T19:48:08.927 INFO:tasks.workunit.client.1.smithi177.stdout: 10 231443 17.31 MB/sec execute 585 sec latency 108.197 ms 2024-05-08T19:48:09.927 INFO:tasks.workunit.client.1.smithi177.stdout: 10 231797 17.30 MB/sec execute 586 sec latency 121.218 ms 2024-05-08T19:48:10.930 INFO:tasks.workunit.client.1.smithi177.stdout: 10 231983 17.29 MB/sec execute 587 sec latency 252.735 ms 2024-05-08T19:48:11.930 INFO:tasks.workunit.client.1.smithi177.stdout: 10 232373 17.29 MB/sec execute 588 sec latency 111.031 ms 2024-05-08T19:48:12.930 INFO:tasks.workunit.client.1.smithi177.stdout: 10 232930 17.33 MB/sec execute 589 sec latency 56.379 ms 2024-05-08T19:48:13.930 INFO:tasks.workunit.client.1.smithi177.stdout: 10 233466 17.33 MB/sec execute 590 sec latency 115.365 ms 2024-05-08T19:48:14.930 INFO:tasks.workunit.client.1.smithi177.stdout: 10 233882 17.35 MB/sec execute 591 sec latency 52.617 ms 2024-05-08T19:48:15.930 INFO:tasks.workunit.client.1.smithi177.stdout: 10 234243 17.36 MB/sec execute 592 sec latency 164.584 ms 2024-05-08T19:48:16.931 INFO:tasks.workunit.client.1.smithi177.stdout: 10 234540 17.37 MB/sec execute 593 sec latency 135.681 ms 2024-05-08T19:48:17.930 INFO:tasks.workunit.client.1.smithi177.stdout: 10 234802 17.36 MB/sec execute 594 sec latency 123.200 ms 2024-05-08T19:48:18.931 INFO:tasks.workunit.client.1.smithi177.stdout: 10 235155 17.35 MB/sec execute 595 sec latency 101.103 ms 2024-05-08T19:48:19.932 INFO:tasks.workunit.client.1.smithi177.stdout: 10 235307 17.33 MB/sec execute 596 sec latency 310.514 ms 2024-05-08T19:48:20.932 INFO:tasks.workunit.client.1.smithi177.stdout: 10 235319 17.30 MB/sec execute 597 sec latency 1310.554 ms 2024-05-08T19:48:21.936 INFO:tasks.workunit.client.1.smithi177.stdout: 10 235323 17.27 MB/sec execute 598 sec latency 2312.916 ms 2024-05-08T19:48:22.934 INFO:tasks.workunit.client.1.smithi177.stdout: 10 235330 17.24 MB/sec execute 599 sec latency 2859.259 ms 2024-05-08T19:48:23.934 INFO:tasks.workunit.client.1.smithi177.stdout: 10 cleanup 600 sec 2024-05-08T19:48:24.934 INFO:tasks.workunit.client.1.smithi177.stdout: 10 cleanup 601 sec 2024-05-08T19:48:25.387 INFO:tasks.workunit.client.1.smithi177.stdout: 0 cleanup 602 sec 2024-05-08T19:48:25.387 INFO:tasks.workunit.client.1.smithi177.stdout: 2024-05-08T19:48:25.388 INFO:tasks.workunit.client.1.smithi177.stdout: Operation Count AvgLat MaxLat 2024-05-08T19:48:25.388 INFO:tasks.workunit.client.1.smithi177.stdout: ---------------------------------------- 2024-05-08T19:48:25.388 INFO:tasks.workunit.client.1.smithi177.stdout: NTCreateX 331771 7.235 1917.050 2024-05-08T19:48:25.388 INFO:tasks.workunit.client.1.smithi177.stdout: Close 243675 0.007 990.911 2024-05-08T19:48:25.388 INFO:tasks.workunit.client.1.smithi177.stdout: Rename 14045 28.573 2859.252 2024-05-08T19:48:25.388 INFO:tasks.workunit.client.1.smithi177.stdout: Unlink 66981 12.231 1866.697 2024-05-08T19:48:25.388 INFO:tasks.workunit.client.1.smithi177.stdout: Qpathinfo 301066 5.145 2075.208 2024-05-08T19:48:25.388 INFO:tasks.workunit.client.1.smithi177.stdout: Qfileinfo 52467 0.001 0.022 2024-05-08T19:48:25.388 INFO:tasks.workunit.client.1.smithi177.stdout: Qfsinfo 55076 0.656 38.274 2024-05-08T19:48:25.388 INFO:tasks.workunit.client.1.smithi177.stdout: Sfileinfo 26994 1.488 674.187 2024-05-08T19:48:25.388 INFO:tasks.workunit.client.1.smithi177.stdout: Find 116230 0.792 1705.683 2024-05-08T19:48:25.389 INFO:tasks.workunit.client.1.smithi177.stdout: WriteX 163828 0.366 2766.026 2024-05-08T19:48:25.389 INFO:tasks.workunit.client.1.smithi177.stdout: ReadX 520156 0.093 2262.032 2024-05-08T19:48:25.389 INFO:tasks.workunit.client.1.smithi177.stdout: LockX 1080 9.657 368.842 2024-05-08T19:48:25.389 INFO:tasks.workunit.client.1.smithi177.stdout: UnlockX 1080 9.226 622.902 2024-05-08T19:48:25.389 INFO:tasks.workunit.client.1.smithi177.stdout: Flush 23157 22.910 2365.874 2024-05-08T19:48:25.389 INFO:tasks.workunit.client.1.smithi177.stdout: 2024-05-08T19:48:25.389 INFO:tasks.workunit.client.1.smithi177.stdout:Throughput 17.2422 MB/sec 10 clients 10 procs max_latency=2859.259 ms 2024-05-08T19:48:25.428 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T19:48:25.428 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-05-08T19:48:28.336 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.1... 2024-05-08T19:48:28.337 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-05-08T19:48:28.963 DEBUG:teuthology.parallel:result is None 2024-05-08T19:48:28.964 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-05-08T19:48:29.230 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-05-08T19:48:29.231 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-08T19:48:29.231 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:48:29.231 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T19:48:29.377 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-05-08T19:48:29.377 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T19:48:29.527 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:48:30.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.250+0000 7f1f0503e700 1 Processor -- start 2024-05-08T19:48:30.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.251+0000 7f1f0503e700 1 -- start start 2024-05-08T19:48:30.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.251+0000 7f1f0503e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f000c2b10 0x7f1f000a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:30.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.251+0000 7f1f0503e700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1f000a89f0 0x7f1f0014ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:30.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.251+0000 7f1f0503e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f000c2880 con 0x7f1f000c1d90 2024-05-08T19:48:30.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.251+0000 7f1f0503e700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f000c3970 con 0x7f1f000a89f0 2024-05-08T19:48:30.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.251+0000 7f1f0503e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f000c3690 con 0x7f1f000c2b10 2024-05-08T19:48:30.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.251+0000 7f1eff59e700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1f000a89f0 0x7f1f0014ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:30.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.252+0000 7f1eff59e700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1f000a89f0 0x7f1f0014ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44118/0 (socket says 172.21.15.47:44118) 2024-05-08T19:48:30.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.252+0000 7f1eff59e700 1 -- 172.21.15.47:0/2817859807 learned_addr learned my addr 172.21.15.47:0/2817859807 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:30.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.252+0000 7f1efe59c700 1 --2- 172.21.15.47:0/2817859807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f000c2b10 0x7f1f000a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:30.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.252+0000 7f1eff59e700 1 -- 172.21.15.47:0/2817859807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f000c2b10 msgr2=0x7f1f000a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:30.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.252+0000 7f1eff59e700 1 --2- 172.21.15.47:0/2817859807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f000c2b10 0x7f1f000a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:30.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.252+0000 7f1eff59e700 1 -- 172.21.15.47:0/2817859807 >> v1:172.21.15.177:6789/0 conn(0x7f1f000c1d90 legacy=0x7f1f000c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:30.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.252+0000 7f1eff59e700 1 -- 172.21.15.47:0/2817859807 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f00154d00 con 0x7f1f000a89f0 2024-05-08T19:48:30.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.252+0000 7f1eff59e700 1 --2- 172.21.15.47:0/2817859807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f000a89f0 0x7f1f0014ea40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800bbc0 tx=0x7f1ef800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6140fde05eb4aec0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:30.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.252+0000 7f1efdd9b700 1 -- 172.21.15.47:0/2817859807 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef800dd50 con 0x7f1f000a89f0 2024-05-08T19:48:30.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.252+0000 7f1efdd9b700 1 -- 172.21.15.47:0/2817859807 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef8010470 con 0x7f1f000a89f0 2024-05-08T19:48:30.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.252+0000 7f1efdd9b700 1 -- 172.21.15.47:0/2817859807 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8010800 con 0x7f1f000a89f0 2024-05-08T19:48:30.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.253+0000 7f1f0503e700 1 -- 172.21.15.47:0/2817859807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f000a89f0 msgr2=0x7f1f0014ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:30.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.253+0000 7f1f0503e700 1 --2- 172.21.15.47:0/2817859807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f000a89f0 0x7f1f0014ea40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800bbc0 tx=0x7f1ef800bed0 comp rx=0 tx=0).stop 2024-05-08T19:48:30.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.253+0000 7f1f0503e700 1 -- 172.21.15.47:0/2817859807 shutdown_connections 2024-05-08T19:48:30.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.253+0000 7f1f0503e700 1 --2- 172.21.15.47:0/2817859807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f000a89f0 0x7f1f0014ea40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:30.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.253+0000 7f1f0503e700 1 --2- 172.21.15.47:0/2817859807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f000c2b10 0x7f1f000a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:30.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.253+0000 7f1f0503e700 1 -- 172.21.15.47:0/2817859807 >> 172.21.15.47:0/2817859807 conn(0x7f1f000c3c20 msgr2=0x7f1f000c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:30.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.253+0000 7f1f0503e700 1 -- 172.21.15.47:0/2817859807 shutdown_connections 2024-05-08T19:48:30.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.253+0000 7f1f0503e700 1 -- 172.21.15.47:0/2817859807 wait complete. 2024-05-08T19:48:30.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.254+0000 7f1f0503e700 1 Processor -- start 2024-05-08T19:48:30.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.255+0000 7f1f0503e700 1 -- start start 2024-05-08T19:48:30.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.255+0000 7f1f0503e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f000c1d90 0x7f1f001542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:30.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.255+0000 7f1f0503e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f000c2b10 0x7f1f0013faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:30.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.255+0000 7f1f0503e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f001e9c90 0x7f1f001ed820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:30.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.255+0000 7f1f0503e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f001dcd60 con 0x7f1f000c2b10 2024-05-08T19:48:30.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.255+0000 7f1f0503e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f001db8c0 con 0x7f1f000c1d90 2024-05-08T19:48:30.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.255+0000 7f1f0503e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f001db5e0 con 0x7f1f001e9c90 2024-05-08T19:48:30.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1efe59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f000c2b10 0x7f1f0013faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:30.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1efe59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f000c2b10 0x7f1f0013faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44120/0 (socket says 172.21.15.47:44120) 2024-05-08T19:48:30.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1efe59c700 1 -- 172.21.15.47:0/2318062340 learned_addr learned my addr 172.21.15.47:0/2318062340 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:30.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1efed9d700 1 --2- 172.21.15.47:0/2318062340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f000c1d90 0x7f1f001542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:30.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1eff59e700 1 --2- 172.21.15.47:0/2318062340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f001e9c90 0x7f1f001ed820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:30.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1efe59c700 1 -- 172.21.15.47:0/2318062340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f001e9c90 msgr2=0x7f1f001ed820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:30.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1efe59c700 1 --2- 172.21.15.47:0/2318062340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f001e9c90 0x7f1f001ed820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:30.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1efe59c700 1 -- 172.21.15.47:0/2318062340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f000c1d90 msgr2=0x7f1f001542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:30.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1efe59c700 1 --2- 172.21.15.47:0/2318062340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f000c1d90 0x7f1f001542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:30.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1efe59c700 1 -- 172.21.15.47:0/2318062340 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef800b7f0 con 0x7f1f000c2b10 2024-05-08T19:48:30.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1efe59c700 1 --2- 172.21.15.47:0/2318062340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f000c2b10 0x7f1f0013faa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800d800 tx=0x7f1ee800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:30.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1ef77fe700 1 -- 172.21.15.47:0/2318062340 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80125f0 con 0x7f1f000c2b10 2024-05-08T19:48:30.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1ef77fe700 1 -- 172.21.15.47:0/2318062340 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee8012750 con 0x7f1f000c2b10 2024-05-08T19:48:30.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1f0503e700 1 -- 172.21.15.47:0/2318062340 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f001dcf70 con 0x7f1f000c2b10 2024-05-08T19:48:30.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1ef77fe700 1 -- 172.21.15.47:0/2318062340 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8012b00 con 0x7f1f000c2b10 2024-05-08T19:48:30.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.256+0000 7f1f0503e700 1 -- 172.21.15.47:0/2318062340 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f001ed300 con 0x7f1f000c2b10 2024-05-08T19:48:30.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.257+0000 7f1f0503e700 1 -- 172.21.15.47:0/2318062340 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f001ed4c0 con 0x7f1f000c2b10 2024-05-08T19:48:30.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.258+0000 7f1ef77fe700 1 -- 172.21.15.47:0/2318062340 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1ee8012c60 con 0x7f1f000c2b10 2024-05-08T19:48:30.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.258+0000 7f1ef77fe700 1 --2- 172.21.15.47:0/2318062340 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1ee006ac90 0x7f1ee006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:30.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.258+0000 7f1ef77fe700 1 -- 172.21.15.47:0/2318062340 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1ee8089640 con 0x7f1f000c2b10 2024-05-08T19:48:30.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.259+0000 7f1efed9d700 1 --2- 172.21.15.47:0/2318062340 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1ee006ac90 0x7f1ee006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:30.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.263+0000 7f1ef77fe700 1 -- 172.21.15.47:0/2318062340 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1ee80544f0 con 0x7f1f000c2b10 2024-05-08T19:48:30.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.330+0000 7f1efed9d700 1 --2- 172.21.15.47:0/2318062340 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1ee006ac90 0x7f1ee006d150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00012e0 tx=0x7f1ef0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:30.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.472+0000 7f1f0503e700 1 -- 172.21.15.47:0/2318062340 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f001ed670 con 0x7f1f000c2b10 2024-05-08T19:48:30.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.473+0000 7f1ef77fe700 1 -- 172.21.15.47:0/2318062340 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f1ee8057b10 con 0x7f1f000c2b10 2024-05-08T19:48:30.464 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:48:30.464 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:23:11.040286+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:48:30.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.475+0000 7f1f0503e700 1 -- 172.21.15.47:0/2318062340 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1ee006ac90 msgr2=0x7f1ee006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:30.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.475+0000 7f1f0503e700 1 --2- 172.21.15.47:0/2318062340 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1ee006ac90 0x7f1ee006d150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00012e0 tx=0x7f1ef0009040 comp rx=0 tx=0).stop 2024-05-08T19:48:30.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.475+0000 7f1f0503e700 1 -- 172.21.15.47:0/2318062340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f000c2b10 msgr2=0x7f1f0013faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:30.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.475+0000 7f1f0503e700 1 --2- 172.21.15.47:0/2318062340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f000c2b10 0x7f1f0013faa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800d800 tx=0x7f1ee800db10 comp rx=0 tx=0).stop 2024-05-08T19:48:30.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.475+0000 7f1f0503e700 1 -- 172.21.15.47:0/2318062340 shutdown_connections 2024-05-08T19:48:30.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.475+0000 7f1f0503e700 1 --2- 172.21.15.47:0/2318062340 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1ee006ac90 0x7f1ee006d150 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:30.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.475+0000 7f1f0503e700 1 --2- 172.21.15.47:0/2318062340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f001e9c90 0x7f1f001ed820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:30.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.475+0000 7f1f0503e700 1 --2- 172.21.15.47:0/2318062340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f000c1d90 0x7f1f001542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:30.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.475+0000 7f1f0503e700 1 --2- 172.21.15.47:0/2318062340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f000c2b10 0x7f1f0013faa0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:30.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.475+0000 7f1f0503e700 1 -- 172.21.15.47:0/2318062340 >> 172.21.15.47:0/2318062340 conn(0x7f1f000c3c20 msgr2=0x7f1f000c2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:30.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.475+0000 7f1f0503e700 1 -- 172.21.15.47:0/2318062340 shutdown_connections 2024-05-08T19:48:30.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.475+0000 7f1f0503e700 1 -- 172.21.15.47:0/2318062340 wait complete. 2024-05-08T19:48:30.478 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T19:22:15.923832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T19:22:18.529792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T19:22:19.389797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T19:22:22.474001+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T19:48:30.479 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T19:48:30.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.618+0000 7fbca042e700 1 Processor -- start 2024-05-08T19:48:30.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.619+0000 7fbca042e700 1 -- start start 2024-05-08T19:48:30.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.619+0000 7fbca042e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980a9d70 0x7fbc98152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:30.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.619+0000 7fbca042e700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc98153420 con 0x7fbc9806e730 2024-05-08T19:48:30.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.619+0000 7fbca042e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc980a8550 con 0x7fbc9814ff90 2024-05-08T19:48:30.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.620+0000 7fbca042e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc980a8830 con 0x7fbc980a9d70 2024-05-08T19:48:30.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.620+0000 7fbc9d9c9700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbc9806e730 0x7fbc981527d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57372/0 (socket says 172.21.15.47:57372) 2024-05-08T19:48:30.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.620+0000 7fbc9d9c9700 1 -- 172.21.15.47:0/673107307 learned_addr learned my addr 172.21.15.47:0/673107307 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:48:30.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.620+0000 7fbc9e9cb700 1 --2- 172.21.15.47:0/673107307 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980a9d70 0x7fbc98152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:30.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.620+0000 7fbc9d1c8700 1 -- 172.21.15.47:0/673107307 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776765913 0 0) 0x7fbc98153420 con 0x7fbc9806e730 2024-05-08T19:48:30.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.620+0000 7fbc9d1c8700 1 -- 172.21.15.47:0/673107307 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc840035b0 con 0x7fbc9806e730 2024-05-08T19:48:30.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.620+0000 7fbc9e9cb700 1 -- 172.21.15.47:0/673107307 >> v1:172.21.15.177:6789/0 conn(0x7fbc9814ff90 legacy=0x7fbc980ac5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:30.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.620+0000 7fbc9e9cb700 1 -- 172.21.15.47:0/673107307 >> v1:172.21.15.47:6789/0 conn(0x7fbc9806e730 legacy=0x7fbc981527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:30.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.620+0000 7fbc9e9cb700 1 -- 172.21.15.47:0/673107307 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9806f540 con 0x7fbc980a9d70 2024-05-08T19:48:30.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.620+0000 7fbc9e9cb700 1 --2- 172.21.15.47:0/673107307 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980a9d70 0x7fbc98152ee0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009dc0 tx=0x7fbc9000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69f523da12369ff2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:30.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.791+0000 7fbc9d1c8700 1 -- 172.21.15.47:0/673107307 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9000e070 con 0x7fbc980a9d70 2024-05-08T19:48:30.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.791+0000 7fbc9d1c8700 1 -- 172.21.15.47:0/673107307 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9000bb20 con 0x7fbc980a9d70 2024-05-08T19:48:30.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.791+0000 7fbc9d1c8700 1 -- 172.21.15.47:0/673107307 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90012430 con 0x7fbc980a9d70 2024-05-08T19:48:30.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.791+0000 7fbca042e700 1 -- 172.21.15.47:0/673107307 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980a9d70 msgr2=0x7fbc98152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:30.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.791+0000 7fbca042e700 1 --2- 172.21.15.47:0/673107307 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980a9d70 0x7fbc98152ee0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009dc0 tx=0x7fbc9000b330 comp rx=0 tx=0).stop 2024-05-08T19:48:30.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.791+0000 7fbca042e700 1 -- 172.21.15.47:0/673107307 shutdown_connections 2024-05-08T19:48:30.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.791+0000 7fbca042e700 1 --2- 172.21.15.47:0/673107307 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980a9d70 0x7fbc98152ee0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:30.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.791+0000 7fbca042e700 1 -- 172.21.15.47:0/673107307 >> 172.21.15.47:0/673107307 conn(0x7fbc980c71c0 msgr2=0x7fbc980c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:30.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.791+0000 7fbca042e700 1 -- 172.21.15.47:0/673107307 shutdown_connections 2024-05-08T19:48:30.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.791+0000 7fbca042e700 1 -- 172.21.15.47:0/673107307 wait complete. 2024-05-08T19:48:30.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.792+0000 7fbca042e700 1 Processor -- start 2024-05-08T19:48:30.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.792+0000 7fbca042e700 1 -- start start 2024-05-08T19:48:30.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbca042e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9806e730 0x7fbc9814ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbca042e700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980a9d70 0x7fbc98144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbca042e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc9814ff90 0x7fbc98142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbca042e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9806f820 con 0x7fbc9814ff90 2024-05-08T19:48:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbca042e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc98154e30 con 0x7fbc9806e730 2024-05-08T19:48:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbca042e700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc980ad520 con 0x7fbc980a9d70 2024-05-08T19:48:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbc9e9cb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc9814ff90 0x7fbc98142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbc9e9cb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc9814ff90 0x7fbc98142ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44126/0 (socket says 172.21.15.47:44126) 2024-05-08T19:48:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbc9e9cb700 1 -- 172.21.15.47:0/2145532955 learned_addr learned my addr 172.21.15.47:0/2145532955 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbc9e1ca700 1 --2- 172.21.15.47:0/2145532955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9806e730 0x7fbc9814ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbc9d9c9700 1 --2- 172.21.15.47:0/2145532955 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980a9d70 0x7fbc98144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbc9e9cb700 1 -- 172.21.15.47:0/2145532955 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980a9d70 msgr2=0x7fbc98144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbc9e9cb700 1 --2- 172.21.15.47:0/2145532955 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980a9d70 0x7fbc98144d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbc9e9cb700 1 -- 172.21.15.47:0/2145532955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9806e730 msgr2=0x7fbc9814ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbc9e9cb700 1 --2- 172.21.15.47:0/2145532955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9806e730 0x7fbc9814ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:30.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.793+0000 7fbc9e9cb700 1 -- 172.21.15.47:0/2145532955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc90009a70 con 0x7fbc9814ff90 2024-05-08T19:48:30.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.794+0000 7fbc9e9cb700 1 --2- 172.21.15.47:0/2145532955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc9814ff90 0x7fbc98142ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbc90014040 tx=0x7fbc90004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:30.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.794+0000 7fbc8effd700 1 -- 172.21.15.47:0/2145532955 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90012430 con 0x7fbc9814ff90 2024-05-08T19:48:30.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.794+0000 7fbc8effd700 1 -- 172.21.15.47:0/2145532955 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc90020070 con 0x7fbc9814ff90 2024-05-08T19:48:30.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.794+0000 7fbc8effd700 1 -- 172.21.15.47:0/2145532955 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90004280 con 0x7fbc9814ff90 2024-05-08T19:48:30.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.794+0000 7fbca042e700 1 -- 172.21.15.47:0/2145532955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9814bd50 con 0x7fbc9814ff90 2024-05-08T19:48:30.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.794+0000 7fbca042e700 1 -- 172.21.15.47:0/2145532955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc98155080 con 0x7fbc9814ff90 2024-05-08T19:48:30.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.795+0000 7fbca042e700 1 -- 172.21.15.47:0/2145532955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9804ec60 con 0x7fbc9814ff90 2024-05-08T19:48:30.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.795+0000 7fbc8effd700 1 -- 172.21.15.47:0/2145532955 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbc900043e0 con 0x7fbc9814ff90 2024-05-08T19:48:30.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.796+0000 7fbc8effd700 1 --2- 172.21.15.47:0/2145532955 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fbc7c06ac90 0x7fbc7c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:30.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.796+0000 7fbc8effd700 1 -- 172.21.15.47:0/2145532955 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbc90022070 con 0x7fbc9814ff90 2024-05-08T19:48:30.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.796+0000 7fbc9e1ca700 1 --2- 172.21.15.47:0/2145532955 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fbc7c06ac90 0x7fbc7c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:30.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.797+0000 7fbc9e1ca700 1 --2- 172.21.15.47:0/2145532955 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fbc7c06ac90 0x7fbc7c06d150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbc94007fd0 tx=0x7fbc94009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:30.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:30.801+0000 7fbc8effd700 1 -- 172.21.15.47:0/2145532955 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbc90056060 con 0x7fbc9814ff90 2024-05-08T19:48:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.007+0000 7fbca042e700 1 -- 172.21.15.47:0/2145532955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc980c7f80 con 0x7fbc9814ff90 2024-05-08T19:48:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.007+0000 7fbc8effd700 1 -- 172.21.15.47:0/2145532955 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc90059680 con 0x7fbc9814ff90 2024-05-08T19:48:30.998 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-08T19:48:31.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.010+0000 7fbca042e700 1 -- 172.21.15.47:0/2145532955 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fbc7c06ac90 msgr2=0x7fbc7c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.010+0000 7fbca042e700 1 --2- 172.21.15.47:0/2145532955 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fbc7c06ac90 0x7fbc7c06d150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbc94007fd0 tx=0x7fbc94009040 comp rx=0 tx=0).stop 2024-05-08T19:48:31.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.010+0000 7fbca042e700 1 -- 172.21.15.47:0/2145532955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc9814ff90 msgr2=0x7fbc98142ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.010+0000 7fbca042e700 1 --2- 172.21.15.47:0/2145532955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc9814ff90 0x7fbc98142ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbc90014040 tx=0x7fbc90004ad0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.010+0000 7fbca042e700 1 -- 172.21.15.47:0/2145532955 shutdown_connections 2024-05-08T19:48:31.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.010+0000 7fbca042e700 1 --2- 172.21.15.47:0/2145532955 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fbc7c06ac90 0x7fbc7c06d150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.010+0000 7fbca042e700 1 --2- 172.21.15.47:0/2145532955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc9814ff90 0x7fbc98142ab0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.010+0000 7fbca042e700 1 --2- 172.21.15.47:0/2145532955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9806e730 0x7fbc9814ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.010+0000 7fbca042e700 1 --2- 172.21.15.47:0/2145532955 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc980a9d70 0x7fbc98144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.010+0000 7fbca042e700 1 -- 172.21.15.47:0/2145532955 >> 172.21.15.47:0/2145532955 conn(0x7fbc980c71c0 msgr2=0x7fbc9814d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:31.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.010+0000 7fbca042e700 1 -- 172.21.15.47:0/2145532955 shutdown_connections 2024-05-08T19:48:31.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.010+0000 7fbca042e700 1 -- 172.21.15.47:0/2145532955 wait complete. 2024-05-08T19:48:31.012 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T19:48:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.150+0000 7fac839bd700 1 Processor -- start 2024-05-08T19:48:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.151+0000 7fac839bd700 1 -- start start 2024-05-08T19:48:31.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.151+0000 7fac839bd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fac7c0c6d70 0x7fac7c06e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.151+0000 7fac839bd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac7c0c8050 0x7fac7c0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.151+0000 7fac839bd700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c1536f0 con 0x7fac7c0ada50 2024-05-08T19:48:31.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.151+0000 7fac839bd700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac7c153190 con 0x7fac7c0c6d70 2024-05-08T19:48:31.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.151+0000 7fac839bd700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c0c7da0 con 0x7fac7c0c8050 2024-05-08T19:48:31.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.152+0000 7fac81759700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fac7c0c6d70 0x7fac7c06e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.152+0000 7fac81f5a700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac7c0c8050 0x7fac7c0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.152+0000 7fac80f58700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fac7c0ada50 0x7fac7c0c7690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:47434/0 (socket says 172.21.15.47:47434) 2024-05-08T19:48:31.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.152+0000 7fac80f58700 1 -- 172.21.15.47:0/882143577 learned_addr learned my addr 172.21.15.47:0/882143577 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:48:31.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.152+0000 7fac73fff700 1 -- 172.21.15.47:0/882143577 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702435174 0 0) 0x7fac7c1536f0 con 0x7fac7c0ada50 2024-05-08T19:48:31.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.152+0000 7fac73fff700 1 -- 172.21.15.47:0/882143577 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac680035b0 con 0x7fac7c0ada50 2024-05-08T19:48:31.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.152+0000 7fac81f5a700 1 -- 172.21.15.47:0/882143577 >> v2:172.21.15.177:3300/0 conn(0x7fac7c0c6d70 msgr2=0x7fac7c06e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:31.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.152+0000 7fac81f5a700 1 --2- 172.21.15.47:0/882143577 >> v2:172.21.15.177:3300/0 conn(0x7fac7c0c6d70 0x7fac7c06e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.152+0000 7fac81f5a700 1 -- 172.21.15.47:0/882143577 >> v1:172.21.15.177:6789/0 conn(0x7fac7c0ada50 legacy=0x7fac7c0c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.152+0000 7fac81f5a700 1 -- 172.21.15.47:0/882143577 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c070860 con 0x7fac7c0c8050 2024-05-08T19:48:31.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.152+0000 7fac81759700 1 --2- 172.21.15.47:0/882143577 >> v2:172.21.15.177:3300/0 conn(0x7fac7c0c6d70 0x7fac7c06e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:48:31.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.152+0000 7fac81f5a700 1 --2- 172.21.15.47:0/882143577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac7c0c8050 0x7fac7c0c8500 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac74009d90 tx=0x7fac7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efd8fef6df35e08f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:31.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.152+0000 7fac73fff700 1 -- 172.21.15.47:0/882143577 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7400e070 con 0x7fac7c0c8050 2024-05-08T19:48:31.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.152+0000 7fac73fff700 1 -- 172.21.15.47:0/882143577 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7400bb20 con 0x7fac7c0c8050 2024-05-08T19:48:31.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.153+0000 7fac73fff700 1 -- 172.21.15.47:0/882143577 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac74012430 con 0x7fac7c0c8050 2024-05-08T19:48:31.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.153+0000 7fac839bd700 1 -- 172.21.15.47:0/882143577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac7c0c8050 msgr2=0x7fac7c0c8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.153+0000 7fac839bd700 1 --2- 172.21.15.47:0/882143577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac7c0c8050 0x7fac7c0c8500 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac74009d90 tx=0x7fac7400b330 comp rx=0 tx=0).stop 2024-05-08T19:48:31.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.153+0000 7fac839bd700 1 -- 172.21.15.47:0/882143577 shutdown_connections 2024-05-08T19:48:31.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.153+0000 7fac839bd700 1 --2- 172.21.15.47:0/882143577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac7c0c8050 0x7fac7c0c8500 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.153+0000 7fac839bd700 1 --2- 172.21.15.47:0/882143577 >> v2:172.21.15.177:3300/0 conn(0x7fac7c0c6d70 0x7fac7c06e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.153+0000 7fac839bd700 1 -- 172.21.15.47:0/882143577 >> 172.21.15.47:0/882143577 conn(0x7fac7c06b1b0 msgr2=0x7fac7c0a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:31.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.153+0000 7fac839bd700 1 -- 172.21.15.47:0/882143577 shutdown_connections 2024-05-08T19:48:31.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.153+0000 7fac839bd700 1 -- 172.21.15.47:0/882143577 wait complete. 2024-05-08T19:48:31.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.154+0000 7fac839bd700 1 Processor -- start 2024-05-08T19:48:31.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.154+0000 7fac839bd700 1 -- start start 2024-05-08T19:48:31.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.155+0000 7fac839bd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac7c0ada50 0x7fac7c0a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.155+0000 7fac839bd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac7c0c6d70 0x7fac7c1e9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.155+0000 7fac839bd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac7c0c8050 0x7fac7c1e9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.155+0000 7fac839bd700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c1546e0 con 0x7fac7c0ada50 2024-05-08T19:48:31.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.155+0000 7fac839bd700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c1dd110 con 0x7fac7c0c8050 2024-05-08T19:48:31.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.155+0000 7fac839bd700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c1540b0 con 0x7fac7c0c6d70 2024-05-08T19:48:31.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.155+0000 7fac81759700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac7c0ada50 0x7fac7c0a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.155+0000 7fac81759700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac7c0ada50 0x7fac7c0a8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44130/0 (socket says 172.21.15.47:44130) 2024-05-08T19:48:31.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.155+0000 7fac81759700 1 -- 172.21.15.47:0/306853068 learned_addr learned my addr 172.21.15.47:0/306853068 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:31.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.155+0000 7fac80f58700 1 --2- 172.21.15.47:0/306853068 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac7c0c6d70 0x7fac7c1e9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.155+0000 7fac81f5a700 1 --2- 172.21.15.47:0/306853068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac7c0c8050 0x7fac7c1e9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.155+0000 7fac81759700 1 -- 172.21.15.47:0/306853068 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac7c0c6d70 msgr2=0x7fac7c1e9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.155+0000 7fac81759700 1 --2- 172.21.15.47:0/306853068 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac7c0c6d70 0x7fac7c1e9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.155+0000 7fac81759700 1 -- 172.21.15.47:0/306853068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac7c0c8050 msgr2=0x7fac7c1e9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.156+0000 7fac81759700 1 --2- 172.21.15.47:0/306853068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac7c0c8050 0x7fac7c1e9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.156+0000 7fac81759700 1 -- 172.21.15.47:0/306853068 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac780094a0 con 0x7fac7c0ada50 2024-05-08T19:48:31.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.156+0000 7fac81759700 1 --2- 172.21.15.47:0/306853068 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac7c0ada50 0x7fac7c0a8bc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fac7800ec10 tx=0x7fac7800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:31.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.156+0000 7fac71ffb700 1 -- 172.21.15.47:0/306853068 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7800c850 con 0x7fac7c0ada50 2024-05-08T19:48:31.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.156+0000 7fac71ffb700 1 -- 172.21.15.47:0/306853068 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7800c9b0 con 0x7fac7c0ada50 2024-05-08T19:48:31.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.156+0000 7fac71ffb700 1 -- 172.21.15.47:0/306853068 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7800cd20 con 0x7fac7c0ada50 2024-05-08T19:48:31.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.156+0000 7fac839bd700 1 -- 172.21.15.47:0/306853068 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac74009a70 con 0x7fac7c0ada50 2024-05-08T19:48:31.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.156+0000 7fac839bd700 1 -- 172.21.15.47:0/306853068 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7c1ec010 con 0x7fac7c0ada50 2024-05-08T19:48:31.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.157+0000 7fac839bd700 1 -- 172.21.15.47:0/306853068 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7c04ec60 con 0x7fac7c0ada50 2024-05-08T19:48:31.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.157+0000 7fac71ffb700 1 -- 172.21.15.47:0/306853068 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fac78013470 con 0x7fac7c0ada50 2024-05-08T19:48:31.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.158+0000 7fac71ffb700 1 --2- 172.21.15.47:0/306853068 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fac6006ac90 0x7fac6006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.158+0000 7fac71ffb700 1 -- 172.21.15.47:0/306853068 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fac78089770 con 0x7fac7c0ada50 2024-05-08T19:48:31.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.158+0000 7fac80f58700 1 --2- 172.21.15.47:0/306853068 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fac6006ac90 0x7fac6006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.159+0000 7fac80f58700 1 --2- 172.21.15.47:0/306853068 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fac6006ac90 0x7fac6006d150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fac7c14b900 tx=0x7fac6c007dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:31.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.162+0000 7fac71ffb700 1 -- 172.21.15.47:0/306853068 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fac78054580 con 0x7fac7c0ada50 2024-05-08T19:48:31.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.369+0000 7fac839bd700 1 -- 172.21.15.47:0/306853068 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fac7c0c7470 con 0x7fac7c0ada50 2024-05-08T19:48:31.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.370+0000 7fac71ffb700 1 -- 172.21.15.47:0/306853068 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fac78057ba0 con 0x7fac7c0ada50 2024-05-08T19:48:31.360 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-08T19:48:31.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.372+0000 7fac839bd700 1 -- 172.21.15.47:0/306853068 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fac6006ac90 msgr2=0x7fac6006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.372+0000 7fac839bd700 1 --2- 172.21.15.47:0/306853068 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fac6006ac90 0x7fac6006d150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fac7c14b900 tx=0x7fac6c007dc0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.372+0000 7fac839bd700 1 -- 172.21.15.47:0/306853068 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac7c0ada50 msgr2=0x7fac7c0a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.372+0000 7fac839bd700 1 --2- 172.21.15.47:0/306853068 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac7c0ada50 0x7fac7c0a8bc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fac7800ec10 tx=0x7fac7800ef20 comp rx=0 tx=0).stop 2024-05-08T19:48:31.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.372+0000 7fac839bd700 1 -- 172.21.15.47:0/306853068 shutdown_connections 2024-05-08T19:48:31.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.372+0000 7fac839bd700 1 --2- 172.21.15.47:0/306853068 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fac6006ac90 0x7fac6006d150 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.372+0000 7fac839bd700 1 --2- 172.21.15.47:0/306853068 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac7c0ada50 0x7fac7c0a8bc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.372+0000 7fac839bd700 1 --2- 172.21.15.47:0/306853068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac7c0c8050 0x7fac7c1e9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.372+0000 7fac839bd700 1 --2- 172.21.15.47:0/306853068 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac7c0c6d70 0x7fac7c1e9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.372+0000 7fac839bd700 1 -- 172.21.15.47:0/306853068 >> 172.21.15.47:0/306853068 conn(0x7fac7c06b1b0 msgr2=0x7fac7c0c22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:31.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.372+0000 7fac839bd700 1 -- 172.21.15.47:0/306853068 shutdown_connections 2024-05-08T19:48:31.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.372+0000 7fac839bd700 1 -- 172.21.15.47:0/306853068 wait complete. 2024-05-08T19:48:31.375 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T19:48:31.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.522+0000 7f364ae44700 1 Processor -- start 2024-05-08T19:48:31.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.522+0000 7f364ae44700 1 -- start start 2024-05-08T19:48:31.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.523+0000 7f364ae44700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f364414f0c0 0x7f36440a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.523+0000 7f364ae44700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f36440c2b80 0x7f364406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.523+0000 7f364ae44700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36440c29c0 con 0x7f364406bf10 2024-05-08T19:48:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.523+0000 7f364ae44700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3644072aa0 con 0x7f36440c2b80 2024-05-08T19:48:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.523+0000 7f364ae44700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364414f4a0 con 0x7f364414f0c0 2024-05-08T19:48:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.523+0000 7f3643fff700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f36440c2b80 0x7f364406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.523+0000 7f3643fff700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f36440c2b80 0x7f364406b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44136/0 (socket says 172.21.15.47:44136) 2024-05-08T19:48:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.523+0000 7f3643fff700 1 -- 172.21.15.47:0/1397604616 learned_addr learned my addr 172.21.15.47:0/1397604616 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.523+0000 7f3648be0700 1 --2- 172.21.15.47:0/1397604616 >> v2:172.21.15.177:3300/0 conn(0x7f364414f0c0 0x7f36440a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.524+0000 7f3643fff700 1 -- 172.21.15.47:0/1397604616 >> v2:172.21.15.177:3300/0 conn(0x7f364414f0c0 msgr2=0x7f36440a5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.524+0000 7f3643fff700 1 --2- 172.21.15.47:0/1397604616 >> v2:172.21.15.177:3300/0 conn(0x7f364414f0c0 0x7f36440a5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.524+0000 7f3643fff700 1 -- 172.21.15.47:0/1397604616 >> v1:172.21.15.177:6789/0 conn(0x7f364406bf10 legacy=0x7f3644070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.524+0000 7f36437fe700 1 -- 172.21.15.47:0/1397604616 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512098103 0 0) 0x7f36440c29c0 con 0x7f364406bf10 2024-05-08T19:48:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.524+0000 7f3643fff700 1 -- 172.21.15.47:0/1397604616 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3644152630 con 0x7f36440c2b80 2024-05-08T19:48:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.524+0000 7f3643fff700 1 --2- 172.21.15.47:0/1397604616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36440c2b80 0x7f364406b9d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3644066980 tx=0x7f3630009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbbbef73f00496f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.524+0000 7f36437fe700 1 -- 172.21.15.47:0/1397604616 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630011830 con 0x7f36440c2b80 2024-05-08T19:48:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.524+0000 7f36437fe700 1 -- 172.21.15.47:0/1397604616 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3630011990 con 0x7f36440c2b80 2024-05-08T19:48:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.524+0000 7f36437fe700 1 -- 172.21.15.47:0/1397604616 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630011d20 con 0x7f36440c2b80 2024-05-08T19:48:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.525+0000 7f364ae44700 1 -- 172.21.15.47:0/1397604616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36440c2b80 msgr2=0x7f364406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.525+0000 7f364ae44700 1 --2- 172.21.15.47:0/1397604616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36440c2b80 0x7f364406b9d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3644066980 tx=0x7f3630009bd0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.525+0000 7f364ae44700 1 -- 172.21.15.47:0/1397604616 shutdown_connections 2024-05-08T19:48:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.525+0000 7f364ae44700 1 --2- 172.21.15.47:0/1397604616 >> v2:172.21.15.177:3300/0 conn(0x7f364414f0c0 0x7f36440a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.525+0000 7f364ae44700 1 --2- 172.21.15.47:0/1397604616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36440c2b80 0x7f364406b9d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.525+0000 7f364ae44700 1 -- 172.21.15.47:0/1397604616 >> 172.21.15.47:0/1397604616 conn(0x7f36440c3360 msgr2=0x7f36440c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.525+0000 7f364ae44700 1 -- 172.21.15.47:0/1397604616 shutdown_connections 2024-05-08T19:48:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.525+0000 7f364ae44700 1 -- 172.21.15.47:0/1397604616 wait complete. 2024-05-08T19:48:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.526+0000 7f364ae44700 1 Processor -- start 2024-05-08T19:48:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.526+0000 7f364ae44700 1 -- start start 2024-05-08T19:48:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f364ae44700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f364406bf10 0x7f36440a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f364ae44700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36440c2b80 0x7f3644152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f364ae44700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f364414f0c0 0x7f36441eb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f364ae44700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364406ee80 con 0x7f364414f0c0 2024-05-08T19:48:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f364ae44700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364406d880 con 0x7f364406bf10 2024-05-08T19:48:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f364ae44700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364406cf70 con 0x7f36440c2b80 2024-05-08T19:48:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f36493e1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f364414f0c0 0x7f36441eb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f3648be0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f364406bf10 0x7f36440a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f3648be0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f364406bf10 0x7f36440a7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:50796/0 (socket says 172.21.15.47:50796) 2024-05-08T19:48:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f3648be0700 1 -- 172.21.15.47:0/1000535102 learned_addr learned my addr 172.21.15.47:0/1000535102 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f3643fff700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36440c2b80 0x7f3644152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f36493e1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f364414f0c0 0x7f36441eb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44140/0 (socket says 172.21.15.47:44140) 2024-05-08T19:48:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f36493e1700 1 -- 172.21.15.47:0/1000535102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36440c2b80 msgr2=0x7f3644152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f36493e1700 1 --2- 172.21.15.47:0/1000535102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36440c2b80 0x7f3644152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f36493e1700 1 -- 172.21.15.47:0/1000535102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f364406bf10 msgr2=0x7f36440a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f36493e1700 1 --2- 172.21.15.47:0/1000535102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f364406bf10 0x7f36440a7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f36493e1700 1 -- 172.21.15.47:0/1000535102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3630009550 con 0x7f364414f0c0 2024-05-08T19:48:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f3643fff700 1 --2- 172.21.15.47:0/1000535102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36440c2b80 0x7f3644152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:48:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.527+0000 7f3648be0700 1 --2- 172.21.15.47:0/1000535102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f364406bf10 0x7f36440a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:48:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.528+0000 7f36493e1700 1 --2- 172.21.15.47:0/1000535102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f364414f0c0 0x7f36441eb440 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f363c00c780 tx=0x7f363c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:31.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.529+0000 7f36417fa700 1 -- 172.21.15.47:0/1000535102 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c003e30 con 0x7f364414f0c0 2024-05-08T19:48:31.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.529+0000 7f364ae44700 1 -- 172.21.15.47:0/1000535102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364406f090 con 0x7f364414f0c0 2024-05-08T19:48:31.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.529+0000 7f36417fa700 1 -- 172.21.15.47:0/1000535102 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c0050d0 con 0x7f364414f0c0 2024-05-08T19:48:31.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.529+0000 7f36417fa700 1 -- 172.21.15.47:0/1000535102 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c005480 con 0x7f364414f0c0 2024-05-08T19:48:31.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.529+0000 7f364ae44700 1 -- 172.21.15.47:0/1000535102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364406d510 con 0x7f364414f0c0 2024-05-08T19:48:31.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.530+0000 7f364ae44700 1 -- 172.21.15.47:0/1000535102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364406d9f0 con 0x7f364414f0c0 2024-05-08T19:48:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.531+0000 7f36417fa700 1 -- 172.21.15.47:0/1000535102 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f363c0055e0 con 0x7f364414f0c0 2024-05-08T19:48:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.531+0000 7f36417fa700 1 --2- 172.21.15.47:0/1000535102 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f362806ac90 0x7f362806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.531+0000 7f36417fa700 1 -- 172.21.15.47:0/1000535102 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f363c088cf0 con 0x7f364414f0c0 2024-05-08T19:48:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.531+0000 7f3648be0700 1 --2- 172.21.15.47:0/1000535102 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f362806ac90 0x7f362806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.532+0000 7f3648be0700 1 --2- 172.21.15.47:0/1000535102 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f362806ac90 0x7f362806d150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f36380113d0 tx=0x7f3638009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:31.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.536+0000 7f36417fa700 1 -- 172.21.15.47:0/1000535102 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f363c053a80 con 0x7f364414f0c0 2024-05-08T19:48:31.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.742+0000 7f364ae44700 1 -- 172.21.15.47:0/1000535102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f364404ec60 con 0x7f364414f0c0 2024-05-08T19:48:31.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.742+0000 7f36417fa700 1 -- 172.21.15.47:0/1000535102 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f363c0170a0 con 0x7f364414f0c0 2024-05-08T19:48:31.732 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-08T19:48:31.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.744+0000 7f364ae44700 1 -- 172.21.15.47:0/1000535102 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f362806ac90 msgr2=0x7f362806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.744+0000 7f364ae44700 1 --2- 172.21.15.47:0/1000535102 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f362806ac90 0x7f362806d150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f36380113d0 tx=0x7f3638009210 comp rx=0 tx=0).stop 2024-05-08T19:48:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.744+0000 7f364ae44700 1 -- 172.21.15.47:0/1000535102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f364414f0c0 msgr2=0x7f36441eb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.744+0000 7f364ae44700 1 --2- 172.21.15.47:0/1000535102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f364414f0c0 0x7f36441eb440 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f363c00c780 tx=0x7f363c00ca90 comp rx=0 tx=0).stop 2024-05-08T19:48:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.744+0000 7f364ae44700 1 -- 172.21.15.47:0/1000535102 shutdown_connections 2024-05-08T19:48:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.744+0000 7f364ae44700 1 --2- 172.21.15.47:0/1000535102 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f362806ac90 0x7f362806d150 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.744+0000 7f364ae44700 1 --2- 172.21.15.47:0/1000535102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f364414f0c0 0x7f36441eb440 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.744+0000 7f364ae44700 1 --2- 172.21.15.47:0/1000535102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f364406bf10 0x7f36440a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.744+0000 7f364ae44700 1 --2- 172.21.15.47:0/1000535102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36440c2b80 0x7f3644152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.744+0000 7f364ae44700 1 -- 172.21.15.47:0/1000535102 >> 172.21.15.47:0/1000535102 conn(0x7f36440c3360 msgr2=0x7f36440c1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.744+0000 7f364ae44700 1 -- 172.21.15.47:0/1000535102 shutdown_connections 2024-05-08T19:48:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.744+0000 7f364ae44700 1 -- 172.21.15.47:0/1000535102 wait complete. 2024-05-08T19:48:31.747 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T19:48:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.885+0000 7f2b4b58d700 1 Processor -- start 2024-05-08T19:48:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.885+0000 7f2b4b58d700 1 -- start start 2024-05-08T19:48:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b4b58d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b440c1790 0x7f2b44155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b4b58d700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2b44070a80 0x7f2b440c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b4b58d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b44071220 con 0x7f2b440c72e0 2024-05-08T19:48:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b4b58d700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4406c960 con 0x7f2b44070a80 2024-05-08T19:48:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b4b58d700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4406d4a0 con 0x7f2b440c1790 2024-05-08T19:48:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b49329700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b440c1790 0x7f2b44155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b48b28700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2b44070a80 0x7f2b440c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b49b2a700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f2b440c72e0 0x7f2b440c5ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:47458/0 (socket says 172.21.15.47:47458) 2024-05-08T19:48:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b49b2a700 1 -- 172.21.15.47:0/2461047170 learned_addr learned my addr 172.21.15.47:0/2461047170 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:48:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b49329700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b440c1790 0x7f2b44155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:41764/0 (socket says 172.21.15.47:41764) 2024-05-08T19:48:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b49329700 1 -- 172.21.15.47:0/2461047170 >> v2:172.21.15.177:3300/0 conn(0x7f2b44070a80 msgr2=0x7f2b440c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b49329700 1 --2- 172.21.15.47:0/2461047170 >> v2:172.21.15.177:3300/0 conn(0x7f2b44070a80 0x7f2b440c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b49329700 1 -- 172.21.15.47:0/2461047170 >> v1:172.21.15.177:6789/0 conn(0x7f2b440c72e0 legacy=0x7f2b440c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b49329700 1 -- 172.21.15.47:0/2461047170 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4406cb70 con 0x7f2b440c1790 2024-05-08T19:48:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b3bfff700 1 -- 172.21.15.47:0/2461047170 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151940952 0 0) 0x7f2b44071220 con 0x7f2b440c72e0 2024-05-08T19:48:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.886+0000 7f2b48b28700 1 --2- 172.21.15.47:0/2461047170 >> v2:172.21.15.177:3300/0 conn(0x7f2b44070a80 0x7f2b440c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:48:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.887+0000 7f2b49329700 1 --2- 172.21.15.47:0/2461047170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b440c1790 0x7f2b44155570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009840 tx=0x7f2b34009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f0cfcdf5f2941ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.887+0000 7f2b3bfff700 1 -- 172.21.15.47:0/2461047170 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34011830 con 0x7f2b440c1790 2024-05-08T19:48:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.887+0000 7f2b3bfff700 1 -- 172.21.15.47:0/2461047170 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b34011990 con 0x7f2b440c1790 2024-05-08T19:48:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.887+0000 7f2b3bfff700 1 -- 172.21.15.47:0/2461047170 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34011d20 con 0x7f2b440c1790 2024-05-08T19:48:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.887+0000 7f2b4b58d700 1 -- 172.21.15.47:0/2461047170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b440c1790 msgr2=0x7f2b44155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.887+0000 7f2b4b58d700 1 --2- 172.21.15.47:0/2461047170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b440c1790 0x7f2b44155570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009840 tx=0x7f2b34009b50 comp rx=0 tx=0).stop 2024-05-08T19:48:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.887+0000 7f2b4b58d700 1 -- 172.21.15.47:0/2461047170 shutdown_connections 2024-05-08T19:48:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.887+0000 7f2b4b58d700 1 --2- 172.21.15.47:0/2461047170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b440c1790 0x7f2b44155570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.887+0000 7f2b4b58d700 1 --2- 172.21.15.47:0/2461047170 >> v2:172.21.15.177:3300/0 conn(0x7f2b44070a80 0x7f2b440c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.887+0000 7f2b4b58d700 1 -- 172.21.15.47:0/2461047170 >> 172.21.15.47:0/2461047170 conn(0x7f2b440a9ea0 msgr2=0x7f2b440aa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.887+0000 7f2b4b58d700 1 -- 172.21.15.47:0/2461047170 shutdown_connections 2024-05-08T19:48:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.887+0000 7f2b4b58d700 1 -- 172.21.15.47:0/2461047170 wait complete. 2024-05-08T19:48:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.889+0000 7f2b4b58d700 1 Processor -- start 2024-05-08T19:48:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.889+0000 7f2b4b58d700 1 -- start start 2024-05-08T19:48:31.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.889+0000 7f2b4b58d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b44070a80 0x7f2b44151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.889+0000 7f2b4b58d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b440c1790 0x7f2b44152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.889+0000 7f2b4b58d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b440c72e0 0x7f2b441ed750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.889+0000 7f2b4b58d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440ab5c0 con 0x7f2b440c1790 2024-05-08T19:48:31.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.889+0000 7f2b4b58d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440ac7d0 con 0x7f2b44070a80 2024-05-08T19:48:31.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.889+0000 7f2b4b58d700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4414fb60 con 0x7f2b440c72e0 2024-05-08T19:48:31.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.889+0000 7f2b49329700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b44070a80 0x7f2b44151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.889+0000 7f2b48b28700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b440c1790 0x7f2b44152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.889+0000 7f2b49329700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b44070a80 0x7f2b44151ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:50820/0 (socket says 172.21.15.47:50820) 2024-05-08T19:48:31.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.889+0000 7f2b49329700 1 -- 172.21.15.47:0/1150594815 learned_addr learned my addr 172.21.15.47:0/1150594815 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:31.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.889+0000 7f2b49b2a700 1 --2- 172.21.15.47:0/1150594815 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b440c72e0 0x7f2b441ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.890+0000 7f2b48b28700 1 -- 172.21.15.47:0/1150594815 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b440c72e0 msgr2=0x7f2b441ed750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.890+0000 7f2b48b28700 1 --2- 172.21.15.47:0/1150594815 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b440c72e0 0x7f2b441ed750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.890+0000 7f2b48b28700 1 -- 172.21.15.47:0/1150594815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b44070a80 msgr2=0x7f2b44151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:31.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.890+0000 7f2b48b28700 1 --2- 172.21.15.47:0/1150594815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b44070a80 0x7f2b44151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:31.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.890+0000 7f2b48b28700 1 -- 172.21.15.47:0/1150594815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b400094a0 con 0x7f2b440c1790 2024-05-08T19:48:31.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.890+0000 7f2b49329700 1 --2- 172.21.15.47:0/1150594815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b44070a80 0x7f2b44151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:48:31.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.890+0000 7f2b48b28700 1 --2- 172.21.15.47:0/1150594815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b440c1790 0x7f2b44152000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000e9b0 tx=0x7f2b4000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:31.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.890+0000 7f2b39ffb700 1 -- 172.21.15.47:0/1150594815 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4000ee50 con 0x7f2b440c1790 2024-05-08T19:48:31.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.890+0000 7f2b39ffb700 1 -- 172.21.15.47:0/1150594815 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4000c850 con 0x7f2b440c1790 2024-05-08T19:48:31.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.890+0000 7f2b4b58d700 1 -- 172.21.15.47:0/1150594815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b340094a0 con 0x7f2b440c1790 2024-05-08T19:48:31.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.890+0000 7f2b39ffb700 1 -- 172.21.15.47:0/1150594815 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4000cc00 con 0x7f2b440c1790 2024-05-08T19:48:31.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.890+0000 7f2b4b58d700 1 -- 172.21.15.47:0/1150594815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b440acd50 con 0x7f2b440c1790 2024-05-08T19:48:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.891+0000 7f2b4b58d700 1 -- 172.21.15.47:0/1150594815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4406d910 con 0x7f2b440c1790 2024-05-08T19:48:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.892+0000 7f2b39ffb700 1 -- 172.21.15.47:0/1150594815 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2b40013470 con 0x7f2b440c1790 2024-05-08T19:48:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.892+0000 7f2b39ffb700 1 --2- 172.21.15.47:0/1150594815 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f2b2806ac90 0x7f2b2806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.893+0000 7f2b39ffb700 1 -- 172.21.15.47:0/1150594815 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2b400895e0 con 0x7f2b440c1790 2024-05-08T19:48:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.893+0000 7f2b49329700 1 --2- 172.21.15.47:0/1150594815 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f2b2806ac90 0x7f2b2806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.893+0000 7f2b49329700 1 --2- 172.21.15.47:0/1150594815 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f2b2806ac90 0x7f2b2806d150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009b90 tx=0x7f2b34008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:31.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:31.897+0000 7f2b39ffb700 1 -- 172.21.15.47:0/1150594815 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2b4406d910 con 0x7f2b440c1790 2024-05-08T19:48:32.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.106+0000 7f2b4b58d700 1 -- 172.21.15.47:0/1150594815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2b4406d910 con 0x7f2b440c1790 2024-05-08T19:48:32.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.106+0000 7f2b39ffb700 1 -- 172.21.15.47:0/1150594815 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2b4406d910 con 0x7f2b440c1790 2024-05-08T19:48:32.096 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-08T19:48:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.108+0000 7f2b4b58d700 1 -- 172.21.15.47:0/1150594815 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f2b2806ac90 msgr2=0x7f2b2806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.108+0000 7f2b4b58d700 1 --2- 172.21.15.47:0/1150594815 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f2b2806ac90 0x7f2b2806d150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009b90 tx=0x7f2b34008030 comp rx=0 tx=0).stop 2024-05-08T19:48:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.108+0000 7f2b4b58d700 1 -- 172.21.15.47:0/1150594815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b440c1790 msgr2=0x7f2b44152000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.108+0000 7f2b4b58d700 1 --2- 172.21.15.47:0/1150594815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b440c1790 0x7f2b44152000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000e9b0 tx=0x7f2b4000ecc0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.108+0000 7f2b4b58d700 1 -- 172.21.15.47:0/1150594815 shutdown_connections 2024-05-08T19:48:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.108+0000 7f2b4b58d700 1 --2- 172.21.15.47:0/1150594815 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f2b2806ac90 0x7f2b2806d150 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.108+0000 7f2b4b58d700 1 --2- 172.21.15.47:0/1150594815 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b440c72e0 0x7f2b441ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.108+0000 7f2b4b58d700 1 --2- 172.21.15.47:0/1150594815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b44070a80 0x7f2b44151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.108+0000 7f2b4b58d700 1 --2- 172.21.15.47:0/1150594815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b440c1790 0x7f2b44152000 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.108+0000 7f2b4b58d700 1 -- 172.21.15.47:0/1150594815 >> 172.21.15.47:0/1150594815 conn(0x7f2b440a9ea0 msgr2=0x7f2b440aa280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.108+0000 7f2b4b58d700 1 -- 172.21.15.47:0/1150594815 shutdown_connections 2024-05-08T19:48:32.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.108+0000 7f2b4b58d700 1 -- 172.21.15.47:0/1150594815 wait complete. 2024-05-08T19:48:32.111 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T19:48:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.247+0000 7fedd4011700 1 Processor -- start 2024-05-08T19:48:32.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.247+0000 7fedd4011700 1 -- start start 2024-05-08T19:48:32.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.248+0000 7fedd4011700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fedcc0c74e0 0x7fedcc070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:32.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.248+0000 7fedd4011700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fedcc0c78c0 0x7fedcc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:32.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.248+0000 7fedd4011700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedcc153430 con 0x7fedcc0c46c0 2024-05-08T19:48:32.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.248+0000 7fedd4011700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedcc071250 con 0x7fedcc0c78c0 2024-05-08T19:48:32.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.248+0000 7fedd4011700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedcc153960 con 0x7fedcc0c74e0 2024-05-08T19:48:32.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.248+0000 7fedd15ac700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fedcc0c78c0 0x7fedcc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:32.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.248+0000 7fedd15ac700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fedcc0c78c0 0x7fedcc06ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44168/0 (socket says 172.21.15.47:44168) 2024-05-08T19:48:32.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.248+0000 7fedd25ae700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fedcc0c46c0 0x7fedcc0c2ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57376/0 (socket says 172.21.15.47:57376) 2024-05-08T19:48:32.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.248+0000 7fedd15ac700 1 -- 172.21.15.47:0/75505291 learned_addr learned my addr 172.21.15.47:0/75505291 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:32.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.249+0000 7fedd1dad700 1 --2- 172.21.15.47:0/75505291 >> v2:172.21.15.177:3300/0 conn(0x7fedcc0c74e0 0x7fedcc070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:32.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.249+0000 7fedd15ac700 1 -- 172.21.15.47:0/75505291 >> v2:172.21.15.177:3300/0 conn(0x7fedcc0c74e0 msgr2=0x7fedcc070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:32.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.249+0000 7fedd15ac700 1 --2- 172.21.15.47:0/75505291 >> v2:172.21.15.177:3300/0 conn(0x7fedcc0c74e0 0x7fedcc070d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.249+0000 7fedd15ac700 1 -- 172.21.15.47:0/75505291 >> v1:172.21.15.47:6789/0 conn(0x7fedcc0c46c0 legacy=0x7fedcc0c2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:32.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.249+0000 7fedd15ac700 1 -- 172.21.15.47:0/75505291 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc06eaf0 con 0x7fedcc0c78c0 2024-05-08T19:48:32.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.249+0000 7fedd0dab700 1 -- 172.21.15.47:0/75505291 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46645890 0 0) 0x7fedcc153430 con 0x7fedcc0c46c0 2024-05-08T19:48:32.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.249+0000 7fedd15ac700 1 --2- 172.21.15.47:0/75505291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedcc0c78c0 0x7fedcc06ef60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fedcc074470 tx=0x7fedc8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4306ec7feb3b78b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:32.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.249+0000 7fedd0dab700 1 -- 172.21.15.47:0/75505291 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8011830 con 0x7fedcc0c78c0 2024-05-08T19:48:32.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.249+0000 7fedd0dab700 1 -- 172.21.15.47:0/75505291 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc8011990 con 0x7fedcc0c78c0 2024-05-08T19:48:32.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.249+0000 7fedd0dab700 1 -- 172.21.15.47:0/75505291 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8011d20 con 0x7fedcc0c78c0 2024-05-08T19:48:32.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.250+0000 7fedd4011700 1 -- 172.21.15.47:0/75505291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedcc0c78c0 msgr2=0x7fedcc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:32.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.250+0000 7fedd4011700 1 --2- 172.21.15.47:0/75505291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedcc0c78c0 0x7fedcc06ef60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fedcc074470 tx=0x7fedc8009bd0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.250+0000 7fedd4011700 1 -- 172.21.15.47:0/75505291 shutdown_connections 2024-05-08T19:48:32.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.250+0000 7fedd4011700 1 --2- 172.21.15.47:0/75505291 >> v2:172.21.15.177:3300/0 conn(0x7fedcc0c74e0 0x7fedcc070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.250+0000 7fedd4011700 1 --2- 172.21.15.47:0/75505291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedcc0c78c0 0x7fedcc06ef60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.250+0000 7fedd4011700 1 -- 172.21.15.47:0/75505291 >> 172.21.15.47:0/75505291 conn(0x7fedcc0a9ea0 msgr2=0x7fedcc0aa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:32.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.250+0000 7fedd4011700 1 -- 172.21.15.47:0/75505291 shutdown_connections 2024-05-08T19:48:32.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.250+0000 7fedd4011700 1 -- 172.21.15.47:0/75505291 wait complete. 2024-05-08T19:48:32.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.251+0000 7fedd4011700 1 Processor -- start 2024-05-08T19:48:32.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.251+0000 7fedd4011700 1 -- start start 2024-05-08T19:48:32.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd4011700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedcc0c46c0 0x7fedcc154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:32.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd4011700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedcc0c74e0 0x7fedcc14d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:32.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd4011700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fedcc0c78c0 0x7fedcc1e8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:32.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd4011700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc1e81a0 con 0x7fedcc0c46c0 2024-05-08T19:48:32.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd4011700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc1e7e50 con 0x7fedcc0c74e0 2024-05-08T19:48:32.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd4011700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc1566c0 con 0x7fedcc0c78c0 2024-05-08T19:48:32.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd1dad700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedcc0c46c0 0x7fedcc154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:32.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd1dad700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedcc0c46c0 0x7fedcc154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44184/0 (socket says 172.21.15.47:44184) 2024-05-08T19:48:32.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd1dad700 1 -- 172.21.15.47:0/2051830728 learned_addr learned my addr 172.21.15.47:0/2051830728 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:32.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd15ac700 1 --2- 172.21.15.47:0/2051830728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedcc0c74e0 0x7fedcc14d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:32.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd25ae700 1 --2- 172.21.15.47:0/2051830728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fedcc0c78c0 0x7fedcc1e8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:32.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd1dad700 1 -- 172.21.15.47:0/2051830728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fedcc0c78c0 msgr2=0x7fedcc1e8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:32.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd1dad700 1 --2- 172.21.15.47:0/2051830728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fedcc0c78c0 0x7fedcc1e8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd1dad700 1 -- 172.21.15.47:0/2051830728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedcc0c74e0 msgr2=0x7fedcc14d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:32.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd1dad700 1 --2- 172.21.15.47:0/2051830728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedcc0c74e0 0x7fedcc14d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd1dad700 1 -- 172.21.15.47:0/2051830728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc8009550 con 0x7fedcc0c46c0 2024-05-08T19:48:32.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd25ae700 1 --2- 172.21.15.47:0/2051830728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fedcc0c78c0 0x7fedcc1e8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:48:32.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd1dad700 1 --2- 172.21.15.47:0/2051830728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedcc0c46c0 0x7fedcc154d70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00e9b0 tx=0x7fedbc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:32.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedc27fc700 1 -- 172.21.15.47:0/2051830728 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc009710 con 0x7fedcc0c46c0 2024-05-08T19:48:32.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedc27fc700 1 -- 172.21.15.47:0/2051830728 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedbc00c850 con 0x7fedcc0c46c0 2024-05-08T19:48:32.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedc27fc700 1 -- 172.21.15.47:0/2051830728 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc00cbc0 con 0x7fedcc0c46c0 2024-05-08T19:48:32.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd4011700 1 -- 172.21.15.47:0/2051830728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedcc1569a0 con 0x7fedcc0c46c0 2024-05-08T19:48:32.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.252+0000 7fedd4011700 1 -- 172.21.15.47:0/2051830728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedcc14db80 con 0x7fedcc0c46c0 2024-05-08T19:48:32.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.253+0000 7fedd4011700 1 -- 172.21.15.47:0/2051830728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedcc1e8480 con 0x7fedcc0c46c0 2024-05-08T19:48:32.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.254+0000 7fedc27fc700 1 -- 172.21.15.47:0/2051830728 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fedbc00cd20 con 0x7fedcc0c46c0 2024-05-08T19:48:32.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.254+0000 7fedc27fc700 1 --2- 172.21.15.47:0/2051830728 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fedb006ac90 0x7fedb006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:32.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.254+0000 7fedc27fc700 1 -- 172.21.15.47:0/2051830728 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fedbc0896b0 con 0x7fedcc0c46c0 2024-05-08T19:48:32.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.254+0000 7fedd15ac700 1 --2- 172.21.15.47:0/2051830728 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fedb006ac90 0x7fedb006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:32.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.255+0000 7fedd15ac700 1 --2- 172.21.15.47:0/2051830728 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fedb006ac90 0x7fedb006d150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009c10 tx=0x7fedc8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:32.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.259+0000 7fedc27fc700 1 -- 172.21.15.47:0/2051830728 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fedbc054560 con 0x7fedcc0c46c0 2024-05-08T19:48:32.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.484+0000 7fedd4011700 1 -- 172.21.15.47:0/2051830728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fedcc04ec60 con 0x7fedcc0c46c0 2024-05-08T19:48:32.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.484+0000 7fedc27fc700 1 -- 172.21.15.47:0/2051830728 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fedbc057b80 con 0x7fedcc0c46c0 2024-05-08T19:48:32.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.486+0000 7fedd4011700 1 -- 172.21.15.47:0/2051830728 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fedb006ac90 msgr2=0x7fedb006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:32.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.486+0000 7fedd4011700 1 --2- 172.21.15.47:0/2051830728 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fedb006ac90 0x7fedb006d150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009c10 tx=0x7fedc8008030 comp rx=0 tx=0).stop 2024-05-08T19:48:32.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.486+0000 7fedd4011700 1 -- 172.21.15.47:0/2051830728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedcc0c46c0 msgr2=0x7fedcc154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:32.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.486+0000 7fedd4011700 1 --2- 172.21.15.47:0/2051830728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedcc0c46c0 0x7fedcc154d70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00e9b0 tx=0x7fedbc00ecc0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.486+0000 7fedd4011700 1 -- 172.21.15.47:0/2051830728 shutdown_connections 2024-05-08T19:48:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.486+0000 7fedd4011700 1 --2- 172.21.15.47:0/2051830728 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fedb006ac90 0x7fedb006d150 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.487+0000 7fedd4011700 1 --2- 172.21.15.47:0/2051830728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedcc0c46c0 0x7fedcc154d70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.487+0000 7fedd4011700 1 --2- 172.21.15.47:0/2051830728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fedcc0c78c0 0x7fedcc1e8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.487+0000 7fedd4011700 1 --2- 172.21.15.47:0/2051830728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedcc0c74e0 0x7fedcc14d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.487+0000 7fedd4011700 1 -- 172.21.15.47:0/2051830728 >> 172.21.15.47:0/2051830728 conn(0x7fedcc0a9ea0 msgr2=0x7fedcc152f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.487+0000 7fedd4011700 1 -- 172.21.15.47:0/2051830728 shutdown_connections 2024-05-08T19:48:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:32.487+0000 7fedd4011700 1 -- 172.21.15.47:0/2051830728 wait complete. 2024-05-08T19:48:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-08T19:48:32.489 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-08T19:48:32.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:48:32.489 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-08T19:48:33.219 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-05-08T19:48:33.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:48:33.219 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-08T19:48:33.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:48:33.311 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-05-08T19:48:33.355 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-08T19:48:33.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:48:33.356 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T19:48:33.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T19:48:33.391 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-05-08T19:48:33.487 DEBUG:teuthology.parallel:result is None 2024-05-08T19:48:33.487 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T19:48:33.499 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T19:48:33.500 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T19:48:33.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.636+0000 7f5b9fa53700 1 Processor -- start 2024-05-08T19:48:33.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.636+0000 7f5b9fa53700 1 -- start start 2024-05-08T19:48:33.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.637+0000 7f5b9fa53700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5b980c1f00 0x7f5b98154960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:33.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.637+0000 7f5b9fa53700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b98158930 con 0x7f5b980c1b20 2024-05-08T19:48:33.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.637+0000 7f5b9fa53700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b980c2380 con 0x7f5b98154ea0 2024-05-08T19:48:33.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.637+0000 7f5b9fa53700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b980c2840 con 0x7f5b980c1f00 2024-05-08T19:48:33.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.637+0000 7f5b9cfee700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5b980c1f00 0x7f5b98154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:33.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.637+0000 7f5b9cfee700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5b980c1f00 0x7f5b98154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44196/0 (socket says 172.21.15.47:44196) 2024-05-08T19:48:33.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.637+0000 7f5b9cfee700 1 -- 172.21.15.47:0/1114570067 learned_addr learned my addr 172.21.15.47:0/1114570067 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:33.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.637+0000 7f5b9d7ef700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5b980c1b20 0x7f5b9813d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57384/0 (socket says 172.21.15.47:57384) 2024-05-08T19:48:33.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.637+0000 7f5b9cfee700 1 -- 172.21.15.47:0/1114570067 >> v1:172.21.15.177:6789/0 conn(0x7f5b98154ea0 legacy=0x7f5b9815f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:33.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.637+0000 7f5b9cfee700 1 -- 172.21.15.47:0/1114570067 >> v1:172.21.15.47:6789/0 conn(0x7f5b980c1b20 legacy=0x7f5b9813d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:33.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.637+0000 7f5b9cfee700 1 -- 172.21.15.47:0/1114570067 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9813e1e0 con 0x7f5b980c1f00 2024-05-08T19:48:33.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.637+0000 7f5b8ffff700 1 -- 172.21.15.47:0/1114570067 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700110218 0 0) 0x7f5b98158930 con 0x7f5b980c1b20 2024-05-08T19:48:33.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.638+0000 7f5b9cfee700 1 --2- 172.21.15.47:0/1114570067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b980c1f00 0x7f5b98154960 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5b940098f0 tx=0x7f5b94009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d889c5dd182a34d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:33.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.638+0000 7f5b8ffff700 1 -- 172.21.15.47:0/1114570067 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9400b8a0 con 0x7f5b980c1f00 2024-05-08T19:48:33.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.638+0000 7f5b8ffff700 1 -- 172.21.15.47:0/1114570067 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9400ba00 con 0x7f5b980c1f00 2024-05-08T19:48:33.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.638+0000 7f5b8ffff700 1 -- 172.21.15.47:0/1114570067 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9400bd90 con 0x7f5b980c1f00 2024-05-08T19:48:33.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.638+0000 7f5b9fa53700 1 -- 172.21.15.47:0/1114570067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b980c1f00 msgr2=0x7f5b98154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:33.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.638+0000 7f5b9fa53700 1 --2- 172.21.15.47:0/1114570067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b980c1f00 0x7f5b98154960 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5b940098f0 tx=0x7f5b94009c00 comp rx=0 tx=0).stop 2024-05-08T19:48:33.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.638+0000 7f5b9fa53700 1 -- 172.21.15.47:0/1114570067 shutdown_connections 2024-05-08T19:48:33.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.638+0000 7f5b9fa53700 1 --2- 172.21.15.47:0/1114570067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b980c1f00 0x7f5b98154960 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:33.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.638+0000 7f5b9fa53700 1 -- 172.21.15.47:0/1114570067 >> 172.21.15.47:0/1114570067 conn(0x7f5b980c3c20 msgr2=0x7f5b980c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:33.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.638+0000 7f5b9fa53700 1 -- 172.21.15.47:0/1114570067 shutdown_connections 2024-05-08T19:48:33.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.638+0000 7f5b9fa53700 1 -- 172.21.15.47:0/1114570067 wait complete. 2024-05-08T19:48:33.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.640+0000 7f5b9fa53700 1 Processor -- start 2024-05-08T19:48:33.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.640+0000 7f5b9fa53700 1 -- start start 2024-05-08T19:48:33.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9fa53700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b980c1b20 0x7f5b981e76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:33.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9fa53700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b980c1f00 0x7f5b9806ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:33.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9fa53700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b98154ea0 0x7f5b9806f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:33.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9fa53700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b981e7c30 con 0x7f5b980c1b20 2024-05-08T19:48:33.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9fa53700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b981ee090 con 0x7f5b980c1f00 2024-05-08T19:48:33.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9fa53700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b981ee370 con 0x7f5b98154ea0 2024-05-08T19:48:33.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9d7ef700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b980c1b20 0x7f5b981e76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:33.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9d7ef700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b980c1b20 0x7f5b981e76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44204/0 (socket says 172.21.15.47:44204) 2024-05-08T19:48:33.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9d7ef700 1 -- 172.21.15.47:0/3927467250 learned_addr learned my addr 172.21.15.47:0/3927467250 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:33.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9cfee700 1 --2- 172.21.15.47:0/3927467250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b980c1f00 0x7f5b9806ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:33.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9dff0700 1 --2- 172.21.15.47:0/3927467250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b98154ea0 0x7f5b9806f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:33.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9d7ef700 1 -- 172.21.15.47:0/3927467250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b98154ea0 msgr2=0x7f5b9806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:33.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9d7ef700 1 --2- 172.21.15.47:0/3927467250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b98154ea0 0x7f5b9806f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:33.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9d7ef700 1 -- 172.21.15.47:0/3927467250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b980c1f00 msgr2=0x7f5b9806ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:33.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9d7ef700 1 --2- 172.21.15.47:0/3927467250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b980c1f00 0x7f5b9806ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:33.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9d7ef700 1 -- 172.21.15.47:0/3927467250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b94009550 con 0x7f5b980c1b20 2024-05-08T19:48:33.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9cfee700 1 --2- 172.21.15.47:0/3927467250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b980c1f00 0x7f5b9806ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:48:33.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.641+0000 7f5b9d7ef700 1 --2- 172.21.15.47:0/3927467250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b980c1b20 0x7f5b981e76f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800c520 tx=0x7f5b8800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:33.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.642+0000 7f5b8dffb700 1 -- 172.21.15.47:0/3927467250 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88004c80 con 0x7f5b980c1b20 2024-05-08T19:48:33.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.642+0000 7f5b8dffb700 1 -- 172.21.15.47:0/3927467250 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b88004e00 con 0x7f5b980c1b20 2024-05-08T19:48:33.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.642+0000 7f5b9fa53700 1 -- 172.21.15.47:0/3927467250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9806e720 con 0x7f5b980c1b20 2024-05-08T19:48:33.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.642+0000 7f5b8dffb700 1 -- 172.21.15.47:0/3927467250 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88007310 con 0x7f5b980c1b20 2024-05-08T19:48:33.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.642+0000 7f5b9fa53700 1 -- 172.21.15.47:0/3927467250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9814fe70 con 0x7f5b980c1b20 2024-05-08T19:48:33.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.643+0000 7f5b9fa53700 1 -- 172.21.15.47:0/3927467250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b98158da0 con 0x7f5b980c1b20 2024-05-08T19:48:33.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.643+0000 7f5b8dffb700 1 -- 172.21.15.47:0/3927467250 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5b88007470 con 0x7f5b980c1b20 2024-05-08T19:48:33.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.644+0000 7f5b8dffb700 1 --2- 172.21.15.47:0/3927467250 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f5b7c06ac90 0x7f5b7c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:33.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.644+0000 7f5b8dffb700 1 -- 172.21.15.47:0/3927467250 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5b88089410 con 0x7f5b980c1b20 2024-05-08T19:48:33.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.644+0000 7f5b9cfee700 1 --2- 172.21.15.47:0/3927467250 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f5b7c06ac90 0x7f5b7c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:33.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.644+0000 7f5b9cfee700 1 --2- 172.21.15.47:0/3927467250 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f5b7c06ac90 0x7f5b7c06d150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5b98151af0 tx=0x7f5b94008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:33.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.648+0000 7f5b8dffb700 1 -- 172.21.15.47:0/3927467250 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5b98158da0 con 0x7f5b980c1b20 2024-05-08T19:48:33.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.854+0000 7f5b9fa53700 1 -- 172.21.15.47:0/3927467250 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b981582e0 con 0x7f5b7c06ac90 2024-05-08T19:48:33.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.865+0000 7f5b8dffb700 1 -- 172.21.15.47:0/3927467250 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371968 (secure 0 0 0) 0x7f5b9400bb70 con 0x7f5b7c06ac90 2024-05-08T19:48:33.860 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:48:33.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.869+0000 7f5b9fa53700 1 -- 172.21.15.47:0/3927467250 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f5b7c06ac90 msgr2=0x7f5b7c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:33.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.869+0000 7f5b9fa53700 1 --2- 172.21.15.47:0/3927467250 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f5b7c06ac90 0x7f5b7c06d150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5b98151af0 tx=0x7f5b94008030 comp rx=0 tx=0).stop 2024-05-08T19:48:33.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.869+0000 7f5b9fa53700 1 -- 172.21.15.47:0/3927467250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b980c1b20 msgr2=0x7f5b981e76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:33.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.869+0000 7f5b9fa53700 1 --2- 172.21.15.47:0/3927467250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b980c1b20 0x7f5b981e76f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800c520 tx=0x7f5b8800c8e0 comp rx=0 tx=0).stop 2024-05-08T19:48:33.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.869+0000 7f5b9fa53700 1 -- 172.21.15.47:0/3927467250 shutdown_connections 2024-05-08T19:48:33.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.869+0000 7f5b9fa53700 1 --2- 172.21.15.47:0/3927467250 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f5b7c06ac90 0x7f5b7c06d150 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:33.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.869+0000 7f5b9fa53700 1 --2- 172.21.15.47:0/3927467250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b980c1b20 0x7f5b981e76f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:33.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.869+0000 7f5b9fa53700 1 --2- 172.21.15.47:0/3927467250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b98154ea0 0x7f5b9806f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:33.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.869+0000 7f5b9fa53700 1 --2- 172.21.15.47:0/3927467250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b980c1f00 0x7f5b9806ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:33.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.869+0000 7f5b9fa53700 1 -- 172.21.15.47:0/3927467250 >> 172.21.15.47:0/3927467250 conn(0x7f5b980c3c20 msgr2=0x7f5b980715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:33.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.869+0000 7f5b9fa53700 1 -- 172.21.15.47:0/3927467250 shutdown_connections 2024-05-08T19:48:33.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:33.869+0000 7f5b9fa53700 1 -- 172.21.15.47:0/3927467250 wait complete. 2024-05-08T19:48:33.865 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-08T19:48:33.872 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":808,"stamp":"2024-05-08T19:48:32.598506+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":338372162,"num_objects":1910,"num_object_clones":0,"num_object_copies":5732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1910,"num_whiteouts":0,"num_read":21638,"num_read_kb":1158704,"num_write":407515,"num_write_kb":31677585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":573783,"ondisk_log_size":573783,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7777204,"kb_used_data":375812,"kb_used_omap":12,"kb_used_meta":7401203,"kb_avail":747197516,"statfs":{"total":773094113280,"available":765130256384,"internally_reserved":0,"allocated":384831488,"data_stored":815498630,"data_compressed":64276350,"data_compressed_allocated":98619392,"data_compressed_original":530673664,"omap_allocated":12741,"internal_metadata":7578832443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,7,9,6,10,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-220761622,"num_objects":-1489,"num_object_clones":0,"num_object_copies":-5090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1489,"num_whiteouts":0,"num_read":79,"num_read_kb":4183,"num_write":4813,"num_write_kb":100688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009198"},"pg_stats":[{"pgid":"3.3f","version":"26'2217","reported_seq":2245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:26.729950+0000","last_change":"2024-05-08T19:22:20.461758+0000","last_active":"2024-05-08T19:48:26.729950+0000","last_peered":"2024-05-08T19:48:26.729950+0000","last_clean":"2024-05-08T19:48:26.729950+0000","last_became_active":"2024-05-08T19:22:20.461515+0000","last_became_peered":"2024-05-08T19:22:20.461515+0000","last_unstale":"2024-05-08T19:48:26.729950+0000","last_undegraded":"2024-05-08T19:48:26.729950+0000","last_fullsized":"2024-05-08T19:48:26.729950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'2252","reported_seq":2280,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.415099+0000","last_change":"2024-05-08T19:22:20.434929+0000","last_active":"2024-05-08T19:48:29.415099+0000","last_peered":"2024-05-08T19:48:29.415099+0000","last_clean":"2024-05-08T19:48:29.415099+0000","last_became_active":"2024-05-08T19:22:20.434629+0000","last_became_peered":"2024-05-08T19:22:20.434629+0000","last_unstale":"2024-05-08T19:48:29.415099+0000","last_undegraded":"2024-05-08T19:48:29.415099+0000","last_fullsized":"2024-05-08T19:48:29.415099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2252,"log_dups_size":0,"ondisk_log_size":2252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"26'2362","reported_seq":2390,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.252030+0000","last_change":"2024-05-08T19:22:20.449450+0000","last_active":"2024-05-08T19:48:29.252030+0000","last_peered":"2024-05-08T19:48:29.252030+0000","last_clean":"2024-05-08T19:48:29.252030+0000","last_became_active":"2024-05-08T19:22:20.449184+0000","last_became_peered":"2024-05-08T19:22:20.449184+0000","last_unstale":"2024-05-08T19:48:29.252030+0000","last_undegraded":"2024-05-08T19:48:29.252030+0000","last_fullsized":"2024-05-08T19:48:29.252030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2362,"log_dups_size":0,"ondisk_log_size":2362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"26'2333","reported_seq":2361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.100139+0000","last_change":"2024-05-08T19:22:20.449919+0000","last_active":"2024-05-08T19:48:30.100139+0000","last_peered":"2024-05-08T19:48:30.100139+0000","last_clean":"2024-05-08T19:48:30.100139+0000","last_became_active":"2024-05-08T19:22:20.449637+0000","last_became_peered":"2024-05-08T19:22:20.449637+0000","last_unstale":"2024-05-08T19:48:30.100139+0000","last_undegraded":"2024-05-08T19:48:30.100139+0000","last_fullsized":"2024-05-08T19:48:30.100139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2333,"log_dups_size":0,"ondisk_log_size":2333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'2261","reported_seq":2287,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.349642+0000","last_change":"2024-05-08T19:22:20.449676+0000","last_active":"2024-05-08T19:48:27.349642+0000","last_peered":"2024-05-08T19:48:27.349642+0000","last_clean":"2024-05-08T19:48:27.349642+0000","last_became_active":"2024-05-08T19:22:20.449347+0000","last_became_peered":"2024-05-08T19:22:20.449347+0000","last_unstale":"2024-05-08T19:48:27.349642+0000","last_undegraded":"2024-05-08T19:48:27.349642+0000","last_fullsized":"2024-05-08T19:48:27.349642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2261,"log_dups_size":0,"ondisk_log_size":2261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:29.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'2206","reported_seq":2226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.699476+0000","last_change":"2024-05-08T19:23:11.053315+0000","last_active":"2024-05-08T19:48:29.699476+0000","last_peered":"2024-05-08T19:48:29.699476+0000","last_clean":"2024-05-08T19:48:29.699476+0000","last_became_active":"2024-05-08T19:23:11.052928+0000","last_became_peered":"2024-05-08T19:23:11.052928+0000","last_unstale":"2024-05-08T19:48:29.699476+0000","last_undegraded":"2024-05-08T19:48:29.699476+0000","last_fullsized":"2024-05-08T19:48:29.699476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2206,"log_dups_size":0,"ondisk_log_size":2206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:17.190935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"26'2264","reported_seq":2290,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.344503+0000","last_change":"2024-05-08T19:22:20.446830+0000","last_active":"2024-05-08T19:48:27.344503+0000","last_peered":"2024-05-08T19:48:27.344503+0000","last_clean":"2024-05-08T19:48:27.344503+0000","last_became_active":"2024-05-08T19:22:20.446520+0000","last_became_peered":"2024-05-08T19:22:20.446520+0000","last_unstale":"2024-05-08T19:48:27.344503+0000","last_undegraded":"2024-05-08T19:48:27.344503+0000","last_fullsized":"2024-05-08T19:48:27.344503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2264,"log_dups_size":0,"ondisk_log_size":2264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:25.101779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'2263","reported_seq":2289,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.950352+0000","last_change":"2024-05-08T19:22:20.447313+0000","last_active":"2024-05-08T19:48:29.950352+0000","last_peered":"2024-05-08T19:48:29.950352+0000","last_clean":"2024-05-08T19:48:29.950352+0000","last_became_active":"2024-05-08T19:22:20.447031+0000","last_became_peered":"2024-05-08T19:22:20.447031+0000","last_unstale":"2024-05-08T19:48:29.950352+0000","last_undegraded":"2024-05-08T19:48:29.950352+0000","last_fullsized":"2024-05-08T19:48:29.950352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2263,"log_dups_size":0,"ondisk_log_size":2263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"26'2318","reported_seq":2344,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.637378+0000","last_change":"2024-05-08T19:22:20.447186+0000","last_active":"2024-05-08T19:48:27.637378+0000","last_peered":"2024-05-08T19:48:27.637378+0000","last_clean":"2024-05-08T19:48:27.637378+0000","last_became_active":"2024-05-08T19:22:20.446803+0000","last_became_peered":"2024-05-08T19:22:20.446803+0000","last_unstale":"2024-05-08T19:48:27.637378+0000","last_undegraded":"2024-05-08T19:48:27.637378+0000","last_fullsized":"2024-05-08T19:48:27.637378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2318,"log_dups_size":0,"ondisk_log_size":2318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'2338","reported_seq":2364,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.900817+0000","last_change":"2024-05-08T19:22:20.462899+0000","last_active":"2024-05-08T19:48:29.900817+0000","last_peered":"2024-05-08T19:48:29.900817+0000","last_clean":"2024-05-08T19:48:29.900817+0000","last_became_active":"2024-05-08T19:22:20.461395+0000","last_became_peered":"2024-05-08T19:22:20.461395+0000","last_unstale":"2024-05-08T19:48:29.900817+0000","last_undegraded":"2024-05-08T19:48:29.900817+0000","last_fullsized":"2024-05-08T19:48:29.900817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2338,"log_dups_size":0,"ondisk_log_size":2338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"26'2216","reported_seq":2242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.839269+0000","last_change":"2024-05-08T19:22:20.459545+0000","last_active":"2024-05-08T19:48:29.839269+0000","last_peered":"2024-05-08T19:48:29.839269+0000","last_clean":"2024-05-08T19:48:29.839269+0000","last_became_active":"2024-05-08T19:22:20.459253+0000","last_became_peered":"2024-05-08T19:22:20.459253+0000","last_unstale":"2024-05-08T19:48:29.839269+0000","last_undegraded":"2024-05-08T19:48:29.839269+0000","last_fullsized":"2024-05-08T19:48:29.839269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2216,"log_dups_size":0,"ondisk_log_size":2216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"26'2202","reported_seq":2228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.909068+0000","last_change":"2024-05-08T19:22:20.462193+0000","last_active":"2024-05-08T19:48:29.909068+0000","last_peered":"2024-05-08T19:48:29.909068+0000","last_clean":"2024-05-08T19:48:29.909068+0000","last_became_active":"2024-05-08T19:22:20.461852+0000","last_became_peered":"2024-05-08T19:22:20.461852+0000","last_unstale":"2024-05-08T19:48:29.909068+0000","last_undegraded":"2024-05-08T19:48:29.909068+0000","last_fullsized":"2024-05-08T19:48:29.909068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:51.431376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"26'2249","reported_seq":2275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.437813+0000","last_change":"2024-05-08T19:22:20.453169+0000","last_active":"2024-05-08T19:48:29.437813+0000","last_peered":"2024-05-08T19:48:29.437813+0000","last_clean":"2024-05-08T19:48:29.437813+0000","last_became_active":"2024-05-08T19:22:20.452884+0000","last_became_peered":"2024-05-08T19:22:20.452884+0000","last_unstale":"2024-05-08T19:48:29.437813+0000","last_undegraded":"2024-05-08T19:48:29.437813+0000","last_fullsized":"2024-05-08T19:48:29.437813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2249,"log_dups_size":0,"ondisk_log_size":2249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"26'2281","reported_seq":2308,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.783911+0000","last_change":"2024-05-08T19:22:20.435745+0000","last_active":"2024-05-08T19:48:29.783911+0000","last_peered":"2024-05-08T19:48:29.783911+0000","last_clean":"2024-05-08T19:48:29.783911+0000","last_became_active":"2024-05-08T19:22:20.435456+0000","last_became_peered":"2024-05-08T19:22:20.435456+0000","last_unstale":"2024-05-08T19:48:29.783911+0000","last_undegraded":"2024-05-08T19:48:29.783911+0000","last_fullsized":"2024-05-08T19:48:29.783911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2281,"log_dups_size":0,"ondisk_log_size":2281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"26'2348","reported_seq":2375,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:28.730522+0000","last_change":"2024-05-08T19:22:20.444615+0000","last_active":"2024-05-08T19:48:28.730522+0000","last_peered":"2024-05-08T19:48:28.730522+0000","last_clean":"2024-05-08T19:48:28.730522+0000","last_became_active":"2024-05-08T19:22:20.444369+0000","last_became_peered":"2024-05-08T19:22:20.444369+0000","last_unstale":"2024-05-08T19:48:28.730522+0000","last_undegraded":"2024-05-08T19:48:28.730522+0000","last_fullsized":"2024-05-08T19:48:28.730522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2348,"log_dups_size":0,"ondisk_log_size":2348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'2251","reported_seq":2278,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.485265+0000","last_change":"2024-05-08T19:22:20.445391+0000","last_active":"2024-05-08T19:48:29.485265+0000","last_peered":"2024-05-08T19:48:29.485265+0000","last_clean":"2024-05-08T19:48:29.485265+0000","last_became_active":"2024-05-08T19:22:20.444996+0000","last_became_peered":"2024-05-08T19:22:20.444996+0000","last_unstale":"2024-05-08T19:48:29.485265+0000","last_undegraded":"2024-05-08T19:48:29.485265+0000","last_fullsized":"2024-05-08T19:48:29.485265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2251,"log_dups_size":0,"ondisk_log_size":2251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"26'2315","reported_seq":2342,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.701160+0000","last_change":"2024-05-08T19:22:20.451170+0000","last_active":"2024-05-08T19:48:29.701160+0000","last_peered":"2024-05-08T19:48:29.701160+0000","last_clean":"2024-05-08T19:48:29.701160+0000","last_became_active":"2024-05-08T19:22:20.450843+0000","last_became_peered":"2024-05-08T19:22:20.450843+0000","last_unstale":"2024-05-08T19:48:29.701160+0000","last_undegraded":"2024-05-08T19:48:29.701160+0000","last_fullsized":"2024-05-08T19:48:29.701160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2315,"log_dups_size":0,"ondisk_log_size":2315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'2280","reported_seq":2307,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.987017+0000","last_change":"2024-05-08T19:22:20.462503+0000","last_active":"2024-05-08T19:48:29.987017+0000","last_peered":"2024-05-08T19:48:29.987017+0000","last_clean":"2024-05-08T19:48:29.987017+0000","last_became_active":"2024-05-08T19:22:20.462266+0000","last_became_peered":"2024-05-08T19:22:20.462266+0000","last_unstale":"2024-05-08T19:48:29.987017+0000","last_undegraded":"2024-05-08T19:48:29.987017+0000","last_fullsized":"2024-05-08T19:48:29.987017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2280,"log_dups_size":0,"ondisk_log_size":2280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:04.174914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"26'2324","reported_seq":2351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:24.010922+0000","last_change":"2024-05-08T19:22:20.454128+0000","last_active":"2024-05-08T19:48:24.010922+0000","last_peered":"2024-05-08T19:48:24.010922+0000","last_clean":"2024-05-08T19:48:24.010922+0000","last_became_active":"2024-05-08T19:22:20.453834+0000","last_became_peered":"2024-05-08T19:22:20.453834+0000","last_unstale":"2024-05-08T19:48:24.010922+0000","last_undegraded":"2024-05-08T19:48:24.010922+0000","last_fullsized":"2024-05-08T19:48:24.010922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:23.193366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"26'8894","reported_seq":8969,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.789537+0000","last_change":"2024-05-08T19:22:24.616532+0000","last_active":"2024-05-08T19:48:29.789537+0000","last_peered":"2024-05-08T19:48:29.789537+0000","last_clean":"2024-05-08T19:48:29.789537+0000","last_became_active":"2024-05-08T19:22:24.616128+0000","last_became_peered":"2024-05-08T19:22:24.616128+0000","last_unstale":"2024-05-08T19:48:29.789537+0000","last_undegraded":"2024-05-08T19:48:29.789537+0000","last_fullsized":"2024-05-08T19:48:29.789537+0000","mapping_epoch":22,"log_start":"26'2412","ondisk_log_start":"26'2412","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6482,"log_dups_size":0,"ondisk_log_size":6482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:44.356550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2261478,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":51,"num_read_kb":3400,"num_write":6550,"num_write_kb":966197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"26'2349","reported_seq":2378,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:08.547207+0000","last_change":"2024-05-08T19:22:20.012743+0000","last_active":"2024-05-08T19:47:08.547207+0000","last_peered":"2024-05-08T19:47:08.547207+0000","last_clean":"2024-05-08T19:47:08.547207+0000","last_became_active":"2024-05-08T19:22:20.012453+0000","last_became_peered":"2024-05-08T19:22:20.012453+0000","last_unstale":"2024-05-08T19:47:08.547207+0000","last_undegraded":"2024-05-08T19:47:08.547207+0000","last_fullsized":"2024-05-08T19:47:08.547207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:52.547906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2351,"num_write_kb":17974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'2295","reported_seq":2323,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.508215+0000","last_change":"2024-05-08T19:22:20.464578+0000","last_active":"2024-05-08T19:48:29.508215+0000","last_peered":"2024-05-08T19:48:29.508215+0000","last_clean":"2024-05-08T19:48:29.508215+0000","last_became_active":"2024-05-08T19:22:20.464396+0000","last_became_peered":"2024-05-08T19:22:20.464396+0000","last_unstale":"2024-05-08T19:48:29.508215+0000","last_undegraded":"2024-05-08T19:48:29.508215+0000","last_fullsized":"2024-05-08T19:48:29.508215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"26'8763","reported_seq":9429,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.011249+0000","last_change":"2024-05-08T19:22:24.469561+0000","last_active":"2024-05-08T19:48:30.011249+0000","last_peered":"2024-05-08T19:48:30.011249+0000","last_clean":"2024-05-08T19:48:30.011249+0000","last_became_active":"2024-05-08T19:22:24.469161+0000","last_became_peered":"2024-05-08T19:22:24.469161+0000","last_unstale":"2024-05-08T19:48:30.011249+0000","last_undegraded":"2024-05-08T19:48:30.011249+0000","last_fullsized":"2024-05-08T19:48:30.011249+0000","mapping_epoch":22,"log_start":"26'1544","ondisk_log_start":"26'1544","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7219,"log_dups_size":0,"ondisk_log_size":7219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:50.011809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2824860,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":642,"num_read_kb":43100,"num_write":6319,"num_write_kb":920646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"26'8076","reported_seq":8105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.072681+0000","last_change":"2024-05-08T19:22:20.006198+0000","last_active":"2024-05-08T19:48:30.072681+0000","last_peered":"2024-05-08T19:48:30.072681+0000","last_clean":"2024-05-08T19:48:30.072681+0000","last_became_active":"2024-05-08T19:22:20.005723+0000","last_became_peered":"2024-05-08T19:22:20.005723+0000","last_unstale":"2024-05-08T19:48:30.072681+0000","last_undegraded":"2024-05-08T19:48:30.072681+0000","last_fullsized":"2024-05-08T19:48:30.072681+0000","mapping_epoch":17,"log_start":"26'1600","ondisk_log_start":"26'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6476,"log_dups_size":0,"ondisk_log_size":6476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8075,"num_write_kb":50504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'2296","reported_seq":2324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.638193+0000","last_change":"2024-05-08T19:22:20.451485+0000","last_active":"2024-05-08T19:48:29.638193+0000","last_peered":"2024-05-08T19:48:29.638193+0000","last_clean":"2024-05-08T19:48:29.638193+0000","last_became_active":"2024-05-08T19:22:20.446380+0000","last_became_peered":"2024-05-08T19:22:20.446380+0000","last_unstale":"2024-05-08T19:48:29.638193+0000","last_undegraded":"2024-05-08T19:48:29.638193+0000","last_fullsized":"2024-05-08T19:48:29.638193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2296,"log_dups_size":0,"ondisk_log_size":2296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:47.856077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"26'8161","reported_seq":8789,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.923489+0000","last_change":"2024-05-08T19:22:24.465354+0000","last_active":"2024-05-08T19:48:29.923489+0000","last_peered":"2024-05-08T19:48:29.923489+0000","last_clean":"2024-05-08T19:48:29.923489+0000","last_became_active":"2024-05-08T19:22:24.464669+0000","last_became_peered":"2024-05-08T19:22:24.464669+0000","last_unstale":"2024-05-08T19:48:29.923489+0000","last_undegraded":"2024-05-08T19:48:29.923489+0000","last_fullsized":"2024-05-08T19:48:29.923489+0000","mapping_epoch":22,"log_start":"26'1003","ondisk_log_start":"26'1003","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7158,"log_dups_size":0,"ondisk_log_size":7158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:29.398413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880683,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":604,"num_read_kb":22018,"num_write":5695,"num_write_kb":861910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'9217","reported_seq":9244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:36.403369+0000","last_change":"2024-05-08T19:22:20.014506+0000","last_active":"2024-05-08T19:47:36.403369+0000","last_peered":"2024-05-08T19:47:36.403369+0000","last_clean":"2024-05-08T19:47:36.403369+0000","last_became_active":"2024-05-08T19:22:20.014239+0000","last_became_peered":"2024-05-08T19:22:20.014239+0000","last_unstale":"2024-05-08T19:47:36.403369+0000","last_undegraded":"2024-05-08T19:47:36.403369+0000","last_fullsized":"2024-05-08T19:47:36.403369+0000","mapping_epoch":17,"log_start":"26'2300","ondisk_log_start":"26'2300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6917,"log_dups_size":0,"ondisk_log_size":6917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:23.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":9231,"num_write_kb":71812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'2380","reported_seq":2400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.896235+0000","last_change":"2024-05-08T19:23:11.054407+0000","last_active":"2024-05-08T19:48:29.896235+0000","last_peered":"2024-05-08T19:48:29.896235+0000","last_clean":"2024-05-08T19:48:29.896235+0000","last_became_active":"2024-05-08T19:23:11.054036+0000","last_became_peered":"2024-05-08T19:23:11.054036+0000","last_unstale":"2024-05-08T19:48:29.896235+0000","last_undegraded":"2024-05-08T19:48:29.896235+0000","last_fullsized":"2024-05-08T19:48:29.896235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2380,"log_dups_size":0,"ondisk_log_size":2380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:41.638647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"26'8184","reported_seq":8450,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.730638+0000","last_change":"2024-05-08T19:22:24.479649+0000","last_active":"2024-05-08T19:48:29.730638+0000","last_peered":"2024-05-08T19:48:29.730638+0000","last_clean":"2024-05-08T19:48:29.730638+0000","last_became_active":"2024-05-08T19:22:24.479255+0000","last_became_peered":"2024-05-08T19:22:24.479255+0000","last_unstale":"2024-05-08T19:48:29.730638+0000","last_undegraded":"2024-05-08T19:48:29.730638+0000","last_fullsized":"2024-05-08T19:48:29.730638+0000","mapping_epoch":22,"log_start":"26'1000","ondisk_log_start":"26'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7184,"log_dups_size":0,"ondisk_log_size":7184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2436548,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":242,"num_read_kb":15390,"num_write":5806,"num_write_kb":1051846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6108","reported_seq":6135,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:22.734555+0000","last_change":"2024-05-08T19:22:20.014093+0000","last_active":"2024-05-08T19:47:22.734555+0000","last_peered":"2024-05-08T19:47:22.734555+0000","last_clean":"2024-05-08T19:47:22.734555+0000","last_became_active":"2024-05-08T19:22:20.013793+0000","last_became_peered":"2024-05-08T19:22:20.013793+0000","last_unstale":"2024-05-08T19:47:22.734555+0000","last_undegraded":"2024-05-08T19:47:22.734555+0000","last_fullsized":"2024-05-08T19:47:22.734555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6108,"log_dups_size":0,"ondisk_log_size":6108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6121,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'2276","reported_seq":2302,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.766528+0000","last_change":"2024-05-08T19:22:20.455505+0000","last_active":"2024-05-08T19:48:29.766528+0000","last_peered":"2024-05-08T19:48:29.766528+0000","last_clean":"2024-05-08T19:48:29.766528+0000","last_became_active":"2024-05-08T19:22:20.455148+0000","last_became_peered":"2024-05-08T19:22:20.455148+0000","last_unstale":"2024-05-08T19:48:29.766528+0000","last_undegraded":"2024-05-08T19:48:29.766528+0000","last_fullsized":"2024-05-08T19:48:29.766528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2276,"log_dups_size":0,"ondisk_log_size":2276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"26'8403","reported_seq":9263,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.767683+0000","last_change":"2024-05-08T19:22:24.465009+0000","last_active":"2024-05-08T19:48:29.767683+0000","last_peered":"2024-05-08T19:48:29.767683+0000","last_clean":"2024-05-08T19:48:29.767683+0000","last_became_active":"2024-05-08T19:22:24.464422+0000","last_became_peered":"2024-05-08T19:22:24.464422+0000","last_unstale":"2024-05-08T19:48:29.767683+0000","last_undegraded":"2024-05-08T19:48:29.767683+0000","last_fullsized":"2024-05-08T19:48:29.767683+0000","mapping_epoch":22,"log_start":"26'2000","ondisk_log_start":"26'2000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6403,"log_dups_size":0,"ondisk_log_size":6403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:12.830755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1989992,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":836,"num_read_kb":58598,"num_write":5961,"num_write_kb":988104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"26'8499","reported_seq":8526,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.071306+0000","last_change":"2024-05-08T19:22:20.011515+0000","last_active":"2024-05-08T19:48:30.071306+0000","last_peered":"2024-05-08T19:48:30.071306+0000","last_clean":"2024-05-08T19:48:30.071306+0000","last_became_active":"2024-05-08T19:22:20.011183+0000","last_became_peered":"2024-05-08T19:22:20.011183+0000","last_unstale":"2024-05-08T19:48:30.071306+0000","last_undegraded":"2024-05-08T19:48:30.071306+0000","last_fullsized":"2024-05-08T19:48:30.071306+0000","mapping_epoch":17,"log_start":"26'2100","ondisk_log_start":"26'2100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6399,"log_dups_size":0,"ondisk_log_size":6399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8493,"num_write_kb":66920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'2319","reported_seq":2345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.609234+0000","last_change":"2024-05-08T19:22:20.439371+0000","last_active":"2024-05-08T19:48:29.609234+0000","last_peered":"2024-05-08T19:48:29.609234+0000","last_clean":"2024-05-08T19:48:29.609234+0000","last_became_active":"2024-05-08T19:22:20.439096+0000","last_became_peered":"2024-05-08T19:22:20.439096+0000","last_unstale":"2024-05-08T19:48:29.609234+0000","last_undegraded":"2024-05-08T19:48:29.609234+0000","last_fullsized":"2024-05-08T19:48:29.609234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2319,"log_dups_size":0,"ondisk_log_size":2319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:56.795619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'8624","reported_seq":9354,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.100706+0000","last_change":"2024-05-08T19:23:11.529967+0000","last_active":"2024-05-08T19:48:30.100706+0000","last_peered":"2024-05-08T19:48:30.100706+0000","last_clean":"2024-05-08T19:48:30.100706+0000","last_became_active":"2024-05-08T19:23:11.529451+0000","last_became_peered":"2024-05-08T19:23:11.529451+0000","last_unstale":"2024-05-08T19:48:30.100706+0000","last_undegraded":"2024-05-08T19:48:30.100706+0000","last_fullsized":"2024-05-08T19:48:30.100706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":8624,"log_dups_size":0,"ondisk_log_size":8624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:23.975698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2253528,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":696,"num_read_kb":42234,"num_write":6155,"num_write_kb":1013077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"26'10407","reported_seq":10434,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:22.961151+0000","last_change":"2024-05-08T19:22:20.004185+0000","last_active":"2024-05-08T19:48:22.961151+0000","last_peered":"2024-05-08T19:48:22.961151+0000","last_clean":"2024-05-08T19:48:22.961151+0000","last_became_active":"2024-05-08T19:22:20.003513+0000","last_became_peered":"2024-05-08T19:22:20.003513+0000","last_unstale":"2024-05-08T19:48:22.961151+0000","last_undegraded":"2024-05-08T19:48:22.961151+0000","last_fullsized":"2024-05-08T19:48:22.961151+0000","mapping_epoch":17,"log_start":"26'2500","ondisk_log_start":"26'2500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7907,"log_dups_size":0,"ondisk_log_size":7907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10402,"num_write_kb":72564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'2262","reported_seq":2288,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.819862+0000","last_change":"2024-05-08T19:22:20.446538+0000","last_active":"2024-05-08T19:48:29.819862+0000","last_peered":"2024-05-08T19:48:29.819862+0000","last_clean":"2024-05-08T19:48:29.819862+0000","last_became_active":"2024-05-08T19:22:20.445238+0000","last_became_peered":"2024-05-08T19:22:20.445238+0000","last_unstale":"2024-05-08T19:48:29.819862+0000","last_undegraded":"2024-05-08T19:48:29.819862+0000","last_fullsized":"2024-05-08T19:48:29.819862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2262,"log_dups_size":0,"ondisk_log_size":2262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'8242","reported_seq":10709,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.972487+0000","last_change":"2024-05-08T19:22:24.479665+0000","last_active":"2024-05-08T19:48:29.972487+0000","last_peered":"2024-05-08T19:48:29.972487+0000","last_clean":"2024-05-08T19:48:29.972487+0000","last_became_active":"2024-05-08T19:22:24.478998+0000","last_became_peered":"2024-05-08T19:22:24.478998+0000","last_unstale":"2024-05-08T19:48:29.972487+0000","last_undegraded":"2024-05-08T19:48:29.972487+0000","last_fullsized":"2024-05-08T19:48:29.972487+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7942,"log_dups_size":0,"ondisk_log_size":7942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:55.287155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1844298,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2441,"num_read_kb":165440,"num_write":5883,"num_write_kb":873311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"26'5851","reported_seq":5878,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.065548+0000","last_change":"2024-05-08T19:22:20.002850+0000","last_active":"2024-05-08T19:48:30.065548+0000","last_peered":"2024-05-08T19:48:30.065548+0000","last_clean":"2024-05-08T19:48:30.065548+0000","last_became_active":"2024-05-08T19:22:20.002534+0000","last_became_peered":"2024-05-08T19:22:20.002534+0000","last_unstale":"2024-05-08T19:48:30.065548+0000","last_undegraded":"2024-05-08T19:48:30.065548+0000","last_fullsized":"2024-05-08T19:48:30.065548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5851,"log_dups_size":0,"ondisk_log_size":5851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5849,"num_write_kb":40670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"26'2347","reported_seq":2373,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.926085+0000","last_change":"2024-05-08T19:22:20.436698+0000","last_active":"2024-05-08T19:48:29.926085+0000","last_peered":"2024-05-08T19:48:29.926085+0000","last_clean":"2024-05-08T19:48:29.926085+0000","last_became_active":"2024-05-08T19:22:20.436431+0000","last_became_peered":"2024-05-08T19:22:20.436431+0000","last_unstale":"2024-05-08T19:48:29.926085+0000","last_undegraded":"2024-05-08T19:48:29.926085+0000","last_fullsized":"2024-05-08T19:48:29.926085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2347,"log_dups_size":0,"ondisk_log_size":2347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'8438","reported_seq":9167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.966724+0000","last_change":"2024-05-08T19:22:24.617420+0000","last_active":"2024-05-08T19:48:29.966724+0000","last_peered":"2024-05-08T19:48:29.966724+0000","last_clean":"2024-05-08T19:48:29.966724+0000","last_became_active":"2024-05-08T19:22:24.617030+0000","last_became_peered":"2024-05-08T19:22:24.617030+0000","last_unstale":"2024-05-08T19:48:29.966724+0000","last_undegraded":"2024-05-08T19:48:29.966724+0000","last_fullsized":"2024-05-08T19:48:29.966724+0000","mapping_epoch":22,"log_start":"26'1202","ondisk_log_start":"26'1202","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7236,"log_dups_size":0,"ondisk_log_size":7236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:29.274973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2763684,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":703,"num_read_kb":49016,"num_write":6096,"num_write_kb":1037918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"26'9201","reported_seq":9228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:46:37.444413+0000","last_change":"2024-05-08T19:22:20.003949+0000","last_active":"2024-05-08T19:46:37.444413+0000","last_peered":"2024-05-08T19:46:37.444413+0000","last_clean":"2024-05-08T19:46:37.444413+0000","last_became_active":"2024-05-08T19:22:20.003365+0000","last_became_peered":"2024-05-08T19:22:20.003365+0000","last_unstale":"2024-05-08T19:46:37.444413+0000","last_undegraded":"2024-05-08T19:46:37.444413+0000","last_fullsized":"2024-05-08T19:46:37.444413+0000","mapping_epoch":17,"log_start":"26'1700","ondisk_log_start":"26'1700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7501,"log_dups_size":0,"ondisk_log_size":7501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9188,"num_write_kb":63509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"26'2275","reported_seq":2301,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.364983+0000","last_change":"2024-05-08T19:22:20.437480+0000","last_active":"2024-05-08T19:48:29.364983+0000","last_peered":"2024-05-08T19:48:29.364983+0000","last_clean":"2024-05-08T19:48:29.364983+0000","last_became_active":"2024-05-08T19:22:20.437214+0000","last_became_peered":"2024-05-08T19:22:20.437214+0000","last_unstale":"2024-05-08T19:48:29.364983+0000","last_undegraded":"2024-05-08T19:48:29.364983+0000","last_fullsized":"2024-05-08T19:48:29.364983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2275,"log_dups_size":0,"ondisk_log_size":2275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"26'8393","reported_seq":8861,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.769227+0000","last_change":"2024-05-08T19:22:24.615730+0000","last_active":"2024-05-08T19:48:29.769227+0000","last_peered":"2024-05-08T19:48:29.769227+0000","last_clean":"2024-05-08T19:48:29.769227+0000","last_became_active":"2024-05-08T19:22:24.615351+0000","last_became_peered":"2024-05-08T19:22:24.615351+0000","last_unstale":"2024-05-08T19:48:29.769227+0000","last_undegraded":"2024-05-08T19:48:29.769227+0000","last_fullsized":"2024-05-08T19:48:29.769227+0000","mapping_epoch":22,"log_start":"26'1914","ondisk_log_start":"26'1914","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6479,"log_dups_size":0,"ondisk_log_size":6479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2591622,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":443,"num_read_kb":19968,"num_write":5920,"num_write_kb":994007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"26'7040","reported_seq":7905,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:46.436611+0000","last_change":"2024-05-08T19:22:20.002400+0000","last_active":"2024-05-08T19:47:46.436611+0000","last_peered":"2024-05-08T19:47:46.436611+0000","last_clean":"2024-05-08T19:47:46.436611+0000","last_became_active":"2024-05-08T19:22:20.001990+0000","last_became_peered":"2024-05-08T19:22:20.001990+0000","last_unstale":"2024-05-08T19:47:46.436611+0000","last_undegraded":"2024-05-08T19:47:46.436611+0000","last_fullsized":"2024-05-08T19:47:46.436611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7040,"log_dups_size":0,"ondisk_log_size":7040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":838,"num_read_kb":4635,"num_write":7033,"num_write_kb":49678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"26'2293","reported_seq":2319,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.474226+0000","last_change":"2024-05-08T19:22:20.447742+0000","last_active":"2024-05-08T19:48:29.474226+0000","last_peered":"2024-05-08T19:48:29.474226+0000","last_clean":"2024-05-08T19:48:29.474226+0000","last_became_active":"2024-05-08T19:22:20.447475+0000","last_became_peered":"2024-05-08T19:22:20.447475+0000","last_unstale":"2024-05-08T19:48:29.474226+0000","last_undegraded":"2024-05-08T19:48:29.474226+0000","last_fullsized":"2024-05-08T19:48:29.474226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2293,"log_dups_size":0,"ondisk_log_size":2293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'7931","reported_seq":8419,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.027857+0000","last_change":"2024-05-08T19:23:11.054182+0000","last_active":"2024-05-08T19:48:30.027857+0000","last_peered":"2024-05-08T19:48:30.027857+0000","last_clean":"2024-05-08T19:48:30.027857+0000","last_became_active":"2024-05-08T19:23:11.053733+0000","last_became_peered":"2024-05-08T19:23:11.053733+0000","last_unstale":"2024-05-08T19:48:30.027857+0000","last_undegraded":"2024-05-08T19:48:30.027857+0000","last_fullsized":"2024-05-08T19:48:30.027857+0000","mapping_epoch":25,"log_start":"26'1500","ondisk_log_start":"26'1500","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6431,"log_dups_size":0,"ondisk_log_size":6431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:25.669682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2393664,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":453,"num_read_kb":17282,"num_write":5539,"num_write_kb":1020101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"26'6222","reported_seq":6249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:46.403274+0000","last_change":"2024-05-08T19:22:20.001272+0000","last_active":"2024-05-08T19:47:46.403274+0000","last_peered":"2024-05-08T19:47:46.403274+0000","last_clean":"2024-05-08T19:47:46.403274+0000","last_became_active":"2024-05-08T19:22:20.000981+0000","last_became_peered":"2024-05-08T19:22:20.000981+0000","last_unstale":"2024-05-08T19:47:46.403274+0000","last_undegraded":"2024-05-08T19:47:46.403274+0000","last_fullsized":"2024-05-08T19:47:46.403274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6222,"log_dups_size":0,"ondisk_log_size":6222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6225,"num_write_kb":45123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"26'2312","reported_seq":2338,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.863471+0000","last_change":"2024-05-08T19:22:20.446938+0000","last_active":"2024-05-08T19:48:29.863471+0000","last_peered":"2024-05-08T19:48:29.863471+0000","last_clean":"2024-05-08T19:48:29.863471+0000","last_became_active":"2024-05-08T19:22:20.446644+0000","last_became_peered":"2024-05-08T19:22:20.446644+0000","last_unstale":"2024-05-08T19:48:29.863471+0000","last_undegraded":"2024-05-08T19:48:29.863471+0000","last_fullsized":"2024-05-08T19:48:29.863471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2312,"log_dups_size":0,"ondisk_log_size":2312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:39:35.443674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"26'8282","reported_seq":8802,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.984044+0000","last_change":"2024-05-08T19:22:24.465089+0000","last_active":"2024-05-08T19:48:29.984044+0000","last_peered":"2024-05-08T19:48:29.984044+0000","last_clean":"2024-05-08T19:48:29.984044+0000","last_became_active":"2024-05-08T19:22:24.464178+0000","last_became_peered":"2024-05-08T19:22:24.464178+0000","last_unstale":"2024-05-08T19:48:29.984044+0000","last_undegraded":"2024-05-08T19:48:29.984044+0000","last_fullsized":"2024-05-08T19:48:29.984044+0000","mapping_epoch":22,"log_start":"26'1100","ondisk_log_start":"26'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7182,"log_dups_size":0,"ondisk_log_size":7182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2099376,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":495,"num_read_kb":27360,"num_write":5849,"num_write_kb":879779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'6718","reported_seq":6745,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:19.537721+0000","last_change":"2024-05-08T19:22:20.001300+0000","last_active":"2024-05-08T19:48:19.537721+0000","last_peered":"2024-05-08T19:48:19.537721+0000","last_clean":"2024-05-08T19:48:19.537721+0000","last_became_active":"2024-05-08T19:22:20.000985+0000","last_became_peered":"2024-05-08T19:22:20.000985+0000","last_unstale":"2024-05-08T19:48:19.537721+0000","last_undegraded":"2024-05-08T19:48:19.537721+0000","last_fullsized":"2024-05-08T19:48:19.537721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6718,"log_dups_size":0,"ondisk_log_size":6718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:50.426177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":6735,"num_write_kb":41822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'2300","reported_seq":2327,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.234932+0000","last_change":"2024-05-08T19:22:20.447801+0000","last_active":"2024-05-08T19:48:29.234932+0000","last_peered":"2024-05-08T19:48:29.234932+0000","last_clean":"2024-05-08T19:48:29.234932+0000","last_became_active":"2024-05-08T19:22:20.447538+0000","last_became_peered":"2024-05-08T19:22:20.447538+0000","last_unstale":"2024-05-08T19:48:29.234932+0000","last_undegraded":"2024-05-08T19:48:29.234932+0000","last_fullsized":"2024-05-08T19:48:29.234932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2300,"log_dups_size":0,"ondisk_log_size":2300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:14.706653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"26'8556","reported_seq":9098,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.377078+0000","last_change":"2024-05-08T19:22:24.479544+0000","last_active":"2024-05-08T19:48:29.377078+0000","last_peered":"2024-05-08T19:48:29.377078+0000","last_clean":"2024-05-08T19:48:29.377078+0000","last_became_active":"2024-05-08T19:22:24.479071+0000","last_became_peered":"2024-05-08T19:22:24.479071+0000","last_unstale":"2024-05-08T19:48:29.377078+0000","last_undegraded":"2024-05-08T19:48:29.377078+0000","last_fullsized":"2024-05-08T19:48:29.377078+0000","mapping_epoch":22,"log_start":"26'1203","ondisk_log_start":"26'1203","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7353,"log_dups_size":0,"ondisk_log_size":7353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:19.704360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5422324,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":517,"num_read_kb":30942,"num_write":6150,"num_write_kb":930944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'10871","reported_seq":11527,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.097575+0000","last_change":"2024-05-08T19:22:20.011799+0000","last_active":"2024-05-08T19:48:30.097575+0000","last_peered":"2024-05-08T19:48:30.097575+0000","last_clean":"2024-05-08T19:48:30.097575+0000","last_became_active":"2024-05-08T19:22:20.011331+0000","last_became_peered":"2024-05-08T19:22:20.011331+0000","last_unstale":"2024-05-08T19:48:30.097575+0000","last_undegraded":"2024-05-08T19:48:30.097575+0000","last_fullsized":"2024-05-08T19:48:30.097575+0000","mapping_epoch":17,"log_start":"26'2900","ondisk_log_start":"26'2900","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7971,"log_dups_size":0,"ondisk_log_size":7971,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":630,"num_read_kb":4505,"num_write":10866,"num_write_kb":72955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"26'2223","reported_seq":2249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:26.642870+0000","last_change":"2024-05-08T19:22:20.447583+0000","last_active":"2024-05-08T19:48:26.642870+0000","last_peered":"2024-05-08T19:48:26.642870+0000","last_clean":"2024-05-08T19:48:26.642870+0000","last_became_active":"2024-05-08T19:22:20.447243+0000","last_became_peered":"2024-05-08T19:22:20.447243+0000","last_unstale":"2024-05-08T19:48:26.642870+0000","last_undegraded":"2024-05-08T19:48:26.642870+0000","last_fullsized":"2024-05-08T19:48:26.642870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2223,"log_dups_size":0,"ondisk_log_size":2223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'8660","reported_seq":9061,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.915473+0000","last_change":"2024-05-08T19:22:24.615622+0000","last_active":"2024-05-08T19:48:29.915473+0000","last_peered":"2024-05-08T19:48:29.915473+0000","last_clean":"2024-05-08T19:48:29.915473+0000","last_became_active":"2024-05-08T19:22:24.614790+0000","last_became_peered":"2024-05-08T19:22:24.614790+0000","last_unstale":"2024-05-08T19:48:29.915473+0000","last_undegraded":"2024-05-08T19:48:29.915473+0000","last_fullsized":"2024-05-08T19:48:29.915473+0000","mapping_epoch":22,"log_start":"26'1126","ondisk_log_start":"26'1126","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7534,"log_dups_size":0,"ondisk_log_size":7534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2455380,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":377,"num_read_kb":22514,"num_write":6329,"num_write_kb":865965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"26'4995","reported_seq":5023,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:15.305590+0000","last_change":"2024-05-08T19:22:20.006367+0000","last_active":"2024-05-08T19:48:15.305590+0000","last_peered":"2024-05-08T19:48:15.305590+0000","last_clean":"2024-05-08T19:48:15.305590+0000","last_became_active":"2024-05-08T19:22:20.005738+0000","last_became_peered":"2024-05-08T19:22:20.005738+0000","last_unstale":"2024-05-08T19:48:15.305590+0000","last_undegraded":"2024-05-08T19:48:15.305590+0000","last_fullsized":"2024-05-08T19:48:15.305590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4995,"log_dups_size":0,"ondisk_log_size":4995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4997,"num_write_kb":36069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"26'2310","reported_seq":2337,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.334524+0000","last_change":"2024-05-08T19:22:20.448713+0000","last_active":"2024-05-08T19:48:29.334524+0000","last_peered":"2024-05-08T19:48:29.334524+0000","last_clean":"2024-05-08T19:48:29.334524+0000","last_became_active":"2024-05-08T19:22:20.448268+0000","last_became_peered":"2024-05-08T19:22:20.448268+0000","last_unstale":"2024-05-08T19:48:29.334524+0000","last_undegraded":"2024-05-08T19:48:29.334524+0000","last_fullsized":"2024-05-08T19:48:29.334524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2310,"log_dups_size":0,"ondisk_log_size":2310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"26'8177","reported_seq":8301,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.029291+0000","last_change":"2024-05-08T19:22:24.614076+0000","last_active":"2024-05-08T19:48:30.029291+0000","last_peered":"2024-05-08T19:48:30.029291+0000","last_clean":"2024-05-08T19:48:30.029291+0000","last_became_active":"2024-05-08T19:22:24.613698+0000","last_became_peered":"2024-05-08T19:22:24.613698+0000","last_unstale":"2024-05-08T19:48:30.029291+0000","last_undegraded":"2024-05-08T19:48:30.029291+0000","last_fullsized":"2024-05-08T19:48:30.029291+0000","mapping_epoch":22,"log_start":"26'1759","ondisk_log_start":"26'1759","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6418,"log_dups_size":0,"ondisk_log_size":6418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:26.030709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3032238,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":99,"num_read_kb":5304,"num_write":5797,"num_write_kb":1072126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'2636","reported_seq":2664,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:59.935072+0000","last_change":"2024-05-08T19:22:20.011480+0000","last_active":"2024-05-08T19:47:59.935072+0000","last_peered":"2024-05-08T19:47:59.935072+0000","last_clean":"2024-05-08T19:47:59.935072+0000","last_became_active":"2024-05-08T19:22:20.011188+0000","last_became_peered":"2024-05-08T19:22:20.011188+0000","last_unstale":"2024-05-08T19:47:59.935072+0000","last_undegraded":"2024-05-08T19:47:59.935072+0000","last_fullsized":"2024-05-08T19:47:59.935072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2636,"log_dups_size":0,"ondisk_log_size":2636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2643,"num_write_kb":22132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'2318","reported_seq":2345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.680606+0000","last_change":"2024-05-08T19:22:20.455818+0000","last_active":"2024-05-08T19:48:27.680606+0000","last_peered":"2024-05-08T19:48:27.680606+0000","last_clean":"2024-05-08T19:48:27.680606+0000","last_became_active":"2024-05-08T19:22:20.455562+0000","last_became_peered":"2024-05-08T19:22:20.455562+0000","last_unstale":"2024-05-08T19:48:27.680606+0000","last_undegraded":"2024-05-08T19:48:27.680606+0000","last_fullsized":"2024-05-08T19:48:27.680606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2318,"log_dups_size":0,"ondisk_log_size":2318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"26'8195","reported_seq":8371,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.846935+0000","last_change":"2024-05-08T19:22:24.616812+0000","last_active":"2024-05-08T19:48:29.846935+0000","last_peered":"2024-05-08T19:48:29.846935+0000","last_clean":"2024-05-08T19:48:29.846935+0000","last_became_active":"2024-05-08T19:22:24.615618+0000","last_became_peered":"2024-05-08T19:22:24.615618+0000","last_unstale":"2024-05-08T19:48:29.846935+0000","last_undegraded":"2024-05-08T19:48:29.846935+0000","last_fullsized":"2024-05-08T19:48:29.846935+0000","mapping_epoch":22,"log_start":"26'1715","ondisk_log_start":"26'1715","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6480,"log_dups_size":0,"ondisk_log_size":6480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:21.559278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2601582,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":152,"num_read_kb":3194,"num_write":5693,"num_write_kb":833306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"26'3930","reported_seq":3958,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:59.629602+0000","last_change":"2024-05-08T19:22:20.004327+0000","last_active":"2024-05-08T19:47:59.629602+0000","last_peered":"2024-05-08T19:47:59.629602+0000","last_clean":"2024-05-08T19:47:59.629602+0000","last_became_active":"2024-05-08T19:22:20.003725+0000","last_became_peered":"2024-05-08T19:22:20.003725+0000","last_unstale":"2024-05-08T19:47:59.629602+0000","last_undegraded":"2024-05-08T19:47:59.629602+0000","last_fullsized":"2024-05-08T19:47:59.629602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":3930,"log_dups_size":0,"ondisk_log_size":3930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3928,"num_write_kb":31166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"26'2224","reported_seq":2251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.015918+0000","last_change":"2024-05-08T19:22:20.459536+0000","last_active":"2024-05-08T19:48:30.015918+0000","last_peered":"2024-05-08T19:48:30.015918+0000","last_clean":"2024-05-08T19:48:30.015918+0000","last_became_active":"2024-05-08T19:22:20.452496+0000","last_became_peered":"2024-05-08T19:22:20.452496+0000","last_unstale":"2024-05-08T19:48:30.015918+0000","last_undegraded":"2024-05-08T19:48:30.015918+0000","last_fullsized":"2024-05-08T19:48:30.015918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2224,"log_dups_size":0,"ondisk_log_size":2224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"26'8416","reported_seq":9020,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.914488+0000","last_change":"2024-05-08T19:22:24.478351+0000","last_active":"2024-05-08T19:48:29.914488+0000","last_peered":"2024-05-08T19:48:29.914488+0000","last_clean":"2024-05-08T19:48:29.914488+0000","last_became_active":"2024-05-08T19:22:24.477728+0000","last_became_peered":"2024-05-08T19:22:24.477728+0000","last_unstale":"2024-05-08T19:48:29.914488+0000","last_undegraded":"2024-05-08T19:48:29.914488+0000","last_fullsized":"2024-05-08T19:48:29.914488+0000","mapping_epoch":22,"log_start":"26'1217","ondisk_log_start":"26'1217","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7199,"log_dups_size":0,"ondisk_log_size":7199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2423580,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":580,"num_read_kb":39960,"num_write":5994,"num_write_kb":827712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"26'5263","reported_seq":5291,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.028947+0000","last_change":"2024-05-08T19:22:20.008346+0000","last_active":"2024-05-08T19:48:30.028947+0000","last_peered":"2024-05-08T19:48:30.028947+0000","last_clean":"2024-05-08T19:48:30.028947+0000","last_became_active":"2024-05-08T19:22:20.007985+0000","last_became_peered":"2024-05-08T19:22:20.007985+0000","last_unstale":"2024-05-08T19:48:30.028947+0000","last_undegraded":"2024-05-08T19:48:30.028947+0000","last_fullsized":"2024-05-08T19:48:30.028947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5263,"log_dups_size":0,"ondisk_log_size":5263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":5293,"num_write_kb":36936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"26'2335","reported_seq":2362,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.360048+0000","last_change":"2024-05-08T19:22:20.458860+0000","last_active":"2024-05-08T19:48:27.360048+0000","last_peered":"2024-05-08T19:48:27.360048+0000","last_clean":"2024-05-08T19:48:27.360048+0000","last_became_active":"2024-05-08T19:22:20.458588+0000","last_became_peered":"2024-05-08T19:22:20.458588+0000","last_unstale":"2024-05-08T19:48:27.360048+0000","last_undegraded":"2024-05-08T19:48:27.360048+0000","last_fullsized":"2024-05-08T19:48:27.360048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2335,"log_dups_size":0,"ondisk_log_size":2335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"26'8503","reported_seq":10172,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.005568+0000","last_change":"2024-05-08T19:22:24.464132+0000","last_active":"2024-05-08T19:48:30.005568+0000","last_peered":"2024-05-08T19:48:30.005568+0000","last_clean":"2024-05-08T19:48:30.005568+0000","last_became_active":"2024-05-08T19:22:24.463741+0000","last_became_peered":"2024-05-08T19:22:24.463741+0000","last_unstale":"2024-05-08T19:48:30.005568+0000","last_undegraded":"2024-05-08T19:48:30.005568+0000","last_fullsized":"2024-05-08T19:48:30.005568+0000","mapping_epoch":22,"log_start":"26'1304","ondisk_log_start":"26'1304","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7199,"log_dups_size":0,"ondisk_log_size":7199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:13.044112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2383830,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1644,"num_read_kb":83588,"num_write":6105,"num_write_kb":944540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"26'5910","reported_seq":5938,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.074638+0000","last_change":"2024-05-08T19:22:20.005994+0000","last_active":"2024-05-08T19:48:30.074638+0000","last_peered":"2024-05-08T19:48:30.074638+0000","last_clean":"2024-05-08T19:48:30.074638+0000","last_became_active":"2024-05-08T19:22:20.005680+0000","last_became_peered":"2024-05-08T19:22:20.005680+0000","last_unstale":"2024-05-08T19:48:30.074638+0000","last_undegraded":"2024-05-08T19:48:30.074638+0000","last_fullsized":"2024-05-08T19:48:30.074638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5910,"log_dups_size":0,"ondisk_log_size":5910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:18.387895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5919,"num_write_kb":40735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"26'2276","reported_seq":2303,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.386106+0000","last_change":"2024-05-08T19:22:20.449812+0000","last_active":"2024-05-08T19:48:27.386106+0000","last_peered":"2024-05-08T19:48:27.386106+0000","last_clean":"2024-05-08T19:48:27.386106+0000","last_became_active":"2024-05-08T19:22:20.449512+0000","last_became_peered":"2024-05-08T19:22:20.449512+0000","last_unstale":"2024-05-08T19:48:27.386106+0000","last_undegraded":"2024-05-08T19:48:27.386106+0000","last_fullsized":"2024-05-08T19:48:27.386106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2276,"log_dups_size":0,"ondisk_log_size":2276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"26'8802","reported_seq":9086,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.216869+0000","last_change":"2024-05-08T19:22:24.478647+0000","last_active":"2024-05-08T19:48:29.216869+0000","last_peered":"2024-05-08T19:48:29.216869+0000","last_clean":"2024-05-08T19:48:29.216869+0000","last_became_active":"2024-05-08T19:22:24.478248+0000","last_became_peered":"2024-05-08T19:22:24.478248+0000","last_unstale":"2024-05-08T19:48:29.216869+0000","last_undegraded":"2024-05-08T19:48:29.216869+0000","last_fullsized":"2024-05-08T19:48:29.216869+0000","mapping_epoch":22,"log_start":"26'1412","ondisk_log_start":"26'1412","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7390,"log_dups_size":0,"ondisk_log_size":7390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:26.651711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4425186,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":258,"num_read_kb":14826,"num_write":6409,"num_write_kb":856300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"26'7007","reported_seq":7036,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:13.224756+0000","last_change":"2024-05-08T19:22:20.003344+0000","last_active":"2024-05-08T19:47:13.224756+0000","last_peered":"2024-05-08T19:47:13.224756+0000","last_clean":"2024-05-08T19:47:13.224756+0000","last_became_active":"2024-05-08T19:22:20.003055+0000","last_became_peered":"2024-05-08T19:22:20.003055+0000","last_unstale":"2024-05-08T19:47:13.224756+0000","last_undegraded":"2024-05-08T19:47:13.224756+0000","last_fullsized":"2024-05-08T19:47:13.224756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7007,"log_dups_size":0,"ondisk_log_size":7007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7014,"num_write_kb":53638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"26'2278","reported_seq":2306,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.646775+0000","last_change":"2024-05-08T19:22:20.450523+0000","last_active":"2024-05-08T19:48:29.646775+0000","last_peered":"2024-05-08T19:48:29.646775+0000","last_clean":"2024-05-08T19:48:29.646775+0000","last_became_active":"2024-05-08T19:22:20.449693+0000","last_became_peered":"2024-05-08T19:22:20.449693+0000","last_unstale":"2024-05-08T19:48:29.646775+0000","last_undegraded":"2024-05-08T19:48:29.646775+0000","last_fullsized":"2024-05-08T19:48:29.646775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2278,"log_dups_size":0,"ondisk_log_size":2278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'8971","reported_seq":9142,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.376868+0000","last_change":"2024-05-08T19:22:24.472926+0000","last_active":"2024-05-08T19:48:29.376868+0000","last_peered":"2024-05-08T19:48:29.376868+0000","last_clean":"2024-05-08T19:48:29.376868+0000","last_became_active":"2024-05-08T19:22:24.472518+0000","last_became_peered":"2024-05-08T19:22:24.472518+0000","last_unstale":"2024-05-08T19:48:29.376868+0000","last_undegraded":"2024-05-08T19:48:29.376868+0000","last_fullsized":"2024-05-08T19:48:29.376868+0000","mapping_epoch":22,"log_start":"26'1583","ondisk_log_start":"26'1583","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7388,"log_dups_size":0,"ondisk_log_size":7388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2685762,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":145,"num_read_kb":5460,"num_write":6536,"num_write_kb":1024036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"26'7864","reported_seq":7893,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.077571+0000","last_change":"2024-05-08T19:22:20.007824+0000","last_active":"2024-05-08T19:48:30.077571+0000","last_peered":"2024-05-08T19:48:30.077571+0000","last_clean":"2024-05-08T19:48:30.077571+0000","last_became_active":"2024-05-08T19:22:20.007542+0000","last_became_peered":"2024-05-08T19:22:20.007542+0000","last_unstale":"2024-05-08T19:48:30.077571+0000","last_undegraded":"2024-05-08T19:48:30.077571+0000","last_fullsized":"2024-05-08T19:48:30.077571+0000","mapping_epoch":17,"log_start":"26'300","ondisk_log_start":"26'300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7564,"log_dups_size":0,"ondisk_log_size":7564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7858,"num_write_kb":54448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'2297","reported_seq":2325,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.956239+0000","last_change":"2024-05-08T19:22:20.443326+0000","last_active":"2024-05-08T19:48:29.956239+0000","last_peered":"2024-05-08T19:48:29.956239+0000","last_clean":"2024-05-08T19:48:29.956239+0000","last_became_active":"2024-05-08T19:22:20.443049+0000","last_became_peered":"2024-05-08T19:22:20.443049+0000","last_unstale":"2024-05-08T19:48:29.956239+0000","last_undegraded":"2024-05-08T19:48:29.956239+0000","last_fullsized":"2024-05-08T19:48:29.956239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2297,"log_dups_size":0,"ondisk_log_size":2297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:04.174914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"26'8075","reported_seq":9057,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.886637+0000","last_change":"2024-05-08T19:23:11.532565+0000","last_active":"2024-05-08T19:48:29.886637+0000","last_peered":"2024-05-08T19:48:29.886637+0000","last_clean":"2024-05-08T19:48:29.886637+0000","last_became_active":"2024-05-08T19:23:11.532148+0000","last_became_peered":"2024-05-08T19:23:11.532148+0000","last_unstale":"2024-05-08T19:48:29.886637+0000","last_undegraded":"2024-05-08T19:48:29.886637+0000","last_fullsized":"2024-05-08T19:48:29.886637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":8075,"log_dups_size":0,"ondisk_log_size":8075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:14.273885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2771094,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":959,"num_read_kb":67642,"num_write":5630,"num_write_kb":895819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'2285","reported_seq":2313,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.171971+0000","last_change":"2024-05-08T19:22:20.449968+0000","last_active":"2024-05-08T19:48:29.171971+0000","last_peered":"2024-05-08T19:48:29.171971+0000","last_clean":"2024-05-08T19:48:29.171971+0000","last_became_active":"2024-05-08T19:22:20.449709+0000","last_became_peered":"2024-05-08T19:22:20.449709+0000","last_unstale":"2024-05-08T19:48:29.171971+0000","last_undegraded":"2024-05-08T19:48:29.171971+0000","last_fullsized":"2024-05-08T19:48:29.171971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2285,"log_dups_size":0,"ondisk_log_size":2285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'7712","reported_seq":8676,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.075764+0000","last_change":"2024-05-08T19:22:20.004708+0000","last_active":"2024-05-08T19:48:30.075764+0000","last_peered":"2024-05-08T19:48:30.075764+0000","last_clean":"2024-05-08T19:48:30.075764+0000","last_became_active":"2024-05-08T19:22:20.004404+0000","last_became_peered":"2024-05-08T19:22:20.004404+0000","last_unstale":"2024-05-08T19:48:30.075764+0000","last_undegraded":"2024-05-08T19:48:30.075764+0000","last_fullsized":"2024-05-08T19:48:30.075764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7712,"log_dups_size":0,"ondisk_log_size":7712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":935,"num_read_kb":4706,"num_write":7714,"num_write_kb":54235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"26'8447","reported_seq":9003,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.713721+0000","last_change":"2024-05-08T19:22:24.617952+0000","last_active":"2024-05-08T19:48:29.713721+0000","last_peered":"2024-05-08T19:48:29.713721+0000","last_clean":"2024-05-08T19:48:29.713721+0000","last_became_active":"2024-05-08T19:22:24.617627+0000","last_became_peered":"2024-05-08T19:22:24.617627+0000","last_unstale":"2024-05-08T19:48:29.713721+0000","last_undegraded":"2024-05-08T19:48:29.713721+0000","last_fullsized":"2024-05-08T19:48:29.713721+0000","mapping_epoch":22,"log_start":"26'474","ondisk_log_start":"26'474","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7973,"log_dups_size":0,"ondisk_log_size":7973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:57.825616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3804310,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":530,"num_read_kb":27006,"num_write":6108,"num_write_kb":958609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"26'2341","reported_seq":2369,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.962672+0000","last_change":"2024-05-08T19:22:20.447152+0000","last_active":"2024-05-08T19:48:29.962672+0000","last_peered":"2024-05-08T19:48:29.962672+0000","last_clean":"2024-05-08T19:48:29.962672+0000","last_became_active":"2024-05-08T19:22:20.446864+0000","last_became_peered":"2024-05-08T19:22:20.446864+0000","last_unstale":"2024-05-08T19:48:29.962672+0000","last_undegraded":"2024-05-08T19:48:29.962672+0000","last_fullsized":"2024-05-08T19:48:29.962672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2341,"log_dups_size":0,"ondisk_log_size":2341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'5126","reported_seq":5155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:24.156639+0000","last_change":"2024-05-08T19:22:20.003790+0000","last_active":"2024-05-08T19:47:24.156639+0000","last_peered":"2024-05-08T19:47:24.156639+0000","last_clean":"2024-05-08T19:47:24.156639+0000","last_became_active":"2024-05-08T19:22:20.003441+0000","last_became_peered":"2024-05-08T19:22:20.003441+0000","last_unstale":"2024-05-08T19:47:24.156639+0000","last_undegraded":"2024-05-08T19:47:24.156639+0000","last_fullsized":"2024-05-08T19:47:24.156639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5126,"log_dups_size":0,"ondisk_log_size":5126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5120,"num_write_kb":36122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:46:27.527762+0000","last_change":"2024-05-08T19:22:17.117278+0000","last_active":"2024-05-08T19:46:27.527762+0000","last_peered":"2024-05-08T19:46:27.527762+0000","last_clean":"2024-05-08T19:46:27.527762+0000","last_became_active":"2024-05-08T19:22:17.116272+0000","last_became_peered":"2024-05-08T19:22:17.116272+0000","last_unstale":"2024-05-08T19:46:27.527762+0000","last_undegraded":"2024-05-08T19:46:27.527762+0000","last_fullsized":"2024-05-08T19:46:27.527762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_clean_scrub_stamp":"2024-05-08T19:22:15.924359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:37.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'8629","reported_seq":8735,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.973317+0000","last_change":"2024-05-08T19:22:24.617594+0000","last_active":"2024-05-08T19:48:29.973317+0000","last_peered":"2024-05-08T19:48:29.973317+0000","last_clean":"2024-05-08T19:48:29.973317+0000","last_became_active":"2024-05-08T19:22:24.616486+0000","last_became_peered":"2024-05-08T19:22:24.616486+0000","last_unstale":"2024-05-08T19:48:29.973317+0000","last_undegraded":"2024-05-08T19:48:29.973317+0000","last_fullsized":"2024-05-08T19:48:29.973317+0000","mapping_epoch":22,"log_start":"26'1423","ondisk_log_start":"26'1423","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7206,"log_dups_size":0,"ondisk_log_size":7206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2775110,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":80,"num_read_kb":5028,"num_write":6226,"num_write_kb":895755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"26'2237","reported_seq":2265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.879418+0000","last_change":"2024-05-08T19:22:20.445458+0000","last_active":"2024-05-08T19:48:29.879418+0000","last_peered":"2024-05-08T19:48:29.879418+0000","last_clean":"2024-05-08T19:48:29.879418+0000","last_became_active":"2024-05-08T19:22:20.445191+0000","last_became_peered":"2024-05-08T19:22:20.445191+0000","last_unstale":"2024-05-08T19:48:29.879418+0000","last_undegraded":"2024-05-08T19:48:29.879418+0000","last_fullsized":"2024-05-08T19:48:29.879418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'8070","reported_seq":8100,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:22.736749+0000","last_change":"2024-05-08T19:22:20.015288+0000","last_active":"2024-05-08T19:48:22.736749+0000","last_peered":"2024-05-08T19:48:22.736749+0000","last_clean":"2024-05-08T19:48:22.736749+0000","last_became_active":"2024-05-08T19:22:20.015062+0000","last_became_peered":"2024-05-08T19:22:20.015062+0000","last_unstale":"2024-05-08T19:48:22.736749+0000","last_undegraded":"2024-05-08T19:48:22.736749+0000","last_fullsized":"2024-05-08T19:48:22.736749+0000","mapping_epoch":17,"log_start":"26'1200","ondisk_log_start":"26'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6870,"log_dups_size":0,"ondisk_log_size":6870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:12.577297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8075,"num_write_kb":54571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'8481","reported_seq":9480,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.944395+0000","last_change":"2024-05-08T19:22:24.614066+0000","last_active":"2024-05-08T19:48:29.944395+0000","last_peered":"2024-05-08T19:48:29.944395+0000","last_clean":"2024-05-08T19:48:29.944395+0000","last_became_active":"2024-05-08T19:22:24.613661+0000","last_became_peered":"2024-05-08T19:22:24.613661+0000","last_unstale":"2024-05-08T19:48:29.944395+0000","last_undegraded":"2024-05-08T19:48:29.944395+0000","last_fullsized":"2024-05-08T19:48:29.944395+0000","mapping_epoch":22,"log_start":"26'1305","ondisk_log_start":"26'1305","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7176,"log_dups_size":0,"ondisk_log_size":7176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2646858,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":973,"num_read_kb":68996,"num_write":6051,"num_write_kb":873899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"26'6234","reported_seq":6263,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.698562+0000","last_change":"2024-05-08T19:22:20.015193+0000","last_active":"2024-05-08T19:48:27.698562+0000","last_peered":"2024-05-08T19:48:27.698562+0000","last_clean":"2024-05-08T19:48:27.698562+0000","last_became_active":"2024-05-08T19:22:20.014926+0000","last_became_peered":"2024-05-08T19:22:20.014926+0000","last_unstale":"2024-05-08T19:48:27.698562+0000","last_undegraded":"2024-05-08T19:48:27.698562+0000","last_fullsized":"2024-05-08T19:48:27.698562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6234,"log_dups_size":0,"ondisk_log_size":6234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:13.701454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4468418,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6230,"num_write_kb":41317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"26'2367","reported_seq":2395,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.300251+0000","last_change":"2024-05-08T19:22:20.446453+0000","last_active":"2024-05-08T19:48:29.300251+0000","last_peered":"2024-05-08T19:48:29.300251+0000","last_clean":"2024-05-08T19:48:29.300251+0000","last_became_active":"2024-05-08T19:22:20.446194+0000","last_became_peered":"2024-05-08T19:22:20.446194+0000","last_unstale":"2024-05-08T19:48:29.300251+0000","last_undegraded":"2024-05-08T19:48:29.300251+0000","last_fullsized":"2024-05-08T19:48:29.300251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2367,"log_dups_size":0,"ondisk_log_size":2367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'8334","reported_seq":8728,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.937236+0000","last_change":"2024-05-08T19:22:24.615481+0000","last_active":"2024-05-08T19:48:29.937236+0000","last_peered":"2024-05-08T19:48:29.937236+0000","last_clean":"2024-05-08T19:48:29.937236+0000","last_became_active":"2024-05-08T19:22:24.615069+0000","last_became_peered":"2024-05-08T19:22:24.615069+0000","last_unstale":"2024-05-08T19:48:29.937236+0000","last_undegraded":"2024-05-08T19:48:29.937236+0000","last_fullsized":"2024-05-08T19:48:29.937236+0000","mapping_epoch":22,"log_start":"26'1929","ondisk_log_start":"26'1929","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6405,"log_dups_size":0,"ondisk_log_size":6405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:28.211177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2253528,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":368,"num_read_kb":23786,"num_write":5957,"num_write_kb":964471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'5773","reported_seq":6288,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:28.097950+0000","last_change":"2024-05-08T19:22:20.001642+0000","last_active":"2024-05-08T19:48:28.097950+0000","last_peered":"2024-05-08T19:48:28.097950+0000","last_clean":"2024-05-08T19:48:28.097950+0000","last_became_active":"2024-05-08T19:22:20.001339+0000","last_became_peered":"2024-05-08T19:22:20.001339+0000","last_unstale":"2024-05-08T19:48:28.097950+0000","last_undegraded":"2024-05-08T19:48:28.097950+0000","last_fullsized":"2024-05-08T19:48:28.097950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5773,"log_dups_size":0,"ondisk_log_size":5773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11614568,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":486,"num_read_kb":3470,"num_write":6355,"num_write_kb":46006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"26'2229","reported_seq":2250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.115543+0000","last_change":"2024-05-08T19:23:11.387164+0000","last_active":"2024-05-08T19:48:29.115543+0000","last_peered":"2024-05-08T19:48:29.115543+0000","last_clean":"2024-05-08T19:48:29.115543+0000","last_became_active":"2024-05-08T19:23:11.386882+0000","last_became_peered":"2024-05-08T19:23:11.386882+0000","last_unstale":"2024-05-08T19:48:29.115543+0000","last_undegraded":"2024-05-08T19:48:29.115543+0000","last_fullsized":"2024-05-08T19:48:29.115543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2229,"log_dups_size":0,"ondisk_log_size":2229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:25.968464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"26'8422","reported_seq":8851,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.886935+0000","last_change":"2024-05-08T19:22:24.614812+0000","last_active":"2024-05-08T19:48:29.886935+0000","last_peered":"2024-05-08T19:48:29.886935+0000","last_clean":"2024-05-08T19:48:29.886935+0000","last_became_active":"2024-05-08T19:22:24.614433+0000","last_became_peered":"2024-05-08T19:22:24.614433+0000","last_unstale":"2024-05-08T19:48:29.886935+0000","last_undegraded":"2024-05-08T19:48:29.886935+0000","last_fullsized":"2024-05-08T19:48:29.886935+0000","mapping_epoch":22,"log_start":"26'1215","ondisk_log_start":"26'1215","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7207,"log_dups_size":0,"ondisk_log_size":7207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:07.924115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2504518,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":403,"num_read_kb":32316,"num_write":6034,"num_write_kb":878060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'4075","reported_seq":4104,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:14.643108+0000","last_change":"2024-05-08T19:22:20.012651+0000","last_active":"2024-05-08T19:48:14.643108+0000","last_peered":"2024-05-08T19:48:14.643108+0000","last_clean":"2024-05-08T19:48:14.643108+0000","last_became_active":"2024-05-08T19:22:20.012383+0000","last_became_peered":"2024-05-08T19:22:20.012383+0000","last_unstale":"2024-05-08T19:48:14.643108+0000","last_undegraded":"2024-05-08T19:48:14.643108+0000","last_fullsized":"2024-05-08T19:48:14.643108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4075,"log_dups_size":0,"ondisk_log_size":4075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":4092,"num_write_kb":27507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'2277","reported_seq":2305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.968360+0000","last_change":"2024-05-08T19:22:20.436459+0000","last_active":"2024-05-08T19:48:29.968360+0000","last_peered":"2024-05-08T19:48:29.968360+0000","last_clean":"2024-05-08T19:48:29.968360+0000","last_became_active":"2024-05-08T19:22:20.435680+0000","last_became_peered":"2024-05-08T19:22:20.435680+0000","last_unstale":"2024-05-08T19:48:29.968360+0000","last_undegraded":"2024-05-08T19:48:29.968360+0000","last_fullsized":"2024-05-08T19:48:29.968360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2277,"log_dups_size":0,"ondisk_log_size":2277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:09.166091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"26'8799","reported_seq":9037,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.021055+0000","last_change":"2024-05-08T19:22:24.473208+0000","last_active":"2024-05-08T19:48:30.021055+0000","last_peered":"2024-05-08T19:48:30.021055+0000","last_clean":"2024-05-08T19:48:30.021055+0000","last_became_active":"2024-05-08T19:22:24.472782+0000","last_became_peered":"2024-05-08T19:22:24.472782+0000","last_unstale":"2024-05-08T19:48:30.021055+0000","last_undegraded":"2024-05-08T19:48:30.021055+0000","last_fullsized":"2024-05-08T19:48:30.021055+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7161,"log_dups_size":0,"ondisk_log_size":7161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823624,"num_objects":21,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":213,"num_read_kb":12280,"num_write":6434,"num_write_kb":1036595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2842","reported_seq":2871,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:46.734455+0000","last_change":"2024-05-08T19:22:20.014848+0000","last_active":"2024-05-08T19:47:46.734455+0000","last_peered":"2024-05-08T19:47:46.734455+0000","last_clean":"2024-05-08T19:47:46.734455+0000","last_became_active":"2024-05-08T19:22:20.013739+0000","last_became_peered":"2024-05-08T19:22:20.013739+0000","last_unstale":"2024-05-08T19:47:46.734455+0000","last_undegraded":"2024-05-08T19:47:46.734455+0000","last_fullsized":"2024-05-08T19:47:46.734455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2842,"log_dups_size":0,"ondisk_log_size":2842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:03.169714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2845,"num_write_kb":22358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"26'2320","reported_seq":2347,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.797694+0000","last_change":"2024-05-08T19:22:20.447451+0000","last_active":"2024-05-08T19:48:29.797694+0000","last_peered":"2024-05-08T19:48:29.797694+0000","last_clean":"2024-05-08T19:48:29.797694+0000","last_became_active":"2024-05-08T19:22:20.447180+0000","last_became_peered":"2024-05-08T19:22:20.447180+0000","last_unstale":"2024-05-08T19:48:29.797694+0000","last_undegraded":"2024-05-08T19:48:29.797694+0000","last_fullsized":"2024-05-08T19:48:29.797694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2320,"log_dups_size":0,"ondisk_log_size":2320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"26'8894","reported_seq":9864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.094299+0000","last_change":"2024-05-08T19:22:24.614091+0000","last_active":"2024-05-08T19:48:29.094299+0000","last_peered":"2024-05-08T19:48:29.094299+0000","last_clean":"2024-05-08T19:48:29.094299+0000","last_became_active":"2024-05-08T19:22:24.613677+0000","last_became_peered":"2024-05-08T19:22:24.613677+0000","last_unstale":"2024-05-08T19:48:29.094299+0000","last_undegraded":"2024-05-08T19:48:29.094299+0000","last_fullsized":"2024-05-08T19:48:29.094299+0000","mapping_epoch":22,"log_start":"26'1529","ondisk_log_start":"26'1529","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7365,"log_dups_size":0,"ondisk_log_size":7365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:50.011809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4461889,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":945,"num_read_kb":70780,"num_write":6592,"num_write_kb":1028558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"26'4272","reported_seq":4301,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:09.543429+0000","last_change":"2024-05-08T19:22:20.011528+0000","last_active":"2024-05-08T19:47:09.543429+0000","last_peered":"2024-05-08T19:47:09.543429+0000","last_clean":"2024-05-08T19:47:09.543429+0000","last_became_active":"2024-05-08T19:22:20.011262+0000","last_became_peered":"2024-05-08T19:22:20.011262+0000","last_unstale":"2024-05-08T19:47:09.543429+0000","last_undegraded":"2024-05-08T19:47:09.543429+0000","last_fullsized":"2024-05-08T19:47:09.543429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4272,"log_dups_size":0,"ondisk_log_size":4272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4269,"num_write_kb":27446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"26'2404","reported_seq":2432,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.112747+0000","last_change":"2024-05-08T19:22:20.438689+0000","last_active":"2024-05-08T19:48:30.112747+0000","last_peered":"2024-05-08T19:48:30.112747+0000","last_clean":"2024-05-08T19:48:30.112747+0000","last_became_active":"2024-05-08T19:22:20.438434+0000","last_became_peered":"2024-05-08T19:22:20.438434+0000","last_unstale":"2024-05-08T19:48:30.112747+0000","last_undegraded":"2024-05-08T19:48:30.112747+0000","last_fullsized":"2024-05-08T19:48:30.112747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2404,"log_dups_size":0,"ondisk_log_size":2404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"26'8228","reported_seq":8492,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.660349+0000","last_change":"2024-05-08T19:22:24.473569+0000","last_active":"2024-05-08T19:48:29.660349+0000","last_peered":"2024-05-08T19:48:29.660349+0000","last_clean":"2024-05-08T19:48:29.660349+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:48:29.660349+0000","last_undegraded":"2024-05-08T19:48:29.660349+0000","last_fullsized":"2024-05-08T19:48:29.660349+0000","mapping_epoch":22,"log_start":"26'1006","ondisk_log_start":"26'1006","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7222,"log_dups_size":0,"ondisk_log_size":7222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:22.875469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1713996,"num_objects":21,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":239,"num_read_kb":13756,"num_write":5760,"num_write_kb":975965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"26'7366","reported_seq":7394,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:11.246408+0000","last_change":"2024-05-08T19:22:20.007101+0000","last_active":"2024-05-08T19:48:11.246408+0000","last_peered":"2024-05-08T19:48:11.246408+0000","last_clean":"2024-05-08T19:48:11.246408+0000","last_became_active":"2024-05-08T19:22:20.006772+0000","last_became_peered":"2024-05-08T19:22:20.006772+0000","last_unstale":"2024-05-08T19:48:11.246408+0000","last_undegraded":"2024-05-08T19:48:11.246408+0000","last_fullsized":"2024-05-08T19:48:11.246408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7366,"log_dups_size":0,"ondisk_log_size":7366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:23.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7361,"num_write_kb":54049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"26'2320","reported_seq":2347,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.910477+0000","last_change":"2024-05-08T19:22:20.436696+0000","last_active":"2024-05-08T19:48:29.910477+0000","last_peered":"2024-05-08T19:48:29.910477+0000","last_clean":"2024-05-08T19:48:29.910477+0000","last_became_active":"2024-05-08T19:22:20.436373+0000","last_became_peered":"2024-05-08T19:22:20.436373+0000","last_unstale":"2024-05-08T19:48:29.910477+0000","last_undegraded":"2024-05-08T19:48:29.910477+0000","last_fullsized":"2024-05-08T19:48:29.910477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2320,"log_dups_size":0,"ondisk_log_size":2320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"26'8784","reported_seq":9412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.660298+0000","last_change":"2024-05-08T19:22:24.478232+0000","last_active":"2024-05-08T19:48:29.660298+0000","last_peered":"2024-05-08T19:48:29.660298+0000","last_clean":"2024-05-08T19:48:29.660298+0000","last_became_active":"2024-05-08T19:22:24.477941+0000","last_became_peered":"2024-05-08T19:22:24.477941+0000","last_unstale":"2024-05-08T19:48:29.660298+0000","last_undegraded":"2024-05-08T19:48:29.660298+0000","last_fullsized":"2024-05-08T19:48:29.660298+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7146,"log_dups_size":0,"ondisk_log_size":7146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2431530,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":603,"num_read_kb":28586,"num_write":6306,"num_write_kb":901267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"26'6172","reported_seq":6200,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:45:56.300834+0000","last_change":"2024-05-08T19:22:20.014076+0000","last_active":"2024-05-08T19:45:56.300834+0000","last_peered":"2024-05-08T19:45:56.300834+0000","last_clean":"2024-05-08T19:45:56.300834+0000","last_became_active":"2024-05-08T19:22:20.013748+0000","last_became_peered":"2024-05-08T19:22:20.013748+0000","last_unstale":"2024-05-08T19:45:56.300834+0000","last_undegraded":"2024-05-08T19:45:56.300834+0000","last_fullsized":"2024-05-08T19:45:56.300834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6172,"log_dups_size":0,"ondisk_log_size":6172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:50.426177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6192,"num_write_kb":41171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"26'2324","reported_seq":2351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.744272+0000","last_change":"2024-05-08T19:22:20.457103+0000","last_active":"2024-05-08T19:48:29.744272+0000","last_peered":"2024-05-08T19:48:29.744272+0000","last_clean":"2024-05-08T19:48:29.744272+0000","last_became_active":"2024-05-08T19:22:20.456850+0000","last_became_peered":"2024-05-08T19:22:20.456850+0000","last_unstale":"2024-05-08T19:48:29.744272+0000","last_undegraded":"2024-05-08T19:48:29.744272+0000","last_fullsized":"2024-05-08T19:48:29.744272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"26'8380","reported_seq":8822,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.028471+0000","last_change":"2024-05-08T19:22:24.614410+0000","last_active":"2024-05-08T19:48:30.028471+0000","last_peered":"2024-05-08T19:48:30.028471+0000","last_clean":"2024-05-08T19:48:30.028471+0000","last_became_active":"2024-05-08T19:22:24.613904+0000","last_became_peered":"2024-05-08T19:22:24.613904+0000","last_unstale":"2024-05-08T19:48:30.028471+0000","last_undegraded":"2024-05-08T19:48:30.028471+0000","last_fullsized":"2024-05-08T19:48:30.028471+0000","mapping_epoch":22,"log_start":"26'412","ondisk_log_start":"26'412","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7968,"log_dups_size":0,"ondisk_log_size":7968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:03.465351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981436,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":417,"num_read_kb":29592,"num_write":5975,"num_write_kb":842872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"26'8391","reported_seq":8419,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.053316+0000","last_change":"2024-05-08T19:22:20.000763+0000","last_active":"2024-05-08T19:48:30.053316+0000","last_peered":"2024-05-08T19:48:30.053316+0000","last_clean":"2024-05-08T19:48:30.053316+0000","last_became_active":"2024-05-08T19:22:20.000454+0000","last_became_peered":"2024-05-08T19:22:20.000454+0000","last_unstale":"2024-05-08T19:48:30.053316+0000","last_undegraded":"2024-05-08T19:48:30.053316+0000","last_fullsized":"2024-05-08T19:48:30.053316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":8391,"log_dups_size":0,"ondisk_log_size":8391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8387,"num_write_kb":54739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'2250","reported_seq":2277,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:26.184502+0000","last_change":"2024-05-08T19:22:20.456485+0000","last_active":"2024-05-08T19:48:26.184502+0000","last_peered":"2024-05-08T19:48:26.184502+0000","last_clean":"2024-05-08T19:48:26.184502+0000","last_became_active":"2024-05-08T19:22:20.456225+0000","last_became_peered":"2024-05-08T19:22:20.456225+0000","last_unstale":"2024-05-08T19:48:26.184502+0000","last_undegraded":"2024-05-08T19:48:26.184502+0000","last_fullsized":"2024-05-08T19:48:26.184502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2250,"log_dups_size":0,"ondisk_log_size":2250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"26'8581","reported_seq":9400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.098204+0000","last_change":"2024-05-08T19:22:24.473117+0000","last_active":"2024-05-08T19:48:30.098204+0000","last_peered":"2024-05-08T19:48:30.098204+0000","last_clean":"2024-05-08T19:48:30.098204+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:48:30.098204+0000","last_undegraded":"2024-05-08T19:48:30.098204+0000","last_fullsized":"2024-05-08T19:48:30.098204+0000","mapping_epoch":22,"log_start":"26'1358","ondisk_log_start":"26'1358","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7223,"log_dups_size":0,"ondisk_log_size":7223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1783122,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":794,"num_read_kb":57832,"num_write":6077,"num_write_kb":1028205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'7802","reported_seq":7830,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:59.722383+0000","last_change":"2024-05-08T19:22:20.006312+0000","last_active":"2024-05-08T19:47:59.722383+0000","last_peered":"2024-05-08T19:47:59.722383+0000","last_clean":"2024-05-08T19:47:59.722383+0000","last_became_active":"2024-05-08T19:22:20.005996+0000","last_became_peered":"2024-05-08T19:22:20.005996+0000","last_unstale":"2024-05-08T19:47:59.722383+0000","last_undegraded":"2024-05-08T19:47:59.722383+0000","last_fullsized":"2024-05-08T19:47:59.722383+0000","mapping_epoch":17,"log_start":"26'400","ondisk_log_start":"26'400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7402,"log_dups_size":0,"ondisk_log_size":7402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:13.701454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7795,"num_write_kb":54350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"26'2288","reported_seq":2315,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.619437+0000","last_change":"2024-05-08T19:22:20.452861+0000","last_active":"2024-05-08T19:48:29.619437+0000","last_peered":"2024-05-08T19:48:29.619437+0000","last_clean":"2024-05-08T19:48:29.619437+0000","last_became_active":"2024-05-08T19:22:20.452600+0000","last_became_peered":"2024-05-08T19:22:20.452600+0000","last_unstale":"2024-05-08T19:48:29.619437+0000","last_undegraded":"2024-05-08T19:48:29.619437+0000","last_fullsized":"2024-05-08T19:48:29.619437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2288,"log_dups_size":0,"ondisk_log_size":2288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"26'8431","reported_seq":9147,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.067381+0000","last_change":"2024-05-08T19:22:24.614345+0000","last_active":"2024-05-08T19:48:30.067381+0000","last_peered":"2024-05-08T19:48:30.067381+0000","last_clean":"2024-05-08T19:48:30.067381+0000","last_became_active":"2024-05-08T19:22:24.613948+0000","last_became_peered":"2024-05-08T19:22:24.613948+0000","last_unstale":"2024-05-08T19:48:30.067381+0000","last_undegraded":"2024-05-08T19:48:30.067381+0000","last_fullsized":"2024-05-08T19:48:30.067381+0000","mapping_epoch":22,"log_start":"26'835","ondisk_log_start":"26'835","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7596,"log_dups_size":0,"ondisk_log_size":7596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4095684,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":690,"num_read_kb":34094,"num_write":5981,"num_write_kb":938401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"26'9148","reported_seq":9176,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:26.399812+0000","last_change":"2024-05-08T19:22:20.004844+0000","last_active":"2024-05-08T19:48:26.399812+0000","last_peered":"2024-05-08T19:48:26.399812+0000","last_clean":"2024-05-08T19:48:26.399812+0000","last_became_active":"2024-05-08T19:22:20.004254+0000","last_became_peered":"2024-05-08T19:22:20.004254+0000","last_unstale":"2024-05-08T19:48:26.399812+0000","last_undegraded":"2024-05-08T19:48:26.399812+0000","last_fullsized":"2024-05-08T19:48:26.399812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":9148,"log_dups_size":0,"ondisk_log_size":9148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":9138,"num_write_kb":67371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'2185","reported_seq":2212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.163585+0000","last_change":"2024-05-08T19:22:20.455712+0000","last_active":"2024-05-08T19:48:27.163585+0000","last_peered":"2024-05-08T19:48:27.163585+0000","last_clean":"2024-05-08T19:48:27.163585+0000","last_became_active":"2024-05-08T19:22:20.455493+0000","last_became_peered":"2024-05-08T19:22:20.455493+0000","last_unstale":"2024-05-08T19:48:27.163585+0000","last_undegraded":"2024-05-08T19:48:27.163585+0000","last_fullsized":"2024-05-08T19:48:27.163585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2185,"log_dups_size":0,"ondisk_log_size":2185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:28.743156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"26'2244","reported_seq":2272,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.842605+0000","last_change":"2024-05-08T19:22:20.459104+0000","last_active":"2024-05-08T19:48:29.842605+0000","last_peered":"2024-05-08T19:48:29.842605+0000","last_clean":"2024-05-08T19:48:29.842605+0000","last_became_active":"2024-05-08T19:22:20.452169+0000","last_became_peered":"2024-05-08T19:22:20.452169+0000","last_unstale":"2024-05-08T19:48:29.842605+0000","last_undegraded":"2024-05-08T19:48:29.842605+0000","last_fullsized":"2024-05-08T19:48:29.842605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2244,"log_dups_size":0,"ondisk_log_size":2244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'2337","reported_seq":2365,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.234543+0000","last_change":"2024-05-08T19:22:20.449335+0000","last_active":"2024-05-08T19:48:29.234543+0000","last_peered":"2024-05-08T19:48:29.234543+0000","last_clean":"2024-05-08T19:48:29.234543+0000","last_became_active":"2024-05-08T19:22:20.449047+0000","last_became_peered":"2024-05-08T19:22:20.449047+0000","last_unstale":"2024-05-08T19:48:29.234543+0000","last_undegraded":"2024-05-08T19:48:29.234543+0000","last_fullsized":"2024-05-08T19:48:29.234543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'2232","reported_seq":2260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.535516+0000","last_change":"2024-05-08T19:22:20.452192+0000","last_active":"2024-05-08T19:48:29.535516+0000","last_peered":"2024-05-08T19:48:29.535516+0000","last_clean":"2024-05-08T19:48:29.535516+0000","last_became_active":"2024-05-08T19:22:20.451625+0000","last_became_peered":"2024-05-08T19:22:20.451625+0000","last_unstale":"2024-05-08T19:48:29.535516+0000","last_undegraded":"2024-05-08T19:48:29.535516+0000","last_fullsized":"2024-05-08T19:48:29.535516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2232,"log_dups_size":0,"ondisk_log_size":2232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'2349","reported_seq":2385,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.790912+0000","last_change":"2024-05-08T19:23:11.054094+0000","last_active":"2024-05-08T19:48:29.790912+0000","last_peered":"2024-05-08T19:48:29.790912+0000","last_clean":"2024-05-08T19:48:29.790912+0000","last_became_active":"2024-05-08T19:23:11.053750+0000","last_became_peered":"2024-05-08T19:23:11.053750+0000","last_unstale":"2024-05-08T19:48:29.790912+0000","last_undegraded":"2024-05-08T19:48:29.790912+0000","last_fullsized":"2024-05-08T19:48:29.790912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:25.968464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'2305","reported_seq":2333,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.339458+0000","last_change":"2024-05-08T19:22:20.444479+0000","last_active":"2024-05-08T19:48:29.339458+0000","last_peered":"2024-05-08T19:48:29.339458+0000","last_clean":"2024-05-08T19:48:29.339458+0000","last_became_active":"2024-05-08T19:22:20.444219+0000","last_became_peered":"2024-05-08T19:22:20.444219+0000","last_unstale":"2024-05-08T19:48:29.339458+0000","last_undegraded":"2024-05-08T19:48:29.339458+0000","last_fullsized":"2024-05-08T19:48:29.339458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2305,"log_dups_size":0,"ondisk_log_size":2305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'2205","reported_seq":2233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:28.865494+0000","last_change":"2024-05-08T19:22:20.436874+0000","last_active":"2024-05-08T19:48:28.865494+0000","last_peered":"2024-05-08T19:48:28.865494+0000","last_clean":"2024-05-08T19:48:28.865494+0000","last_became_active":"2024-05-08T19:22:20.436626+0000","last_became_peered":"2024-05-08T19:22:20.436626+0000","last_unstale":"2024-05-08T19:48:28.865494+0000","last_undegraded":"2024-05-08T19:48:28.865494+0000","last_fullsized":"2024-05-08T19:48:28.865494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2205,"log_dups_size":0,"ondisk_log_size":2205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'2323","reported_seq":2351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.917145+0000","last_change":"2024-05-08T19:22:20.462445+0000","last_active":"2024-05-08T19:48:29.917145+0000","last_peered":"2024-05-08T19:48:29.917145+0000","last_clean":"2024-05-08T19:48:29.917145+0000","last_became_active":"2024-05-08T19:22:20.461547+0000","last_became_peered":"2024-05-08T19:22:20.461547+0000","last_unstale":"2024-05-08T19:48:29.917145+0000","last_undegraded":"2024-05-08T19:48:29.917145+0000","last_fullsized":"2024-05-08T19:48:29.917145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2323,"log_dups_size":0,"ondisk_log_size":2323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'2302","reported_seq":2329,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.537782+0000","last_change":"2024-05-08T19:22:20.443498+0000","last_active":"2024-05-08T19:48:29.537782+0000","last_peered":"2024-05-08T19:48:29.537782+0000","last_clean":"2024-05-08T19:48:29.537782+0000","last_became_active":"2024-05-08T19:22:20.442667+0000","last_became_peered":"2024-05-08T19:22:20.442667+0000","last_unstale":"2024-05-08T19:48:29.537782+0000","last_undegraded":"2024-05-08T19:48:29.537782+0000","last_fullsized":"2024-05-08T19:48:29.537782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2302,"log_dups_size":0,"ondisk_log_size":2302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'2260","reported_seq":2287,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.792032+0000","last_change":"2024-05-08T19:22:20.448722+0000","last_active":"2024-05-08T19:48:29.792032+0000","last_peered":"2024-05-08T19:48:29.792032+0000","last_clean":"2024-05-08T19:48:29.792032+0000","last_became_active":"2024-05-08T19:22:20.448449+0000","last_became_peered":"2024-05-08T19:22:20.448449+0000","last_unstale":"2024-05-08T19:48:29.792032+0000","last_undegraded":"2024-05-08T19:48:29.792032+0000","last_fullsized":"2024-05-08T19:48:29.792032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2260,"log_dups_size":0,"ondisk_log_size":2260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'2259","reported_seq":2286,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.987384+0000","last_change":"2024-05-08T19:22:20.450677+0000","last_active":"2024-05-08T19:48:29.987384+0000","last_peered":"2024-05-08T19:48:29.987384+0000","last_clean":"2024-05-08T19:48:29.987384+0000","last_became_active":"2024-05-08T19:22:20.450217+0000","last_became_peered":"2024-05-08T19:22:20.450217+0000","last_unstale":"2024-05-08T19:48:29.987384+0000","last_undegraded":"2024-05-08T19:48:29.987384+0000","last_fullsized":"2024-05-08T19:48:29.987384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2259,"log_dups_size":0,"ondisk_log_size":2259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'2292","reported_seq":2319,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.877227+0000","last_change":"2024-05-08T19:22:20.453450+0000","last_active":"2024-05-08T19:48:29.877227+0000","last_peered":"2024-05-08T19:48:29.877227+0000","last_clean":"2024-05-08T19:48:29.877227+0000","last_became_active":"2024-05-08T19:22:20.453191+0000","last_became_peered":"2024-05-08T19:22:20.453191+0000","last_unstale":"2024-05-08T19:48:29.877227+0000","last_undegraded":"2024-05-08T19:48:29.877227+0000","last_fullsized":"2024-05-08T19:48:29.877227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2292,"log_dups_size":0,"ondisk_log_size":2292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'2331","reported_seq":2358,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.913762+0000","last_change":"2024-05-08T19:22:20.452591+0000","last_active":"2024-05-08T19:48:29.913762+0000","last_peered":"2024-05-08T19:48:29.913762+0000","last_clean":"2024-05-08T19:48:29.913762+0000","last_became_active":"2024-05-08T19:22:20.451209+0000","last_became_peered":"2024-05-08T19:22:20.451209+0000","last_unstale":"2024-05-08T19:48:29.913762+0000","last_undegraded":"2024-05-08T19:48:29.913762+0000","last_fullsized":"2024-05-08T19:48:29.913762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2331,"log_dups_size":0,"ondisk_log_size":2331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'2333","reported_seq":2360,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.457862+0000","last_change":"2024-05-08T19:22:20.461584+0000","last_active":"2024-05-08T19:48:29.457862+0000","last_peered":"2024-05-08T19:48:29.457862+0000","last_clean":"2024-05-08T19:48:29.457862+0000","last_became_active":"2024-05-08T19:22:20.461097+0000","last_became_peered":"2024-05-08T19:22:20.461097+0000","last_unstale":"2024-05-08T19:48:29.457862+0000","last_undegraded":"2024-05-08T19:48:29.457862+0000","last_fullsized":"2024-05-08T19:48:29.457862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2333,"log_dups_size":0,"ondisk_log_size":2333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":86816314,"num_objects":956,"num_object_clones":0,"num_object_copies":3824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":956,"num_whiteouts":0,"num_read":18592,"num_read_kb":1141288,"num_write":193917,"num_write_kb":30180301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36454400,"data_stored":245432320,"data_compressed":11584054,"data_compressed_allocated":20762624,"data_compressed_original":229740544,"omap_allocated":0,"internal_metadata":0},"log_size":231024,"ondisk_log_size":231024,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":789,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1645,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146495,"ondisk_log_size":146495,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":250965480,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":2930,"num_read_kb":17316,"num_write":211794,"num_write_kb":1494868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":340918272,"data_stored":502162396,"data_compressed":49542707,"data_compressed_allocated":73392128,"data_compressed_original":234696704,"omap_allocated":0,"internal_metadata":0},"log_size":196147,"ondisk_log_size":196147,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575165,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":907688,"kb_used_data":46324,"kb_used_omap":1,"kb_used_meta":861310,"kb_avail":93464152,"statfs":{"total":96636764160,"available":95707291648,"internally_reserved":0,"allocated":47435776,"data_stored":131762807,"data_compressed":9351617,"data_compressed_allocated":14061568,"data_compressed_original":98562048,"omap_allocated":1588,"internal_metadata":881981900},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":1.988,"15min":1.417},"min":{"1min":0.216,"5min":0.216,"15min":0.20699999999999999},"max":{"1min":3.4830000000000001,"5min":26.544,"15min":26.544},"last":13.09},{"interface":"front","average":{"1min":1.2529999999999999,"5min":2.149,"15min":1.702},"min":{"1min":0.28799999999999998,"5min":0.27800000000000002,"15min":0.223},"max":{"1min":6.7789999999999999,"5min":26.713999999999999,"15min":26.713999999999999},"last":12.454000000000001}]},{"osd":1,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.978,"5min":2.367,"15min":1.9390000000000001},"min":{"1min":0.24099999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":12.176,"5min":14.557,"15min":32.259999999999998},"last":3.6160000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":2.0609999999999999,"15min":1.5569999999999999},"min":{"1min":0.26300000000000001,"5min":0.251,"15min":0.25},"max":{"1min":9.5860000000000003,"5min":21.867000000000001,"15min":36.018000000000001},"last":4.6849999999999996}]},{"osd":2,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":2.069,"15min":1.4259999999999999},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":8.3849999999999998,"5min":13.635,"15min":13.635},"last":4.1820000000000004},{"interface":"front","average":{"1min":1.4910000000000001,"5min":2.4500000000000002,"15min":1.718},"min":{"1min":0.29599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":7.024,"5min":19.469999999999999,"15min":19.469999999999999},"last":4.5750000000000002}]},{"osd":3,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":2.4489999999999998,"15min":1.641},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":11.510999999999999,"5min":26.274999999999999,"15min":26.274999999999999},"last":8.5579999999999998},{"interface":"front","average":{"1min":1.1719999999999999,"5min":2.3069999999999999,"15min":1.708},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.30599999999999999},"max":{"1min":6.8259999999999996,"5min":26.501999999999999,"15min":26.501999999999999},"last":7.8220000000000001}]},{"osd":4,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":2,"5min":2.5449999999999999,"15min":1.6619999999999999},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.24399999999999999},"max":{"1min":13.914999999999999,"5min":37.356000000000002,"15min":37.356000000000002},"last":1.464},{"interface":"front","average":{"1min":2.3410000000000002,"5min":2.6589999999999998,"15min":1.6890000000000001},"min":{"1min":0.28799999999999998,"5min":0.253,"15min":0.247},"max":{"1min":16.417000000000002,"5min":31.786000000000001,"15min":31.786000000000001},"last":5.9950000000000001}]},{"osd":5,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":3.2669999999999999,"5min":2.4910000000000001,"15min":1.798},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26300000000000001},"max":{"1min":29.346,"5min":29.346,"15min":35.156999999999996},"last":0.33000000000000002},{"interface":"front","average":{"1min":1.423,"5min":1.976,"15min":1.3},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":9.6170000000000009,"5min":32.988999999999997,"15min":32.988999999999997},"last":1.411}]},{"osd":6,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.8220000000000001,"15min":1.4299999999999999},"min":{"1min":0.33000000000000002,"5min":0.315,"15min":0.27400000000000002},"max":{"1min":6.6799999999999997,"5min":13.763,"15min":16.077999999999999},"last":4.1479999999999997},{"interface":"front","average":{"1min":1.821,"5min":2.2280000000000002,"15min":1.4870000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.27500000000000002},"max":{"1min":12.867000000000001,"5min":17.353999999999999,"15min":17.353999999999999},"last":1.444}]}]},{"osd":6,"up_from":13,"seq":55834575164,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1066964,"kb_used_data":53132,"kb_used_omap":1,"kb_used_meta":1013822,"kb_avail":93304876,"statfs":{"total":96636764160,"available":95544193024,"internally_reserved":0,"allocated":54407168,"data_stored":96876629,"data_compressed":8407298,"data_compressed_allocated":12894208,"data_compressed_original":55537664,"omap_allocated":1593,"internal_metadata":1038154183},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":2.6739999999999999,"5min":2.0550000000000002,"15min":1.466},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":17.488,"5min":17.488,"15min":17.488},"last":0.40200000000000002},{"interface":"front","average":{"1min":3.4830000000000001,"5min":2.9060000000000001,"15min":1.899},"min":{"1min":0.34200000000000003,"5min":0.246,"15min":0.245},"max":{"1min":17.445,"5min":37.295999999999999,"15min":37.295999999999999},"last":0.38700000000000001}]},{"osd":1,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.101,"5min":2.581,"15min":1.8320000000000001},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.22800000000000001},"max":{"1min":20.460000000000001,"5min":22.753,"15min":22.753},"last":0.41299999999999998},{"interface":"front","average":{"1min":3.2210000000000001,"5min":2.7170000000000001,"15min":1.8859999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":18.388000000000002,"5min":37.521000000000001,"15min":37.521000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.879,"5min":2.7669999999999999,"15min":1.903},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.247},"max":{"1min":23.228999999999999,"5min":23.952999999999999,"15min":23.952999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.367,"15min":1.6890000000000001},"min":{"1min":0.35799999999999998,"5min":0.29499999999999998,"15min":0.255},"max":{"1min":14.472,"5min":23.196999999999999,"15min":23.196999999999999},"last":0.439}]},{"osd":3,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.2400000000000002,"5min":2.5579999999999998,"15min":1.994},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.25800000000000001},"max":{"1min":17.577999999999999,"5min":21.975000000000001,"15min":43.082999999999998},"last":0.432},{"interface":"front","average":{"1min":3.6709999999999998,"5min":2.911,"15min":2.1219999999999999},"min":{"1min":0.434,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":17.719000000000001,"5min":23.859000000000002,"15min":43.872999999999998},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.0910000000000002,"5min":2.7829999999999999,"15min":2.4390000000000001},"min":{"1min":0.29999999999999999,"5min":0.26500000000000001,"15min":0.26100000000000001},"max":{"1min":18.416,"5min":23.055,"15min":111.04900000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":4.2690000000000001,"5min":2.8079999999999998,"15min":1.7549999999999999},"min":{"1min":0.34499999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":28.757999999999999,"5min":28.757999999999999,"15min":28.757999999999999},"last":0.32200000000000001}]},{"osd":5,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.2090000000000001,"5min":2.5169999999999999,"15min":1.617},"min":{"1min":0.33900000000000002,"5min":0.309,"15min":0.251},"max":{"1min":14.680999999999999,"5min":39.134,"15min":39.134},"last":0.37},{"interface":"front","average":{"1min":3.2709999999999999,"5min":3.2789999999999999,"15min":2.0249999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":19.527000000000001,"5min":67.576999999999998,"15min":67.576999999999998},"last":0.48499999999999999}]},{"osd":7,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.7450000000000001,"5min":2.52,"15min":1.6259999999999999},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":17.402000000000001,"5min":17.402000000000001,"15min":17.402000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":2.5459999999999998,"5min":1.9119999999999999,"15min":1.4590000000000001},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.29899999999999999},"max":{"1min":14.436999999999999,"5min":14.436999999999999,"15min":17.251000000000001},"last":0.46500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575164,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1178760,"kb_used_data":64892,"kb_used_omap":1,"kb_used_meta":1113790,"kb_avail":93193080,"statfs":{"total":96636764160,"available":95429713920,"internally_reserved":0,"allocated":66449408,"data_stored":174597717,"data_compressed":12331706,"data_compressed_allocated":18718720,"data_compressed_original":127041536,"omap_allocated":1594,"internal_metadata":1140521414},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.379,"15min":1.147},"min":{"1min":0.214,"5min":0.20300000000000001,"15min":0.186},"max":{"1min":8.6210000000000004,"5min":11.619999999999999,"15min":27.282},"last":0.317},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.8440000000000001,"15min":1.1040000000000001},"min":{"1min":0.23699999999999999,"5min":0.217,"15min":0.186},"max":{"1min":10.148,"5min":17.922000000000001,"15min":17.922000000000001},"last":0.27700000000000002}]},{"osd":2,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.891,"15min":1.0760000000000001},"min":{"1min":0.21199999999999999,"5min":0.20999999999999999,"15min":0.183},"max":{"1min":16.600000000000001,"5min":17.658000000000001,"15min":17.658000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.3520000000000001,"15min":0.97299999999999998},"min":{"1min":0.29599999999999999,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":7.2709999999999999,"5min":18.058,"15min":18.058},"last":0.34000000000000002}]},{"osd":3,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":2.1960000000000002,"5min":1.712,"15min":1.2150000000000001},"min":{"1min":0.32400000000000001,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":15.871,"5min":18.024999999999999,"15min":18.024999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.577,"15min":1.323},"min":{"1min":0.32100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":7.4379999999999997,"5min":10.773,"15min":44.454999999999998},"last":0.251}]},{"osd":4,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":2.7210000000000001,"15min":1.7749999999999999},"min":{"1min":0.311,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":9.4320000000000004,"5min":17.629000000000001,"15min":33.939999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":1.839,"5min":2.0680000000000001,"15min":1.744},"min":{"1min":0.378,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":9.5009999999999994,"5min":20.326000000000001,"15min":41.939},"last":0.38600000000000001}]},{"osd":5,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":3.0430000000000001,"5min":2.1030000000000002,"15min":1.5229999999999999},"min":{"1min":0.38100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":27.143000000000001,"5min":27.727,"15min":27.727},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.343,"5min":2.5270000000000001,"15min":1.6479999999999999},"min":{"1min":0.35999999999999999,"5min":0.32300000000000001,"15min":0.318},"max":{"1min":9.3970000000000002,"5min":20.289999999999999,"15min":20.289999999999999},"last":0.39500000000000002}]},{"osd":6,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.8100000000000001,"5min":2.5030000000000001,"15min":1.7150000000000001},"min":{"1min":0.48899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":8.5879999999999992,"5min":33.189999999999998,"15min":33.189999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":3.5880000000000001,"5min":3.2570000000000001,"15min":2.0129999999999999},"min":{"1min":0.39500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":23.395,"5min":35.344000000000001,"15min":35.344000000000001},"last":0.42799999999999999}]},{"osd":7,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":1.762,"15min":1.3620000000000001},"min":{"1min":0.41599999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":9.5440000000000005,"5min":17.890000000000001,"15min":17.890000000000001},"last":0.442},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.492,"15min":1.726},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":15.553000000000001,"5min":21.039999999999999,"15min":21.039999999999999},"last":0.45100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575164,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":809040,"kb_used_data":42184,"kb_used_omap":1,"kb_used_meta":766846,"kb_avail":93562800,"statfs":{"total":96636764160,"available":95808307200,"internally_reserved":0,"allocated":43196416,"data_stored":97970105,"data_compressed":7494028,"data_compressed_allocated":11452416,"data_compressed_original":66408448,"omap_allocated":1593,"internal_metadata":785250759},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.6200000000000001,"15min":1.7170000000000001},"min":{"1min":0.20799999999999999,"5min":0.189,"15min":0.185},"max":{"1min":12.77,"5min":22.343,"15min":37.991999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":1.236,"5min":1.571,"15min":1.2490000000000001},"min":{"1min":0.23899999999999999,"5min":0.191,"15min":0.191},"max":{"1min":7.8449999999999998,"5min":20.382000000000001,"15min":21.954000000000001},"last":0.23799999999999999}]},{"osd":2,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":1.1759999999999999,"15min":1.101},"min":{"1min":0.27400000000000002,"5min":0.22600000000000001,"15min":0.20899999999999999},"max":{"1min":3.7400000000000002,"5min":17.687999999999999,"15min":19.789999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":1.4510000000000001,"15min":1.1539999999999999},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.20899999999999999},"max":{"1min":3.2109999999999999,"5min":20.419,"15min":22.026},"last":0.29399999999999998}]},{"osd":3,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":2.0950000000000002,"15min":1.7},"min":{"1min":0.24099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":18.613,"5min":34.515000000000001,"15min":34.515000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.98699999999999999,"5min":2.286,"15min":1.619},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.22600000000000001},"max":{"1min":7.6399999999999997,"5min":85.606999999999999,"15min":85.606999999999999},"last":0.40600000000000003}]},{"osd":4,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":2.5800000000000001,"15min":2.1059999999999999},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":14.317,"5min":42.345999999999997,"15min":66.331999999999994},"last":2.9609999999999999},{"interface":"front","average":{"1min":1.6719999999999999,"5min":2.7599999999999998,"15min":2.3010000000000002},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":12.81,"5min":59.832999999999998,"15min":59.832999999999998},"last":6.0839999999999996}]},{"osd":5,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.881,"15min":1.53},"min":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":12.012,"5min":14.026999999999999,"15min":21.981000000000002},"last":16.021999999999998},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.74,"15min":1.538},"min":{"1min":0.33200000000000002,"5min":0.32400000000000001,"15min":0.30599999999999999},"max":{"1min":14.019,"5min":14.019,"15min":25.446999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":3.1000000000000001,"15min":2.0990000000000002},"min":{"1min":0.38300000000000001,"5min":0.33900000000000002,"15min":0.318},"max":{"1min":9.2370000000000001,"5min":82.542000000000002,"15min":82.542000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.131,"5min":2.0569999999999999,"15min":1.8859999999999999},"min":{"1min":0.373,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":6.4420000000000002,"5min":25.914999999999999,"15min":25.914999999999999},"last":16.056000000000001}]},{"osd":7,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":2.242,"15min":1.974},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.34599999999999997},"max":{"1min":6.3460000000000001,"5min":26.669,"15min":26.669},"last":0.754},{"interface":"front","average":{"1min":1.569,"5min":1.732,"15min":1.7210000000000001},"min":{"1min":0.41599999999999998,"5min":0.38400000000000001,"15min":0.33100000000000002},"max":{"1min":13.964,"5min":13.964,"15min":20.146000000000001},"last":14.9}]}]},{"osd":2,"up_from":13,"seq":55834575165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":728684,"kb_used_data":43876,"kb_used_omap":1,"kb_used_meta":684798,"kb_avail":93643156,"statfs":{"total":96636764160,"available":95890591744,"internally_reserved":0,"allocated":44929024,"data_stored":78974029,"data_compressed":6538000,"data_compressed_allocated":10211328,"data_compressed_original":44421120,"omap_allocated":1594,"internal_metadata":701233606},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.849,"5min":1.4379999999999999,"15min":1.135},"min":{"1min":0.19800000000000001,"5min":0.186,"15min":0.16900000000000001},"max":{"1min":15.834,"5min":15.834,"15min":21.475999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1779999999999999,"15min":1.141},"min":{"1min":0.23100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":7.4950000000000001,"5min":14.374000000000001,"15min":30.434999999999999},"last":11.121}]},{"osd":1,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":1.831,"15min":1.5369999999999999},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":15.907,"5min":24.190000000000001,"15min":25.550000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.93799999999999994,"15min":1.032},"min":{"1min":0.215,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":2.8929999999999998,"5min":8.532,"15min":20.591000000000001},"last":4.1529999999999996}]},{"osd":3,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":2.5569999999999999,"5min":2.0609999999999999,"15min":1.6839999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.21099999999999999},"max":{"1min":34.598999999999997,"5min":34.598999999999997,"15min":34.598999999999997},"last":7.641},{"interface":"front","average":{"1min":2.1989999999999998,"5min":2.2829999999999999,"15min":1.633},"min":{"1min":0.29899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":15.789999999999999,"5min":20.491,"15min":25.827000000000002},"last":2.7130000000000001}]},{"osd":4,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":2.4049999999999998,"15min":2.4500000000000002},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.312},"max":{"1min":15.936,"5min":27.963000000000001,"15min":67.506},"last":1.9039999999999999},{"interface":"front","average":{"1min":2.121,"5min":2.4369999999999998,"15min":2.573},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":7.5759999999999996,"5min":37.548999999999999,"15min":111.973},"last":4.968}]},{"osd":5,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":2.1309999999999998,"5min":2.0510000000000002,"15min":1.573},"min":{"1min":0.33500000000000002,"5min":0.314,"15min":0.308},"max":{"1min":13.215999999999999,"5min":37.496000000000002,"15min":37.496000000000002},"last":15.443},{"interface":"front","average":{"1min":2.5379999999999998,"5min":2.2799999999999998,"15min":1.645},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32600000000000001},"max":{"1min":34.545000000000002,"5min":45.997999999999998,"15min":45.997999999999998},"last":4.9249999999999998}]},{"osd":6,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":3.2850000000000001,"5min":2.9300000000000002,"15min":1.984},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":29.954999999999998,"5min":68.453000000000003,"15min":68.453000000000003},"last":5.4580000000000002},{"interface":"front","average":{"1min":2.4860000000000002,"5min":2.859,"15min":1.927},"min":{"1min":0.40699999999999997,"5min":0.34899999999999998,"15min":0.33600000000000002},"max":{"1min":11.115,"5min":63.966000000000001,"15min":63.966000000000001},"last":2.464}]},{"osd":7,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":2.0409999999999999,"15min":1.8720000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.0629999999999997,"5min":27.504000000000001,"15min":32.700000000000003},"last":9.1180000000000003},{"interface":"front","average":{"1min":2.6520000000000001,"5min":2.2450000000000001,"15min":2.0259999999999998},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":29.881,"5min":29.881,"15min":32.840000000000003},"last":4.8949999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575164,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1202252,"kb_used_data":62212,"kb_used_omap":1,"kb_used_meta":1140030,"kb_avail":93169588,"statfs":{"total":96636764160,"available":95405658112,"internally_reserved":0,"allocated":63705088,"data_stored":114855661,"data_compressed":10247405,"data_compressed_allocated":15732736,"data_compressed_original":67055616,"omap_allocated":1591,"internal_metadata":1167391177},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,6,3,8,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.5740000000000001,"15min":1.103},"min":{"1min":0.20899999999999999,"5min":0.192,"15min":0.184},"max":{"1min":7.7149999999999999,"5min":24.539999999999999,"15min":24.539999999999999},"last":8.6839999999999993},{"interface":"front","average":{"1min":1.48,"5min":1.468,"15min":1.476},"min":{"1min":0.21099999999999999,"5min":0.20100000000000001,"15min":0.19900000000000001},"max":{"1min":8.7539999999999996,"5min":12.204000000000001,"15min":95.932000000000002},"last":30.457000000000001}]},{"osd":1,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":2.048,"5min":3.0209999999999999,"15min":2.036},"min":{"1min":0.22600000000000001,"5min":0.193,"15min":0.193},"max":{"1min":18.105,"5min":44.308,"15min":44.308},"last":2.1160000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.99,"15min":1.2889999999999999},"min":{"1min":0.28999999999999998,"5min":0.23100000000000001,"15min":0.22},"max":{"1min":14.875,"5min":38.054000000000002,"15min":38.054000000000002},"last":13.927}]},{"osd":2,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":2.2029999999999998,"5min":1.8839999999999999,"15min":1.522},"min":{"1min":0.26100000000000001,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":15.788,"5min":18.132000000000001,"15min":18.132000000000001},"last":1.9770000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.2769999999999999,"15min":1.1040000000000001},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.26700000000000002},"max":{"1min":4.0629999999999997,"5min":17.364000000000001,"15min":17.364000000000001},"last":13.897}]},{"osd":4,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":2.0459999999999998,"15min":1.6439999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27100000000000002},"max":{"1min":8.6159999999999997,"5min":18.960000000000001,"15min":19.16},"last":18.422999999999998},{"interface":"front","average":{"1min":2.379,"5min":2.351,"15min":2.0609999999999999},"min":{"1min":0.31900000000000001,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":15.739000000000001,"5min":20.808,"15min":27.515999999999998},"last":8.9990000000000006}]},{"osd":5,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.7250000000000001,"5min":2.3050000000000002,"15min":1.8979999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32100000000000001},"max":{"1min":8.7739999999999991,"5min":33.436999999999998,"15min":33.436999999999998},"last":9.0570000000000004},{"interface":"front","average":{"1min":2.1139999999999999,"5min":2.048,"15min":1.5860000000000001},"min":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":13.818,"5min":17.329000000000001,"15min":17.329000000000001},"last":8.7110000000000003}]},{"osd":6,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":2.3500000000000001,"5min":2.3220000000000001,"15min":1.9850000000000001},"min":{"1min":0.38800000000000001,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":25.329000000000001,"5min":25.329000000000001,"15min":30.588000000000001},"last":8.6430000000000007},{"interface":"front","average":{"1min":1.5189999999999999,"5min":2.0659999999999998,"15min":1.804},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.33900000000000002},"max":{"1min":8.5809999999999995,"5min":18.803000000000001,"15min":23.318999999999999},"last":16.077000000000002}]},{"osd":7,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.9630000000000001,"5min":1.8280000000000001,"15min":1.7929999999999999},"min":{"1min":0.40999999999999998,"5min":0.35699999999999998,"15min":0.34699999999999998},"max":{"1min":10.007999999999999,"5min":18.841999999999999,"15min":19.116},"last":13.25},{"interface":"front","average":{"1min":3.129,"5min":2.5910000000000002,"15min":1.9770000000000001},"min":{"1min":0.42699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":19.504999999999999,"5min":33.505000000000003,"15min":33.505000000000003},"last":9.0350000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575164,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":924836,"kb_used_data":27676,"kb_used_omap":1,"kb_used_meta":897150,"kb_avail":93447004,"statfs":{"total":96636764160,"available":95689732096,"internally_reserved":0,"allocated":28340224,"data_stored":58256587,"data_compressed":4973009,"data_compressed_allocated":7712768,"data_compressed_original":37806080,"omap_allocated":1594,"internal_metadata":918682054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1,0,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.355,"5min":2.613,"15min":1.677},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.20599999999999999},"max":{"1min":19.058,"5min":21.062999999999999,"15min":45.375},"last":5.0049999999999999},{"interface":"front","average":{"1min":2.375,"5min":2.206,"15min":1.704},"min":{"1min":0.27500000000000002,"5min":0.23100000000000001,"15min":0.188},"max":{"1min":8.9550000000000001,"5min":19.850999999999999,"15min":35.765000000000001},"last":0.497}]},{"osd":1,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.617,"5min":2.9140000000000001,"15min":2.0609999999999999},"min":{"1min":0.26300000000000001,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":22.718,"5min":22.718,"15min":29.928000000000001},"last":7.9459999999999997},{"interface":"front","average":{"1min":3.3170000000000002,"5min":2.8740000000000001,"15min":1.714},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":19.032,"5min":21.103000000000002,"15min":23.634},"last":1.218}]},{"osd":2,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.2349999999999999,"5min":2.8679999999999999,"15min":1.786},"min":{"1min":0.32400000000000001,"5min":0.28599999999999998,"15min":0.27600000000000002},"max":{"1min":22.774000000000001,"5min":30.512,"15min":30.512},"last":8.0359999999999996},{"interface":"front","average":{"1min":5.0419999999999998,"5min":4.0350000000000001,"15min":2.109},"min":{"1min":0.29499999999999998,"5min":0.27400000000000002,"15min":0.26300000000000001},"max":{"1min":26.567,"5min":82.847999999999999,"15min":82.847999999999999},"last":0.84199999999999997}]},{"osd":3,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":2.1880000000000002,"5min":2.2400000000000002,"15min":1.5960000000000001},"min":{"1min":0.32600000000000001,"5min":0.26600000000000001,"15min":0.23899999999999999},"max":{"1min":8.452,"5min":15.500999999999999,"15min":22.555},"last":0.92200000000000004},{"interface":"front","average":{"1min":3.1230000000000002,"5min":3.1400000000000001,"15min":1.9710000000000001},"min":{"1min":0.37,"5min":0.313,"15min":0.308},"max":{"1min":22.66,"5min":26.259,"15min":26.259},"last":8.0609999999999999}]},{"osd":5,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":4.4569999999999999,"5min":4.1269999999999998,"15min":2.073},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.24399999999999999},"max":{"1min":26.484999999999999,"5min":82.918999999999997,"15min":82.918999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":2.4569999999999999,"5min":2.7490000000000001,"15min":1.8320000000000001},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.249},"max":{"1min":18.288,"5min":25.120000000000001,"15min":25.120000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":2.573,"5min":2.552,"15min":1.671},"min":{"1min":0.313,"5min":0.313,"15min":0.252},"max":{"1min":18.141999999999999,"5min":18.141999999999999,"15min":20.562999999999999},"last":8.0109999999999992},{"interface":"front","average":{"1min":3.8940000000000001,"5min":3.8290000000000002,"15min":2.2440000000000002},"min":{"1min":0.36199999999999999,"5min":0.30499999999999999,"15min":0.29499999999999998},"max":{"1min":21.478000000000002,"5min":83.643000000000001,"15min":83.643000000000001},"last":0.879}]},{"osd":7,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.1389999999999998,"5min":2.3490000000000002,"15min":1.748},"min":{"1min":0.373,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":19.021999999999998,"5min":19.021999999999998,"15min":25.878},"last":0.56000000000000005},{"interface":"front","average":{"1min":2.9780000000000002,"5min":2.4380000000000002,"15min":1.7609999999999999},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.27800000000000002},"max":{"1min":22.75,"5min":22.75,"15min":22.75},"last":7.9850000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575164,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":958980,"kb_used_data":35516,"kb_used_omap":1,"kb_used_meta":923454,"kb_avail":93412860,"statfs":{"total":96636764160,"available":95654768640,"internally_reserved":0,"allocated":36368384,"data_stored":62205095,"data_compressed":4933287,"data_compressed_allocated":7835648,"data_compressed_original":33841152,"omap_allocated":1594,"internal_metadata":945617350},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.911,"15min":1.306},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":6.2060000000000004,"5min":19.097999999999999,"15min":19.097999999999999},"last":6.1260000000000003},{"interface":"front","average":{"1min":1.609,"5min":2.157,"15min":1.508},"min":{"1min":0.28599999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":14.662000000000001,"5min":21.416,"15min":21.416},"last":1.6679999999999999}]},{"osd":1,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":2.0070000000000001,"15min":1.6040000000000001},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":3.4750000000000001,"5min":16.515000000000001,"15min":19.581},"last":1.468},{"interface":"front","average":{"1min":1.153,"5min":1.611,"15min":1.28},"min":{"1min":0.27100000000000002,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":8.4629999999999992,"5min":16.492999999999999,"15min":16.492999999999999},"last":13.266999999999999}]},{"osd":2,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.679,"15min":1.409},"min":{"1min":0.30599999999999999,"5min":0.27300000000000002,"15min":0.25700000000000001},"max":{"1min":5.7770000000000001,"5min":21.186,"15min":21.186},"last":0.496},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.6859999999999999,"15min":1.2609999999999999},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.25700000000000001},"max":{"1min":6.1289999999999996,"5min":22.353999999999999,"15min":22.353999999999999},"last":6.226}]},{"osd":3,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":2.0169999999999999,"15min":1.595},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.28199999999999997},"max":{"1min":14.736000000000001,"5min":16.324999999999999,"15min":17.103999999999999},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.5940000000000001,"5min":2.1800000000000002,"15min":1.6819999999999999},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.29899999999999999},"max":{"1min":15.821999999999999,"5min":18.798999999999999,"15min":23.224},"last":7.7539999999999996}]},{"osd":4,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":2.2869999999999999,"5min":2.206,"15min":1.5},"min":{"1min":0.27600000000000002,"5min":0.25,"15min":0.20799999999999999},"max":{"1min":17.914000000000001,"5min":22.300000000000001,"15min":28.724},"last":6.2000000000000002},{"interface":"front","average":{"1min":2.0960000000000001,"5min":2.4940000000000002,"15min":1.5980000000000001},"min":{"1min":0.371,"5min":0.28100000000000003,"15min":0.22800000000000001},"max":{"1min":22.385999999999999,"5min":25.466999999999999,"15min":25.466999999999999},"last":1.518}]},{"osd":6,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":2.1000000000000001,"15min":1.5129999999999999},"min":{"1min":0.29699999999999999,"5min":0.28699999999999998,"15min":0.23899999999999999},"max":{"1min":9.3539999999999992,"5min":21.294,"15min":21.294},"last":7.7210000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":2.3690000000000002,"15min":1.4590000000000001},"min":{"1min":0.39700000000000002,"5min":0.34300000000000003,"15min":0.24199999999999999},"max":{"1min":6.1820000000000004,"5min":23.731000000000002,"15min":23.731000000000002},"last":6.1660000000000004}]},{"osd":7,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.724,"5min":2.0630000000000002,"15min":1.4370000000000001},"min":{"1min":0.436,"5min":0.29799999999999999,"15min":0.28100000000000003},"max":{"1min":14.711,"5min":21.462,"15min":30.076000000000001},"last":1.845},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.796,"15min":1.29},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.26100000000000001},"max":{"1min":5.7460000000000004,"5min":21.257000000000001,"15min":21.257000000000001},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37617664,"data_stored":55032140,"data_compressed":5468644,"data_compressed_allocated":8114176,"data_compressed_original":25542656,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":56696832,"data_stored":82917896,"data_compressed":8014159,"data_compressed_allocated":12091392,"data_compressed_original":38322176,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41410560,"data_stored":58720256,"data_compressed":5586562,"data_compressed_allocated":8433664,"data_compressed_original":25743360,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58433536,"data_stored":88081056,"data_compressed":8987385,"data_compressed_allocated":13205504,"data_compressed_original":42860544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24395776,"data_stored":37748862,"data_compressed":4009381,"data_compressed_allocated":5820416,"data_compressed_original":19185664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33177600,"data_stored":46137434,"data_compressed":4179228,"data_compressed_allocated":6336512,"data_compressed_original":19300352,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50081792,"data_stored":74529800,"data_compressed":7356666,"data_compressed_allocated":10809344,"data_compressed_original":35266560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":39104512,"data_stored":58994952,"data_compressed":5940682,"data_compressed_allocated":8581120,"data_compressed_original":28475392,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3661824,"data_stored":19365888,"data_compressed":915424,"data_compressed_allocated":1843200,"data_compressed_original":17547264,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7176192,"data_stored":58953728,"data_compressed":2780979,"data_compressed_allocated":4546560,"data_compressed_original":56324096,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2895872,"data_stored":15314944,"data_compressed":723954,"data_compressed_allocated":1462272,"data_compressed_original":13881344,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4993024,"data_stored":26660864,"data_compressed":1260020,"data_compressed_allocated":2527232,"data_compressed_original":24195072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3665920,"data_stored":20393984,"data_compressed":963628,"data_compressed_allocated":1892352,"data_compressed_original":18620416,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2912256,"data_stored":15953920,"data_compressed":754059,"data_compressed_allocated":1499136,"data_compressed_original":14540800,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4046848,"data_stored":22233088,"data_compressed":1050632,"data_compressed_allocated":2084864,"data_compressed_original":20271104,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7102464,"data_stored":66555904,"data_compressed":3135358,"data_compressed_allocated":4907008,"data_compressed_original":64360448,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T19:48:33.879 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T19:48:34.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.047+0000 7fb0881bd700 1 Processor -- start 2024-05-08T19:48:34.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.047+0000 7fb0881bd700 1 -- start start 2024-05-08T19:48:34.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.048+0000 7fb0881bd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb080071710 0x7fb080154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.048+0000 7fb0881bd700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb080071b50 0x7fb0801551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.048+0000 7fb0881bd700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0800c0be0 con 0x7fb0801521c0 2024-05-08T19:48:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.048+0000 7fb0881bd700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08006b470 con 0x7fb080071b50 2024-05-08T19:48:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.048+0000 7fb0881bd700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800c1250 con 0x7fb080071710 2024-05-08T19:48:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.048+0000 7fb08675a700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb080071b50 0x7fb0801551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.048+0000 7fb085f59700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb0801521c0 0x7fb0800720a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57400/0 (socket says 172.21.15.47:57400) 2024-05-08T19:48:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.048+0000 7fb085f59700 1 -- 172.21.15.47:0/2463762981 learned_addr learned my addr 172.21.15.47:0/2463762981 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:48:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.048+0000 7fb085758700 1 --2- 172.21.15.47:0/2463762981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb080071710 0x7fb080154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.048+0000 7fb08675a700 1 -- 172.21.15.47:0/2463762981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb080071710 msgr2=0x7fb080154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.048+0000 7fb08675a700 1 --2- 172.21.15.47:0/2463762981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb080071710 0x7fb080154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.048+0000 7fb08675a700 1 -- 172.21.15.47:0/2463762981 >> v1:172.21.15.47:6789/0 conn(0x7fb0801521c0 legacy=0x7fb0800720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.048+0000 7fb08675a700 1 -- 172.21.15.47:0/2463762981 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08006b710 con 0x7fb080071b50 2024-05-08T19:48:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.048+0000 7fb084f57700 1 -- 172.21.15.47:0/2463762981 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798594814 0 0) 0x7fb0800c0be0 con 0x7fb0801521c0 2024-05-08T19:48:34.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.048+0000 7fb08675a700 1 --2- 172.21.15.47:0/2463762981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080071b50 0x7fb0801551f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb078009d90 tx=0x7fb07800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37fcfecca5b26d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:34.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.049+0000 7fb084f57700 1 -- 172.21.15.47:0/2463762981 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07800e070 con 0x7fb080071b50 2024-05-08T19:48:34.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.049+0000 7fb084f57700 1 -- 172.21.15.47:0/2463762981 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07800bb20 con 0x7fb080071b50 2024-05-08T19:48:34.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.049+0000 7fb084f57700 1 -- 172.21.15.47:0/2463762981 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078012430 con 0x7fb080071b50 2024-05-08T19:48:34.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.049+0000 7fb0881bd700 1 -- 172.21.15.47:0/2463762981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080071b50 msgr2=0x7fb0801551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:34.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.049+0000 7fb0881bd700 1 --2- 172.21.15.47:0/2463762981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080071b50 0x7fb0801551f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb078009d90 tx=0x7fb07800b330 comp rx=0 tx=0).stop 2024-05-08T19:48:34.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.049+0000 7fb0881bd700 1 -- 172.21.15.47:0/2463762981 shutdown_connections 2024-05-08T19:48:34.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.049+0000 7fb0881bd700 1 --2- 172.21.15.47:0/2463762981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080071b50 0x7fb0801551f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:34.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.049+0000 7fb0881bd700 1 --2- 172.21.15.47:0/2463762981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb080071710 0x7fb080154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:34.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.049+0000 7fb0881bd700 1 -- 172.21.15.47:0/2463762981 >> 172.21.15.47:0/2463762981 conn(0x7fb0800c7120 msgr2=0x7fb0800c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:34.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.049+0000 7fb0881bd700 1 -- 172.21.15.47:0/2463762981 shutdown_connections 2024-05-08T19:48:34.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.049+0000 7fb0881bd700 1 -- 172.21.15.47:0/2463762981 wait complete. 2024-05-08T19:48:34.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.050+0000 7fb0881bd700 1 Processor -- start 2024-05-08T19:48:34.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.050+0000 7fb0881bd700 1 -- start start 2024-05-08T19:48:34.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb0881bd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080071710 0x7fb080148f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:34.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb0881bd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb080071b50 0x7fb0801edf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:34.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb0881bd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0801521c0 0x7fb0801ee480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:34.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb0881bd700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0801538f0 con 0x7fb080071710 2024-05-08T19:48:34.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb0881bd700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0801487f0 con 0x7fb080071b50 2024-05-08T19:48:34.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb0881bd700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb080148a90 con 0x7fb0801521c0 2024-05-08T19:48:34.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb085f59700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080071710 0x7fb080148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:34.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb085f59700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080071710 0x7fb080148f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44230/0 (socket says 172.21.15.47:44230) 2024-05-08T19:48:34.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb085f59700 1 -- 172.21.15.47:0/1581880909 learned_addr learned my addr 172.21.15.47:0/1581880909 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:34.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb085758700 1 --2- 172.21.15.47:0/1581880909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb080071b50 0x7fb0801edf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:34.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb08675a700 1 --2- 172.21.15.47:0/1581880909 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0801521c0 0x7fb0801ee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:34.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb085f59700 1 -- 172.21.15.47:0/1581880909 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0801521c0 msgr2=0x7fb0801ee480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:34.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb085f59700 1 --2- 172.21.15.47:0/1581880909 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0801521c0 0x7fb0801ee480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:34.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb085f59700 1 -- 172.21.15.47:0/1581880909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb080071b50 msgr2=0x7fb0801edf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:34.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb085f59700 1 --2- 172.21.15.47:0/1581880909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb080071b50 0x7fb0801edf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:34.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.051+0000 7fb085f59700 1 -- 172.21.15.47:0/1581880909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb078009a70 con 0x7fb080071710 2024-05-08T19:48:34.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.052+0000 7fb085f59700 1 --2- 172.21.15.47:0/1581880909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080071710 0x7fb080148f20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00c550 tx=0x7fb07c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:34.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.052+0000 7fb0767fc700 1 -- 172.21.15.47:0/1581880909 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c004c80 con 0x7fb080071710 2024-05-08T19:48:34.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.052+0000 7fb0767fc700 1 -- 172.21.15.47:0/1581880909 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c004e00 con 0x7fb080071710 2024-05-08T19:48:34.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.052+0000 7fb0767fc700 1 -- 172.21.15.47:0/1581880909 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c007310 con 0x7fb080071710 2024-05-08T19:48:34.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.052+0000 7fb0881bd700 1 -- 172.21.15.47:0/1581880909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb080154910 con 0x7fb080071710 2024-05-08T19:48:34.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.052+0000 7fb0881bd700 1 -- 172.21.15.47:0/1581880909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb080153db0 con 0x7fb080071710 2024-05-08T19:48:34.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.053+0000 7fb0881bd700 1 -- 172.21.15.47:0/1581880909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb080148d70 con 0x7fb080071710 2024-05-08T19:48:34.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.053+0000 7fb0767fc700 1 -- 172.21.15.47:0/1581880909 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb07c007470 con 0x7fb080071710 2024-05-08T19:48:34.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.054+0000 7fb0767fc700 1 --2- 172.21.15.47:0/1581880909 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb06406ac90 0x7fb06406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:34.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.054+0000 7fb0767fc700 1 -- 172.21.15.47:0/1581880909 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb07c0893a0 con 0x7fb080071710 2024-05-08T19:48:34.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.054+0000 7fb085758700 1 --2- 172.21.15.47:0/1581880909 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb06406ac90 0x7fb06406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:34.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.054+0000 7fb085758700 1 --2- 172.21.15.47:0/1581880909 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb06406ac90 0x7fb06406d150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb08014f4e0 tx=0x7fb070008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:34.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.058+0000 7fb0767fc700 1 -- 172.21.15.47:0/1581880909 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb07c0541c0 con 0x7fb080071710 2024-05-08T19:48:34.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.511+0000 7fb0881bd700 1 -- 172.21.15.47:0/1581880909 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb080074210 con 0x7fb06406ac90 2024-05-08T19:48:34.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.539+0000 7fb0767fc700 1 -- 172.21.15.47:0/1581880909 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371968 (secure 0 0 0) 0x7fb070011780 con 0x7fb06406ac90 2024-05-08T19:48:34.533 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:48:34.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.545+0000 7fb0881bd700 1 -- 172.21.15.47:0/1581880909 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb06406ac90 msgr2=0x7fb06406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:34.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.545+0000 7fb0881bd700 1 --2- 172.21.15.47:0/1581880909 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb06406ac90 0x7fb06406d150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb08014f4e0 tx=0x7fb070008040 comp rx=0 tx=0).stop 2024-05-08T19:48:34.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.545+0000 7fb0881bd700 1 -- 172.21.15.47:0/1581880909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080071710 msgr2=0x7fb080148f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:34.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.545+0000 7fb0881bd700 1 --2- 172.21.15.47:0/1581880909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080071710 0x7fb080148f20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00c550 tx=0x7fb07c00c910 comp rx=0 tx=0).stop 2024-05-08T19:48:34.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.569+0000 7fb0881bd700 1 -- 172.21.15.47:0/1581880909 shutdown_connections 2024-05-08T19:48:34.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.569+0000 7fb0881bd700 1 --2- 172.21.15.47:0/1581880909 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb06406ac90 0x7fb06406d150 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:34.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.569+0000 7fb0881bd700 1 --2- 172.21.15.47:0/1581880909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080071710 0x7fb080148f20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:34.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.569+0000 7fb0881bd700 1 --2- 172.21.15.47:0/1581880909 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0801521c0 0x7fb0801ee480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:34.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.569+0000 7fb0881bd700 1 --2- 172.21.15.47:0/1581880909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb080071b50 0x7fb0801edf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:34.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.569+0000 7fb0881bd700 1 -- 172.21.15.47:0/1581880909 >> 172.21.15.47:0/1581880909 conn(0x7fb0800c7120 msgr2=0x7fb0800c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:34.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.570+0000 7fb0881bd700 1 -- 172.21.15.47:0/1581880909 shutdown_connections 2024-05-08T19:48:34.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:34.570+0000 7fb0881bd700 1 -- 172.21.15.47:0/1581880909 wait complete. 2024-05-08T19:48:34.569 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-08T19:48:34.591 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":808,"stamp":"2024-05-08T19:48:32.598506+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":338372162,"num_objects":1910,"num_object_clones":0,"num_object_copies":5732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1910,"num_whiteouts":0,"num_read":21638,"num_read_kb":1158704,"num_write":407515,"num_write_kb":31677585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":573783,"ondisk_log_size":573783,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7777204,"kb_used_data":375812,"kb_used_omap":12,"kb_used_meta":7401203,"kb_avail":747197516,"statfs":{"total":773094113280,"available":765130256384,"internally_reserved":0,"allocated":384831488,"data_stored":815498630,"data_compressed":64276350,"data_compressed_allocated":98619392,"data_compressed_original":530673664,"omap_allocated":12741,"internal_metadata":7578832443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,7,9,6,10,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-220761622,"num_objects":-1489,"num_object_clones":0,"num_object_copies":-5090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1489,"num_whiteouts":0,"num_read":79,"num_read_kb":4183,"num_write":4813,"num_write_kb":100688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009198"},"pg_stats":[{"pgid":"3.3f","version":"26'2217","reported_seq":2245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:26.729950+0000","last_change":"2024-05-08T19:22:20.461758+0000","last_active":"2024-05-08T19:48:26.729950+0000","last_peered":"2024-05-08T19:48:26.729950+0000","last_clean":"2024-05-08T19:48:26.729950+0000","last_became_active":"2024-05-08T19:22:20.461515+0000","last_became_peered":"2024-05-08T19:22:20.461515+0000","last_unstale":"2024-05-08T19:48:26.729950+0000","last_undegraded":"2024-05-08T19:48:26.729950+0000","last_fullsized":"2024-05-08T19:48:26.729950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'2252","reported_seq":2280,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.415099+0000","last_change":"2024-05-08T19:22:20.434929+0000","last_active":"2024-05-08T19:48:29.415099+0000","last_peered":"2024-05-08T19:48:29.415099+0000","last_clean":"2024-05-08T19:48:29.415099+0000","last_became_active":"2024-05-08T19:22:20.434629+0000","last_became_peered":"2024-05-08T19:22:20.434629+0000","last_unstale":"2024-05-08T19:48:29.415099+0000","last_undegraded":"2024-05-08T19:48:29.415099+0000","last_fullsized":"2024-05-08T19:48:29.415099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2252,"log_dups_size":0,"ondisk_log_size":2252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"26'2362","reported_seq":2390,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.252030+0000","last_change":"2024-05-08T19:22:20.449450+0000","last_active":"2024-05-08T19:48:29.252030+0000","last_peered":"2024-05-08T19:48:29.252030+0000","last_clean":"2024-05-08T19:48:29.252030+0000","last_became_active":"2024-05-08T19:22:20.449184+0000","last_became_peered":"2024-05-08T19:22:20.449184+0000","last_unstale":"2024-05-08T19:48:29.252030+0000","last_undegraded":"2024-05-08T19:48:29.252030+0000","last_fullsized":"2024-05-08T19:48:29.252030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2362,"log_dups_size":0,"ondisk_log_size":2362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"26'2333","reported_seq":2361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.100139+0000","last_change":"2024-05-08T19:22:20.449919+0000","last_active":"2024-05-08T19:48:30.100139+0000","last_peered":"2024-05-08T19:48:30.100139+0000","last_clean":"2024-05-08T19:48:30.100139+0000","last_became_active":"2024-05-08T19:22:20.449637+0000","last_became_peered":"2024-05-08T19:22:20.449637+0000","last_unstale":"2024-05-08T19:48:30.100139+0000","last_undegraded":"2024-05-08T19:48:30.100139+0000","last_fullsized":"2024-05-08T19:48:30.100139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2333,"log_dups_size":0,"ondisk_log_size":2333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'2261","reported_seq":2287,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.349642+0000","last_change":"2024-05-08T19:22:20.449676+0000","last_active":"2024-05-08T19:48:27.349642+0000","last_peered":"2024-05-08T19:48:27.349642+0000","last_clean":"2024-05-08T19:48:27.349642+0000","last_became_active":"2024-05-08T19:22:20.449347+0000","last_became_peered":"2024-05-08T19:22:20.449347+0000","last_unstale":"2024-05-08T19:48:27.349642+0000","last_undegraded":"2024-05-08T19:48:27.349642+0000","last_fullsized":"2024-05-08T19:48:27.349642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2261,"log_dups_size":0,"ondisk_log_size":2261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:29.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'2206","reported_seq":2226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.699476+0000","last_change":"2024-05-08T19:23:11.053315+0000","last_active":"2024-05-08T19:48:29.699476+0000","last_peered":"2024-05-08T19:48:29.699476+0000","last_clean":"2024-05-08T19:48:29.699476+0000","last_became_active":"2024-05-08T19:23:11.052928+0000","last_became_peered":"2024-05-08T19:23:11.052928+0000","last_unstale":"2024-05-08T19:48:29.699476+0000","last_undegraded":"2024-05-08T19:48:29.699476+0000","last_fullsized":"2024-05-08T19:48:29.699476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2206,"log_dups_size":0,"ondisk_log_size":2206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:17.190935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"26'2264","reported_seq":2290,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.344503+0000","last_change":"2024-05-08T19:22:20.446830+0000","last_active":"2024-05-08T19:48:27.344503+0000","last_peered":"2024-05-08T19:48:27.344503+0000","last_clean":"2024-05-08T19:48:27.344503+0000","last_became_active":"2024-05-08T19:22:20.446520+0000","last_became_peered":"2024-05-08T19:22:20.446520+0000","last_unstale":"2024-05-08T19:48:27.344503+0000","last_undegraded":"2024-05-08T19:48:27.344503+0000","last_fullsized":"2024-05-08T19:48:27.344503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2264,"log_dups_size":0,"ondisk_log_size":2264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:25.101779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'2263","reported_seq":2289,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.950352+0000","last_change":"2024-05-08T19:22:20.447313+0000","last_active":"2024-05-08T19:48:29.950352+0000","last_peered":"2024-05-08T19:48:29.950352+0000","last_clean":"2024-05-08T19:48:29.950352+0000","last_became_active":"2024-05-08T19:22:20.447031+0000","last_became_peered":"2024-05-08T19:22:20.447031+0000","last_unstale":"2024-05-08T19:48:29.950352+0000","last_undegraded":"2024-05-08T19:48:29.950352+0000","last_fullsized":"2024-05-08T19:48:29.950352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2263,"log_dups_size":0,"ondisk_log_size":2263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"26'2318","reported_seq":2344,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.637378+0000","last_change":"2024-05-08T19:22:20.447186+0000","last_active":"2024-05-08T19:48:27.637378+0000","last_peered":"2024-05-08T19:48:27.637378+0000","last_clean":"2024-05-08T19:48:27.637378+0000","last_became_active":"2024-05-08T19:22:20.446803+0000","last_became_peered":"2024-05-08T19:22:20.446803+0000","last_unstale":"2024-05-08T19:48:27.637378+0000","last_undegraded":"2024-05-08T19:48:27.637378+0000","last_fullsized":"2024-05-08T19:48:27.637378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2318,"log_dups_size":0,"ondisk_log_size":2318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'2338","reported_seq":2364,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.900817+0000","last_change":"2024-05-08T19:22:20.462899+0000","last_active":"2024-05-08T19:48:29.900817+0000","last_peered":"2024-05-08T19:48:29.900817+0000","last_clean":"2024-05-08T19:48:29.900817+0000","last_became_active":"2024-05-08T19:22:20.461395+0000","last_became_peered":"2024-05-08T19:22:20.461395+0000","last_unstale":"2024-05-08T19:48:29.900817+0000","last_undegraded":"2024-05-08T19:48:29.900817+0000","last_fullsized":"2024-05-08T19:48:29.900817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2338,"log_dups_size":0,"ondisk_log_size":2338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"26'2216","reported_seq":2242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.839269+0000","last_change":"2024-05-08T19:22:20.459545+0000","last_active":"2024-05-08T19:48:29.839269+0000","last_peered":"2024-05-08T19:48:29.839269+0000","last_clean":"2024-05-08T19:48:29.839269+0000","last_became_active":"2024-05-08T19:22:20.459253+0000","last_became_peered":"2024-05-08T19:22:20.459253+0000","last_unstale":"2024-05-08T19:48:29.839269+0000","last_undegraded":"2024-05-08T19:48:29.839269+0000","last_fullsized":"2024-05-08T19:48:29.839269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2216,"log_dups_size":0,"ondisk_log_size":2216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"26'2202","reported_seq":2228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.909068+0000","last_change":"2024-05-08T19:22:20.462193+0000","last_active":"2024-05-08T19:48:29.909068+0000","last_peered":"2024-05-08T19:48:29.909068+0000","last_clean":"2024-05-08T19:48:29.909068+0000","last_became_active":"2024-05-08T19:22:20.461852+0000","last_became_peered":"2024-05-08T19:22:20.461852+0000","last_unstale":"2024-05-08T19:48:29.909068+0000","last_undegraded":"2024-05-08T19:48:29.909068+0000","last_fullsized":"2024-05-08T19:48:29.909068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:51.431376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"26'2249","reported_seq":2275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.437813+0000","last_change":"2024-05-08T19:22:20.453169+0000","last_active":"2024-05-08T19:48:29.437813+0000","last_peered":"2024-05-08T19:48:29.437813+0000","last_clean":"2024-05-08T19:48:29.437813+0000","last_became_active":"2024-05-08T19:22:20.452884+0000","last_became_peered":"2024-05-08T19:22:20.452884+0000","last_unstale":"2024-05-08T19:48:29.437813+0000","last_undegraded":"2024-05-08T19:48:29.437813+0000","last_fullsized":"2024-05-08T19:48:29.437813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2249,"log_dups_size":0,"ondisk_log_size":2249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"26'2281","reported_seq":2308,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.783911+0000","last_change":"2024-05-08T19:22:20.435745+0000","last_active":"2024-05-08T19:48:29.783911+0000","last_peered":"2024-05-08T19:48:29.783911+0000","last_clean":"2024-05-08T19:48:29.783911+0000","last_became_active":"2024-05-08T19:22:20.435456+0000","last_became_peered":"2024-05-08T19:22:20.435456+0000","last_unstale":"2024-05-08T19:48:29.783911+0000","last_undegraded":"2024-05-08T19:48:29.783911+0000","last_fullsized":"2024-05-08T19:48:29.783911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2281,"log_dups_size":0,"ondisk_log_size":2281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"26'2348","reported_seq":2375,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:28.730522+0000","last_change":"2024-05-08T19:22:20.444615+0000","last_active":"2024-05-08T19:48:28.730522+0000","last_peered":"2024-05-08T19:48:28.730522+0000","last_clean":"2024-05-08T19:48:28.730522+0000","last_became_active":"2024-05-08T19:22:20.444369+0000","last_became_peered":"2024-05-08T19:22:20.444369+0000","last_unstale":"2024-05-08T19:48:28.730522+0000","last_undegraded":"2024-05-08T19:48:28.730522+0000","last_fullsized":"2024-05-08T19:48:28.730522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2348,"log_dups_size":0,"ondisk_log_size":2348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'2251","reported_seq":2278,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.485265+0000","last_change":"2024-05-08T19:22:20.445391+0000","last_active":"2024-05-08T19:48:29.485265+0000","last_peered":"2024-05-08T19:48:29.485265+0000","last_clean":"2024-05-08T19:48:29.485265+0000","last_became_active":"2024-05-08T19:22:20.444996+0000","last_became_peered":"2024-05-08T19:22:20.444996+0000","last_unstale":"2024-05-08T19:48:29.485265+0000","last_undegraded":"2024-05-08T19:48:29.485265+0000","last_fullsized":"2024-05-08T19:48:29.485265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2251,"log_dups_size":0,"ondisk_log_size":2251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"26'2315","reported_seq":2342,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.701160+0000","last_change":"2024-05-08T19:22:20.451170+0000","last_active":"2024-05-08T19:48:29.701160+0000","last_peered":"2024-05-08T19:48:29.701160+0000","last_clean":"2024-05-08T19:48:29.701160+0000","last_became_active":"2024-05-08T19:22:20.450843+0000","last_became_peered":"2024-05-08T19:22:20.450843+0000","last_unstale":"2024-05-08T19:48:29.701160+0000","last_undegraded":"2024-05-08T19:48:29.701160+0000","last_fullsized":"2024-05-08T19:48:29.701160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2315,"log_dups_size":0,"ondisk_log_size":2315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'2280","reported_seq":2307,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.987017+0000","last_change":"2024-05-08T19:22:20.462503+0000","last_active":"2024-05-08T19:48:29.987017+0000","last_peered":"2024-05-08T19:48:29.987017+0000","last_clean":"2024-05-08T19:48:29.987017+0000","last_became_active":"2024-05-08T19:22:20.462266+0000","last_became_peered":"2024-05-08T19:22:20.462266+0000","last_unstale":"2024-05-08T19:48:29.987017+0000","last_undegraded":"2024-05-08T19:48:29.987017+0000","last_fullsized":"2024-05-08T19:48:29.987017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2280,"log_dups_size":0,"ondisk_log_size":2280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:04.174914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"26'2324","reported_seq":2351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:24.010922+0000","last_change":"2024-05-08T19:22:20.454128+0000","last_active":"2024-05-08T19:48:24.010922+0000","last_peered":"2024-05-08T19:48:24.010922+0000","last_clean":"2024-05-08T19:48:24.010922+0000","last_became_active":"2024-05-08T19:22:20.453834+0000","last_became_peered":"2024-05-08T19:22:20.453834+0000","last_unstale":"2024-05-08T19:48:24.010922+0000","last_undegraded":"2024-05-08T19:48:24.010922+0000","last_fullsized":"2024-05-08T19:48:24.010922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:23.193366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"26'8894","reported_seq":8969,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.789537+0000","last_change":"2024-05-08T19:22:24.616532+0000","last_active":"2024-05-08T19:48:29.789537+0000","last_peered":"2024-05-08T19:48:29.789537+0000","last_clean":"2024-05-08T19:48:29.789537+0000","last_became_active":"2024-05-08T19:22:24.616128+0000","last_became_peered":"2024-05-08T19:22:24.616128+0000","last_unstale":"2024-05-08T19:48:29.789537+0000","last_undegraded":"2024-05-08T19:48:29.789537+0000","last_fullsized":"2024-05-08T19:48:29.789537+0000","mapping_epoch":22,"log_start":"26'2412","ondisk_log_start":"26'2412","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6482,"log_dups_size":0,"ondisk_log_size":6482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:44.356550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2261478,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":51,"num_read_kb":3400,"num_write":6550,"num_write_kb":966197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"26'2349","reported_seq":2378,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:08.547207+0000","last_change":"2024-05-08T19:22:20.012743+0000","last_active":"2024-05-08T19:47:08.547207+0000","last_peered":"2024-05-08T19:47:08.547207+0000","last_clean":"2024-05-08T19:47:08.547207+0000","last_became_active":"2024-05-08T19:22:20.012453+0000","last_became_peered":"2024-05-08T19:22:20.012453+0000","last_unstale":"2024-05-08T19:47:08.547207+0000","last_undegraded":"2024-05-08T19:47:08.547207+0000","last_fullsized":"2024-05-08T19:47:08.547207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:52.547906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2351,"num_write_kb":17974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'2295","reported_seq":2323,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.508215+0000","last_change":"2024-05-08T19:22:20.464578+0000","last_active":"2024-05-08T19:48:29.508215+0000","last_peered":"2024-05-08T19:48:29.508215+0000","last_clean":"2024-05-08T19:48:29.508215+0000","last_became_active":"2024-05-08T19:22:20.464396+0000","last_became_peered":"2024-05-08T19:22:20.464396+0000","last_unstale":"2024-05-08T19:48:29.508215+0000","last_undegraded":"2024-05-08T19:48:29.508215+0000","last_fullsized":"2024-05-08T19:48:29.508215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"26'8763","reported_seq":9429,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.011249+0000","last_change":"2024-05-08T19:22:24.469561+0000","last_active":"2024-05-08T19:48:30.011249+0000","last_peered":"2024-05-08T19:48:30.011249+0000","last_clean":"2024-05-08T19:48:30.011249+0000","last_became_active":"2024-05-08T19:22:24.469161+0000","last_became_peered":"2024-05-08T19:22:24.469161+0000","last_unstale":"2024-05-08T19:48:30.011249+0000","last_undegraded":"2024-05-08T19:48:30.011249+0000","last_fullsized":"2024-05-08T19:48:30.011249+0000","mapping_epoch":22,"log_start":"26'1544","ondisk_log_start":"26'1544","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7219,"log_dups_size":0,"ondisk_log_size":7219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:50.011809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2824860,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":642,"num_read_kb":43100,"num_write":6319,"num_write_kb":920646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"26'8076","reported_seq":8105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.072681+0000","last_change":"2024-05-08T19:22:20.006198+0000","last_active":"2024-05-08T19:48:30.072681+0000","last_peered":"2024-05-08T19:48:30.072681+0000","last_clean":"2024-05-08T19:48:30.072681+0000","last_became_active":"2024-05-08T19:22:20.005723+0000","last_became_peered":"2024-05-08T19:22:20.005723+0000","last_unstale":"2024-05-08T19:48:30.072681+0000","last_undegraded":"2024-05-08T19:48:30.072681+0000","last_fullsized":"2024-05-08T19:48:30.072681+0000","mapping_epoch":17,"log_start":"26'1600","ondisk_log_start":"26'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6476,"log_dups_size":0,"ondisk_log_size":6476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8075,"num_write_kb":50504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'2296","reported_seq":2324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.638193+0000","last_change":"2024-05-08T19:22:20.451485+0000","last_active":"2024-05-08T19:48:29.638193+0000","last_peered":"2024-05-08T19:48:29.638193+0000","last_clean":"2024-05-08T19:48:29.638193+0000","last_became_active":"2024-05-08T19:22:20.446380+0000","last_became_peered":"2024-05-08T19:22:20.446380+0000","last_unstale":"2024-05-08T19:48:29.638193+0000","last_undegraded":"2024-05-08T19:48:29.638193+0000","last_fullsized":"2024-05-08T19:48:29.638193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2296,"log_dups_size":0,"ondisk_log_size":2296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:47.856077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"26'8161","reported_seq":8789,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.923489+0000","last_change":"2024-05-08T19:22:24.465354+0000","last_active":"2024-05-08T19:48:29.923489+0000","last_peered":"2024-05-08T19:48:29.923489+0000","last_clean":"2024-05-08T19:48:29.923489+0000","last_became_active":"2024-05-08T19:22:24.464669+0000","last_became_peered":"2024-05-08T19:22:24.464669+0000","last_unstale":"2024-05-08T19:48:29.923489+0000","last_undegraded":"2024-05-08T19:48:29.923489+0000","last_fullsized":"2024-05-08T19:48:29.923489+0000","mapping_epoch":22,"log_start":"26'1003","ondisk_log_start":"26'1003","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7158,"log_dups_size":0,"ondisk_log_size":7158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:29.398413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880683,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":604,"num_read_kb":22018,"num_write":5695,"num_write_kb":861910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'9217","reported_seq":9244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:36.403369+0000","last_change":"2024-05-08T19:22:20.014506+0000","last_active":"2024-05-08T19:47:36.403369+0000","last_peered":"2024-05-08T19:47:36.403369+0000","last_clean":"2024-05-08T19:47:36.403369+0000","last_became_active":"2024-05-08T19:22:20.014239+0000","last_became_peered":"2024-05-08T19:22:20.014239+0000","last_unstale":"2024-05-08T19:47:36.403369+0000","last_undegraded":"2024-05-08T19:47:36.403369+0000","last_fullsized":"2024-05-08T19:47:36.403369+0000","mapping_epoch":17,"log_start":"26'2300","ondisk_log_start":"26'2300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6917,"log_dups_size":0,"ondisk_log_size":6917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:23.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":9231,"num_write_kb":71812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'2380","reported_seq":2400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.896235+0000","last_change":"2024-05-08T19:23:11.054407+0000","last_active":"2024-05-08T19:48:29.896235+0000","last_peered":"2024-05-08T19:48:29.896235+0000","last_clean":"2024-05-08T19:48:29.896235+0000","last_became_active":"2024-05-08T19:23:11.054036+0000","last_became_peered":"2024-05-08T19:23:11.054036+0000","last_unstale":"2024-05-08T19:48:29.896235+0000","last_undegraded":"2024-05-08T19:48:29.896235+0000","last_fullsized":"2024-05-08T19:48:29.896235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2380,"log_dups_size":0,"ondisk_log_size":2380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:41.638647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"26'8184","reported_seq":8450,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.730638+0000","last_change":"2024-05-08T19:22:24.479649+0000","last_active":"2024-05-08T19:48:29.730638+0000","last_peered":"2024-05-08T19:48:29.730638+0000","last_clean":"2024-05-08T19:48:29.730638+0000","last_became_active":"2024-05-08T19:22:24.479255+0000","last_became_peered":"2024-05-08T19:22:24.479255+0000","last_unstale":"2024-05-08T19:48:29.730638+0000","last_undegraded":"2024-05-08T19:48:29.730638+0000","last_fullsized":"2024-05-08T19:48:29.730638+0000","mapping_epoch":22,"log_start":"26'1000","ondisk_log_start":"26'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7184,"log_dups_size":0,"ondisk_log_size":7184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2436548,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":242,"num_read_kb":15390,"num_write":5806,"num_write_kb":1051846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6108","reported_seq":6135,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:22.734555+0000","last_change":"2024-05-08T19:22:20.014093+0000","last_active":"2024-05-08T19:47:22.734555+0000","last_peered":"2024-05-08T19:47:22.734555+0000","last_clean":"2024-05-08T19:47:22.734555+0000","last_became_active":"2024-05-08T19:22:20.013793+0000","last_became_peered":"2024-05-08T19:22:20.013793+0000","last_unstale":"2024-05-08T19:47:22.734555+0000","last_undegraded":"2024-05-08T19:47:22.734555+0000","last_fullsized":"2024-05-08T19:47:22.734555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6108,"log_dups_size":0,"ondisk_log_size":6108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6121,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'2276","reported_seq":2302,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.766528+0000","last_change":"2024-05-08T19:22:20.455505+0000","last_active":"2024-05-08T19:48:29.766528+0000","last_peered":"2024-05-08T19:48:29.766528+0000","last_clean":"2024-05-08T19:48:29.766528+0000","last_became_active":"2024-05-08T19:22:20.455148+0000","last_became_peered":"2024-05-08T19:22:20.455148+0000","last_unstale":"2024-05-08T19:48:29.766528+0000","last_undegraded":"2024-05-08T19:48:29.766528+0000","last_fullsized":"2024-05-08T19:48:29.766528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2276,"log_dups_size":0,"ondisk_log_size":2276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"26'8403","reported_seq":9263,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.767683+0000","last_change":"2024-05-08T19:22:24.465009+0000","last_active":"2024-05-08T19:48:29.767683+0000","last_peered":"2024-05-08T19:48:29.767683+0000","last_clean":"2024-05-08T19:48:29.767683+0000","last_became_active":"2024-05-08T19:22:24.464422+0000","last_became_peered":"2024-05-08T19:22:24.464422+0000","last_unstale":"2024-05-08T19:48:29.767683+0000","last_undegraded":"2024-05-08T19:48:29.767683+0000","last_fullsized":"2024-05-08T19:48:29.767683+0000","mapping_epoch":22,"log_start":"26'2000","ondisk_log_start":"26'2000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6403,"log_dups_size":0,"ondisk_log_size":6403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:12.830755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1989992,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":836,"num_read_kb":58598,"num_write":5961,"num_write_kb":988104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"26'8499","reported_seq":8526,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.071306+0000","last_change":"2024-05-08T19:22:20.011515+0000","last_active":"2024-05-08T19:48:30.071306+0000","last_peered":"2024-05-08T19:48:30.071306+0000","last_clean":"2024-05-08T19:48:30.071306+0000","last_became_active":"2024-05-08T19:22:20.011183+0000","last_became_peered":"2024-05-08T19:22:20.011183+0000","last_unstale":"2024-05-08T19:48:30.071306+0000","last_undegraded":"2024-05-08T19:48:30.071306+0000","last_fullsized":"2024-05-08T19:48:30.071306+0000","mapping_epoch":17,"log_start":"26'2100","ondisk_log_start":"26'2100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6399,"log_dups_size":0,"ondisk_log_size":6399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8493,"num_write_kb":66920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'2319","reported_seq":2345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.609234+0000","last_change":"2024-05-08T19:22:20.439371+0000","last_active":"2024-05-08T19:48:29.609234+0000","last_peered":"2024-05-08T19:48:29.609234+0000","last_clean":"2024-05-08T19:48:29.609234+0000","last_became_active":"2024-05-08T19:22:20.439096+0000","last_became_peered":"2024-05-08T19:22:20.439096+0000","last_unstale":"2024-05-08T19:48:29.609234+0000","last_undegraded":"2024-05-08T19:48:29.609234+0000","last_fullsized":"2024-05-08T19:48:29.609234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2319,"log_dups_size":0,"ondisk_log_size":2319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:56.795619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'8624","reported_seq":9354,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.100706+0000","last_change":"2024-05-08T19:23:11.529967+0000","last_active":"2024-05-08T19:48:30.100706+0000","last_peered":"2024-05-08T19:48:30.100706+0000","last_clean":"2024-05-08T19:48:30.100706+0000","last_became_active":"2024-05-08T19:23:11.529451+0000","last_became_peered":"2024-05-08T19:23:11.529451+0000","last_unstale":"2024-05-08T19:48:30.100706+0000","last_undegraded":"2024-05-08T19:48:30.100706+0000","last_fullsized":"2024-05-08T19:48:30.100706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":8624,"log_dups_size":0,"ondisk_log_size":8624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:23.975698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2253528,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":696,"num_read_kb":42234,"num_write":6155,"num_write_kb":1013077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"26'10407","reported_seq":10434,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:22.961151+0000","last_change":"2024-05-08T19:22:20.004185+0000","last_active":"2024-05-08T19:48:22.961151+0000","last_peered":"2024-05-08T19:48:22.961151+0000","last_clean":"2024-05-08T19:48:22.961151+0000","last_became_active":"2024-05-08T19:22:20.003513+0000","last_became_peered":"2024-05-08T19:22:20.003513+0000","last_unstale":"2024-05-08T19:48:22.961151+0000","last_undegraded":"2024-05-08T19:48:22.961151+0000","last_fullsized":"2024-05-08T19:48:22.961151+0000","mapping_epoch":17,"log_start":"26'2500","ondisk_log_start":"26'2500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7907,"log_dups_size":0,"ondisk_log_size":7907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10402,"num_write_kb":72564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'2262","reported_seq":2288,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.819862+0000","last_change":"2024-05-08T19:22:20.446538+0000","last_active":"2024-05-08T19:48:29.819862+0000","last_peered":"2024-05-08T19:48:29.819862+0000","last_clean":"2024-05-08T19:48:29.819862+0000","last_became_active":"2024-05-08T19:22:20.445238+0000","last_became_peered":"2024-05-08T19:22:20.445238+0000","last_unstale":"2024-05-08T19:48:29.819862+0000","last_undegraded":"2024-05-08T19:48:29.819862+0000","last_fullsized":"2024-05-08T19:48:29.819862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2262,"log_dups_size":0,"ondisk_log_size":2262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'8242","reported_seq":10709,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.972487+0000","last_change":"2024-05-08T19:22:24.479665+0000","last_active":"2024-05-08T19:48:29.972487+0000","last_peered":"2024-05-08T19:48:29.972487+0000","last_clean":"2024-05-08T19:48:29.972487+0000","last_became_active":"2024-05-08T19:22:24.478998+0000","last_became_peered":"2024-05-08T19:22:24.478998+0000","last_unstale":"2024-05-08T19:48:29.972487+0000","last_undegraded":"2024-05-08T19:48:29.972487+0000","last_fullsized":"2024-05-08T19:48:29.972487+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7942,"log_dups_size":0,"ondisk_log_size":7942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:55.287155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1844298,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2441,"num_read_kb":165440,"num_write":5883,"num_write_kb":873311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"26'5851","reported_seq":5878,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.065548+0000","last_change":"2024-05-08T19:22:20.002850+0000","last_active":"2024-05-08T19:48:30.065548+0000","last_peered":"2024-05-08T19:48:30.065548+0000","last_clean":"2024-05-08T19:48:30.065548+0000","last_became_active":"2024-05-08T19:22:20.002534+0000","last_became_peered":"2024-05-08T19:22:20.002534+0000","last_unstale":"2024-05-08T19:48:30.065548+0000","last_undegraded":"2024-05-08T19:48:30.065548+0000","last_fullsized":"2024-05-08T19:48:30.065548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5851,"log_dups_size":0,"ondisk_log_size":5851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5849,"num_write_kb":40670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"26'2347","reported_seq":2373,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.926085+0000","last_change":"2024-05-08T19:22:20.436698+0000","last_active":"2024-05-08T19:48:29.926085+0000","last_peered":"2024-05-08T19:48:29.926085+0000","last_clean":"2024-05-08T19:48:29.926085+0000","last_became_active":"2024-05-08T19:22:20.436431+0000","last_became_peered":"2024-05-08T19:22:20.436431+0000","last_unstale":"2024-05-08T19:48:29.926085+0000","last_undegraded":"2024-05-08T19:48:29.926085+0000","last_fullsized":"2024-05-08T19:48:29.926085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2347,"log_dups_size":0,"ondisk_log_size":2347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'8438","reported_seq":9167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.966724+0000","last_change":"2024-05-08T19:22:24.617420+0000","last_active":"2024-05-08T19:48:29.966724+0000","last_peered":"2024-05-08T19:48:29.966724+0000","last_clean":"2024-05-08T19:48:29.966724+0000","last_became_active":"2024-05-08T19:22:24.617030+0000","last_became_peered":"2024-05-08T19:22:24.617030+0000","last_unstale":"2024-05-08T19:48:29.966724+0000","last_undegraded":"2024-05-08T19:48:29.966724+0000","last_fullsized":"2024-05-08T19:48:29.966724+0000","mapping_epoch":22,"log_start":"26'1202","ondisk_log_start":"26'1202","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7236,"log_dups_size":0,"ondisk_log_size":7236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:29.274973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2763684,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":703,"num_read_kb":49016,"num_write":6096,"num_write_kb":1037918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"26'9201","reported_seq":9228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:46:37.444413+0000","last_change":"2024-05-08T19:22:20.003949+0000","last_active":"2024-05-08T19:46:37.444413+0000","last_peered":"2024-05-08T19:46:37.444413+0000","last_clean":"2024-05-08T19:46:37.444413+0000","last_became_active":"2024-05-08T19:22:20.003365+0000","last_became_peered":"2024-05-08T19:22:20.003365+0000","last_unstale":"2024-05-08T19:46:37.444413+0000","last_undegraded":"2024-05-08T19:46:37.444413+0000","last_fullsized":"2024-05-08T19:46:37.444413+0000","mapping_epoch":17,"log_start":"26'1700","ondisk_log_start":"26'1700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7501,"log_dups_size":0,"ondisk_log_size":7501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9188,"num_write_kb":63509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"26'2275","reported_seq":2301,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.364983+0000","last_change":"2024-05-08T19:22:20.437480+0000","last_active":"2024-05-08T19:48:29.364983+0000","last_peered":"2024-05-08T19:48:29.364983+0000","last_clean":"2024-05-08T19:48:29.364983+0000","last_became_active":"2024-05-08T19:22:20.437214+0000","last_became_peered":"2024-05-08T19:22:20.437214+0000","last_unstale":"2024-05-08T19:48:29.364983+0000","last_undegraded":"2024-05-08T19:48:29.364983+0000","last_fullsized":"2024-05-08T19:48:29.364983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2275,"log_dups_size":0,"ondisk_log_size":2275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"26'8393","reported_seq":8861,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.769227+0000","last_change":"2024-05-08T19:22:24.615730+0000","last_active":"2024-05-08T19:48:29.769227+0000","last_peered":"2024-05-08T19:48:29.769227+0000","last_clean":"2024-05-08T19:48:29.769227+0000","last_became_active":"2024-05-08T19:22:24.615351+0000","last_became_peered":"2024-05-08T19:22:24.615351+0000","last_unstale":"2024-05-08T19:48:29.769227+0000","last_undegraded":"2024-05-08T19:48:29.769227+0000","last_fullsized":"2024-05-08T19:48:29.769227+0000","mapping_epoch":22,"log_start":"26'1914","ondisk_log_start":"26'1914","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6479,"log_dups_size":0,"ondisk_log_size":6479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2591622,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":443,"num_read_kb":19968,"num_write":5920,"num_write_kb":994007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"26'7040","reported_seq":7905,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:46.436611+0000","last_change":"2024-05-08T19:22:20.002400+0000","last_active":"2024-05-08T19:47:46.436611+0000","last_peered":"2024-05-08T19:47:46.436611+0000","last_clean":"2024-05-08T19:47:46.436611+0000","last_became_active":"2024-05-08T19:22:20.001990+0000","last_became_peered":"2024-05-08T19:22:20.001990+0000","last_unstale":"2024-05-08T19:47:46.436611+0000","last_undegraded":"2024-05-08T19:47:46.436611+0000","last_fullsized":"2024-05-08T19:47:46.436611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7040,"log_dups_size":0,"ondisk_log_size":7040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":838,"num_read_kb":4635,"num_write":7033,"num_write_kb":49678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"26'2293","reported_seq":2319,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.474226+0000","last_change":"2024-05-08T19:22:20.447742+0000","last_active":"2024-05-08T19:48:29.474226+0000","last_peered":"2024-05-08T19:48:29.474226+0000","last_clean":"2024-05-08T19:48:29.474226+0000","last_became_active":"2024-05-08T19:22:20.447475+0000","last_became_peered":"2024-05-08T19:22:20.447475+0000","last_unstale":"2024-05-08T19:48:29.474226+0000","last_undegraded":"2024-05-08T19:48:29.474226+0000","last_fullsized":"2024-05-08T19:48:29.474226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2293,"log_dups_size":0,"ondisk_log_size":2293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'7931","reported_seq":8419,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.027857+0000","last_change":"2024-05-08T19:23:11.054182+0000","last_active":"2024-05-08T19:48:30.027857+0000","last_peered":"2024-05-08T19:48:30.027857+0000","last_clean":"2024-05-08T19:48:30.027857+0000","last_became_active":"2024-05-08T19:23:11.053733+0000","last_became_peered":"2024-05-08T19:23:11.053733+0000","last_unstale":"2024-05-08T19:48:30.027857+0000","last_undegraded":"2024-05-08T19:48:30.027857+0000","last_fullsized":"2024-05-08T19:48:30.027857+0000","mapping_epoch":25,"log_start":"26'1500","ondisk_log_start":"26'1500","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6431,"log_dups_size":0,"ondisk_log_size":6431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:25.669682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2393664,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":453,"num_read_kb":17282,"num_write":5539,"num_write_kb":1020101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"26'6222","reported_seq":6249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:46.403274+0000","last_change":"2024-05-08T19:22:20.001272+0000","last_active":"2024-05-08T19:47:46.403274+0000","last_peered":"2024-05-08T19:47:46.403274+0000","last_clean":"2024-05-08T19:47:46.403274+0000","last_became_active":"2024-05-08T19:22:20.000981+0000","last_became_peered":"2024-05-08T19:22:20.000981+0000","last_unstale":"2024-05-08T19:47:46.403274+0000","last_undegraded":"2024-05-08T19:47:46.403274+0000","last_fullsized":"2024-05-08T19:47:46.403274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6222,"log_dups_size":0,"ondisk_log_size":6222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6225,"num_write_kb":45123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"26'2312","reported_seq":2338,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.863471+0000","last_change":"2024-05-08T19:22:20.446938+0000","last_active":"2024-05-08T19:48:29.863471+0000","last_peered":"2024-05-08T19:48:29.863471+0000","last_clean":"2024-05-08T19:48:29.863471+0000","last_became_active":"2024-05-08T19:22:20.446644+0000","last_became_peered":"2024-05-08T19:22:20.446644+0000","last_unstale":"2024-05-08T19:48:29.863471+0000","last_undegraded":"2024-05-08T19:48:29.863471+0000","last_fullsized":"2024-05-08T19:48:29.863471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2312,"log_dups_size":0,"ondisk_log_size":2312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:39:35.443674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"26'8282","reported_seq":8802,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.984044+0000","last_change":"2024-05-08T19:22:24.465089+0000","last_active":"2024-05-08T19:48:29.984044+0000","last_peered":"2024-05-08T19:48:29.984044+0000","last_clean":"2024-05-08T19:48:29.984044+0000","last_became_active":"2024-05-08T19:22:24.464178+0000","last_became_peered":"2024-05-08T19:22:24.464178+0000","last_unstale":"2024-05-08T19:48:29.984044+0000","last_undegraded":"2024-05-08T19:48:29.984044+0000","last_fullsized":"2024-05-08T19:48:29.984044+0000","mapping_epoch":22,"log_start":"26'1100","ondisk_log_start":"26'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7182,"log_dups_size":0,"ondisk_log_size":7182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2099376,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":495,"num_read_kb":27360,"num_write":5849,"num_write_kb":879779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'6718","reported_seq":6745,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:19.537721+0000","last_change":"2024-05-08T19:22:20.001300+0000","last_active":"2024-05-08T19:48:19.537721+0000","last_peered":"2024-05-08T19:48:19.537721+0000","last_clean":"2024-05-08T19:48:19.537721+0000","last_became_active":"2024-05-08T19:22:20.000985+0000","last_became_peered":"2024-05-08T19:22:20.000985+0000","last_unstale":"2024-05-08T19:48:19.537721+0000","last_undegraded":"2024-05-08T19:48:19.537721+0000","last_fullsized":"2024-05-08T19:48:19.537721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6718,"log_dups_size":0,"ondisk_log_size":6718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:50.426177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":6735,"num_write_kb":41822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'2300","reported_seq":2327,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.234932+0000","last_change":"2024-05-08T19:22:20.447801+0000","last_active":"2024-05-08T19:48:29.234932+0000","last_peered":"2024-05-08T19:48:29.234932+0000","last_clean":"2024-05-08T19:48:29.234932+0000","last_became_active":"2024-05-08T19:22:20.447538+0000","last_became_peered":"2024-05-08T19:22:20.447538+0000","last_unstale":"2024-05-08T19:48:29.234932+0000","last_undegraded":"2024-05-08T19:48:29.234932+0000","last_fullsized":"2024-05-08T19:48:29.234932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2300,"log_dups_size":0,"ondisk_log_size":2300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:14.706653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"26'8556","reported_seq":9098,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.377078+0000","last_change":"2024-05-08T19:22:24.479544+0000","last_active":"2024-05-08T19:48:29.377078+0000","last_peered":"2024-05-08T19:48:29.377078+0000","last_clean":"2024-05-08T19:48:29.377078+0000","last_became_active":"2024-05-08T19:22:24.479071+0000","last_became_peered":"2024-05-08T19:22:24.479071+0000","last_unstale":"2024-05-08T19:48:29.377078+0000","last_undegraded":"2024-05-08T19:48:29.377078+0000","last_fullsized":"2024-05-08T19:48:29.377078+0000","mapping_epoch":22,"log_start":"26'1203","ondisk_log_start":"26'1203","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7353,"log_dups_size":0,"ondisk_log_size":7353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:19.704360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5422324,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":517,"num_read_kb":30942,"num_write":6150,"num_write_kb":930944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'10871","reported_seq":11527,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.097575+0000","last_change":"2024-05-08T19:22:20.011799+0000","last_active":"2024-05-08T19:48:30.097575+0000","last_peered":"2024-05-08T19:48:30.097575+0000","last_clean":"2024-05-08T19:48:30.097575+0000","last_became_active":"2024-05-08T19:22:20.011331+0000","last_became_peered":"2024-05-08T19:22:20.011331+0000","last_unstale":"2024-05-08T19:48:30.097575+0000","last_undegraded":"2024-05-08T19:48:30.097575+0000","last_fullsized":"2024-05-08T19:48:30.097575+0000","mapping_epoch":17,"log_start":"26'2900","ondisk_log_start":"26'2900","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7971,"log_dups_size":0,"ondisk_log_size":7971,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":630,"num_read_kb":4505,"num_write":10866,"num_write_kb":72955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"26'2223","reported_seq":2249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:26.642870+0000","last_change":"2024-05-08T19:22:20.447583+0000","last_active":"2024-05-08T19:48:26.642870+0000","last_peered":"2024-05-08T19:48:26.642870+0000","last_clean":"2024-05-08T19:48:26.642870+0000","last_became_active":"2024-05-08T19:22:20.447243+0000","last_became_peered":"2024-05-08T19:22:20.447243+0000","last_unstale":"2024-05-08T19:48:26.642870+0000","last_undegraded":"2024-05-08T19:48:26.642870+0000","last_fullsized":"2024-05-08T19:48:26.642870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2223,"log_dups_size":0,"ondisk_log_size":2223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'8660","reported_seq":9061,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.915473+0000","last_change":"2024-05-08T19:22:24.615622+0000","last_active":"2024-05-08T19:48:29.915473+0000","last_peered":"2024-05-08T19:48:29.915473+0000","last_clean":"2024-05-08T19:48:29.915473+0000","last_became_active":"2024-05-08T19:22:24.614790+0000","last_became_peered":"2024-05-08T19:22:24.614790+0000","last_unstale":"2024-05-08T19:48:29.915473+0000","last_undegraded":"2024-05-08T19:48:29.915473+0000","last_fullsized":"2024-05-08T19:48:29.915473+0000","mapping_epoch":22,"log_start":"26'1126","ondisk_log_start":"26'1126","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7534,"log_dups_size":0,"ondisk_log_size":7534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2455380,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":377,"num_read_kb":22514,"num_write":6329,"num_write_kb":865965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"26'4995","reported_seq":5023,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:15.305590+0000","last_change":"2024-05-08T19:22:20.006367+0000","last_active":"2024-05-08T19:48:15.305590+0000","last_peered":"2024-05-08T19:48:15.305590+0000","last_clean":"2024-05-08T19:48:15.305590+0000","last_became_active":"2024-05-08T19:22:20.005738+0000","last_became_peered":"2024-05-08T19:22:20.005738+0000","last_unstale":"2024-05-08T19:48:15.305590+0000","last_undegraded":"2024-05-08T19:48:15.305590+0000","last_fullsized":"2024-05-08T19:48:15.305590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4995,"log_dups_size":0,"ondisk_log_size":4995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4997,"num_write_kb":36069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"26'2310","reported_seq":2337,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.334524+0000","last_change":"2024-05-08T19:22:20.448713+0000","last_active":"2024-05-08T19:48:29.334524+0000","last_peered":"2024-05-08T19:48:29.334524+0000","last_clean":"2024-05-08T19:48:29.334524+0000","last_became_active":"2024-05-08T19:22:20.448268+0000","last_became_peered":"2024-05-08T19:22:20.448268+0000","last_unstale":"2024-05-08T19:48:29.334524+0000","last_undegraded":"2024-05-08T19:48:29.334524+0000","last_fullsized":"2024-05-08T19:48:29.334524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2310,"log_dups_size":0,"ondisk_log_size":2310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"26'8177","reported_seq":8301,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.029291+0000","last_change":"2024-05-08T19:22:24.614076+0000","last_active":"2024-05-08T19:48:30.029291+0000","last_peered":"2024-05-08T19:48:30.029291+0000","last_clean":"2024-05-08T19:48:30.029291+0000","last_became_active":"2024-05-08T19:22:24.613698+0000","last_became_peered":"2024-05-08T19:22:24.613698+0000","last_unstale":"2024-05-08T19:48:30.029291+0000","last_undegraded":"2024-05-08T19:48:30.029291+0000","last_fullsized":"2024-05-08T19:48:30.029291+0000","mapping_epoch":22,"log_start":"26'1759","ondisk_log_start":"26'1759","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6418,"log_dups_size":0,"ondisk_log_size":6418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:26.030709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3032238,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":99,"num_read_kb":5304,"num_write":5797,"num_write_kb":1072126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'2636","reported_seq":2664,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:59.935072+0000","last_change":"2024-05-08T19:22:20.011480+0000","last_active":"2024-05-08T19:47:59.935072+0000","last_peered":"2024-05-08T19:47:59.935072+0000","last_clean":"2024-05-08T19:47:59.935072+0000","last_became_active":"2024-05-08T19:22:20.011188+0000","last_became_peered":"2024-05-08T19:22:20.011188+0000","last_unstale":"2024-05-08T19:47:59.935072+0000","last_undegraded":"2024-05-08T19:47:59.935072+0000","last_fullsized":"2024-05-08T19:47:59.935072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2636,"log_dups_size":0,"ondisk_log_size":2636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2643,"num_write_kb":22132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'2318","reported_seq":2345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.680606+0000","last_change":"2024-05-08T19:22:20.455818+0000","last_active":"2024-05-08T19:48:27.680606+0000","last_peered":"2024-05-08T19:48:27.680606+0000","last_clean":"2024-05-08T19:48:27.680606+0000","last_became_active":"2024-05-08T19:22:20.455562+0000","last_became_peered":"2024-05-08T19:22:20.455562+0000","last_unstale":"2024-05-08T19:48:27.680606+0000","last_undegraded":"2024-05-08T19:48:27.680606+0000","last_fullsized":"2024-05-08T19:48:27.680606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2318,"log_dups_size":0,"ondisk_log_size":2318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"26'8195","reported_seq":8371,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.846935+0000","last_change":"2024-05-08T19:22:24.616812+0000","last_active":"2024-05-08T19:48:29.846935+0000","last_peered":"2024-05-08T19:48:29.846935+0000","last_clean":"2024-05-08T19:48:29.846935+0000","last_became_active":"2024-05-08T19:22:24.615618+0000","last_became_peered":"2024-05-08T19:22:24.615618+0000","last_unstale":"2024-05-08T19:48:29.846935+0000","last_undegraded":"2024-05-08T19:48:29.846935+0000","last_fullsized":"2024-05-08T19:48:29.846935+0000","mapping_epoch":22,"log_start":"26'1715","ondisk_log_start":"26'1715","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6480,"log_dups_size":0,"ondisk_log_size":6480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:21.559278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2601582,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":152,"num_read_kb":3194,"num_write":5693,"num_write_kb":833306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"26'3930","reported_seq":3958,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:59.629602+0000","last_change":"2024-05-08T19:22:20.004327+0000","last_active":"2024-05-08T19:47:59.629602+0000","last_peered":"2024-05-08T19:47:59.629602+0000","last_clean":"2024-05-08T19:47:59.629602+0000","last_became_active":"2024-05-08T19:22:20.003725+0000","last_became_peered":"2024-05-08T19:22:20.003725+0000","last_unstale":"2024-05-08T19:47:59.629602+0000","last_undegraded":"2024-05-08T19:47:59.629602+0000","last_fullsized":"2024-05-08T19:47:59.629602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":3930,"log_dups_size":0,"ondisk_log_size":3930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3928,"num_write_kb":31166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"26'2224","reported_seq":2251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.015918+0000","last_change":"2024-05-08T19:22:20.459536+0000","last_active":"2024-05-08T19:48:30.015918+0000","last_peered":"2024-05-08T19:48:30.015918+0000","last_clean":"2024-05-08T19:48:30.015918+0000","last_became_active":"2024-05-08T19:22:20.452496+0000","last_became_peered":"2024-05-08T19:22:20.452496+0000","last_unstale":"2024-05-08T19:48:30.015918+0000","last_undegraded":"2024-05-08T19:48:30.015918+0000","last_fullsized":"2024-05-08T19:48:30.015918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2224,"log_dups_size":0,"ondisk_log_size":2224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"26'8416","reported_seq":9020,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.914488+0000","last_change":"2024-05-08T19:22:24.478351+0000","last_active":"2024-05-08T19:48:29.914488+0000","last_peered":"2024-05-08T19:48:29.914488+0000","last_clean":"2024-05-08T19:48:29.914488+0000","last_became_active":"2024-05-08T19:22:24.477728+0000","last_became_peered":"2024-05-08T19:22:24.477728+0000","last_unstale":"2024-05-08T19:48:29.914488+0000","last_undegraded":"2024-05-08T19:48:29.914488+0000","last_fullsized":"2024-05-08T19:48:29.914488+0000","mapping_epoch":22,"log_start":"26'1217","ondisk_log_start":"26'1217","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7199,"log_dups_size":0,"ondisk_log_size":7199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2423580,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":580,"num_read_kb":39960,"num_write":5994,"num_write_kb":827712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"26'5263","reported_seq":5291,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.028947+0000","last_change":"2024-05-08T19:22:20.008346+0000","last_active":"2024-05-08T19:48:30.028947+0000","last_peered":"2024-05-08T19:48:30.028947+0000","last_clean":"2024-05-08T19:48:30.028947+0000","last_became_active":"2024-05-08T19:22:20.007985+0000","last_became_peered":"2024-05-08T19:22:20.007985+0000","last_unstale":"2024-05-08T19:48:30.028947+0000","last_undegraded":"2024-05-08T19:48:30.028947+0000","last_fullsized":"2024-05-08T19:48:30.028947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5263,"log_dups_size":0,"ondisk_log_size":5263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":5293,"num_write_kb":36936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"26'2335","reported_seq":2362,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.360048+0000","last_change":"2024-05-08T19:22:20.458860+0000","last_active":"2024-05-08T19:48:27.360048+0000","last_peered":"2024-05-08T19:48:27.360048+0000","last_clean":"2024-05-08T19:48:27.360048+0000","last_became_active":"2024-05-08T19:22:20.458588+0000","last_became_peered":"2024-05-08T19:22:20.458588+0000","last_unstale":"2024-05-08T19:48:27.360048+0000","last_undegraded":"2024-05-08T19:48:27.360048+0000","last_fullsized":"2024-05-08T19:48:27.360048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2335,"log_dups_size":0,"ondisk_log_size":2335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"26'8503","reported_seq":10172,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.005568+0000","last_change":"2024-05-08T19:22:24.464132+0000","last_active":"2024-05-08T19:48:30.005568+0000","last_peered":"2024-05-08T19:48:30.005568+0000","last_clean":"2024-05-08T19:48:30.005568+0000","last_became_active":"2024-05-08T19:22:24.463741+0000","last_became_peered":"2024-05-08T19:22:24.463741+0000","last_unstale":"2024-05-08T19:48:30.005568+0000","last_undegraded":"2024-05-08T19:48:30.005568+0000","last_fullsized":"2024-05-08T19:48:30.005568+0000","mapping_epoch":22,"log_start":"26'1304","ondisk_log_start":"26'1304","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7199,"log_dups_size":0,"ondisk_log_size":7199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:13.044112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2383830,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1644,"num_read_kb":83588,"num_write":6105,"num_write_kb":944540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"26'5910","reported_seq":5938,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.074638+0000","last_change":"2024-05-08T19:22:20.005994+0000","last_active":"2024-05-08T19:48:30.074638+0000","last_peered":"2024-05-08T19:48:30.074638+0000","last_clean":"2024-05-08T19:48:30.074638+0000","last_became_active":"2024-05-08T19:22:20.005680+0000","last_became_peered":"2024-05-08T19:22:20.005680+0000","last_unstale":"2024-05-08T19:48:30.074638+0000","last_undegraded":"2024-05-08T19:48:30.074638+0000","last_fullsized":"2024-05-08T19:48:30.074638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5910,"log_dups_size":0,"ondisk_log_size":5910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:18.387895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5919,"num_write_kb":40735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"26'2276","reported_seq":2303,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.386106+0000","last_change":"2024-05-08T19:22:20.449812+0000","last_active":"2024-05-08T19:48:27.386106+0000","last_peered":"2024-05-08T19:48:27.386106+0000","last_clean":"2024-05-08T19:48:27.386106+0000","last_became_active":"2024-05-08T19:22:20.449512+0000","last_became_peered":"2024-05-08T19:22:20.449512+0000","last_unstale":"2024-05-08T19:48:27.386106+0000","last_undegraded":"2024-05-08T19:48:27.386106+0000","last_fullsized":"2024-05-08T19:48:27.386106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2276,"log_dups_size":0,"ondisk_log_size":2276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"26'8802","reported_seq":9086,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.216869+0000","last_change":"2024-05-08T19:22:24.478647+0000","last_active":"2024-05-08T19:48:29.216869+0000","last_peered":"2024-05-08T19:48:29.216869+0000","last_clean":"2024-05-08T19:48:29.216869+0000","last_became_active":"2024-05-08T19:22:24.478248+0000","last_became_peered":"2024-05-08T19:22:24.478248+0000","last_unstale":"2024-05-08T19:48:29.216869+0000","last_undegraded":"2024-05-08T19:48:29.216869+0000","last_fullsized":"2024-05-08T19:48:29.216869+0000","mapping_epoch":22,"log_start":"26'1412","ondisk_log_start":"26'1412","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7390,"log_dups_size":0,"ondisk_log_size":7390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:26.651711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4425186,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":258,"num_read_kb":14826,"num_write":6409,"num_write_kb":856300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"26'7007","reported_seq":7036,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:13.224756+0000","last_change":"2024-05-08T19:22:20.003344+0000","last_active":"2024-05-08T19:47:13.224756+0000","last_peered":"2024-05-08T19:47:13.224756+0000","last_clean":"2024-05-08T19:47:13.224756+0000","last_became_active":"2024-05-08T19:22:20.003055+0000","last_became_peered":"2024-05-08T19:22:20.003055+0000","last_unstale":"2024-05-08T19:47:13.224756+0000","last_undegraded":"2024-05-08T19:47:13.224756+0000","last_fullsized":"2024-05-08T19:47:13.224756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7007,"log_dups_size":0,"ondisk_log_size":7007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7014,"num_write_kb":53638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"26'2278","reported_seq":2306,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.646775+0000","last_change":"2024-05-08T19:22:20.450523+0000","last_active":"2024-05-08T19:48:29.646775+0000","last_peered":"2024-05-08T19:48:29.646775+0000","last_clean":"2024-05-08T19:48:29.646775+0000","last_became_active":"2024-05-08T19:22:20.449693+0000","last_became_peered":"2024-05-08T19:22:20.449693+0000","last_unstale":"2024-05-08T19:48:29.646775+0000","last_undegraded":"2024-05-08T19:48:29.646775+0000","last_fullsized":"2024-05-08T19:48:29.646775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2278,"log_dups_size":0,"ondisk_log_size":2278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'8971","reported_seq":9142,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.376868+0000","last_change":"2024-05-08T19:22:24.472926+0000","last_active":"2024-05-08T19:48:29.376868+0000","last_peered":"2024-05-08T19:48:29.376868+0000","last_clean":"2024-05-08T19:48:29.376868+0000","last_became_active":"2024-05-08T19:22:24.472518+0000","last_became_peered":"2024-05-08T19:22:24.472518+0000","last_unstale":"2024-05-08T19:48:29.376868+0000","last_undegraded":"2024-05-08T19:48:29.376868+0000","last_fullsized":"2024-05-08T19:48:29.376868+0000","mapping_epoch":22,"log_start":"26'1583","ondisk_log_start":"26'1583","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7388,"log_dups_size":0,"ondisk_log_size":7388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2685762,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":145,"num_read_kb":5460,"num_write":6536,"num_write_kb":1024036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"26'7864","reported_seq":7893,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.077571+0000","last_change":"2024-05-08T19:22:20.007824+0000","last_active":"2024-05-08T19:48:30.077571+0000","last_peered":"2024-05-08T19:48:30.077571+0000","last_clean":"2024-05-08T19:48:30.077571+0000","last_became_active":"2024-05-08T19:22:20.007542+0000","last_became_peered":"2024-05-08T19:22:20.007542+0000","last_unstale":"2024-05-08T19:48:30.077571+0000","last_undegraded":"2024-05-08T19:48:30.077571+0000","last_fullsized":"2024-05-08T19:48:30.077571+0000","mapping_epoch":17,"log_start":"26'300","ondisk_log_start":"26'300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7564,"log_dups_size":0,"ondisk_log_size":7564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7858,"num_write_kb":54448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'2297","reported_seq":2325,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.956239+0000","last_change":"2024-05-08T19:22:20.443326+0000","last_active":"2024-05-08T19:48:29.956239+0000","last_peered":"2024-05-08T19:48:29.956239+0000","last_clean":"2024-05-08T19:48:29.956239+0000","last_became_active":"2024-05-08T19:22:20.443049+0000","last_became_peered":"2024-05-08T19:22:20.443049+0000","last_unstale":"2024-05-08T19:48:29.956239+0000","last_undegraded":"2024-05-08T19:48:29.956239+0000","last_fullsized":"2024-05-08T19:48:29.956239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2297,"log_dups_size":0,"ondisk_log_size":2297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:04.174914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"26'8075","reported_seq":9057,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.886637+0000","last_change":"2024-05-08T19:23:11.532565+0000","last_active":"2024-05-08T19:48:29.886637+0000","last_peered":"2024-05-08T19:48:29.886637+0000","last_clean":"2024-05-08T19:48:29.886637+0000","last_became_active":"2024-05-08T19:23:11.532148+0000","last_became_peered":"2024-05-08T19:23:11.532148+0000","last_unstale":"2024-05-08T19:48:29.886637+0000","last_undegraded":"2024-05-08T19:48:29.886637+0000","last_fullsized":"2024-05-08T19:48:29.886637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":8075,"log_dups_size":0,"ondisk_log_size":8075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:14.273885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2771094,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":959,"num_read_kb":67642,"num_write":5630,"num_write_kb":895819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'2285","reported_seq":2313,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.171971+0000","last_change":"2024-05-08T19:22:20.449968+0000","last_active":"2024-05-08T19:48:29.171971+0000","last_peered":"2024-05-08T19:48:29.171971+0000","last_clean":"2024-05-08T19:48:29.171971+0000","last_became_active":"2024-05-08T19:22:20.449709+0000","last_became_peered":"2024-05-08T19:22:20.449709+0000","last_unstale":"2024-05-08T19:48:29.171971+0000","last_undegraded":"2024-05-08T19:48:29.171971+0000","last_fullsized":"2024-05-08T19:48:29.171971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2285,"log_dups_size":0,"ondisk_log_size":2285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'7712","reported_seq":8676,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.075764+0000","last_change":"2024-05-08T19:22:20.004708+0000","last_active":"2024-05-08T19:48:30.075764+0000","last_peered":"2024-05-08T19:48:30.075764+0000","last_clean":"2024-05-08T19:48:30.075764+0000","last_became_active":"2024-05-08T19:22:20.004404+0000","last_became_peered":"2024-05-08T19:22:20.004404+0000","last_unstale":"2024-05-08T19:48:30.075764+0000","last_undegraded":"2024-05-08T19:48:30.075764+0000","last_fullsized":"2024-05-08T19:48:30.075764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7712,"log_dups_size":0,"ondisk_log_size":7712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":935,"num_read_kb":4706,"num_write":7714,"num_write_kb":54235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"26'8447","reported_seq":9003,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.713721+0000","last_change":"2024-05-08T19:22:24.617952+0000","last_active":"2024-05-08T19:48:29.713721+0000","last_peered":"2024-05-08T19:48:29.713721+0000","last_clean":"2024-05-08T19:48:29.713721+0000","last_became_active":"2024-05-08T19:22:24.617627+0000","last_became_peered":"2024-05-08T19:22:24.617627+0000","last_unstale":"2024-05-08T19:48:29.713721+0000","last_undegraded":"2024-05-08T19:48:29.713721+0000","last_fullsized":"2024-05-08T19:48:29.713721+0000","mapping_epoch":22,"log_start":"26'474","ondisk_log_start":"26'474","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7973,"log_dups_size":0,"ondisk_log_size":7973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:57.825616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3804310,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":530,"num_read_kb":27006,"num_write":6108,"num_write_kb":958609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"26'2341","reported_seq":2369,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.962672+0000","last_change":"2024-05-08T19:22:20.447152+0000","last_active":"2024-05-08T19:48:29.962672+0000","last_peered":"2024-05-08T19:48:29.962672+0000","last_clean":"2024-05-08T19:48:29.962672+0000","last_became_active":"2024-05-08T19:22:20.446864+0000","last_became_peered":"2024-05-08T19:22:20.446864+0000","last_unstale":"2024-05-08T19:48:29.962672+0000","last_undegraded":"2024-05-08T19:48:29.962672+0000","last_fullsized":"2024-05-08T19:48:29.962672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2341,"log_dups_size":0,"ondisk_log_size":2341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'5126","reported_seq":5155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:24.156639+0000","last_change":"2024-05-08T19:22:20.003790+0000","last_active":"2024-05-08T19:47:24.156639+0000","last_peered":"2024-05-08T19:47:24.156639+0000","last_clean":"2024-05-08T19:47:24.156639+0000","last_became_active":"2024-05-08T19:22:20.003441+0000","last_became_peered":"2024-05-08T19:22:20.003441+0000","last_unstale":"2024-05-08T19:47:24.156639+0000","last_undegraded":"2024-05-08T19:47:24.156639+0000","last_fullsized":"2024-05-08T19:47:24.156639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5126,"log_dups_size":0,"ondisk_log_size":5126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5120,"num_write_kb":36122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:46:27.527762+0000","last_change":"2024-05-08T19:22:17.117278+0000","last_active":"2024-05-08T19:46:27.527762+0000","last_peered":"2024-05-08T19:46:27.527762+0000","last_clean":"2024-05-08T19:46:27.527762+0000","last_became_active":"2024-05-08T19:22:17.116272+0000","last_became_peered":"2024-05-08T19:22:17.116272+0000","last_unstale":"2024-05-08T19:46:27.527762+0000","last_undegraded":"2024-05-08T19:46:27.527762+0000","last_fullsized":"2024-05-08T19:46:27.527762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_clean_scrub_stamp":"2024-05-08T19:22:15.924359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:37.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'8629","reported_seq":8735,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.973317+0000","last_change":"2024-05-08T19:22:24.617594+0000","last_active":"2024-05-08T19:48:29.973317+0000","last_peered":"2024-05-08T19:48:29.973317+0000","last_clean":"2024-05-08T19:48:29.973317+0000","last_became_active":"2024-05-08T19:22:24.616486+0000","last_became_peered":"2024-05-08T19:22:24.616486+0000","last_unstale":"2024-05-08T19:48:29.973317+0000","last_undegraded":"2024-05-08T19:48:29.973317+0000","last_fullsized":"2024-05-08T19:48:29.973317+0000","mapping_epoch":22,"log_start":"26'1423","ondisk_log_start":"26'1423","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7206,"log_dups_size":0,"ondisk_log_size":7206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2775110,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":80,"num_read_kb":5028,"num_write":6226,"num_write_kb":895755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"26'2237","reported_seq":2265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.879418+0000","last_change":"2024-05-08T19:22:20.445458+0000","last_active":"2024-05-08T19:48:29.879418+0000","last_peered":"2024-05-08T19:48:29.879418+0000","last_clean":"2024-05-08T19:48:29.879418+0000","last_became_active":"2024-05-08T19:22:20.445191+0000","last_became_peered":"2024-05-08T19:22:20.445191+0000","last_unstale":"2024-05-08T19:48:29.879418+0000","last_undegraded":"2024-05-08T19:48:29.879418+0000","last_fullsized":"2024-05-08T19:48:29.879418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'8070","reported_seq":8100,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:22.736749+0000","last_change":"2024-05-08T19:22:20.015288+0000","last_active":"2024-05-08T19:48:22.736749+0000","last_peered":"2024-05-08T19:48:22.736749+0000","last_clean":"2024-05-08T19:48:22.736749+0000","last_became_active":"2024-05-08T19:22:20.015062+0000","last_became_peered":"2024-05-08T19:22:20.015062+0000","last_unstale":"2024-05-08T19:48:22.736749+0000","last_undegraded":"2024-05-08T19:48:22.736749+0000","last_fullsized":"2024-05-08T19:48:22.736749+0000","mapping_epoch":17,"log_start":"26'1200","ondisk_log_start":"26'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6870,"log_dups_size":0,"ondisk_log_size":6870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:12.577297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8075,"num_write_kb":54571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'8481","reported_seq":9480,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.944395+0000","last_change":"2024-05-08T19:22:24.614066+0000","last_active":"2024-05-08T19:48:29.944395+0000","last_peered":"2024-05-08T19:48:29.944395+0000","last_clean":"2024-05-08T19:48:29.944395+0000","last_became_active":"2024-05-08T19:22:24.613661+0000","last_became_peered":"2024-05-08T19:22:24.613661+0000","last_unstale":"2024-05-08T19:48:29.944395+0000","last_undegraded":"2024-05-08T19:48:29.944395+0000","last_fullsized":"2024-05-08T19:48:29.944395+0000","mapping_epoch":22,"log_start":"26'1305","ondisk_log_start":"26'1305","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7176,"log_dups_size":0,"ondisk_log_size":7176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2646858,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":973,"num_read_kb":68996,"num_write":6051,"num_write_kb":873899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"26'6234","reported_seq":6263,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.698562+0000","last_change":"2024-05-08T19:22:20.015193+0000","last_active":"2024-05-08T19:48:27.698562+0000","last_peered":"2024-05-08T19:48:27.698562+0000","last_clean":"2024-05-08T19:48:27.698562+0000","last_became_active":"2024-05-08T19:22:20.014926+0000","last_became_peered":"2024-05-08T19:22:20.014926+0000","last_unstale":"2024-05-08T19:48:27.698562+0000","last_undegraded":"2024-05-08T19:48:27.698562+0000","last_fullsized":"2024-05-08T19:48:27.698562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6234,"log_dups_size":0,"ondisk_log_size":6234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:13.701454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4468418,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6230,"num_write_kb":41317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"26'2367","reported_seq":2395,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.300251+0000","last_change":"2024-05-08T19:22:20.446453+0000","last_active":"2024-05-08T19:48:29.300251+0000","last_peered":"2024-05-08T19:48:29.300251+0000","last_clean":"2024-05-08T19:48:29.300251+0000","last_became_active":"2024-05-08T19:22:20.446194+0000","last_became_peered":"2024-05-08T19:22:20.446194+0000","last_unstale":"2024-05-08T19:48:29.300251+0000","last_undegraded":"2024-05-08T19:48:29.300251+0000","last_fullsized":"2024-05-08T19:48:29.300251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2367,"log_dups_size":0,"ondisk_log_size":2367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'8334","reported_seq":8728,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.937236+0000","last_change":"2024-05-08T19:22:24.615481+0000","last_active":"2024-05-08T19:48:29.937236+0000","last_peered":"2024-05-08T19:48:29.937236+0000","last_clean":"2024-05-08T19:48:29.937236+0000","last_became_active":"2024-05-08T19:22:24.615069+0000","last_became_peered":"2024-05-08T19:22:24.615069+0000","last_unstale":"2024-05-08T19:48:29.937236+0000","last_undegraded":"2024-05-08T19:48:29.937236+0000","last_fullsized":"2024-05-08T19:48:29.937236+0000","mapping_epoch":22,"log_start":"26'1929","ondisk_log_start":"26'1929","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6405,"log_dups_size":0,"ondisk_log_size":6405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:28.211177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2253528,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":368,"num_read_kb":23786,"num_write":5957,"num_write_kb":964471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'5773","reported_seq":6288,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:28.097950+0000","last_change":"2024-05-08T19:22:20.001642+0000","last_active":"2024-05-08T19:48:28.097950+0000","last_peered":"2024-05-08T19:48:28.097950+0000","last_clean":"2024-05-08T19:48:28.097950+0000","last_became_active":"2024-05-08T19:22:20.001339+0000","last_became_peered":"2024-05-08T19:22:20.001339+0000","last_unstale":"2024-05-08T19:48:28.097950+0000","last_undegraded":"2024-05-08T19:48:28.097950+0000","last_fullsized":"2024-05-08T19:48:28.097950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5773,"log_dups_size":0,"ondisk_log_size":5773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11614568,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":486,"num_read_kb":3470,"num_write":6355,"num_write_kb":46006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"26'2229","reported_seq":2250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.115543+0000","last_change":"2024-05-08T19:23:11.387164+0000","last_active":"2024-05-08T19:48:29.115543+0000","last_peered":"2024-05-08T19:48:29.115543+0000","last_clean":"2024-05-08T19:48:29.115543+0000","last_became_active":"2024-05-08T19:23:11.386882+0000","last_became_peered":"2024-05-08T19:23:11.386882+0000","last_unstale":"2024-05-08T19:48:29.115543+0000","last_undegraded":"2024-05-08T19:48:29.115543+0000","last_fullsized":"2024-05-08T19:48:29.115543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2229,"log_dups_size":0,"ondisk_log_size":2229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:25.968464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"26'8422","reported_seq":8851,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.886935+0000","last_change":"2024-05-08T19:22:24.614812+0000","last_active":"2024-05-08T19:48:29.886935+0000","last_peered":"2024-05-08T19:48:29.886935+0000","last_clean":"2024-05-08T19:48:29.886935+0000","last_became_active":"2024-05-08T19:22:24.614433+0000","last_became_peered":"2024-05-08T19:22:24.614433+0000","last_unstale":"2024-05-08T19:48:29.886935+0000","last_undegraded":"2024-05-08T19:48:29.886935+0000","last_fullsized":"2024-05-08T19:48:29.886935+0000","mapping_epoch":22,"log_start":"26'1215","ondisk_log_start":"26'1215","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7207,"log_dups_size":0,"ondisk_log_size":7207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:07.924115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2504518,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":403,"num_read_kb":32316,"num_write":6034,"num_write_kb":878060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'4075","reported_seq":4104,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:14.643108+0000","last_change":"2024-05-08T19:22:20.012651+0000","last_active":"2024-05-08T19:48:14.643108+0000","last_peered":"2024-05-08T19:48:14.643108+0000","last_clean":"2024-05-08T19:48:14.643108+0000","last_became_active":"2024-05-08T19:22:20.012383+0000","last_became_peered":"2024-05-08T19:22:20.012383+0000","last_unstale":"2024-05-08T19:48:14.643108+0000","last_undegraded":"2024-05-08T19:48:14.643108+0000","last_fullsized":"2024-05-08T19:48:14.643108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4075,"log_dups_size":0,"ondisk_log_size":4075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":4092,"num_write_kb":27507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'2277","reported_seq":2305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.968360+0000","last_change":"2024-05-08T19:22:20.436459+0000","last_active":"2024-05-08T19:48:29.968360+0000","last_peered":"2024-05-08T19:48:29.968360+0000","last_clean":"2024-05-08T19:48:29.968360+0000","last_became_active":"2024-05-08T19:22:20.435680+0000","last_became_peered":"2024-05-08T19:22:20.435680+0000","last_unstale":"2024-05-08T19:48:29.968360+0000","last_undegraded":"2024-05-08T19:48:29.968360+0000","last_fullsized":"2024-05-08T19:48:29.968360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2277,"log_dups_size":0,"ondisk_log_size":2277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:09.166091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"26'8799","reported_seq":9037,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.021055+0000","last_change":"2024-05-08T19:22:24.473208+0000","last_active":"2024-05-08T19:48:30.021055+0000","last_peered":"2024-05-08T19:48:30.021055+0000","last_clean":"2024-05-08T19:48:30.021055+0000","last_became_active":"2024-05-08T19:22:24.472782+0000","last_became_peered":"2024-05-08T19:22:24.472782+0000","last_unstale":"2024-05-08T19:48:30.021055+0000","last_undegraded":"2024-05-08T19:48:30.021055+0000","last_fullsized":"2024-05-08T19:48:30.021055+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7161,"log_dups_size":0,"ondisk_log_size":7161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823624,"num_objects":21,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":213,"num_read_kb":12280,"num_write":6434,"num_write_kb":1036595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2842","reported_seq":2871,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:46.734455+0000","last_change":"2024-05-08T19:22:20.014848+0000","last_active":"2024-05-08T19:47:46.734455+0000","last_peered":"2024-05-08T19:47:46.734455+0000","last_clean":"2024-05-08T19:47:46.734455+0000","last_became_active":"2024-05-08T19:22:20.013739+0000","last_became_peered":"2024-05-08T19:22:20.013739+0000","last_unstale":"2024-05-08T19:47:46.734455+0000","last_undegraded":"2024-05-08T19:47:46.734455+0000","last_fullsized":"2024-05-08T19:47:46.734455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2842,"log_dups_size":0,"ondisk_log_size":2842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:03.169714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2845,"num_write_kb":22358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"26'2320","reported_seq":2347,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.797694+0000","last_change":"2024-05-08T19:22:20.447451+0000","last_active":"2024-05-08T19:48:29.797694+0000","last_peered":"2024-05-08T19:48:29.797694+0000","last_clean":"2024-05-08T19:48:29.797694+0000","last_became_active":"2024-05-08T19:22:20.447180+0000","last_became_peered":"2024-05-08T19:22:20.447180+0000","last_unstale":"2024-05-08T19:48:29.797694+0000","last_undegraded":"2024-05-08T19:48:29.797694+0000","last_fullsized":"2024-05-08T19:48:29.797694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2320,"log_dups_size":0,"ondisk_log_size":2320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"26'8894","reported_seq":9864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.094299+0000","last_change":"2024-05-08T19:22:24.614091+0000","last_active":"2024-05-08T19:48:29.094299+0000","last_peered":"2024-05-08T19:48:29.094299+0000","last_clean":"2024-05-08T19:48:29.094299+0000","last_became_active":"2024-05-08T19:22:24.613677+0000","last_became_peered":"2024-05-08T19:22:24.613677+0000","last_unstale":"2024-05-08T19:48:29.094299+0000","last_undegraded":"2024-05-08T19:48:29.094299+0000","last_fullsized":"2024-05-08T19:48:29.094299+0000","mapping_epoch":22,"log_start":"26'1529","ondisk_log_start":"26'1529","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7365,"log_dups_size":0,"ondisk_log_size":7365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:50.011809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4461889,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":945,"num_read_kb":70780,"num_write":6592,"num_write_kb":1028558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"26'4272","reported_seq":4301,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:09.543429+0000","last_change":"2024-05-08T19:22:20.011528+0000","last_active":"2024-05-08T19:47:09.543429+0000","last_peered":"2024-05-08T19:47:09.543429+0000","last_clean":"2024-05-08T19:47:09.543429+0000","last_became_active":"2024-05-08T19:22:20.011262+0000","last_became_peered":"2024-05-08T19:22:20.011262+0000","last_unstale":"2024-05-08T19:47:09.543429+0000","last_undegraded":"2024-05-08T19:47:09.543429+0000","last_fullsized":"2024-05-08T19:47:09.543429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4272,"log_dups_size":0,"ondisk_log_size":4272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4269,"num_write_kb":27446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"26'2404","reported_seq":2432,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.112747+0000","last_change":"2024-05-08T19:22:20.438689+0000","last_active":"2024-05-08T19:48:30.112747+0000","last_peered":"2024-05-08T19:48:30.112747+0000","last_clean":"2024-05-08T19:48:30.112747+0000","last_became_active":"2024-05-08T19:22:20.438434+0000","last_became_peered":"2024-05-08T19:22:20.438434+0000","last_unstale":"2024-05-08T19:48:30.112747+0000","last_undegraded":"2024-05-08T19:48:30.112747+0000","last_fullsized":"2024-05-08T19:48:30.112747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2404,"log_dups_size":0,"ondisk_log_size":2404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"26'8228","reported_seq":8492,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.660349+0000","last_change":"2024-05-08T19:22:24.473569+0000","last_active":"2024-05-08T19:48:29.660349+0000","last_peered":"2024-05-08T19:48:29.660349+0000","last_clean":"2024-05-08T19:48:29.660349+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:48:29.660349+0000","last_undegraded":"2024-05-08T19:48:29.660349+0000","last_fullsized":"2024-05-08T19:48:29.660349+0000","mapping_epoch":22,"log_start":"26'1006","ondisk_log_start":"26'1006","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7222,"log_dups_size":0,"ondisk_log_size":7222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:22.875469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1713996,"num_objects":21,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":239,"num_read_kb":13756,"num_write":5760,"num_write_kb":975965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"26'7366","reported_seq":7394,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:11.246408+0000","last_change":"2024-05-08T19:22:20.007101+0000","last_active":"2024-05-08T19:48:11.246408+0000","last_peered":"2024-05-08T19:48:11.246408+0000","last_clean":"2024-05-08T19:48:11.246408+0000","last_became_active":"2024-05-08T19:22:20.006772+0000","last_became_peered":"2024-05-08T19:22:20.006772+0000","last_unstale":"2024-05-08T19:48:11.246408+0000","last_undegraded":"2024-05-08T19:48:11.246408+0000","last_fullsized":"2024-05-08T19:48:11.246408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7366,"log_dups_size":0,"ondisk_log_size":7366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:23.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7361,"num_write_kb":54049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"26'2320","reported_seq":2347,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.910477+0000","last_change":"2024-05-08T19:22:20.436696+0000","last_active":"2024-05-08T19:48:29.910477+0000","last_peered":"2024-05-08T19:48:29.910477+0000","last_clean":"2024-05-08T19:48:29.910477+0000","last_became_active":"2024-05-08T19:22:20.436373+0000","last_became_peered":"2024-05-08T19:22:20.436373+0000","last_unstale":"2024-05-08T19:48:29.910477+0000","last_undegraded":"2024-05-08T19:48:29.910477+0000","last_fullsized":"2024-05-08T19:48:29.910477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2320,"log_dups_size":0,"ondisk_log_size":2320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"26'8784","reported_seq":9412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.660298+0000","last_change":"2024-05-08T19:22:24.478232+0000","last_active":"2024-05-08T19:48:29.660298+0000","last_peered":"2024-05-08T19:48:29.660298+0000","last_clean":"2024-05-08T19:48:29.660298+0000","last_became_active":"2024-05-08T19:22:24.477941+0000","last_became_peered":"2024-05-08T19:22:24.477941+0000","last_unstale":"2024-05-08T19:48:29.660298+0000","last_undegraded":"2024-05-08T19:48:29.660298+0000","last_fullsized":"2024-05-08T19:48:29.660298+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7146,"log_dups_size":0,"ondisk_log_size":7146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2431530,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":603,"num_read_kb":28586,"num_write":6306,"num_write_kb":901267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"26'6172","reported_seq":6200,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:45:56.300834+0000","last_change":"2024-05-08T19:22:20.014076+0000","last_active":"2024-05-08T19:45:56.300834+0000","last_peered":"2024-05-08T19:45:56.300834+0000","last_clean":"2024-05-08T19:45:56.300834+0000","last_became_active":"2024-05-08T19:22:20.013748+0000","last_became_peered":"2024-05-08T19:22:20.013748+0000","last_unstale":"2024-05-08T19:45:56.300834+0000","last_undegraded":"2024-05-08T19:45:56.300834+0000","last_fullsized":"2024-05-08T19:45:56.300834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6172,"log_dups_size":0,"ondisk_log_size":6172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:50.426177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6192,"num_write_kb":41171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"26'2324","reported_seq":2351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.744272+0000","last_change":"2024-05-08T19:22:20.457103+0000","last_active":"2024-05-08T19:48:29.744272+0000","last_peered":"2024-05-08T19:48:29.744272+0000","last_clean":"2024-05-08T19:48:29.744272+0000","last_became_active":"2024-05-08T19:22:20.456850+0000","last_became_peered":"2024-05-08T19:22:20.456850+0000","last_unstale":"2024-05-08T19:48:29.744272+0000","last_undegraded":"2024-05-08T19:48:29.744272+0000","last_fullsized":"2024-05-08T19:48:29.744272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"26'8380","reported_seq":8822,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.028471+0000","last_change":"2024-05-08T19:22:24.614410+0000","last_active":"2024-05-08T19:48:30.028471+0000","last_peered":"2024-05-08T19:48:30.028471+0000","last_clean":"2024-05-08T19:48:30.028471+0000","last_became_active":"2024-05-08T19:22:24.613904+0000","last_became_peered":"2024-05-08T19:22:24.613904+0000","last_unstale":"2024-05-08T19:48:30.028471+0000","last_undegraded":"2024-05-08T19:48:30.028471+0000","last_fullsized":"2024-05-08T19:48:30.028471+0000","mapping_epoch":22,"log_start":"26'412","ondisk_log_start":"26'412","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7968,"log_dups_size":0,"ondisk_log_size":7968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:03.465351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981436,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":417,"num_read_kb":29592,"num_write":5975,"num_write_kb":842872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"26'8391","reported_seq":8419,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.053316+0000","last_change":"2024-05-08T19:22:20.000763+0000","last_active":"2024-05-08T19:48:30.053316+0000","last_peered":"2024-05-08T19:48:30.053316+0000","last_clean":"2024-05-08T19:48:30.053316+0000","last_became_active":"2024-05-08T19:22:20.000454+0000","last_became_peered":"2024-05-08T19:22:20.000454+0000","last_unstale":"2024-05-08T19:48:30.053316+0000","last_undegraded":"2024-05-08T19:48:30.053316+0000","last_fullsized":"2024-05-08T19:48:30.053316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":8391,"log_dups_size":0,"ondisk_log_size":8391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8387,"num_write_kb":54739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'2250","reported_seq":2277,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:26.184502+0000","last_change":"2024-05-08T19:22:20.456485+0000","last_active":"2024-05-08T19:48:26.184502+0000","last_peered":"2024-05-08T19:48:26.184502+0000","last_clean":"2024-05-08T19:48:26.184502+0000","last_became_active":"2024-05-08T19:22:20.456225+0000","last_became_peered":"2024-05-08T19:22:20.456225+0000","last_unstale":"2024-05-08T19:48:26.184502+0000","last_undegraded":"2024-05-08T19:48:26.184502+0000","last_fullsized":"2024-05-08T19:48:26.184502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2250,"log_dups_size":0,"ondisk_log_size":2250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"26'8581","reported_seq":9400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.098204+0000","last_change":"2024-05-08T19:22:24.473117+0000","last_active":"2024-05-08T19:48:30.098204+0000","last_peered":"2024-05-08T19:48:30.098204+0000","last_clean":"2024-05-08T19:48:30.098204+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:48:30.098204+0000","last_undegraded":"2024-05-08T19:48:30.098204+0000","last_fullsized":"2024-05-08T19:48:30.098204+0000","mapping_epoch":22,"log_start":"26'1358","ondisk_log_start":"26'1358","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7223,"log_dups_size":0,"ondisk_log_size":7223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1783122,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":794,"num_read_kb":57832,"num_write":6077,"num_write_kb":1028205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'7802","reported_seq":7830,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:59.722383+0000","last_change":"2024-05-08T19:22:20.006312+0000","last_active":"2024-05-08T19:47:59.722383+0000","last_peered":"2024-05-08T19:47:59.722383+0000","last_clean":"2024-05-08T19:47:59.722383+0000","last_became_active":"2024-05-08T19:22:20.005996+0000","last_became_peered":"2024-05-08T19:22:20.005996+0000","last_unstale":"2024-05-08T19:47:59.722383+0000","last_undegraded":"2024-05-08T19:47:59.722383+0000","last_fullsized":"2024-05-08T19:47:59.722383+0000","mapping_epoch":17,"log_start":"26'400","ondisk_log_start":"26'400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7402,"log_dups_size":0,"ondisk_log_size":7402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:13.701454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7795,"num_write_kb":54350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"26'2288","reported_seq":2315,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.619437+0000","last_change":"2024-05-08T19:22:20.452861+0000","last_active":"2024-05-08T19:48:29.619437+0000","last_peered":"2024-05-08T19:48:29.619437+0000","last_clean":"2024-05-08T19:48:29.619437+0000","last_became_active":"2024-05-08T19:22:20.452600+0000","last_became_peered":"2024-05-08T19:22:20.452600+0000","last_unstale":"2024-05-08T19:48:29.619437+0000","last_undegraded":"2024-05-08T19:48:29.619437+0000","last_fullsized":"2024-05-08T19:48:29.619437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2288,"log_dups_size":0,"ondisk_log_size":2288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"26'8431","reported_seq":9147,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.067381+0000","last_change":"2024-05-08T19:22:24.614345+0000","last_active":"2024-05-08T19:48:30.067381+0000","last_peered":"2024-05-08T19:48:30.067381+0000","last_clean":"2024-05-08T19:48:30.067381+0000","last_became_active":"2024-05-08T19:22:24.613948+0000","last_became_peered":"2024-05-08T19:22:24.613948+0000","last_unstale":"2024-05-08T19:48:30.067381+0000","last_undegraded":"2024-05-08T19:48:30.067381+0000","last_fullsized":"2024-05-08T19:48:30.067381+0000","mapping_epoch":22,"log_start":"26'835","ondisk_log_start":"26'835","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7596,"log_dups_size":0,"ondisk_log_size":7596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4095684,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":690,"num_read_kb":34094,"num_write":5981,"num_write_kb":938401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"26'9148","reported_seq":9176,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:26.399812+0000","last_change":"2024-05-08T19:22:20.004844+0000","last_active":"2024-05-08T19:48:26.399812+0000","last_peered":"2024-05-08T19:48:26.399812+0000","last_clean":"2024-05-08T19:48:26.399812+0000","last_became_active":"2024-05-08T19:22:20.004254+0000","last_became_peered":"2024-05-08T19:22:20.004254+0000","last_unstale":"2024-05-08T19:48:26.399812+0000","last_undegraded":"2024-05-08T19:48:26.399812+0000","last_fullsized":"2024-05-08T19:48:26.399812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":9148,"log_dups_size":0,"ondisk_log_size":9148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":9138,"num_write_kb":67371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'2185","reported_seq":2212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:27.163585+0000","last_change":"2024-05-08T19:22:20.455712+0000","last_active":"2024-05-08T19:48:27.163585+0000","last_peered":"2024-05-08T19:48:27.163585+0000","last_clean":"2024-05-08T19:48:27.163585+0000","last_became_active":"2024-05-08T19:22:20.455493+0000","last_became_peered":"2024-05-08T19:22:20.455493+0000","last_unstale":"2024-05-08T19:48:27.163585+0000","last_undegraded":"2024-05-08T19:48:27.163585+0000","last_fullsized":"2024-05-08T19:48:27.163585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2185,"log_dups_size":0,"ondisk_log_size":2185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:28.743156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"26'2244","reported_seq":2272,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.842605+0000","last_change":"2024-05-08T19:22:20.459104+0000","last_active":"2024-05-08T19:48:29.842605+0000","last_peered":"2024-05-08T19:48:29.842605+0000","last_clean":"2024-05-08T19:48:29.842605+0000","last_became_active":"2024-05-08T19:22:20.452169+0000","last_became_peered":"2024-05-08T19:22:20.452169+0000","last_unstale":"2024-05-08T19:48:29.842605+0000","last_undegraded":"2024-05-08T19:48:29.842605+0000","last_fullsized":"2024-05-08T19:48:29.842605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2244,"log_dups_size":0,"ondisk_log_size":2244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'2337","reported_seq":2365,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.234543+0000","last_change":"2024-05-08T19:22:20.449335+0000","last_active":"2024-05-08T19:48:29.234543+0000","last_peered":"2024-05-08T19:48:29.234543+0000","last_clean":"2024-05-08T19:48:29.234543+0000","last_became_active":"2024-05-08T19:22:20.449047+0000","last_became_peered":"2024-05-08T19:22:20.449047+0000","last_unstale":"2024-05-08T19:48:29.234543+0000","last_undegraded":"2024-05-08T19:48:29.234543+0000","last_fullsized":"2024-05-08T19:48:29.234543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'2232","reported_seq":2260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.535516+0000","last_change":"2024-05-08T19:22:20.452192+0000","last_active":"2024-05-08T19:48:29.535516+0000","last_peered":"2024-05-08T19:48:29.535516+0000","last_clean":"2024-05-08T19:48:29.535516+0000","last_became_active":"2024-05-08T19:22:20.451625+0000","last_became_peered":"2024-05-08T19:22:20.451625+0000","last_unstale":"2024-05-08T19:48:29.535516+0000","last_undegraded":"2024-05-08T19:48:29.535516+0000","last_fullsized":"2024-05-08T19:48:29.535516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2232,"log_dups_size":0,"ondisk_log_size":2232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'2349","reported_seq":2385,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.790912+0000","last_change":"2024-05-08T19:23:11.054094+0000","last_active":"2024-05-08T19:48:29.790912+0000","last_peered":"2024-05-08T19:48:29.790912+0000","last_clean":"2024-05-08T19:48:29.790912+0000","last_became_active":"2024-05-08T19:23:11.053750+0000","last_became_peered":"2024-05-08T19:23:11.053750+0000","last_unstale":"2024-05-08T19:48:29.790912+0000","last_undegraded":"2024-05-08T19:48:29.790912+0000","last_fullsized":"2024-05-08T19:48:29.790912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:25.968464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'2305","reported_seq":2333,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.339458+0000","last_change":"2024-05-08T19:22:20.444479+0000","last_active":"2024-05-08T19:48:29.339458+0000","last_peered":"2024-05-08T19:48:29.339458+0000","last_clean":"2024-05-08T19:48:29.339458+0000","last_became_active":"2024-05-08T19:22:20.444219+0000","last_became_peered":"2024-05-08T19:22:20.444219+0000","last_unstale":"2024-05-08T19:48:29.339458+0000","last_undegraded":"2024-05-08T19:48:29.339458+0000","last_fullsized":"2024-05-08T19:48:29.339458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2305,"log_dups_size":0,"ondisk_log_size":2305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'2205","reported_seq":2233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:28.865494+0000","last_change":"2024-05-08T19:22:20.436874+0000","last_active":"2024-05-08T19:48:28.865494+0000","last_peered":"2024-05-08T19:48:28.865494+0000","last_clean":"2024-05-08T19:48:28.865494+0000","last_became_active":"2024-05-08T19:22:20.436626+0000","last_became_peered":"2024-05-08T19:22:20.436626+0000","last_unstale":"2024-05-08T19:48:28.865494+0000","last_undegraded":"2024-05-08T19:48:28.865494+0000","last_fullsized":"2024-05-08T19:48:28.865494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2205,"log_dups_size":0,"ondisk_log_size":2205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'2323","reported_seq":2351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.917145+0000","last_change":"2024-05-08T19:22:20.462445+0000","last_active":"2024-05-08T19:48:29.917145+0000","last_peered":"2024-05-08T19:48:29.917145+0000","last_clean":"2024-05-08T19:48:29.917145+0000","last_became_active":"2024-05-08T19:22:20.461547+0000","last_became_peered":"2024-05-08T19:22:20.461547+0000","last_unstale":"2024-05-08T19:48:29.917145+0000","last_undegraded":"2024-05-08T19:48:29.917145+0000","last_fullsized":"2024-05-08T19:48:29.917145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2323,"log_dups_size":0,"ondisk_log_size":2323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'2302","reported_seq":2329,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.537782+0000","last_change":"2024-05-08T19:22:20.443498+0000","last_active":"2024-05-08T19:48:29.537782+0000","last_peered":"2024-05-08T19:48:29.537782+0000","last_clean":"2024-05-08T19:48:29.537782+0000","last_became_active":"2024-05-08T19:22:20.442667+0000","last_became_peered":"2024-05-08T19:22:20.442667+0000","last_unstale":"2024-05-08T19:48:29.537782+0000","last_undegraded":"2024-05-08T19:48:29.537782+0000","last_fullsized":"2024-05-08T19:48:29.537782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2302,"log_dups_size":0,"ondisk_log_size":2302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'2260","reported_seq":2287,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.792032+0000","last_change":"2024-05-08T19:22:20.448722+0000","last_active":"2024-05-08T19:48:29.792032+0000","last_peered":"2024-05-08T19:48:29.792032+0000","last_clean":"2024-05-08T19:48:29.792032+0000","last_became_active":"2024-05-08T19:22:20.448449+0000","last_became_peered":"2024-05-08T19:22:20.448449+0000","last_unstale":"2024-05-08T19:48:29.792032+0000","last_undegraded":"2024-05-08T19:48:29.792032+0000","last_fullsized":"2024-05-08T19:48:29.792032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2260,"log_dups_size":0,"ondisk_log_size":2260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'2259","reported_seq":2286,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.987384+0000","last_change":"2024-05-08T19:22:20.450677+0000","last_active":"2024-05-08T19:48:29.987384+0000","last_peered":"2024-05-08T19:48:29.987384+0000","last_clean":"2024-05-08T19:48:29.987384+0000","last_became_active":"2024-05-08T19:22:20.450217+0000","last_became_peered":"2024-05-08T19:22:20.450217+0000","last_unstale":"2024-05-08T19:48:29.987384+0000","last_undegraded":"2024-05-08T19:48:29.987384+0000","last_fullsized":"2024-05-08T19:48:29.987384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2259,"log_dups_size":0,"ondisk_log_size":2259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'2292","reported_seq":2319,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.877227+0000","last_change":"2024-05-08T19:22:20.453450+0000","last_active":"2024-05-08T19:48:29.877227+0000","last_peered":"2024-05-08T19:48:29.877227+0000","last_clean":"2024-05-08T19:48:29.877227+0000","last_became_active":"2024-05-08T19:22:20.453191+0000","last_became_peered":"2024-05-08T19:22:20.453191+0000","last_unstale":"2024-05-08T19:48:29.877227+0000","last_undegraded":"2024-05-08T19:48:29.877227+0000","last_fullsized":"2024-05-08T19:48:29.877227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2292,"log_dups_size":0,"ondisk_log_size":2292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'2331","reported_seq":2358,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.913762+0000","last_change":"2024-05-08T19:22:20.452591+0000","last_active":"2024-05-08T19:48:29.913762+0000","last_peered":"2024-05-08T19:48:29.913762+0000","last_clean":"2024-05-08T19:48:29.913762+0000","last_became_active":"2024-05-08T19:22:20.451209+0000","last_became_peered":"2024-05-08T19:22:20.451209+0000","last_unstale":"2024-05-08T19:48:29.913762+0000","last_undegraded":"2024-05-08T19:48:29.913762+0000","last_fullsized":"2024-05-08T19:48:29.913762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2331,"log_dups_size":0,"ondisk_log_size":2331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'2333","reported_seq":2360,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.457862+0000","last_change":"2024-05-08T19:22:20.461584+0000","last_active":"2024-05-08T19:48:29.457862+0000","last_peered":"2024-05-08T19:48:29.457862+0000","last_clean":"2024-05-08T19:48:29.457862+0000","last_became_active":"2024-05-08T19:22:20.461097+0000","last_became_peered":"2024-05-08T19:22:20.461097+0000","last_unstale":"2024-05-08T19:48:29.457862+0000","last_undegraded":"2024-05-08T19:48:29.457862+0000","last_fullsized":"2024-05-08T19:48:29.457862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2333,"log_dups_size":0,"ondisk_log_size":2333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":86816314,"num_objects":956,"num_object_clones":0,"num_object_copies":3824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":956,"num_whiteouts":0,"num_read":18592,"num_read_kb":1141288,"num_write":193917,"num_write_kb":30180301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36454400,"data_stored":245432320,"data_compressed":11584054,"data_compressed_allocated":20762624,"data_compressed_original":229740544,"omap_allocated":0,"internal_metadata":0},"log_size":231024,"ondisk_log_size":231024,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":789,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1645,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146495,"ondisk_log_size":146495,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":250965480,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":2930,"num_read_kb":17316,"num_write":211794,"num_write_kb":1494868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":340918272,"data_stored":502162396,"data_compressed":49542707,"data_compressed_allocated":73392128,"data_compressed_original":234696704,"omap_allocated":0,"internal_metadata":0},"log_size":196147,"ondisk_log_size":196147,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575165,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":907688,"kb_used_data":46324,"kb_used_omap":1,"kb_used_meta":861310,"kb_avail":93464152,"statfs":{"total":96636764160,"available":95707291648,"internally_reserved":0,"allocated":47435776,"data_stored":131762807,"data_compressed":9351617,"data_compressed_allocated":14061568,"data_compressed_original":98562048,"omap_allocated":1588,"internal_metadata":881981900},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":1.988,"15min":1.417},"min":{"1min":0.216,"5min":0.216,"15min":0.20699999999999999},"max":{"1min":3.4830000000000001,"5min":26.544,"15min":26.544},"last":13.09},{"interface":"front","average":{"1min":1.2529999999999999,"5min":2.149,"15min":1.702},"min":{"1min":0.28799999999999998,"5min":0.27800000000000002,"15min":0.223},"max":{"1min":6.7789999999999999,"5min":26.713999999999999,"15min":26.713999999999999},"last":12.454000000000001}]},{"osd":1,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.978,"5min":2.367,"15min":1.9390000000000001},"min":{"1min":0.24099999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":12.176,"5min":14.557,"15min":32.259999999999998},"last":3.6160000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":2.0609999999999999,"15min":1.5569999999999999},"min":{"1min":0.26300000000000001,"5min":0.251,"15min":0.25},"max":{"1min":9.5860000000000003,"5min":21.867000000000001,"15min":36.018000000000001},"last":4.6849999999999996}]},{"osd":2,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":2.069,"15min":1.4259999999999999},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":8.3849999999999998,"5min":13.635,"15min":13.635},"last":4.1820000000000004},{"interface":"front","average":{"1min":1.4910000000000001,"5min":2.4500000000000002,"15min":1.718},"min":{"1min":0.29599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":7.024,"5min":19.469999999999999,"15min":19.469999999999999},"last":4.5750000000000002}]},{"osd":3,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":2.4489999999999998,"15min":1.641},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":11.510999999999999,"5min":26.274999999999999,"15min":26.274999999999999},"last":8.5579999999999998},{"interface":"front","average":{"1min":1.1719999999999999,"5min":2.3069999999999999,"15min":1.708},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.30599999999999999},"max":{"1min":6.8259999999999996,"5min":26.501999999999999,"15min":26.501999999999999},"last":7.8220000000000001}]},{"osd":4,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":2,"5min":2.5449999999999999,"15min":1.6619999999999999},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.24399999999999999},"max":{"1min":13.914999999999999,"5min":37.356000000000002,"15min":37.356000000000002},"last":1.464},{"interface":"front","average":{"1min":2.3410000000000002,"5min":2.6589999999999998,"15min":1.6890000000000001},"min":{"1min":0.28799999999999998,"5min":0.253,"15min":0.247},"max":{"1min":16.417000000000002,"5min":31.786000000000001,"15min":31.786000000000001},"last":5.9950000000000001}]},{"osd":5,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":3.2669999999999999,"5min":2.4910000000000001,"15min":1.798},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26300000000000001},"max":{"1min":29.346,"5min":29.346,"15min":35.156999999999996},"last":0.33000000000000002},{"interface":"front","average":{"1min":1.423,"5min":1.976,"15min":1.3},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":9.6170000000000009,"5min":32.988999999999997,"15min":32.988999999999997},"last":1.411}]},{"osd":6,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.8220000000000001,"15min":1.4299999999999999},"min":{"1min":0.33000000000000002,"5min":0.315,"15min":0.27400000000000002},"max":{"1min":6.6799999999999997,"5min":13.763,"15min":16.077999999999999},"last":4.1479999999999997},{"interface":"front","average":{"1min":1.821,"5min":2.2280000000000002,"15min":1.4870000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.27500000000000002},"max":{"1min":12.867000000000001,"5min":17.353999999999999,"15min":17.353999999999999},"last":1.444}]}]},{"osd":6,"up_from":13,"seq":55834575164,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1066964,"kb_used_data":53132,"kb_used_omap":1,"kb_used_meta":1013822,"kb_avail":93304876,"statfs":{"total":96636764160,"available":95544193024,"internally_reserved":0,"allocated":54407168,"data_stored":96876629,"data_compressed":8407298,"data_compressed_allocated":12894208,"data_compressed_original":55537664,"omap_allocated":1593,"internal_metadata":1038154183},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":2.6739999999999999,"5min":2.0550000000000002,"15min":1.466},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":17.488,"5min":17.488,"15min":17.488},"last":0.40200000000000002},{"interface":"front","average":{"1min":3.4830000000000001,"5min":2.9060000000000001,"15min":1.899},"min":{"1min":0.34200000000000003,"5min":0.246,"15min":0.245},"max":{"1min":17.445,"5min":37.295999999999999,"15min":37.295999999999999},"last":0.38700000000000001}]},{"osd":1,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.101,"5min":2.581,"15min":1.8320000000000001},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.22800000000000001},"max":{"1min":20.460000000000001,"5min":22.753,"15min":22.753},"last":0.41299999999999998},{"interface":"front","average":{"1min":3.2210000000000001,"5min":2.7170000000000001,"15min":1.8859999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":18.388000000000002,"5min":37.521000000000001,"15min":37.521000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.879,"5min":2.7669999999999999,"15min":1.903},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.247},"max":{"1min":23.228999999999999,"5min":23.952999999999999,"15min":23.952999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.367,"15min":1.6890000000000001},"min":{"1min":0.35799999999999998,"5min":0.29499999999999998,"15min":0.255},"max":{"1min":14.472,"5min":23.196999999999999,"15min":23.196999999999999},"last":0.439}]},{"osd":3,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.2400000000000002,"5min":2.5579999999999998,"15min":1.994},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.25800000000000001},"max":{"1min":17.577999999999999,"5min":21.975000000000001,"15min":43.082999999999998},"last":0.432},{"interface":"front","average":{"1min":3.6709999999999998,"5min":2.911,"15min":2.1219999999999999},"min":{"1min":0.434,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":17.719000000000001,"5min":23.859000000000002,"15min":43.872999999999998},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.0910000000000002,"5min":2.7829999999999999,"15min":2.4390000000000001},"min":{"1min":0.29999999999999999,"5min":0.26500000000000001,"15min":0.26100000000000001},"max":{"1min":18.416,"5min":23.055,"15min":111.04900000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":4.2690000000000001,"5min":2.8079999999999998,"15min":1.7549999999999999},"min":{"1min":0.34499999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":28.757999999999999,"5min":28.757999999999999,"15min":28.757999999999999},"last":0.32200000000000001}]},{"osd":5,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.2090000000000001,"5min":2.5169999999999999,"15min":1.617},"min":{"1min":0.33900000000000002,"5min":0.309,"15min":0.251},"max":{"1min":14.680999999999999,"5min":39.134,"15min":39.134},"last":0.37},{"interface":"front","average":{"1min":3.2709999999999999,"5min":3.2789999999999999,"15min":2.0249999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":19.527000000000001,"5min":67.576999999999998,"15min":67.576999999999998},"last":0.48499999999999999}]},{"osd":7,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.7450000000000001,"5min":2.52,"15min":1.6259999999999999},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":17.402000000000001,"5min":17.402000000000001,"15min":17.402000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":2.5459999999999998,"5min":1.9119999999999999,"15min":1.4590000000000001},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.29899999999999999},"max":{"1min":14.436999999999999,"5min":14.436999999999999,"15min":17.251000000000001},"last":0.46500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575164,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1178760,"kb_used_data":64892,"kb_used_omap":1,"kb_used_meta":1113790,"kb_avail":93193080,"statfs":{"total":96636764160,"available":95429713920,"internally_reserved":0,"allocated":66449408,"data_stored":174597717,"data_compressed":12331706,"data_compressed_allocated":18718720,"data_compressed_original":127041536,"omap_allocated":1594,"internal_metadata":1140521414},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.379,"15min":1.147},"min":{"1min":0.214,"5min":0.20300000000000001,"15min":0.186},"max":{"1min":8.6210000000000004,"5min":11.619999999999999,"15min":27.282},"last":0.317},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.8440000000000001,"15min":1.1040000000000001},"min":{"1min":0.23699999999999999,"5min":0.217,"15min":0.186},"max":{"1min":10.148,"5min":17.922000000000001,"15min":17.922000000000001},"last":0.27700000000000002}]},{"osd":2,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.891,"15min":1.0760000000000001},"min":{"1min":0.21199999999999999,"5min":0.20999999999999999,"15min":0.183},"max":{"1min":16.600000000000001,"5min":17.658000000000001,"15min":17.658000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.3520000000000001,"15min":0.97299999999999998},"min":{"1min":0.29599999999999999,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":7.2709999999999999,"5min":18.058,"15min":18.058},"last":0.34000000000000002}]},{"osd":3,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":2.1960000000000002,"5min":1.712,"15min":1.2150000000000001},"min":{"1min":0.32400000000000001,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":15.871,"5min":18.024999999999999,"15min":18.024999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.577,"15min":1.323},"min":{"1min":0.32100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":7.4379999999999997,"5min":10.773,"15min":44.454999999999998},"last":0.251}]},{"osd":4,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":2.7210000000000001,"15min":1.7749999999999999},"min":{"1min":0.311,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":9.4320000000000004,"5min":17.629000000000001,"15min":33.939999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":1.839,"5min":2.0680000000000001,"15min":1.744},"min":{"1min":0.378,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":9.5009999999999994,"5min":20.326000000000001,"15min":41.939},"last":0.38600000000000001}]},{"osd":5,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":3.0430000000000001,"5min":2.1030000000000002,"15min":1.5229999999999999},"min":{"1min":0.38100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":27.143000000000001,"5min":27.727,"15min":27.727},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.343,"5min":2.5270000000000001,"15min":1.6479999999999999},"min":{"1min":0.35999999999999999,"5min":0.32300000000000001,"15min":0.318},"max":{"1min":9.3970000000000002,"5min":20.289999999999999,"15min":20.289999999999999},"last":0.39500000000000002}]},{"osd":6,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.8100000000000001,"5min":2.5030000000000001,"15min":1.7150000000000001},"min":{"1min":0.48899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":8.5879999999999992,"5min":33.189999999999998,"15min":33.189999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":3.5880000000000001,"5min":3.2570000000000001,"15min":2.0129999999999999},"min":{"1min":0.39500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":23.395,"5min":35.344000000000001,"15min":35.344000000000001},"last":0.42799999999999999}]},{"osd":7,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":1.762,"15min":1.3620000000000001},"min":{"1min":0.41599999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":9.5440000000000005,"5min":17.890000000000001,"15min":17.890000000000001},"last":0.442},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.492,"15min":1.726},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":15.553000000000001,"5min":21.039999999999999,"15min":21.039999999999999},"last":0.45100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575164,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":809040,"kb_used_data":42184,"kb_used_omap":1,"kb_used_meta":766846,"kb_avail":93562800,"statfs":{"total":96636764160,"available":95808307200,"internally_reserved":0,"allocated":43196416,"data_stored":97970105,"data_compressed":7494028,"data_compressed_allocated":11452416,"data_compressed_original":66408448,"omap_allocated":1593,"internal_metadata":785250759},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.6200000000000001,"15min":1.7170000000000001},"min":{"1min":0.20799999999999999,"5min":0.189,"15min":0.185},"max":{"1min":12.77,"5min":22.343,"15min":37.991999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":1.236,"5min":1.571,"15min":1.2490000000000001},"min":{"1min":0.23899999999999999,"5min":0.191,"15min":0.191},"max":{"1min":7.8449999999999998,"5min":20.382000000000001,"15min":21.954000000000001},"last":0.23799999999999999}]},{"osd":2,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":1.1759999999999999,"15min":1.101},"min":{"1min":0.27400000000000002,"5min":0.22600000000000001,"15min":0.20899999999999999},"max":{"1min":3.7400000000000002,"5min":17.687999999999999,"15min":19.789999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":1.4510000000000001,"15min":1.1539999999999999},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.20899999999999999},"max":{"1min":3.2109999999999999,"5min":20.419,"15min":22.026},"last":0.29399999999999998}]},{"osd":3,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":2.0950000000000002,"15min":1.7},"min":{"1min":0.24099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":18.613,"5min":34.515000000000001,"15min":34.515000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.98699999999999999,"5min":2.286,"15min":1.619},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.22600000000000001},"max":{"1min":7.6399999999999997,"5min":85.606999999999999,"15min":85.606999999999999},"last":0.40600000000000003}]},{"osd":4,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":2.5800000000000001,"15min":2.1059999999999999},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":14.317,"5min":42.345999999999997,"15min":66.331999999999994},"last":2.9609999999999999},{"interface":"front","average":{"1min":1.6719999999999999,"5min":2.7599999999999998,"15min":2.3010000000000002},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":12.81,"5min":59.832999999999998,"15min":59.832999999999998},"last":6.0839999999999996}]},{"osd":5,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.881,"15min":1.53},"min":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":12.012,"5min":14.026999999999999,"15min":21.981000000000002},"last":16.021999999999998},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.74,"15min":1.538},"min":{"1min":0.33200000000000002,"5min":0.32400000000000001,"15min":0.30599999999999999},"max":{"1min":14.019,"5min":14.019,"15min":25.446999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":3.1000000000000001,"15min":2.0990000000000002},"min":{"1min":0.38300000000000001,"5min":0.33900000000000002,"15min":0.318},"max":{"1min":9.2370000000000001,"5min":82.542000000000002,"15min":82.542000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.131,"5min":2.0569999999999999,"15min":1.8859999999999999},"min":{"1min":0.373,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":6.4420000000000002,"5min":25.914999999999999,"15min":25.914999999999999},"last":16.056000000000001}]},{"osd":7,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":2.242,"15min":1.974},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.34599999999999997},"max":{"1min":6.3460000000000001,"5min":26.669,"15min":26.669},"last":0.754},{"interface":"front","average":{"1min":1.569,"5min":1.732,"15min":1.7210000000000001},"min":{"1min":0.41599999999999998,"5min":0.38400000000000001,"15min":0.33100000000000002},"max":{"1min":13.964,"5min":13.964,"15min":20.146000000000001},"last":14.9}]}]},{"osd":2,"up_from":13,"seq":55834575165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":728684,"kb_used_data":43876,"kb_used_omap":1,"kb_used_meta":684798,"kb_avail":93643156,"statfs":{"total":96636764160,"available":95890591744,"internally_reserved":0,"allocated":44929024,"data_stored":78974029,"data_compressed":6538000,"data_compressed_allocated":10211328,"data_compressed_original":44421120,"omap_allocated":1594,"internal_metadata":701233606},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.849,"5min":1.4379999999999999,"15min":1.135},"min":{"1min":0.19800000000000001,"5min":0.186,"15min":0.16900000000000001},"max":{"1min":15.834,"5min":15.834,"15min":21.475999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1779999999999999,"15min":1.141},"min":{"1min":0.23100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":7.4950000000000001,"5min":14.374000000000001,"15min":30.434999999999999},"last":11.121}]},{"osd":1,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":1.831,"15min":1.5369999999999999},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":15.907,"5min":24.190000000000001,"15min":25.550000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.93799999999999994,"15min":1.032},"min":{"1min":0.215,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":2.8929999999999998,"5min":8.532,"15min":20.591000000000001},"last":4.1529999999999996}]},{"osd":3,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":2.5569999999999999,"5min":2.0609999999999999,"15min":1.6839999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.21099999999999999},"max":{"1min":34.598999999999997,"5min":34.598999999999997,"15min":34.598999999999997},"last":7.641},{"interface":"front","average":{"1min":2.1989999999999998,"5min":2.2829999999999999,"15min":1.633},"min":{"1min":0.29899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":15.789999999999999,"5min":20.491,"15min":25.827000000000002},"last":2.7130000000000001}]},{"osd":4,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":2.4049999999999998,"15min":2.4500000000000002},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.312},"max":{"1min":15.936,"5min":27.963000000000001,"15min":67.506},"last":1.9039999999999999},{"interface":"front","average":{"1min":2.121,"5min":2.4369999999999998,"15min":2.573},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":7.5759999999999996,"5min":37.548999999999999,"15min":111.973},"last":4.968}]},{"osd":5,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":2.1309999999999998,"5min":2.0510000000000002,"15min":1.573},"min":{"1min":0.33500000000000002,"5min":0.314,"15min":0.308},"max":{"1min":13.215999999999999,"5min":37.496000000000002,"15min":37.496000000000002},"last":15.443},{"interface":"front","average":{"1min":2.5379999999999998,"5min":2.2799999999999998,"15min":1.645},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32600000000000001},"max":{"1min":34.545000000000002,"5min":45.997999999999998,"15min":45.997999999999998},"last":4.9249999999999998}]},{"osd":6,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":3.2850000000000001,"5min":2.9300000000000002,"15min":1.984},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":29.954999999999998,"5min":68.453000000000003,"15min":68.453000000000003},"last":5.4580000000000002},{"interface":"front","average":{"1min":2.4860000000000002,"5min":2.859,"15min":1.927},"min":{"1min":0.40699999999999997,"5min":0.34899999999999998,"15min":0.33600000000000002},"max":{"1min":11.115,"5min":63.966000000000001,"15min":63.966000000000001},"last":2.464}]},{"osd":7,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":2.0409999999999999,"15min":1.8720000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.0629999999999997,"5min":27.504000000000001,"15min":32.700000000000003},"last":9.1180000000000003},{"interface":"front","average":{"1min":2.6520000000000001,"5min":2.2450000000000001,"15min":2.0259999999999998},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":29.881,"5min":29.881,"15min":32.840000000000003},"last":4.8949999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575164,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1202252,"kb_used_data":62212,"kb_used_omap":1,"kb_used_meta":1140030,"kb_avail":93169588,"statfs":{"total":96636764160,"available":95405658112,"internally_reserved":0,"allocated":63705088,"data_stored":114855661,"data_compressed":10247405,"data_compressed_allocated":15732736,"data_compressed_original":67055616,"omap_allocated":1591,"internal_metadata":1167391177},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,6,3,8,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.5740000000000001,"15min":1.103},"min":{"1min":0.20899999999999999,"5min":0.192,"15min":0.184},"max":{"1min":7.7149999999999999,"5min":24.539999999999999,"15min":24.539999999999999},"last":8.6839999999999993},{"interface":"front","average":{"1min":1.48,"5min":1.468,"15min":1.476},"min":{"1min":0.21099999999999999,"5min":0.20100000000000001,"15min":0.19900000000000001},"max":{"1min":8.7539999999999996,"5min":12.204000000000001,"15min":95.932000000000002},"last":30.457000000000001}]},{"osd":1,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":2.048,"5min":3.0209999999999999,"15min":2.036},"min":{"1min":0.22600000000000001,"5min":0.193,"15min":0.193},"max":{"1min":18.105,"5min":44.308,"15min":44.308},"last":2.1160000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.99,"15min":1.2889999999999999},"min":{"1min":0.28999999999999998,"5min":0.23100000000000001,"15min":0.22},"max":{"1min":14.875,"5min":38.054000000000002,"15min":38.054000000000002},"last":13.927}]},{"osd":2,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":2.2029999999999998,"5min":1.8839999999999999,"15min":1.522},"min":{"1min":0.26100000000000001,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":15.788,"5min":18.132000000000001,"15min":18.132000000000001},"last":1.9770000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.2769999999999999,"15min":1.1040000000000001},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.26700000000000002},"max":{"1min":4.0629999999999997,"5min":17.364000000000001,"15min":17.364000000000001},"last":13.897}]},{"osd":4,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":2.0459999999999998,"15min":1.6439999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27100000000000002},"max":{"1min":8.6159999999999997,"5min":18.960000000000001,"15min":19.16},"last":18.422999999999998},{"interface":"front","average":{"1min":2.379,"5min":2.351,"15min":2.0609999999999999},"min":{"1min":0.31900000000000001,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":15.739000000000001,"5min":20.808,"15min":27.515999999999998},"last":8.9990000000000006}]},{"osd":5,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.7250000000000001,"5min":2.3050000000000002,"15min":1.8979999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32100000000000001},"max":{"1min":8.7739999999999991,"5min":33.436999999999998,"15min":33.436999999999998},"last":9.0570000000000004},{"interface":"front","average":{"1min":2.1139999999999999,"5min":2.048,"15min":1.5860000000000001},"min":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":13.818,"5min":17.329000000000001,"15min":17.329000000000001},"last":8.7110000000000003}]},{"osd":6,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":2.3500000000000001,"5min":2.3220000000000001,"15min":1.9850000000000001},"min":{"1min":0.38800000000000001,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":25.329000000000001,"5min":25.329000000000001,"15min":30.588000000000001},"last":8.6430000000000007},{"interface":"front","average":{"1min":1.5189999999999999,"5min":2.0659999999999998,"15min":1.804},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.33900000000000002},"max":{"1min":8.5809999999999995,"5min":18.803000000000001,"15min":23.318999999999999},"last":16.077000000000002}]},{"osd":7,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.9630000000000001,"5min":1.8280000000000001,"15min":1.7929999999999999},"min":{"1min":0.40999999999999998,"5min":0.35699999999999998,"15min":0.34699999999999998},"max":{"1min":10.007999999999999,"5min":18.841999999999999,"15min":19.116},"last":13.25},{"interface":"front","average":{"1min":3.129,"5min":2.5910000000000002,"15min":1.9770000000000001},"min":{"1min":0.42699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":19.504999999999999,"5min":33.505000000000003,"15min":33.505000000000003},"last":9.0350000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575164,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":924836,"kb_used_data":27676,"kb_used_omap":1,"kb_used_meta":897150,"kb_avail":93447004,"statfs":{"total":96636764160,"available":95689732096,"internally_reserved":0,"allocated":28340224,"data_stored":58256587,"data_compressed":4973009,"data_compressed_allocated":7712768,"data_compressed_original":37806080,"omap_allocated":1594,"internal_metadata":918682054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1,0,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.355,"5min":2.613,"15min":1.677},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.20599999999999999},"max":{"1min":19.058,"5min":21.062999999999999,"15min":45.375},"last":5.0049999999999999},{"interface":"front","average":{"1min":2.375,"5min":2.206,"15min":1.704},"min":{"1min":0.27500000000000002,"5min":0.23100000000000001,"15min":0.188},"max":{"1min":8.9550000000000001,"5min":19.850999999999999,"15min":35.765000000000001},"last":0.497}]},{"osd":1,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.617,"5min":2.9140000000000001,"15min":2.0609999999999999},"min":{"1min":0.26300000000000001,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":22.718,"5min":22.718,"15min":29.928000000000001},"last":7.9459999999999997},{"interface":"front","average":{"1min":3.3170000000000002,"5min":2.8740000000000001,"15min":1.714},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":19.032,"5min":21.103000000000002,"15min":23.634},"last":1.218}]},{"osd":2,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.2349999999999999,"5min":2.8679999999999999,"15min":1.786},"min":{"1min":0.32400000000000001,"5min":0.28599999999999998,"15min":0.27600000000000002},"max":{"1min":22.774000000000001,"5min":30.512,"15min":30.512},"last":8.0359999999999996},{"interface":"front","average":{"1min":5.0419999999999998,"5min":4.0350000000000001,"15min":2.109},"min":{"1min":0.29499999999999998,"5min":0.27400000000000002,"15min":0.26300000000000001},"max":{"1min":26.567,"5min":82.847999999999999,"15min":82.847999999999999},"last":0.84199999999999997}]},{"osd":3,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":2.1880000000000002,"5min":2.2400000000000002,"15min":1.5960000000000001},"min":{"1min":0.32600000000000001,"5min":0.26600000000000001,"15min":0.23899999999999999},"max":{"1min":8.452,"5min":15.500999999999999,"15min":22.555},"last":0.92200000000000004},{"interface":"front","average":{"1min":3.1230000000000002,"5min":3.1400000000000001,"15min":1.9710000000000001},"min":{"1min":0.37,"5min":0.313,"15min":0.308},"max":{"1min":22.66,"5min":26.259,"15min":26.259},"last":8.0609999999999999}]},{"osd":5,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":4.4569999999999999,"5min":4.1269999999999998,"15min":2.073},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.24399999999999999},"max":{"1min":26.484999999999999,"5min":82.918999999999997,"15min":82.918999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":2.4569999999999999,"5min":2.7490000000000001,"15min":1.8320000000000001},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.249},"max":{"1min":18.288,"5min":25.120000000000001,"15min":25.120000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":2.573,"5min":2.552,"15min":1.671},"min":{"1min":0.313,"5min":0.313,"15min":0.252},"max":{"1min":18.141999999999999,"5min":18.141999999999999,"15min":20.562999999999999},"last":8.0109999999999992},{"interface":"front","average":{"1min":3.8940000000000001,"5min":3.8290000000000002,"15min":2.2440000000000002},"min":{"1min":0.36199999999999999,"5min":0.30499999999999999,"15min":0.29499999999999998},"max":{"1min":21.478000000000002,"5min":83.643000000000001,"15min":83.643000000000001},"last":0.879}]},{"osd":7,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.1389999999999998,"5min":2.3490000000000002,"15min":1.748},"min":{"1min":0.373,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":19.021999999999998,"5min":19.021999999999998,"15min":25.878},"last":0.56000000000000005},{"interface":"front","average":{"1min":2.9780000000000002,"5min":2.4380000000000002,"15min":1.7609999999999999},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.27800000000000002},"max":{"1min":22.75,"5min":22.75,"15min":22.75},"last":7.9850000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575164,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":958980,"kb_used_data":35516,"kb_used_omap":1,"kb_used_meta":923454,"kb_avail":93412860,"statfs":{"total":96636764160,"available":95654768640,"internally_reserved":0,"allocated":36368384,"data_stored":62205095,"data_compressed":4933287,"data_compressed_allocated":7835648,"data_compressed_original":33841152,"omap_allocated":1594,"internal_metadata":945617350},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.911,"15min":1.306},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":6.2060000000000004,"5min":19.097999999999999,"15min":19.097999999999999},"last":6.1260000000000003},{"interface":"front","average":{"1min":1.609,"5min":2.157,"15min":1.508},"min":{"1min":0.28599999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":14.662000000000001,"5min":21.416,"15min":21.416},"last":1.6679999999999999}]},{"osd":1,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":2.0070000000000001,"15min":1.6040000000000001},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":3.4750000000000001,"5min":16.515000000000001,"15min":19.581},"last":1.468},{"interface":"front","average":{"1min":1.153,"5min":1.611,"15min":1.28},"min":{"1min":0.27100000000000002,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":8.4629999999999992,"5min":16.492999999999999,"15min":16.492999999999999},"last":13.266999999999999}]},{"osd":2,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.679,"15min":1.409},"min":{"1min":0.30599999999999999,"5min":0.27300000000000002,"15min":0.25700000000000001},"max":{"1min":5.7770000000000001,"5min":21.186,"15min":21.186},"last":0.496},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.6859999999999999,"15min":1.2609999999999999},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.25700000000000001},"max":{"1min":6.1289999999999996,"5min":22.353999999999999,"15min":22.353999999999999},"last":6.226}]},{"osd":3,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":2.0169999999999999,"15min":1.595},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.28199999999999997},"max":{"1min":14.736000000000001,"5min":16.324999999999999,"15min":17.103999999999999},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.5940000000000001,"5min":2.1800000000000002,"15min":1.6819999999999999},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.29899999999999999},"max":{"1min":15.821999999999999,"5min":18.798999999999999,"15min":23.224},"last":7.7539999999999996}]},{"osd":4,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":2.2869999999999999,"5min":2.206,"15min":1.5},"min":{"1min":0.27600000000000002,"5min":0.25,"15min":0.20799999999999999},"max":{"1min":17.914000000000001,"5min":22.300000000000001,"15min":28.724},"last":6.2000000000000002},{"interface":"front","average":{"1min":2.0960000000000001,"5min":2.4940000000000002,"15min":1.5980000000000001},"min":{"1min":0.371,"5min":0.28100000000000003,"15min":0.22800000000000001},"max":{"1min":22.385999999999999,"5min":25.466999999999999,"15min":25.466999999999999},"last":1.518}]},{"osd":6,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":2.1000000000000001,"15min":1.5129999999999999},"min":{"1min":0.29699999999999999,"5min":0.28699999999999998,"15min":0.23899999999999999},"max":{"1min":9.3539999999999992,"5min":21.294,"15min":21.294},"last":7.7210000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":2.3690000000000002,"15min":1.4590000000000001},"min":{"1min":0.39700000000000002,"5min":0.34300000000000003,"15min":0.24199999999999999},"max":{"1min":6.1820000000000004,"5min":23.731000000000002,"15min":23.731000000000002},"last":6.1660000000000004}]},{"osd":7,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.724,"5min":2.0630000000000002,"15min":1.4370000000000001},"min":{"1min":0.436,"5min":0.29799999999999999,"15min":0.28100000000000003},"max":{"1min":14.711,"5min":21.462,"15min":30.076000000000001},"last":1.845},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.796,"15min":1.29},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.26100000000000001},"max":{"1min":5.7460000000000004,"5min":21.257000000000001,"15min":21.257000000000001},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37617664,"data_stored":55032140,"data_compressed":5468644,"data_compressed_allocated":8114176,"data_compressed_original":25542656,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":56696832,"data_stored":82917896,"data_compressed":8014159,"data_compressed_allocated":12091392,"data_compressed_original":38322176,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41410560,"data_stored":58720256,"data_compressed":5586562,"data_compressed_allocated":8433664,"data_compressed_original":25743360,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58433536,"data_stored":88081056,"data_compressed":8987385,"data_compressed_allocated":13205504,"data_compressed_original":42860544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24395776,"data_stored":37748862,"data_compressed":4009381,"data_compressed_allocated":5820416,"data_compressed_original":19185664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33177600,"data_stored":46137434,"data_compressed":4179228,"data_compressed_allocated":6336512,"data_compressed_original":19300352,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50081792,"data_stored":74529800,"data_compressed":7356666,"data_compressed_allocated":10809344,"data_compressed_original":35266560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":39104512,"data_stored":58994952,"data_compressed":5940682,"data_compressed_allocated":8581120,"data_compressed_original":28475392,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3661824,"data_stored":19365888,"data_compressed":915424,"data_compressed_allocated":1843200,"data_compressed_original":17547264,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7176192,"data_stored":58953728,"data_compressed":2780979,"data_compressed_allocated":4546560,"data_compressed_original":56324096,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2895872,"data_stored":15314944,"data_compressed":723954,"data_compressed_allocated":1462272,"data_compressed_original":13881344,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4993024,"data_stored":26660864,"data_compressed":1260020,"data_compressed_allocated":2527232,"data_compressed_original":24195072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3665920,"data_stored":20393984,"data_compressed":963628,"data_compressed_allocated":1892352,"data_compressed_original":18620416,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2912256,"data_stored":15953920,"data_compressed":754059,"data_compressed_allocated":1499136,"data_compressed_original":14540800,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4046848,"data_stored":22233088,"data_compressed":1050632,"data_compressed_allocated":2084864,"data_compressed_original":20271104,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7102464,"data_stored":66555904,"data_compressed":3135358,"data_compressed_allocated":4907008,"data_compressed_original":64360448,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T19:48:34.597 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T19:48:34.598 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T19:48:35.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.096+0000 7ff6bf58c700 1 Processor -- start 2024-05-08T19:48:35.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.096+0000 7ff6bf58c700 1 -- start start 2024-05-08T19:48:35.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.098+0000 7ff6bf58c700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff6b80c2ea0 0x7ff6b80a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:35.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.098+0000 7ff6bf58c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff6b806d450 0x7ff6b80c3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:35.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.098+0000 7ff6bf58c700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b806dcd0 con 0x7ff6b806e900 2024-05-08T19:48:35.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.098+0000 7ff6bf58c700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b80c3940 con 0x7ff6b80c2ea0 2024-05-08T19:48:35.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.098+0000 7ff6bf58c700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b8155ae0 con 0x7ff6b806d450 2024-05-08T19:48:35.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.099+0000 7ff6bd328700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff6b80c2ea0 0x7ff6b80a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:35.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.099+0000 7ff6bd328700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff6b80c2ea0 0x7ff6b80a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44242/0 (socket says 172.21.15.47:44242) 2024-05-08T19:48:35.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.099+0000 7ff6bd328700 1 -- 172.21.15.47:0/2577384714 learned_addr learned my addr 172.21.15.47:0/2577384714 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:35.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.099+0000 7ff6bd328700 1 -- 172.21.15.47:0/2577384714 >> v2:172.21.15.177:3300/0 conn(0x7ff6b806d450 msgr2=0x7ff6b80c3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:35.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.099+0000 7ff6bd328700 1 --2- 172.21.15.47:0/2577384714 >> v2:172.21.15.177:3300/0 conn(0x7ff6b806d450 0x7ff6b80c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:35.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.099+0000 7ff6bd328700 1 -- 172.21.15.47:0/2577384714 >> v1:172.21.15.177:6789/0 conn(0x7ff6b806e900 legacy=0x7ff6b81553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:35.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.099+0000 7ff6bd328700 1 -- 172.21.15.47:0/2577384714 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b80c26a0 con 0x7ff6b80c2ea0 2024-05-08T19:48:35.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.100+0000 7ff6bd328700 1 --2- 172.21.15.47:0/2577384714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6b80c2ea0 0x7ff6b80a84b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80c1bb0 tx=0x7ff6a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95952b3f924263d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:35.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.102+0000 7ff6affff700 1 -- 172.21.15.47:0/2577384714 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8004230 con 0x7ff6b80c2ea0 2024-05-08T19:48:35.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.102+0000 7ff6affff700 1 -- 172.21.15.47:0/2577384714 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a8004390 con 0x7ff6b80c2ea0 2024-05-08T19:48:35.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.102+0000 7ff6affff700 1 -- 172.21.15.47:0/2577384714 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80036a0 con 0x7ff6b80c2ea0 2024-05-08T19:48:35.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.103+0000 7ff6bf58c700 1 -- 172.21.15.47:0/2577384714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6b80c2ea0 msgr2=0x7ff6b80a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:35.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.103+0000 7ff6bf58c700 1 --2- 172.21.15.47:0/2577384714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6b80c2ea0 0x7ff6b80a84b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80c1bb0 tx=0x7ff6a8009bd0 comp rx=0 tx=0).stop 2024-05-08T19:48:35.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.103+0000 7ff6bf58c700 1 -- 172.21.15.47:0/2577384714 shutdown_connections 2024-05-08T19:48:35.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.103+0000 7ff6bf58c700 1 --2- 172.21.15.47:0/2577384714 >> v2:172.21.15.177:3300/0 conn(0x7ff6b806d450 0x7ff6b80c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:35.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.103+0000 7ff6bf58c700 1 --2- 172.21.15.47:0/2577384714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6b80c2ea0 0x7ff6b80a84b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:35.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.103+0000 7ff6bf58c700 1 -- 172.21.15.47:0/2577384714 >> 172.21.15.47:0/2577384714 conn(0x7ff6b80c3c20 msgr2=0x7ff6b80c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:35.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.104+0000 7ff6bf58c700 1 -- 172.21.15.47:0/2577384714 shutdown_connections 2024-05-08T19:48:35.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.104+0000 7ff6bf58c700 1 -- 172.21.15.47:0/2577384714 wait complete. 2024-05-08T19:48:35.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.106+0000 7ff6bf58c700 1 Processor -- start 2024-05-08T19:48:35.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.106+0000 7ff6bf58c700 1 -- start start 2024-05-08T19:48:35.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.107+0000 7ff6bf58c700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b806d450 0x7ff6b8153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:35.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.107+0000 7ff6bf58c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6b806e900 0x7ff6b81514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:35.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.107+0000 7ff6bf58c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b8137200 0x7ff6b81519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:35.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.107+0000 7ff6bf58c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b8142570 con 0x7ff6b806e900 2024-05-08T19:48:35.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.107+0000 7ff6bf58c700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b81378c0 con 0x7ff6b8137200 2024-05-08T19:48:35.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.107+0000 7ff6bf58c700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b8136560 con 0x7ff6b806d450 2024-05-08T19:48:35.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.107+0000 7ff6bcb27700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6b806e900 0x7ff6b81514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:35.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.107+0000 7ff6bcb27700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6b806e900 0x7ff6b81514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44252/0 (socket says 172.21.15.47:44252) 2024-05-08T19:48:35.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.107+0000 7ff6bcb27700 1 -- 172.21.15.47:0/4221296276 learned_addr learned my addr 172.21.15.47:0/4221296276 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:35.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.108+0000 7ff6bcb27700 1 -- 172.21.15.47:0/4221296276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b806d450 msgr2=0x7ff6b8153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:35.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.108+0000 7ff6bcb27700 1 --2- 172.21.15.47:0/4221296276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b806d450 0x7ff6b8153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:35.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.108+0000 7ff6bcb27700 1 -- 172.21.15.47:0/4221296276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b8137200 msgr2=0x7ff6b81519e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T19:48:35.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.108+0000 7ff6bcb27700 1 --2- 172.21.15.47:0/4221296276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b8137200 0x7ff6b81519e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:35.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.108+0000 7ff6bcb27700 1 -- 172.21.15.47:0/4221296276 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a8009550 con 0x7ff6b806e900 2024-05-08T19:48:35.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.108+0000 7ff6bcb27700 1 --2- 172.21.15.47:0/4221296276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6b806e900 0x7ff6b81514a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400c450 tx=0x7ff6b400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:35.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.108+0000 7ff6adffb700 1 -- 172.21.15.47:0/4221296276 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40054e0 con 0x7ff6b806e900 2024-05-08T19:48:35.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.109+0000 7ff6adffb700 1 -- 172.21.15.47:0/4221296276 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b4003680 con 0x7ff6b806e900 2024-05-08T19:48:35.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.109+0000 7ff6bf58c700 1 -- 172.21.15.47:0/4221296276 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b81389b0 con 0x7ff6b806e900 2024-05-08T19:48:35.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.109+0000 7ff6adffb700 1 -- 172.21.15.47:0/4221296276 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4003a30 con 0x7ff6b806e900 2024-05-08T19:48:35.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.109+0000 7ff6bf58c700 1 -- 172.21.15.47:0/4221296276 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b8136280 con 0x7ff6b806e900 2024-05-08T19:48:35.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.110+0000 7ff6bf58c700 1 -- 172.21.15.47:0/4221296276 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6980052f0 con 0x7ff6b806e900 2024-05-08T19:48:35.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.112+0000 7ff6adffb700 1 -- 172.21.15.47:0/4221296276 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff6b4003b90 con 0x7ff6b806e900 2024-05-08T19:48:35.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.112+0000 7ff6adffb700 1 --2- 172.21.15.47:0/4221296276 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ff69c06ac90 0x7ff69c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:35.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.112+0000 7ff6adffb700 1 -- 172.21.15.47:0/4221296276 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff6b4088a00 con 0x7ff6b806e900 2024-05-08T19:48:35.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.129+0000 7ff6adffb700 1 -- 172.21.15.47:0/4221296276 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff6b4053800 con 0x7ff6b806e900 2024-05-08T19:48:35.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.133+0000 7ff6bd328700 1 --2- 172.21.15.47:0/4221296276 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ff69c06ac90 0x7ff69c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:35.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.135+0000 7ff6bd328700 1 --2- 172.21.15.47:0/4221296276 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ff69c06ac90 0x7ff69c06d150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80c81e0 tx=0x7ff6a8010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:35.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.600+0000 7ff6bf58c700 1 -- 172.21.15.47:0/4221296276 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff698000bc0 con 0x7ff69c06ac90 2024-05-08T19:48:35.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.619+0000 7ff6adffb700 1 -- 172.21.15.47:0/4221296276 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371946 (secure 0 0 0) 0x7ff698000bc0 con 0x7ff69c06ac90 2024-05-08T19:48:35.617 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:48:35.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.629+0000 7ff6bf58c700 1 -- 172.21.15.47:0/4221296276 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ff69c06ac90 msgr2=0x7ff69c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:35.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.629+0000 7ff6bf58c700 1 --2- 172.21.15.47:0/4221296276 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ff69c06ac90 0x7ff69c06d150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80c81e0 tx=0x7ff6a8010000 comp rx=0 tx=0).stop 2024-05-08T19:48:35.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.629+0000 7ff6bf58c700 1 -- 172.21.15.47:0/4221296276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6b806e900 msgr2=0x7ff6b81514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:35.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.629+0000 7ff6bf58c700 1 --2- 172.21.15.47:0/4221296276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6b806e900 0x7ff6b81514a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400c450 tx=0x7ff6b400c810 comp rx=0 tx=0).stop 2024-05-08T19:48:35.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.629+0000 7ff6bf58c700 1 -- 172.21.15.47:0/4221296276 shutdown_connections 2024-05-08T19:48:35.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.629+0000 7ff6bf58c700 1 --2- 172.21.15.47:0/4221296276 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7ff69c06ac90 0x7ff69c06d150 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:35.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.629+0000 7ff6bf58c700 1 --2- 172.21.15.47:0/4221296276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b8137200 0x7ff6b81519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:35.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.629+0000 7ff6bf58c700 1 --2- 172.21.15.47:0/4221296276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b806d450 0x7ff6b8153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:35.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.629+0000 7ff6bf58c700 1 --2- 172.21.15.47:0/4221296276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6b806e900 0x7ff6b81514a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:35.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.629+0000 7ff6bf58c700 1 -- 172.21.15.47:0/4221296276 >> 172.21.15.47:0/4221296276 conn(0x7ff6b80c3c20 msgr2=0x7ff6b80a84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:35.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.629+0000 7ff6bf58c700 1 -- 172.21.15.47:0/4221296276 shutdown_connections 2024-05-08T19:48:35.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:35.629+0000 7ff6bf58c700 1 -- 172.21.15.47:0/4221296276 wait complete. 2024-05-08T19:48:35.624 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-08T19:48:35.641 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":809,"stamp":"2024-05-08T19:48:34.599066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":324808289,"num_objects":1704,"num_object_clones":0,"num_object_copies":5236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1704,"num_whiteouts":0,"num_read":21643,"num_read_kb":1158813,"num_write":407773,"num_write_kb":31677962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":574073,"ondisk_log_size":574073,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7791732,"kb_used_data":364212,"kb_used_omap":12,"kb_used_meta":7427443,"kb_avail":747182988,"statfs":{"total":773094113280,"available":765115379712,"internally_reserved":0,"allocated":372953088,"data_stored":693938587,"data_compressed":58400453,"data_compressed_allocated":90324992,"data_compressed_original":412696576,"omap_allocated":12741,"internal_metadata":7605702203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,9,12,9,10,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-260188210,"num_objects":-2055,"num_object_clones":0,"num_object_copies":-7024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2055,"num_whiteouts":0,"num_read":20,"num_read_kb":376,"num_write":4338,"num_write_kb":68841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009308"},"pg_stats":[{"pgid":"3.3f","version":"26'2233","reported_seq":2261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.843824+0000","last_change":"2024-05-08T19:22:20.461758+0000","last_active":"2024-05-08T19:48:29.843824+0000","last_peered":"2024-05-08T19:48:29.843824+0000","last_clean":"2024-05-08T19:48:29.843824+0000","last_became_active":"2024-05-08T19:22:20.461515+0000","last_became_peered":"2024-05-08T19:22:20.461515+0000","last_unstale":"2024-05-08T19:48:29.843824+0000","last_undegraded":"2024-05-08T19:48:29.843824+0000","last_fullsized":"2024-05-08T19:48:29.843824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2233,"log_dups_size":0,"ondisk_log_size":2233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'2260","reported_seq":2288,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.249753+0000","last_change":"2024-05-08T19:22:20.434929+0000","last_active":"2024-05-08T19:48:33.249753+0000","last_peered":"2024-05-08T19:48:33.249753+0000","last_clean":"2024-05-08T19:48:33.249753+0000","last_became_active":"2024-05-08T19:22:20.434629+0000","last_became_peered":"2024-05-08T19:22:20.434629+0000","last_unstale":"2024-05-08T19:48:33.249753+0000","last_undegraded":"2024-05-08T19:48:33.249753+0000","last_fullsized":"2024-05-08T19:48:33.249753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2260,"log_dups_size":0,"ondisk_log_size":2260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"26'2362","reported_seq":2390,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.252030+0000","last_change":"2024-05-08T19:22:20.449450+0000","last_active":"2024-05-08T19:48:29.252030+0000","last_peered":"2024-05-08T19:48:29.252030+0000","last_clean":"2024-05-08T19:48:29.252030+0000","last_became_active":"2024-05-08T19:22:20.449184+0000","last_became_peered":"2024-05-08T19:22:20.449184+0000","last_unstale":"2024-05-08T19:48:29.252030+0000","last_undegraded":"2024-05-08T19:48:29.252030+0000","last_fullsized":"2024-05-08T19:48:29.252030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2362,"log_dups_size":0,"ondisk_log_size":2362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"26'2333","reported_seq":2361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.100139+0000","last_change":"2024-05-08T19:22:20.449919+0000","last_active":"2024-05-08T19:48:30.100139+0000","last_peered":"2024-05-08T19:48:30.100139+0000","last_clean":"2024-05-08T19:48:30.100139+0000","last_became_active":"2024-05-08T19:22:20.449637+0000","last_became_peered":"2024-05-08T19:22:20.449637+0000","last_unstale":"2024-05-08T19:48:30.100139+0000","last_undegraded":"2024-05-08T19:48:30.100139+0000","last_fullsized":"2024-05-08T19:48:30.100139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2333,"log_dups_size":0,"ondisk_log_size":2333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'2290","reported_seq":2316,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.662066+0000","last_change":"2024-05-08T19:22:20.449676+0000","last_active":"2024-05-08T19:48:29.662066+0000","last_peered":"2024-05-08T19:48:29.662066+0000","last_clean":"2024-05-08T19:48:29.662066+0000","last_became_active":"2024-05-08T19:22:20.449347+0000","last_became_peered":"2024-05-08T19:22:20.449347+0000","last_unstale":"2024-05-08T19:48:29.662066+0000","last_undegraded":"2024-05-08T19:48:29.662066+0000","last_fullsized":"2024-05-08T19:48:29.662066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2290,"log_dups_size":0,"ondisk_log_size":2290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:29.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'2206","reported_seq":2226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.699476+0000","last_change":"2024-05-08T19:23:11.053315+0000","last_active":"2024-05-08T19:48:29.699476+0000","last_peered":"2024-05-08T19:48:29.699476+0000","last_clean":"2024-05-08T19:48:29.699476+0000","last_became_active":"2024-05-08T19:23:11.052928+0000","last_became_peered":"2024-05-08T19:23:11.052928+0000","last_unstale":"2024-05-08T19:48:29.699476+0000","last_undegraded":"2024-05-08T19:48:29.699476+0000","last_fullsized":"2024-05-08T19:48:29.699476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2206,"log_dups_size":0,"ondisk_log_size":2206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:17.190935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"26'2270","reported_seq":2296,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.439336+0000","last_change":"2024-05-08T19:22:20.446830+0000","last_active":"2024-05-08T19:48:29.439336+0000","last_peered":"2024-05-08T19:48:29.439336+0000","last_clean":"2024-05-08T19:48:29.439336+0000","last_became_active":"2024-05-08T19:22:20.446520+0000","last_became_peered":"2024-05-08T19:22:20.446520+0000","last_unstale":"2024-05-08T19:48:29.439336+0000","last_undegraded":"2024-05-08T19:48:29.439336+0000","last_fullsized":"2024-05-08T19:48:29.439336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2270,"log_dups_size":0,"ondisk_log_size":2270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:25.101779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'2263","reported_seq":2289,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.950352+0000","last_change":"2024-05-08T19:22:20.447313+0000","last_active":"2024-05-08T19:48:29.950352+0000","last_peered":"2024-05-08T19:48:29.950352+0000","last_clean":"2024-05-08T19:48:29.950352+0000","last_became_active":"2024-05-08T19:22:20.447031+0000","last_became_peered":"2024-05-08T19:22:20.447031+0000","last_unstale":"2024-05-08T19:48:29.950352+0000","last_undegraded":"2024-05-08T19:48:29.950352+0000","last_fullsized":"2024-05-08T19:48:29.950352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2263,"log_dups_size":0,"ondisk_log_size":2263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"26'2326","reported_seq":2352,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.461472+0000","last_change":"2024-05-08T19:22:20.447186+0000","last_active":"2024-05-08T19:48:29.461472+0000","last_peered":"2024-05-08T19:48:29.461472+0000","last_clean":"2024-05-08T19:48:29.461472+0000","last_became_active":"2024-05-08T19:22:20.446803+0000","last_became_peered":"2024-05-08T19:22:20.446803+0000","last_unstale":"2024-05-08T19:48:29.461472+0000","last_undegraded":"2024-05-08T19:48:29.461472+0000","last_fullsized":"2024-05-08T19:48:29.461472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2326,"log_dups_size":0,"ondisk_log_size":2326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'2338","reported_seq":2364,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.900817+0000","last_change":"2024-05-08T19:22:20.462899+0000","last_active":"2024-05-08T19:48:29.900817+0000","last_peered":"2024-05-08T19:48:29.900817+0000","last_clean":"2024-05-08T19:48:29.900817+0000","last_became_active":"2024-05-08T19:22:20.461395+0000","last_became_peered":"2024-05-08T19:22:20.461395+0000","last_unstale":"2024-05-08T19:48:29.900817+0000","last_undegraded":"2024-05-08T19:48:29.900817+0000","last_fullsized":"2024-05-08T19:48:29.900817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2338,"log_dups_size":0,"ondisk_log_size":2338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"26'2216","reported_seq":2242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.839269+0000","last_change":"2024-05-08T19:22:20.459545+0000","last_active":"2024-05-08T19:48:29.839269+0000","last_peered":"2024-05-08T19:48:29.839269+0000","last_clean":"2024-05-08T19:48:29.839269+0000","last_became_active":"2024-05-08T19:22:20.459253+0000","last_became_peered":"2024-05-08T19:22:20.459253+0000","last_unstale":"2024-05-08T19:48:29.839269+0000","last_undegraded":"2024-05-08T19:48:29.839269+0000","last_fullsized":"2024-05-08T19:48:29.839269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2216,"log_dups_size":0,"ondisk_log_size":2216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"26'2202","reported_seq":2228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.909068+0000","last_change":"2024-05-08T19:22:20.462193+0000","last_active":"2024-05-08T19:48:29.909068+0000","last_peered":"2024-05-08T19:48:29.909068+0000","last_clean":"2024-05-08T19:48:29.909068+0000","last_became_active":"2024-05-08T19:22:20.461852+0000","last_became_peered":"2024-05-08T19:22:20.461852+0000","last_unstale":"2024-05-08T19:48:29.909068+0000","last_undegraded":"2024-05-08T19:48:29.909068+0000","last_fullsized":"2024-05-08T19:48:29.909068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:51.431376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"26'2249","reported_seq":2275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.437813+0000","last_change":"2024-05-08T19:22:20.453169+0000","last_active":"2024-05-08T19:48:29.437813+0000","last_peered":"2024-05-08T19:48:29.437813+0000","last_clean":"2024-05-08T19:48:29.437813+0000","last_became_active":"2024-05-08T19:22:20.452884+0000","last_became_peered":"2024-05-08T19:22:20.452884+0000","last_unstale":"2024-05-08T19:48:29.437813+0000","last_undegraded":"2024-05-08T19:48:29.437813+0000","last_fullsized":"2024-05-08T19:48:29.437813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2249,"log_dups_size":0,"ondisk_log_size":2249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"26'2281","reported_seq":2308,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.783911+0000","last_change":"2024-05-08T19:22:20.435745+0000","last_active":"2024-05-08T19:48:29.783911+0000","last_peered":"2024-05-08T19:48:29.783911+0000","last_clean":"2024-05-08T19:48:29.783911+0000","last_became_active":"2024-05-08T19:22:20.435456+0000","last_became_peered":"2024-05-08T19:22:20.435456+0000","last_unstale":"2024-05-08T19:48:29.783911+0000","last_undegraded":"2024-05-08T19:48:29.783911+0000","last_fullsized":"2024-05-08T19:48:29.783911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2281,"log_dups_size":0,"ondisk_log_size":2281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"26'2360","reported_seq":2387,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:34.295601+0000","last_change":"2024-05-08T19:22:20.444615+0000","last_active":"2024-05-08T19:48:34.295601+0000","last_peered":"2024-05-08T19:48:34.295601+0000","last_clean":"2024-05-08T19:48:34.295601+0000","last_became_active":"2024-05-08T19:22:20.444369+0000","last_became_peered":"2024-05-08T19:22:20.444369+0000","last_unstale":"2024-05-08T19:48:34.295601+0000","last_undegraded":"2024-05-08T19:48:34.295601+0000","last_fullsized":"2024-05-08T19:48:34.295601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2360,"log_dups_size":0,"ondisk_log_size":2360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'2251","reported_seq":2278,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.485265+0000","last_change":"2024-05-08T19:22:20.445391+0000","last_active":"2024-05-08T19:48:29.485265+0000","last_peered":"2024-05-08T19:48:29.485265+0000","last_clean":"2024-05-08T19:48:29.485265+0000","last_became_active":"2024-05-08T19:22:20.444996+0000","last_became_peered":"2024-05-08T19:22:20.444996+0000","last_unstale":"2024-05-08T19:48:29.485265+0000","last_undegraded":"2024-05-08T19:48:29.485265+0000","last_fullsized":"2024-05-08T19:48:29.485265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2251,"log_dups_size":0,"ondisk_log_size":2251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"26'2315","reported_seq":2342,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.701160+0000","last_change":"2024-05-08T19:22:20.451170+0000","last_active":"2024-05-08T19:48:29.701160+0000","last_peered":"2024-05-08T19:48:29.701160+0000","last_clean":"2024-05-08T19:48:29.701160+0000","last_became_active":"2024-05-08T19:22:20.450843+0000","last_became_peered":"2024-05-08T19:22:20.450843+0000","last_unstale":"2024-05-08T19:48:29.701160+0000","last_undegraded":"2024-05-08T19:48:29.701160+0000","last_fullsized":"2024-05-08T19:48:29.701160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2315,"log_dups_size":0,"ondisk_log_size":2315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'2280","reported_seq":2307,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.987017+0000","last_change":"2024-05-08T19:22:20.462503+0000","last_active":"2024-05-08T19:48:29.987017+0000","last_peered":"2024-05-08T19:48:29.987017+0000","last_clean":"2024-05-08T19:48:29.987017+0000","last_became_active":"2024-05-08T19:22:20.462266+0000","last_became_peered":"2024-05-08T19:22:20.462266+0000","last_unstale":"2024-05-08T19:48:29.987017+0000","last_undegraded":"2024-05-08T19:48:29.987017+0000","last_fullsized":"2024-05-08T19:48:29.987017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2280,"log_dups_size":0,"ondisk_log_size":2280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:04.174914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"26'2344","reported_seq":2371,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.222108+0000","last_change":"2024-05-08T19:22:20.454128+0000","last_active":"2024-05-08T19:48:29.222108+0000","last_peered":"2024-05-08T19:48:29.222108+0000","last_clean":"2024-05-08T19:48:29.222108+0000","last_became_active":"2024-05-08T19:22:20.453834+0000","last_became_peered":"2024-05-08T19:22:20.453834+0000","last_unstale":"2024-05-08T19:48:29.222108+0000","last_undegraded":"2024-05-08T19:48:29.222108+0000","last_fullsized":"2024-05-08T19:48:29.222108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2344,"log_dups_size":0,"ondisk_log_size":2344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:23.193366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"26'8894","reported_seq":8969,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.789537+0000","last_change":"2024-05-08T19:22:24.616532+0000","last_active":"2024-05-08T19:48:29.789537+0000","last_peered":"2024-05-08T19:48:29.789537+0000","last_clean":"2024-05-08T19:48:29.789537+0000","last_became_active":"2024-05-08T19:22:24.616128+0000","last_became_peered":"2024-05-08T19:22:24.616128+0000","last_unstale":"2024-05-08T19:48:29.789537+0000","last_undegraded":"2024-05-08T19:48:29.789537+0000","last_fullsized":"2024-05-08T19:48:29.789537+0000","mapping_epoch":22,"log_start":"26'2412","ondisk_log_start":"26'2412","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6482,"log_dups_size":0,"ondisk_log_size":6482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:44.356550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2261478,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":51,"num_read_kb":3400,"num_write":6550,"num_write_kb":966197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"26'2349","reported_seq":2378,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:08.547207+0000","last_change":"2024-05-08T19:22:20.012743+0000","last_active":"2024-05-08T19:47:08.547207+0000","last_peered":"2024-05-08T19:47:08.547207+0000","last_clean":"2024-05-08T19:47:08.547207+0000","last_became_active":"2024-05-08T19:22:20.012453+0000","last_became_peered":"2024-05-08T19:22:20.012453+0000","last_unstale":"2024-05-08T19:47:08.547207+0000","last_undegraded":"2024-05-08T19:47:08.547207+0000","last_fullsized":"2024-05-08T19:47:08.547207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:52.547906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2351,"num_write_kb":17974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'2295","reported_seq":2323,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.508215+0000","last_change":"2024-05-08T19:22:20.464578+0000","last_active":"2024-05-08T19:48:29.508215+0000","last_peered":"2024-05-08T19:48:29.508215+0000","last_clean":"2024-05-08T19:48:29.508215+0000","last_became_active":"2024-05-08T19:22:20.464396+0000","last_became_peered":"2024-05-08T19:22:20.464396+0000","last_unstale":"2024-05-08T19:48:29.508215+0000","last_undegraded":"2024-05-08T19:48:29.508215+0000","last_fullsized":"2024-05-08T19:48:29.508215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"26'8763","reported_seq":9429,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.011249+0000","last_change":"2024-05-08T19:22:24.469561+0000","last_active":"2024-05-08T19:48:30.011249+0000","last_peered":"2024-05-08T19:48:30.011249+0000","last_clean":"2024-05-08T19:48:30.011249+0000","last_became_active":"2024-05-08T19:22:24.469161+0000","last_became_peered":"2024-05-08T19:22:24.469161+0000","last_unstale":"2024-05-08T19:48:30.011249+0000","last_undegraded":"2024-05-08T19:48:30.011249+0000","last_fullsized":"2024-05-08T19:48:30.011249+0000","mapping_epoch":22,"log_start":"26'1544","ondisk_log_start":"26'1544","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7219,"log_dups_size":0,"ondisk_log_size":7219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:50.011809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2824860,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":642,"num_read_kb":43100,"num_write":6319,"num_write_kb":920646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"26'8076","reported_seq":8105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.072681+0000","last_change":"2024-05-08T19:22:20.006198+0000","last_active":"2024-05-08T19:48:30.072681+0000","last_peered":"2024-05-08T19:48:30.072681+0000","last_clean":"2024-05-08T19:48:30.072681+0000","last_became_active":"2024-05-08T19:22:20.005723+0000","last_became_peered":"2024-05-08T19:22:20.005723+0000","last_unstale":"2024-05-08T19:48:30.072681+0000","last_undegraded":"2024-05-08T19:48:30.072681+0000","last_fullsized":"2024-05-08T19:48:30.072681+0000","mapping_epoch":17,"log_start":"26'1600","ondisk_log_start":"26'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6476,"log_dups_size":0,"ondisk_log_size":6476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8075,"num_write_kb":50504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'2296","reported_seq":2324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.638193+0000","last_change":"2024-05-08T19:22:20.451485+0000","last_active":"2024-05-08T19:48:29.638193+0000","last_peered":"2024-05-08T19:48:29.638193+0000","last_clean":"2024-05-08T19:48:29.638193+0000","last_became_active":"2024-05-08T19:22:20.446380+0000","last_became_peered":"2024-05-08T19:22:20.446380+0000","last_unstale":"2024-05-08T19:48:29.638193+0000","last_undegraded":"2024-05-08T19:48:29.638193+0000","last_fullsized":"2024-05-08T19:48:29.638193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2296,"log_dups_size":0,"ondisk_log_size":2296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:47.856077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"26'8161","reported_seq":8789,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.923489+0000","last_change":"2024-05-08T19:22:24.465354+0000","last_active":"2024-05-08T19:48:29.923489+0000","last_peered":"2024-05-08T19:48:29.923489+0000","last_clean":"2024-05-08T19:48:29.923489+0000","last_became_active":"2024-05-08T19:22:24.464669+0000","last_became_peered":"2024-05-08T19:22:24.464669+0000","last_unstale":"2024-05-08T19:48:29.923489+0000","last_undegraded":"2024-05-08T19:48:29.923489+0000","last_fullsized":"2024-05-08T19:48:29.923489+0000","mapping_epoch":22,"log_start":"26'1003","ondisk_log_start":"26'1003","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7158,"log_dups_size":0,"ondisk_log_size":7158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:29.398413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880683,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":604,"num_read_kb":22018,"num_write":5695,"num_write_kb":861910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'9221","reported_seq":9248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.074809+0000","last_change":"2024-05-08T19:22:20.014506+0000","last_active":"2024-05-08T19:48:30.074809+0000","last_peered":"2024-05-08T19:48:30.074809+0000","last_clean":"2024-05-08T19:48:30.074809+0000","last_became_active":"2024-05-08T19:22:20.014239+0000","last_became_peered":"2024-05-08T19:22:20.014239+0000","last_unstale":"2024-05-08T19:48:30.074809+0000","last_undegraded":"2024-05-08T19:48:30.074809+0000","last_fullsized":"2024-05-08T19:48:30.074809+0000","mapping_epoch":17,"log_start":"26'2400","ondisk_log_start":"26'2400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6821,"log_dups_size":0,"ondisk_log_size":6821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:23.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":9235,"num_write_kb":71812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'2380","reported_seq":2400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.896235+0000","last_change":"2024-05-08T19:23:11.054407+0000","last_active":"2024-05-08T19:48:29.896235+0000","last_peered":"2024-05-08T19:48:29.896235+0000","last_clean":"2024-05-08T19:48:29.896235+0000","last_became_active":"2024-05-08T19:23:11.054036+0000","last_became_peered":"2024-05-08T19:23:11.054036+0000","last_unstale":"2024-05-08T19:48:29.896235+0000","last_undegraded":"2024-05-08T19:48:29.896235+0000","last_fullsized":"2024-05-08T19:48:29.896235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2380,"log_dups_size":0,"ondisk_log_size":2380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:41.638647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"26'8184","reported_seq":8450,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.730638+0000","last_change":"2024-05-08T19:22:24.479649+0000","last_active":"2024-05-08T19:48:29.730638+0000","last_peered":"2024-05-08T19:48:29.730638+0000","last_clean":"2024-05-08T19:48:29.730638+0000","last_became_active":"2024-05-08T19:22:24.479255+0000","last_became_peered":"2024-05-08T19:22:24.479255+0000","last_unstale":"2024-05-08T19:48:29.730638+0000","last_undegraded":"2024-05-08T19:48:29.730638+0000","last_fullsized":"2024-05-08T19:48:29.730638+0000","mapping_epoch":22,"log_start":"26'1000","ondisk_log_start":"26'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7184,"log_dups_size":0,"ondisk_log_size":7184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2436548,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":242,"num_read_kb":15390,"num_write":5806,"num_write_kb":1051846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6111","reported_seq":6138,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.087704+0000","last_change":"2024-05-08T19:22:20.014093+0000","last_active":"2024-05-08T19:48:30.087704+0000","last_peered":"2024-05-08T19:48:30.087704+0000","last_clean":"2024-05-08T19:48:30.087704+0000","last_became_active":"2024-05-08T19:22:20.013793+0000","last_became_peered":"2024-05-08T19:22:20.013793+0000","last_unstale":"2024-05-08T19:48:30.087704+0000","last_undegraded":"2024-05-08T19:48:30.087704+0000","last_fullsized":"2024-05-08T19:48:30.087704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6111,"log_dups_size":0,"ondisk_log_size":6111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6124,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'2276","reported_seq":2302,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.766528+0000","last_change":"2024-05-08T19:22:20.455505+0000","last_active":"2024-05-08T19:48:29.766528+0000","last_peered":"2024-05-08T19:48:29.766528+0000","last_clean":"2024-05-08T19:48:29.766528+0000","last_became_active":"2024-05-08T19:22:20.455148+0000","last_became_peered":"2024-05-08T19:22:20.455148+0000","last_unstale":"2024-05-08T19:48:29.766528+0000","last_undegraded":"2024-05-08T19:48:29.766528+0000","last_fullsized":"2024-05-08T19:48:29.766528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2276,"log_dups_size":0,"ondisk_log_size":2276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"26'8403","reported_seq":9263,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.767683+0000","last_change":"2024-05-08T19:22:24.465009+0000","last_active":"2024-05-08T19:48:29.767683+0000","last_peered":"2024-05-08T19:48:29.767683+0000","last_clean":"2024-05-08T19:48:29.767683+0000","last_became_active":"2024-05-08T19:22:24.464422+0000","last_became_peered":"2024-05-08T19:22:24.464422+0000","last_unstale":"2024-05-08T19:48:29.767683+0000","last_undegraded":"2024-05-08T19:48:29.767683+0000","last_fullsized":"2024-05-08T19:48:29.767683+0000","mapping_epoch":22,"log_start":"26'2000","ondisk_log_start":"26'2000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6403,"log_dups_size":0,"ondisk_log_size":6403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:12.830755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1989992,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":836,"num_read_kb":58598,"num_write":5961,"num_write_kb":988104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"26'8499","reported_seq":8526,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.071306+0000","last_change":"2024-05-08T19:22:20.011515+0000","last_active":"2024-05-08T19:48:30.071306+0000","last_peered":"2024-05-08T19:48:30.071306+0000","last_clean":"2024-05-08T19:48:30.071306+0000","last_became_active":"2024-05-08T19:22:20.011183+0000","last_became_peered":"2024-05-08T19:22:20.011183+0000","last_unstale":"2024-05-08T19:48:30.071306+0000","last_undegraded":"2024-05-08T19:48:30.071306+0000","last_fullsized":"2024-05-08T19:48:30.071306+0000","mapping_epoch":17,"log_start":"26'2100","ondisk_log_start":"26'2100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6399,"log_dups_size":0,"ondisk_log_size":6399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8493,"num_write_kb":66920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'2319","reported_seq":2345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.609234+0000","last_change":"2024-05-08T19:22:20.439371+0000","last_active":"2024-05-08T19:48:29.609234+0000","last_peered":"2024-05-08T19:48:29.609234+0000","last_clean":"2024-05-08T19:48:29.609234+0000","last_became_active":"2024-05-08T19:22:20.439096+0000","last_became_peered":"2024-05-08T19:22:20.439096+0000","last_unstale":"2024-05-08T19:48:29.609234+0000","last_undegraded":"2024-05-08T19:48:29.609234+0000","last_fullsized":"2024-05-08T19:48:29.609234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2319,"log_dups_size":0,"ondisk_log_size":2319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:56.795619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'8624","reported_seq":9354,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.100706+0000","last_change":"2024-05-08T19:23:11.529967+0000","last_active":"2024-05-08T19:48:30.100706+0000","last_peered":"2024-05-08T19:48:30.100706+0000","last_clean":"2024-05-08T19:48:30.100706+0000","last_became_active":"2024-05-08T19:23:11.529451+0000","last_became_peered":"2024-05-08T19:23:11.529451+0000","last_unstale":"2024-05-08T19:48:30.100706+0000","last_undegraded":"2024-05-08T19:48:30.100706+0000","last_fullsized":"2024-05-08T19:48:30.100706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":8624,"log_dups_size":0,"ondisk_log_size":8624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:23.975698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2253528,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":696,"num_read_kb":42234,"num_write":6155,"num_write_kb":1013077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"26'10407","reported_seq":10434,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:22.961151+0000","last_change":"2024-05-08T19:22:20.004185+0000","last_active":"2024-05-08T19:48:22.961151+0000","last_peered":"2024-05-08T19:48:22.961151+0000","last_clean":"2024-05-08T19:48:22.961151+0000","last_became_active":"2024-05-08T19:22:20.003513+0000","last_became_peered":"2024-05-08T19:22:20.003513+0000","last_unstale":"2024-05-08T19:48:22.961151+0000","last_undegraded":"2024-05-08T19:48:22.961151+0000","last_fullsized":"2024-05-08T19:48:22.961151+0000","mapping_epoch":17,"log_start":"26'2500","ondisk_log_start":"26'2500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7907,"log_dups_size":0,"ondisk_log_size":7907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10402,"num_write_kb":72564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'2262","reported_seq":2288,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.819862+0000","last_change":"2024-05-08T19:22:20.446538+0000","last_active":"2024-05-08T19:48:29.819862+0000","last_peered":"2024-05-08T19:48:29.819862+0000","last_clean":"2024-05-08T19:48:29.819862+0000","last_became_active":"2024-05-08T19:22:20.445238+0000","last_became_peered":"2024-05-08T19:22:20.445238+0000","last_unstale":"2024-05-08T19:48:29.819862+0000","last_undegraded":"2024-05-08T19:48:29.819862+0000","last_fullsized":"2024-05-08T19:48:29.819862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2262,"log_dups_size":0,"ondisk_log_size":2262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'8242","reported_seq":10709,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.972487+0000","last_change":"2024-05-08T19:22:24.479665+0000","last_active":"2024-05-08T19:48:29.972487+0000","last_peered":"2024-05-08T19:48:29.972487+0000","last_clean":"2024-05-08T19:48:29.972487+0000","last_became_active":"2024-05-08T19:22:24.478998+0000","last_became_peered":"2024-05-08T19:22:24.478998+0000","last_unstale":"2024-05-08T19:48:29.972487+0000","last_undegraded":"2024-05-08T19:48:29.972487+0000","last_fullsized":"2024-05-08T19:48:29.972487+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7942,"log_dups_size":0,"ondisk_log_size":7942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:55.287155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1844298,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2441,"num_read_kb":165440,"num_write":5883,"num_write_kb":873311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"26'5851","reported_seq":5878,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.065548+0000","last_change":"2024-05-08T19:22:20.002850+0000","last_active":"2024-05-08T19:48:30.065548+0000","last_peered":"2024-05-08T19:48:30.065548+0000","last_clean":"2024-05-08T19:48:30.065548+0000","last_became_active":"2024-05-08T19:22:20.002534+0000","last_became_peered":"2024-05-08T19:22:20.002534+0000","last_unstale":"2024-05-08T19:48:30.065548+0000","last_undegraded":"2024-05-08T19:48:30.065548+0000","last_fullsized":"2024-05-08T19:48:30.065548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5851,"log_dups_size":0,"ondisk_log_size":5851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5849,"num_write_kb":40670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"26'2347","reported_seq":2373,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.926085+0000","last_change":"2024-05-08T19:22:20.436698+0000","last_active":"2024-05-08T19:48:29.926085+0000","last_peered":"2024-05-08T19:48:29.926085+0000","last_clean":"2024-05-08T19:48:29.926085+0000","last_became_active":"2024-05-08T19:22:20.436431+0000","last_became_peered":"2024-05-08T19:22:20.436431+0000","last_unstale":"2024-05-08T19:48:29.926085+0000","last_undegraded":"2024-05-08T19:48:29.926085+0000","last_fullsized":"2024-05-08T19:48:29.926085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2347,"log_dups_size":0,"ondisk_log_size":2347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'8438","reported_seq":9167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.966724+0000","last_change":"2024-05-08T19:22:24.617420+0000","last_active":"2024-05-08T19:48:29.966724+0000","last_peered":"2024-05-08T19:48:29.966724+0000","last_clean":"2024-05-08T19:48:29.966724+0000","last_became_active":"2024-05-08T19:22:24.617030+0000","last_became_peered":"2024-05-08T19:22:24.617030+0000","last_unstale":"2024-05-08T19:48:29.966724+0000","last_undegraded":"2024-05-08T19:48:29.966724+0000","last_fullsized":"2024-05-08T19:48:29.966724+0000","mapping_epoch":22,"log_start":"26'1202","ondisk_log_start":"26'1202","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7236,"log_dups_size":0,"ondisk_log_size":7236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:29.274973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2763684,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":703,"num_read_kb":49016,"num_write":6096,"num_write_kb":1037918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"26'9201","reported_seq":9228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:46:37.444413+0000","last_change":"2024-05-08T19:22:20.003949+0000","last_active":"2024-05-08T19:46:37.444413+0000","last_peered":"2024-05-08T19:46:37.444413+0000","last_clean":"2024-05-08T19:46:37.444413+0000","last_became_active":"2024-05-08T19:22:20.003365+0000","last_became_peered":"2024-05-08T19:22:20.003365+0000","last_unstale":"2024-05-08T19:46:37.444413+0000","last_undegraded":"2024-05-08T19:46:37.444413+0000","last_fullsized":"2024-05-08T19:46:37.444413+0000","mapping_epoch":17,"log_start":"26'1700","ondisk_log_start":"26'1700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7501,"log_dups_size":0,"ondisk_log_size":7501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9188,"num_write_kb":63509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"26'2290","reported_seq":2316,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.256241+0000","last_change":"2024-05-08T19:22:20.437480+0000","last_active":"2024-05-08T19:48:33.256241+0000","last_peered":"2024-05-08T19:48:33.256241+0000","last_clean":"2024-05-08T19:48:33.256241+0000","last_became_active":"2024-05-08T19:22:20.437214+0000","last_became_peered":"2024-05-08T19:22:20.437214+0000","last_unstale":"2024-05-08T19:48:33.256241+0000","last_undegraded":"2024-05-08T19:48:33.256241+0000","last_fullsized":"2024-05-08T19:48:33.256241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2290,"log_dups_size":0,"ondisk_log_size":2290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"26'8393","reported_seq":8861,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.769227+0000","last_change":"2024-05-08T19:22:24.615730+0000","last_active":"2024-05-08T19:48:29.769227+0000","last_peered":"2024-05-08T19:48:29.769227+0000","last_clean":"2024-05-08T19:48:29.769227+0000","last_became_active":"2024-05-08T19:22:24.615351+0000","last_became_peered":"2024-05-08T19:22:24.615351+0000","last_unstale":"2024-05-08T19:48:29.769227+0000","last_undegraded":"2024-05-08T19:48:29.769227+0000","last_fullsized":"2024-05-08T19:48:29.769227+0000","mapping_epoch":22,"log_start":"26'1914","ondisk_log_start":"26'1914","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6479,"log_dups_size":0,"ondisk_log_size":6479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2591622,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":443,"num_read_kb":19968,"num_write":5920,"num_write_kb":994007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"26'7040","reported_seq":7905,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:46.436611+0000","last_change":"2024-05-08T19:22:20.002400+0000","last_active":"2024-05-08T19:47:46.436611+0000","last_peered":"2024-05-08T19:47:46.436611+0000","last_clean":"2024-05-08T19:47:46.436611+0000","last_became_active":"2024-05-08T19:22:20.001990+0000","last_became_peered":"2024-05-08T19:22:20.001990+0000","last_unstale":"2024-05-08T19:47:46.436611+0000","last_undegraded":"2024-05-08T19:47:46.436611+0000","last_fullsized":"2024-05-08T19:47:46.436611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7040,"log_dups_size":0,"ondisk_log_size":7040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":838,"num_read_kb":4635,"num_write":7033,"num_write_kb":49678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"26'2293","reported_seq":2319,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.474226+0000","last_change":"2024-05-08T19:22:20.447742+0000","last_active":"2024-05-08T19:48:29.474226+0000","last_peered":"2024-05-08T19:48:29.474226+0000","last_clean":"2024-05-08T19:48:29.474226+0000","last_became_active":"2024-05-08T19:22:20.447475+0000","last_became_peered":"2024-05-08T19:22:20.447475+0000","last_unstale":"2024-05-08T19:48:29.474226+0000","last_undegraded":"2024-05-08T19:48:29.474226+0000","last_fullsized":"2024-05-08T19:48:29.474226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2293,"log_dups_size":0,"ondisk_log_size":2293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'7931","reported_seq":8419,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.027857+0000","last_change":"2024-05-08T19:23:11.054182+0000","last_active":"2024-05-08T19:48:30.027857+0000","last_peered":"2024-05-08T19:48:30.027857+0000","last_clean":"2024-05-08T19:48:30.027857+0000","last_became_active":"2024-05-08T19:23:11.053733+0000","last_became_peered":"2024-05-08T19:23:11.053733+0000","last_unstale":"2024-05-08T19:48:30.027857+0000","last_undegraded":"2024-05-08T19:48:30.027857+0000","last_fullsized":"2024-05-08T19:48:30.027857+0000","mapping_epoch":25,"log_start":"26'1500","ondisk_log_start":"26'1500","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6431,"log_dups_size":0,"ondisk_log_size":6431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:25.669682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2393664,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":453,"num_read_kb":17282,"num_write":5539,"num_write_kb":1020101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"26'6222","reported_seq":6249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:46.403274+0000","last_change":"2024-05-08T19:22:20.001272+0000","last_active":"2024-05-08T19:47:46.403274+0000","last_peered":"2024-05-08T19:47:46.403274+0000","last_clean":"2024-05-08T19:47:46.403274+0000","last_became_active":"2024-05-08T19:22:20.000981+0000","last_became_peered":"2024-05-08T19:22:20.000981+0000","last_unstale":"2024-05-08T19:47:46.403274+0000","last_undegraded":"2024-05-08T19:47:46.403274+0000","last_fullsized":"2024-05-08T19:47:46.403274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6222,"log_dups_size":0,"ondisk_log_size":6222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6225,"num_write_kb":45123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"26'2312","reported_seq":2338,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.863471+0000","last_change":"2024-05-08T19:22:20.446938+0000","last_active":"2024-05-08T19:48:29.863471+0000","last_peered":"2024-05-08T19:48:29.863471+0000","last_clean":"2024-05-08T19:48:29.863471+0000","last_became_active":"2024-05-08T19:22:20.446644+0000","last_became_peered":"2024-05-08T19:22:20.446644+0000","last_unstale":"2024-05-08T19:48:29.863471+0000","last_undegraded":"2024-05-08T19:48:29.863471+0000","last_fullsized":"2024-05-08T19:48:29.863471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2312,"log_dups_size":0,"ondisk_log_size":2312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:39:35.443674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"26'8282","reported_seq":8802,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.984044+0000","last_change":"2024-05-08T19:22:24.465089+0000","last_active":"2024-05-08T19:48:29.984044+0000","last_peered":"2024-05-08T19:48:29.984044+0000","last_clean":"2024-05-08T19:48:29.984044+0000","last_became_active":"2024-05-08T19:22:24.464178+0000","last_became_peered":"2024-05-08T19:22:24.464178+0000","last_unstale":"2024-05-08T19:48:29.984044+0000","last_undegraded":"2024-05-08T19:48:29.984044+0000","last_fullsized":"2024-05-08T19:48:29.984044+0000","mapping_epoch":22,"log_start":"26'1100","ondisk_log_start":"26'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7182,"log_dups_size":0,"ondisk_log_size":7182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2099376,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":495,"num_read_kb":27360,"num_write":5849,"num_write_kb":879779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'6726","reported_seq":6753,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.132356+0000","last_change":"2024-05-08T19:22:20.001300+0000","last_active":"2024-05-08T19:48:33.132356+0000","last_peered":"2024-05-08T19:48:33.132356+0000","last_clean":"2024-05-08T19:48:33.132356+0000","last_became_active":"2024-05-08T19:22:20.000985+0000","last_became_peered":"2024-05-08T19:22:20.000985+0000","last_unstale":"2024-05-08T19:48:33.132356+0000","last_undegraded":"2024-05-08T19:48:33.132356+0000","last_fullsized":"2024-05-08T19:48:33.132356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6726,"log_dups_size":0,"ondisk_log_size":6726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:50.426177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":6743,"num_write_kb":41824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'2300","reported_seq":2327,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.234932+0000","last_change":"2024-05-08T19:22:20.447801+0000","last_active":"2024-05-08T19:48:29.234932+0000","last_peered":"2024-05-08T19:48:29.234932+0000","last_clean":"2024-05-08T19:48:29.234932+0000","last_became_active":"2024-05-08T19:22:20.447538+0000","last_became_peered":"2024-05-08T19:22:20.447538+0000","last_unstale":"2024-05-08T19:48:29.234932+0000","last_undegraded":"2024-05-08T19:48:29.234932+0000","last_fullsized":"2024-05-08T19:48:29.234932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2300,"log_dups_size":0,"ondisk_log_size":2300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:14.706653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"26'8567","reported_seq":9109,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:34.309014+0000","last_change":"2024-05-08T19:22:24.479544+0000","last_active":"2024-05-08T19:48:34.309014+0000","last_peered":"2024-05-08T19:48:34.309014+0000","last_clean":"2024-05-08T19:48:34.309014+0000","last_became_active":"2024-05-08T19:22:24.479071+0000","last_became_peered":"2024-05-08T19:22:24.479071+0000","last_unstale":"2024-05-08T19:48:34.309014+0000","last_undegraded":"2024-05-08T19:48:34.309014+0000","last_fullsized":"2024-05-08T19:48:34.309014+0000","mapping_epoch":22,"log_start":"26'1203","ondisk_log_start":"26'1203","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7364,"log_dups_size":0,"ondisk_log_size":7364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:19.704360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1875558,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":517,"num_read_kb":30942,"num_write":6161,"num_write_kb":930944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'10871","reported_seq":11527,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.097575+0000","last_change":"2024-05-08T19:22:20.011799+0000","last_active":"2024-05-08T19:48:30.097575+0000","last_peered":"2024-05-08T19:48:30.097575+0000","last_clean":"2024-05-08T19:48:30.097575+0000","last_became_active":"2024-05-08T19:22:20.011331+0000","last_became_peered":"2024-05-08T19:22:20.011331+0000","last_unstale":"2024-05-08T19:48:30.097575+0000","last_undegraded":"2024-05-08T19:48:30.097575+0000","last_fullsized":"2024-05-08T19:48:30.097575+0000","mapping_epoch":17,"log_start":"26'2900","ondisk_log_start":"26'2900","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7971,"log_dups_size":0,"ondisk_log_size":7971,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":630,"num_read_kb":4505,"num_write":10866,"num_write_kb":72955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"26'2234","reported_seq":2260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.774011+0000","last_change":"2024-05-08T19:22:20.447583+0000","last_active":"2024-05-08T19:48:29.774011+0000","last_peered":"2024-05-08T19:48:29.774011+0000","last_clean":"2024-05-08T19:48:29.774011+0000","last_became_active":"2024-05-08T19:22:20.447243+0000","last_became_peered":"2024-05-08T19:22:20.447243+0000","last_unstale":"2024-05-08T19:48:29.774011+0000","last_undegraded":"2024-05-08T19:48:29.774011+0000","last_fullsized":"2024-05-08T19:48:29.774011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2234,"log_dups_size":0,"ondisk_log_size":2234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'8660","reported_seq":9061,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.915473+0000","last_change":"2024-05-08T19:22:24.615622+0000","last_active":"2024-05-08T19:48:29.915473+0000","last_peered":"2024-05-08T19:48:29.915473+0000","last_clean":"2024-05-08T19:48:29.915473+0000","last_became_active":"2024-05-08T19:22:24.614790+0000","last_became_peered":"2024-05-08T19:22:24.614790+0000","last_unstale":"2024-05-08T19:48:29.915473+0000","last_undegraded":"2024-05-08T19:48:29.915473+0000","last_fullsized":"2024-05-08T19:48:29.915473+0000","mapping_epoch":22,"log_start":"26'1126","ondisk_log_start":"26'1126","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7534,"log_dups_size":0,"ondisk_log_size":7534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2455380,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":377,"num_read_kb":22514,"num_write":6329,"num_write_kb":865965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"26'4995","reported_seq":5023,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:15.305590+0000","last_change":"2024-05-08T19:22:20.006367+0000","last_active":"2024-05-08T19:48:15.305590+0000","last_peered":"2024-05-08T19:48:15.305590+0000","last_clean":"2024-05-08T19:48:15.305590+0000","last_became_active":"2024-05-08T19:22:20.005738+0000","last_became_peered":"2024-05-08T19:22:20.005738+0000","last_unstale":"2024-05-08T19:48:15.305590+0000","last_undegraded":"2024-05-08T19:48:15.305590+0000","last_fullsized":"2024-05-08T19:48:15.305590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4995,"log_dups_size":0,"ondisk_log_size":4995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4997,"num_write_kb":36069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"26'2310","reported_seq":2337,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.334524+0000","last_change":"2024-05-08T19:22:20.448713+0000","last_active":"2024-05-08T19:48:29.334524+0000","last_peered":"2024-05-08T19:48:29.334524+0000","last_clean":"2024-05-08T19:48:29.334524+0000","last_became_active":"2024-05-08T19:22:20.448268+0000","last_became_peered":"2024-05-08T19:22:20.448268+0000","last_unstale":"2024-05-08T19:48:29.334524+0000","last_undegraded":"2024-05-08T19:48:29.334524+0000","last_fullsized":"2024-05-08T19:48:29.334524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2310,"log_dups_size":0,"ondisk_log_size":2310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"26'8177","reported_seq":8301,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.029291+0000","last_change":"2024-05-08T19:22:24.614076+0000","last_active":"2024-05-08T19:48:30.029291+0000","last_peered":"2024-05-08T19:48:30.029291+0000","last_clean":"2024-05-08T19:48:30.029291+0000","last_became_active":"2024-05-08T19:22:24.613698+0000","last_became_peered":"2024-05-08T19:22:24.613698+0000","last_unstale":"2024-05-08T19:48:30.029291+0000","last_undegraded":"2024-05-08T19:48:30.029291+0000","last_fullsized":"2024-05-08T19:48:30.029291+0000","mapping_epoch":22,"log_start":"26'1759","ondisk_log_start":"26'1759","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6418,"log_dups_size":0,"ondisk_log_size":6418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:26.030709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3032238,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":99,"num_read_kb":5304,"num_write":5797,"num_write_kb":1072126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'2636","reported_seq":2664,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:59.935072+0000","last_change":"2024-05-08T19:22:20.011480+0000","last_active":"2024-05-08T19:47:59.935072+0000","last_peered":"2024-05-08T19:47:59.935072+0000","last_clean":"2024-05-08T19:47:59.935072+0000","last_became_active":"2024-05-08T19:22:20.011188+0000","last_became_peered":"2024-05-08T19:22:20.011188+0000","last_unstale":"2024-05-08T19:47:59.935072+0000","last_undegraded":"2024-05-08T19:47:59.935072+0000","last_fullsized":"2024-05-08T19:47:59.935072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2636,"log_dups_size":0,"ondisk_log_size":2636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2643,"num_write_kb":22132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'2346","reported_seq":2373,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.933793+0000","last_change":"2024-05-08T19:22:20.455818+0000","last_active":"2024-05-08T19:48:29.933793+0000","last_peered":"2024-05-08T19:48:29.933793+0000","last_clean":"2024-05-08T19:48:29.933793+0000","last_became_active":"2024-05-08T19:22:20.455562+0000","last_became_peered":"2024-05-08T19:22:20.455562+0000","last_unstale":"2024-05-08T19:48:29.933793+0000","last_undegraded":"2024-05-08T19:48:29.933793+0000","last_fullsized":"2024-05-08T19:48:29.933793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2346,"log_dups_size":0,"ondisk_log_size":2346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"26'8195","reported_seq":8371,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.846935+0000","last_change":"2024-05-08T19:22:24.616812+0000","last_active":"2024-05-08T19:48:29.846935+0000","last_peered":"2024-05-08T19:48:29.846935+0000","last_clean":"2024-05-08T19:48:29.846935+0000","last_became_active":"2024-05-08T19:22:24.615618+0000","last_became_peered":"2024-05-08T19:22:24.615618+0000","last_unstale":"2024-05-08T19:48:29.846935+0000","last_undegraded":"2024-05-08T19:48:29.846935+0000","last_fullsized":"2024-05-08T19:48:29.846935+0000","mapping_epoch":22,"log_start":"26'1715","ondisk_log_start":"26'1715","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6480,"log_dups_size":0,"ondisk_log_size":6480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:21.559278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2601582,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":152,"num_read_kb":3194,"num_write":5693,"num_write_kb":833306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"26'3930","reported_seq":3958,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:59.629602+0000","last_change":"2024-05-08T19:22:20.004327+0000","last_active":"2024-05-08T19:47:59.629602+0000","last_peered":"2024-05-08T19:47:59.629602+0000","last_clean":"2024-05-08T19:47:59.629602+0000","last_became_active":"2024-05-08T19:22:20.003725+0000","last_became_peered":"2024-05-08T19:22:20.003725+0000","last_unstale":"2024-05-08T19:47:59.629602+0000","last_undegraded":"2024-05-08T19:47:59.629602+0000","last_fullsized":"2024-05-08T19:47:59.629602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":3930,"log_dups_size":0,"ondisk_log_size":3930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3928,"num_write_kb":31166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"26'2224","reported_seq":2251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.015918+0000","last_change":"2024-05-08T19:22:20.459536+0000","last_active":"2024-05-08T19:48:30.015918+0000","last_peered":"2024-05-08T19:48:30.015918+0000","last_clean":"2024-05-08T19:48:30.015918+0000","last_became_active":"2024-05-08T19:22:20.452496+0000","last_became_peered":"2024-05-08T19:22:20.452496+0000","last_unstale":"2024-05-08T19:48:30.015918+0000","last_undegraded":"2024-05-08T19:48:30.015918+0000","last_fullsized":"2024-05-08T19:48:30.015918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2224,"log_dups_size":0,"ondisk_log_size":2224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"26'8416","reported_seq":9020,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.914488+0000","last_change":"2024-05-08T19:22:24.478351+0000","last_active":"2024-05-08T19:48:29.914488+0000","last_peered":"2024-05-08T19:48:29.914488+0000","last_clean":"2024-05-08T19:48:29.914488+0000","last_became_active":"2024-05-08T19:22:24.477728+0000","last_became_peered":"2024-05-08T19:22:24.477728+0000","last_unstale":"2024-05-08T19:48:29.914488+0000","last_undegraded":"2024-05-08T19:48:29.914488+0000","last_fullsized":"2024-05-08T19:48:29.914488+0000","mapping_epoch":22,"log_start":"26'1217","ondisk_log_start":"26'1217","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7199,"log_dups_size":0,"ondisk_log_size":7199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2423580,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":580,"num_read_kb":39960,"num_write":5994,"num_write_kb":827712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"26'5263","reported_seq":5291,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.028947+0000","last_change":"2024-05-08T19:22:20.008346+0000","last_active":"2024-05-08T19:48:30.028947+0000","last_peered":"2024-05-08T19:48:30.028947+0000","last_clean":"2024-05-08T19:48:30.028947+0000","last_became_active":"2024-05-08T19:22:20.007985+0000","last_became_peered":"2024-05-08T19:22:20.007985+0000","last_unstale":"2024-05-08T19:48:30.028947+0000","last_undegraded":"2024-05-08T19:48:30.028947+0000","last_fullsized":"2024-05-08T19:48:30.028947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5263,"log_dups_size":0,"ondisk_log_size":5263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":5293,"num_write_kb":36936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"26'2341","reported_seq":2368,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.354119+0000","last_change":"2024-05-08T19:22:20.458860+0000","last_active":"2024-05-08T19:48:29.354119+0000","last_peered":"2024-05-08T19:48:29.354119+0000","last_clean":"2024-05-08T19:48:29.354119+0000","last_became_active":"2024-05-08T19:22:20.458588+0000","last_became_peered":"2024-05-08T19:22:20.458588+0000","last_unstale":"2024-05-08T19:48:29.354119+0000","last_undegraded":"2024-05-08T19:48:29.354119+0000","last_fullsized":"2024-05-08T19:48:29.354119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2341,"log_dups_size":0,"ondisk_log_size":2341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"26'8503","reported_seq":10172,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.005568+0000","last_change":"2024-05-08T19:22:24.464132+0000","last_active":"2024-05-08T19:48:30.005568+0000","last_peered":"2024-05-08T19:48:30.005568+0000","last_clean":"2024-05-08T19:48:30.005568+0000","last_became_active":"2024-05-08T19:22:24.463741+0000","last_became_peered":"2024-05-08T19:22:24.463741+0000","last_unstale":"2024-05-08T19:48:30.005568+0000","last_undegraded":"2024-05-08T19:48:30.005568+0000","last_fullsized":"2024-05-08T19:48:30.005568+0000","mapping_epoch":22,"log_start":"26'1304","ondisk_log_start":"26'1304","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7199,"log_dups_size":0,"ondisk_log_size":7199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:13.044112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2383830,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1644,"num_read_kb":83588,"num_write":6105,"num_write_kb":944540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"26'5910","reported_seq":5938,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.074638+0000","last_change":"2024-05-08T19:22:20.005994+0000","last_active":"2024-05-08T19:48:30.074638+0000","last_peered":"2024-05-08T19:48:30.074638+0000","last_clean":"2024-05-08T19:48:30.074638+0000","last_became_active":"2024-05-08T19:22:20.005680+0000","last_became_peered":"2024-05-08T19:22:20.005680+0000","last_unstale":"2024-05-08T19:48:30.074638+0000","last_undegraded":"2024-05-08T19:48:30.074638+0000","last_fullsized":"2024-05-08T19:48:30.074638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5910,"log_dups_size":0,"ondisk_log_size":5910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:18.387895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5919,"num_write_kb":40735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"26'2291","reported_seq":2318,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.993555+0000","last_change":"2024-05-08T19:22:20.449812+0000","last_active":"2024-05-08T19:48:29.993555+0000","last_peered":"2024-05-08T19:48:29.993555+0000","last_clean":"2024-05-08T19:48:29.993555+0000","last_became_active":"2024-05-08T19:22:20.449512+0000","last_became_peered":"2024-05-08T19:22:20.449512+0000","last_unstale":"2024-05-08T19:48:29.993555+0000","last_undegraded":"2024-05-08T19:48:29.993555+0000","last_fullsized":"2024-05-08T19:48:29.993555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2291,"log_dups_size":0,"ondisk_log_size":2291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"26'8815","reported_seq":9099,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:34.313420+0000","last_change":"2024-05-08T19:22:24.478647+0000","last_active":"2024-05-08T19:48:34.313420+0000","last_peered":"2024-05-08T19:48:34.313420+0000","last_clean":"2024-05-08T19:48:34.313420+0000","last_became_active":"2024-05-08T19:22:24.478248+0000","last_became_peered":"2024-05-08T19:22:24.478248+0000","last_unstale":"2024-05-08T19:48:34.313420+0000","last_undegraded":"2024-05-08T19:48:34.313420+0000","last_fullsized":"2024-05-08T19:48:34.313420+0000","mapping_epoch":22,"log_start":"26'1412","ondisk_log_start":"26'1412","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7403,"log_dups_size":0,"ondisk_log_size":7403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:26.651711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293278,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":258,"num_read_kb":14826,"num_write":6422,"num_write_kb":856300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"26'7014","reported_seq":7043,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.110756+0000","last_change":"2024-05-08T19:22:20.003344+0000","last_active":"2024-05-08T19:48:33.110756+0000","last_peered":"2024-05-08T19:48:33.110756+0000","last_clean":"2024-05-08T19:48:33.110756+0000","last_became_active":"2024-05-08T19:22:20.003055+0000","last_became_peered":"2024-05-08T19:22:20.003055+0000","last_unstale":"2024-05-08T19:48:33.110756+0000","last_undegraded":"2024-05-08T19:48:33.110756+0000","last_fullsized":"2024-05-08T19:48:33.110756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7014,"log_dups_size":0,"ondisk_log_size":7014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7021,"num_write_kb":53638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"26'2278","reported_seq":2306,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.646775+0000","last_change":"2024-05-08T19:22:20.450523+0000","last_active":"2024-05-08T19:48:29.646775+0000","last_peered":"2024-05-08T19:48:29.646775+0000","last_clean":"2024-05-08T19:48:29.646775+0000","last_became_active":"2024-05-08T19:22:20.449693+0000","last_became_peered":"2024-05-08T19:22:20.449693+0000","last_unstale":"2024-05-08T19:48:29.646775+0000","last_undegraded":"2024-05-08T19:48:29.646775+0000","last_fullsized":"2024-05-08T19:48:29.646775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2278,"log_dups_size":0,"ondisk_log_size":2278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'8976","reported_seq":9147,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:34.171129+0000","last_change":"2024-05-08T19:22:24.472926+0000","last_active":"2024-05-08T19:48:34.171129+0000","last_peered":"2024-05-08T19:48:34.171129+0000","last_clean":"2024-05-08T19:48:34.171129+0000","last_became_active":"2024-05-08T19:22:24.472518+0000","last_became_peered":"2024-05-08T19:22:24.472518+0000","last_unstale":"2024-05-08T19:48:34.171129+0000","last_undegraded":"2024-05-08T19:48:34.171129+0000","last_fullsized":"2024-05-08T19:48:34.171129+0000","mapping_epoch":22,"log_start":"26'1583","ondisk_log_start":"26'1583","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7393,"log_dups_size":0,"ondisk_log_size":7393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1743372,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":145,"num_read_kb":5460,"num_write":6541,"num_write_kb":1024036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"26'7864","reported_seq":7893,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.077571+0000","last_change":"2024-05-08T19:22:20.007824+0000","last_active":"2024-05-08T19:48:30.077571+0000","last_peered":"2024-05-08T19:48:30.077571+0000","last_clean":"2024-05-08T19:48:30.077571+0000","last_became_active":"2024-05-08T19:22:20.007542+0000","last_became_peered":"2024-05-08T19:22:20.007542+0000","last_unstale":"2024-05-08T19:48:30.077571+0000","last_undegraded":"2024-05-08T19:48:30.077571+0000","last_fullsized":"2024-05-08T19:48:30.077571+0000","mapping_epoch":17,"log_start":"26'300","ondisk_log_start":"26'300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7564,"log_dups_size":0,"ondisk_log_size":7564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7858,"num_write_kb":54448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'2297","reported_seq":2325,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.956239+0000","last_change":"2024-05-08T19:22:20.443326+0000","last_active":"2024-05-08T19:48:29.956239+0000","last_peered":"2024-05-08T19:48:29.956239+0000","last_clean":"2024-05-08T19:48:29.956239+0000","last_became_active":"2024-05-08T19:22:20.443049+0000","last_became_peered":"2024-05-08T19:22:20.443049+0000","last_unstale":"2024-05-08T19:48:29.956239+0000","last_undegraded":"2024-05-08T19:48:29.956239+0000","last_fullsized":"2024-05-08T19:48:29.956239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2297,"log_dups_size":0,"ondisk_log_size":2297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:04.174914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"26'8075","reported_seq":9057,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.886637+0000","last_change":"2024-05-08T19:23:11.532565+0000","last_active":"2024-05-08T19:48:29.886637+0000","last_peered":"2024-05-08T19:48:29.886637+0000","last_clean":"2024-05-08T19:48:29.886637+0000","last_became_active":"2024-05-08T19:23:11.532148+0000","last_became_peered":"2024-05-08T19:23:11.532148+0000","last_unstale":"2024-05-08T19:48:29.886637+0000","last_undegraded":"2024-05-08T19:48:29.886637+0000","last_fullsized":"2024-05-08T19:48:29.886637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":8075,"log_dups_size":0,"ondisk_log_size":8075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:14.273885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2771094,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":959,"num_read_kb":67642,"num_write":5630,"num_write_kb":895819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'2299","reported_seq":2327,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.255840+0000","last_change":"2024-05-08T19:22:20.449968+0000","last_active":"2024-05-08T19:48:33.255840+0000","last_peered":"2024-05-08T19:48:33.255840+0000","last_clean":"2024-05-08T19:48:33.255840+0000","last_became_active":"2024-05-08T19:22:20.449709+0000","last_became_peered":"2024-05-08T19:22:20.449709+0000","last_unstale":"2024-05-08T19:48:33.255840+0000","last_undegraded":"2024-05-08T19:48:33.255840+0000","last_fullsized":"2024-05-08T19:48:33.255840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2299,"log_dups_size":0,"ondisk_log_size":2299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'7712","reported_seq":8676,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.075764+0000","last_change":"2024-05-08T19:22:20.004708+0000","last_active":"2024-05-08T19:48:30.075764+0000","last_peered":"2024-05-08T19:48:30.075764+0000","last_clean":"2024-05-08T19:48:30.075764+0000","last_became_active":"2024-05-08T19:22:20.004404+0000","last_became_peered":"2024-05-08T19:22:20.004404+0000","last_unstale":"2024-05-08T19:48:30.075764+0000","last_undegraded":"2024-05-08T19:48:30.075764+0000","last_fullsized":"2024-05-08T19:48:30.075764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7712,"log_dups_size":0,"ondisk_log_size":7712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":935,"num_read_kb":4706,"num_write":7714,"num_write_kb":54235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"26'8447","reported_seq":9003,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.713721+0000","last_change":"2024-05-08T19:22:24.617952+0000","last_active":"2024-05-08T19:48:29.713721+0000","last_peered":"2024-05-08T19:48:29.713721+0000","last_clean":"2024-05-08T19:48:29.713721+0000","last_became_active":"2024-05-08T19:22:24.617627+0000","last_became_peered":"2024-05-08T19:22:24.617627+0000","last_unstale":"2024-05-08T19:48:29.713721+0000","last_undegraded":"2024-05-08T19:48:29.713721+0000","last_fullsized":"2024-05-08T19:48:29.713721+0000","mapping_epoch":22,"log_start":"26'474","ondisk_log_start":"26'474","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7973,"log_dups_size":0,"ondisk_log_size":7973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:57.825616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3804310,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":530,"num_read_kb":27006,"num_write":6108,"num_write_kb":958609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"26'2341","reported_seq":2369,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.962672+0000","last_change":"2024-05-08T19:22:20.447152+0000","last_active":"2024-05-08T19:48:29.962672+0000","last_peered":"2024-05-08T19:48:29.962672+0000","last_clean":"2024-05-08T19:48:29.962672+0000","last_became_active":"2024-05-08T19:22:20.446864+0000","last_became_peered":"2024-05-08T19:22:20.446864+0000","last_unstale":"2024-05-08T19:48:29.962672+0000","last_undegraded":"2024-05-08T19:48:29.962672+0000","last_fullsized":"2024-05-08T19:48:29.962672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2341,"log_dups_size":0,"ondisk_log_size":2341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'5126","reported_seq":5155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:24.156639+0000","last_change":"2024-05-08T19:22:20.003790+0000","last_active":"2024-05-08T19:47:24.156639+0000","last_peered":"2024-05-08T19:47:24.156639+0000","last_clean":"2024-05-08T19:47:24.156639+0000","last_became_active":"2024-05-08T19:22:20.003441+0000","last_became_peered":"2024-05-08T19:22:20.003441+0000","last_unstale":"2024-05-08T19:47:24.156639+0000","last_undegraded":"2024-05-08T19:47:24.156639+0000","last_fullsized":"2024-05-08T19:47:24.156639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5126,"log_dups_size":0,"ondisk_log_size":5126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5120,"num_write_kb":36122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:46:27.527762+0000","last_change":"2024-05-08T19:22:17.117278+0000","last_active":"2024-05-08T19:46:27.527762+0000","last_peered":"2024-05-08T19:46:27.527762+0000","last_clean":"2024-05-08T19:46:27.527762+0000","last_became_active":"2024-05-08T19:22:17.116272+0000","last_became_peered":"2024-05-08T19:22:17.116272+0000","last_unstale":"2024-05-08T19:46:27.527762+0000","last_undegraded":"2024-05-08T19:46:27.527762+0000","last_fullsized":"2024-05-08T19:46:27.527762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_clean_scrub_stamp":"2024-05-08T19:22:15.924359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:37.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'8629","reported_seq":8735,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.973317+0000","last_change":"2024-05-08T19:22:24.617594+0000","last_active":"2024-05-08T19:48:29.973317+0000","last_peered":"2024-05-08T19:48:29.973317+0000","last_clean":"2024-05-08T19:48:29.973317+0000","last_became_active":"2024-05-08T19:22:24.616486+0000","last_became_peered":"2024-05-08T19:22:24.616486+0000","last_unstale":"2024-05-08T19:48:29.973317+0000","last_undegraded":"2024-05-08T19:48:29.973317+0000","last_fullsized":"2024-05-08T19:48:29.973317+0000","mapping_epoch":22,"log_start":"26'1423","ondisk_log_start":"26'1423","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7206,"log_dups_size":0,"ondisk_log_size":7206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2775110,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":80,"num_read_kb":5028,"num_write":6226,"num_write_kb":895755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"26'2237","reported_seq":2265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.879418+0000","last_change":"2024-05-08T19:22:20.445458+0000","last_active":"2024-05-08T19:48:29.879418+0000","last_peered":"2024-05-08T19:48:29.879418+0000","last_clean":"2024-05-08T19:48:29.879418+0000","last_became_active":"2024-05-08T19:22:20.445191+0000","last_became_peered":"2024-05-08T19:22:20.445191+0000","last_unstale":"2024-05-08T19:48:29.879418+0000","last_undegraded":"2024-05-08T19:48:29.879418+0000","last_fullsized":"2024-05-08T19:48:29.879418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'8074","reported_seq":8104,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.077436+0000","last_change":"2024-05-08T19:22:20.015288+0000","last_active":"2024-05-08T19:48:30.077436+0000","last_peered":"2024-05-08T19:48:30.077436+0000","last_clean":"2024-05-08T19:48:30.077436+0000","last_became_active":"2024-05-08T19:22:20.015062+0000","last_became_peered":"2024-05-08T19:22:20.015062+0000","last_unstale":"2024-05-08T19:48:30.077436+0000","last_undegraded":"2024-05-08T19:48:30.077436+0000","last_fullsized":"2024-05-08T19:48:30.077436+0000","mapping_epoch":17,"log_start":"26'1200","ondisk_log_start":"26'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6874,"log_dups_size":0,"ondisk_log_size":6874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:12.577297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8079,"num_write_kb":54571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'8481","reported_seq":9480,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.944395+0000","last_change":"2024-05-08T19:22:24.614066+0000","last_active":"2024-05-08T19:48:29.944395+0000","last_peered":"2024-05-08T19:48:29.944395+0000","last_clean":"2024-05-08T19:48:29.944395+0000","last_became_active":"2024-05-08T19:22:24.613661+0000","last_became_peered":"2024-05-08T19:22:24.613661+0000","last_unstale":"2024-05-08T19:48:29.944395+0000","last_undegraded":"2024-05-08T19:48:29.944395+0000","last_fullsized":"2024-05-08T19:48:29.944395+0000","mapping_epoch":22,"log_start":"26'1305","ondisk_log_start":"26'1305","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7176,"log_dups_size":0,"ondisk_log_size":7176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2646858,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":973,"num_read_kb":68996,"num_write":6051,"num_write_kb":873899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"26'6274","reported_seq":6303,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:31.440405+0000","last_change":"2024-05-08T19:22:20.015193+0000","last_active":"2024-05-08T19:48:31.440405+0000","last_peered":"2024-05-08T19:48:31.440405+0000","last_clean":"2024-05-08T19:48:31.440405+0000","last_became_active":"2024-05-08T19:22:20.014926+0000","last_became_peered":"2024-05-08T19:22:20.014926+0000","last_unstale":"2024-05-08T19:48:31.440405+0000","last_undegraded":"2024-05-08T19:48:31.440405+0000","last_fullsized":"2024-05-08T19:48:31.440405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6274,"log_dups_size":0,"ondisk_log_size":6274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:13.701454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4708592,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6270,"num_write_kb":41579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"26'2378","reported_seq":2406,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.255092+0000","last_change":"2024-05-08T19:22:20.446453+0000","last_active":"2024-05-08T19:48:33.255092+0000","last_peered":"2024-05-08T19:48:33.255092+0000","last_clean":"2024-05-08T19:48:33.255092+0000","last_became_active":"2024-05-08T19:22:20.446194+0000","last_became_peered":"2024-05-08T19:22:20.446194+0000","last_unstale":"2024-05-08T19:48:33.255092+0000","last_undegraded":"2024-05-08T19:48:33.255092+0000","last_fullsized":"2024-05-08T19:48:33.255092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2378,"log_dups_size":0,"ondisk_log_size":2378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'8334","reported_seq":8728,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.937236+0000","last_change":"2024-05-08T19:22:24.615481+0000","last_active":"2024-05-08T19:48:29.937236+0000","last_peered":"2024-05-08T19:48:29.937236+0000","last_clean":"2024-05-08T19:48:29.937236+0000","last_became_active":"2024-05-08T19:22:24.615069+0000","last_became_peered":"2024-05-08T19:22:24.615069+0000","last_unstale":"2024-05-08T19:48:29.937236+0000","last_undegraded":"2024-05-08T19:48:29.937236+0000","last_fullsized":"2024-05-08T19:48:29.937236+0000","mapping_epoch":22,"log_start":"26'1929","ondisk_log_start":"26'1929","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6405,"log_dups_size":0,"ondisk_log_size":6405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:28.211177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2253528,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":368,"num_read_kb":23786,"num_write":5957,"num_write_kb":964471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'5783","reported_seq":6303,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:34.095723+0000","last_change":"2024-05-08T19:22:20.001642+0000","last_active":"2024-05-08T19:48:34.095723+0000","last_peered":"2024-05-08T19:48:34.095723+0000","last_clean":"2024-05-08T19:48:34.095723+0000","last_became_active":"2024-05-08T19:22:20.001339+0000","last_became_peered":"2024-05-08T19:22:20.001339+0000","last_unstale":"2024-05-08T19:48:34.095723+0000","last_undegraded":"2024-05-08T19:48:34.095723+0000","last_fullsized":"2024-05-08T19:48:34.095723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5783,"log_dups_size":0,"ondisk_log_size":5783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11721836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":3579,"num_write":6367,"num_write_kb":46119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"26'2240","reported_seq":2261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:34.315530+0000","last_change":"2024-05-08T19:23:11.387164+0000","last_active":"2024-05-08T19:48:34.315530+0000","last_peered":"2024-05-08T19:48:34.315530+0000","last_clean":"2024-05-08T19:48:34.315530+0000","last_became_active":"2024-05-08T19:23:11.386882+0000","last_became_peered":"2024-05-08T19:23:11.386882+0000","last_unstale":"2024-05-08T19:48:34.315530+0000","last_undegraded":"2024-05-08T19:48:34.315530+0000","last_fullsized":"2024-05-08T19:48:34.315530+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2240,"log_dups_size":0,"ondisk_log_size":2240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:25.968464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"26'8422","reported_seq":8851,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.886935+0000","last_change":"2024-05-08T19:22:24.614812+0000","last_active":"2024-05-08T19:48:29.886935+0000","last_peered":"2024-05-08T19:48:29.886935+0000","last_clean":"2024-05-08T19:48:29.886935+0000","last_became_active":"2024-05-08T19:22:24.614433+0000","last_became_peered":"2024-05-08T19:22:24.614433+0000","last_unstale":"2024-05-08T19:48:29.886935+0000","last_undegraded":"2024-05-08T19:48:29.886935+0000","last_fullsized":"2024-05-08T19:48:29.886935+0000","mapping_epoch":22,"log_start":"26'1215","ondisk_log_start":"26'1215","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7207,"log_dups_size":0,"ondisk_log_size":7207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:07.924115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2504518,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":403,"num_read_kb":32316,"num_write":6034,"num_write_kb":878060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'4075","reported_seq":4104,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:14.643108+0000","last_change":"2024-05-08T19:22:20.012651+0000","last_active":"2024-05-08T19:48:14.643108+0000","last_peered":"2024-05-08T19:48:14.643108+0000","last_clean":"2024-05-08T19:48:14.643108+0000","last_became_active":"2024-05-08T19:22:20.012383+0000","last_became_peered":"2024-05-08T19:22:20.012383+0000","last_unstale":"2024-05-08T19:48:14.643108+0000","last_undegraded":"2024-05-08T19:48:14.643108+0000","last_fullsized":"2024-05-08T19:48:14.643108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4075,"log_dups_size":0,"ondisk_log_size":4075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":4092,"num_write_kb":27507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'2277","reported_seq":2305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.968360+0000","last_change":"2024-05-08T19:22:20.436459+0000","last_active":"2024-05-08T19:48:29.968360+0000","last_peered":"2024-05-08T19:48:29.968360+0000","last_clean":"2024-05-08T19:48:29.968360+0000","last_became_active":"2024-05-08T19:22:20.435680+0000","last_became_peered":"2024-05-08T19:22:20.435680+0000","last_unstale":"2024-05-08T19:48:29.968360+0000","last_undegraded":"2024-05-08T19:48:29.968360+0000","last_fullsized":"2024-05-08T19:48:29.968360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2277,"log_dups_size":0,"ondisk_log_size":2277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:09.166091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"26'8799","reported_seq":9037,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.021055+0000","last_change":"2024-05-08T19:22:24.473208+0000","last_active":"2024-05-08T19:48:30.021055+0000","last_peered":"2024-05-08T19:48:30.021055+0000","last_clean":"2024-05-08T19:48:30.021055+0000","last_became_active":"2024-05-08T19:22:24.472782+0000","last_became_peered":"2024-05-08T19:22:24.472782+0000","last_unstale":"2024-05-08T19:48:30.021055+0000","last_undegraded":"2024-05-08T19:48:30.021055+0000","last_fullsized":"2024-05-08T19:48:30.021055+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7161,"log_dups_size":0,"ondisk_log_size":7161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823624,"num_objects":21,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":213,"num_read_kb":12280,"num_write":6434,"num_write_kb":1036595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2843","reported_seq":2872,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:22.752115+0000","last_change":"2024-05-08T19:22:20.014848+0000","last_active":"2024-05-08T19:48:22.752115+0000","last_peered":"2024-05-08T19:48:22.752115+0000","last_clean":"2024-05-08T19:48:22.752115+0000","last_became_active":"2024-05-08T19:22:20.013739+0000","last_became_peered":"2024-05-08T19:22:20.013739+0000","last_unstale":"2024-05-08T19:48:22.752115+0000","last_undegraded":"2024-05-08T19:48:22.752115+0000","last_fullsized":"2024-05-08T19:48:22.752115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2843,"log_dups_size":0,"ondisk_log_size":2843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:03.169714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2846,"num_write_kb":22358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"26'2320","reported_seq":2347,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.797694+0000","last_change":"2024-05-08T19:22:20.447451+0000","last_active":"2024-05-08T19:48:29.797694+0000","last_peered":"2024-05-08T19:48:29.797694+0000","last_clean":"2024-05-08T19:48:29.797694+0000","last_became_active":"2024-05-08T19:22:20.447180+0000","last_became_peered":"2024-05-08T19:22:20.447180+0000","last_unstale":"2024-05-08T19:48:29.797694+0000","last_undegraded":"2024-05-08T19:48:29.797694+0000","last_fullsized":"2024-05-08T19:48:29.797694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2320,"log_dups_size":0,"ondisk_log_size":2320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"26'8907","reported_seq":9877,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:34.363728+0000","last_change":"2024-05-08T19:22:24.614091+0000","last_active":"2024-05-08T19:48:34.363728+0000","last_peered":"2024-05-08T19:48:34.363728+0000","last_clean":"2024-05-08T19:48:34.363728+0000","last_became_active":"2024-05-08T19:22:24.613677+0000","last_became_peered":"2024-05-08T19:22:24.613677+0000","last_unstale":"2024-05-08T19:48:34.363728+0000","last_undegraded":"2024-05-08T19:48:34.363728+0000","last_fullsized":"2024-05-08T19:48:34.363728+0000","mapping_epoch":22,"log_start":"26'1529","ondisk_log_start":"26'1529","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7378,"log_dups_size":0,"ondisk_log_size":7378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:50.011809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1365942,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":945,"num_read_kb":70780,"num_write":6605,"num_write_kb":1028558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"26'4273","reported_seq":4302,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.425341+0000","last_change":"2024-05-08T19:22:20.011528+0000","last_active":"2024-05-08T19:48:29.425341+0000","last_peered":"2024-05-08T19:48:29.425341+0000","last_clean":"2024-05-08T19:48:29.425341+0000","last_became_active":"2024-05-08T19:22:20.011262+0000","last_became_peered":"2024-05-08T19:22:20.011262+0000","last_unstale":"2024-05-08T19:48:29.425341+0000","last_undegraded":"2024-05-08T19:48:29.425341+0000","last_fullsized":"2024-05-08T19:48:29.425341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4273,"log_dups_size":0,"ondisk_log_size":4273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4270,"num_write_kb":27446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"26'2404","reported_seq":2432,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.112747+0000","last_change":"2024-05-08T19:22:20.438689+0000","last_active":"2024-05-08T19:48:30.112747+0000","last_peered":"2024-05-08T19:48:30.112747+0000","last_clean":"2024-05-08T19:48:30.112747+0000","last_became_active":"2024-05-08T19:22:20.438434+0000","last_became_peered":"2024-05-08T19:22:20.438434+0000","last_unstale":"2024-05-08T19:48:30.112747+0000","last_undegraded":"2024-05-08T19:48:30.112747+0000","last_fullsized":"2024-05-08T19:48:30.112747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2404,"log_dups_size":0,"ondisk_log_size":2404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"26'8228","reported_seq":8492,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.660349+0000","last_change":"2024-05-08T19:22:24.473569+0000","last_active":"2024-05-08T19:48:29.660349+0000","last_peered":"2024-05-08T19:48:29.660349+0000","last_clean":"2024-05-08T19:48:29.660349+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:48:29.660349+0000","last_undegraded":"2024-05-08T19:48:29.660349+0000","last_fullsized":"2024-05-08T19:48:29.660349+0000","mapping_epoch":22,"log_start":"26'1006","ondisk_log_start":"26'1006","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7222,"log_dups_size":0,"ondisk_log_size":7222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:22.875469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1713996,"num_objects":21,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":239,"num_read_kb":13756,"num_write":5760,"num_write_kb":975965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"26'7369","reported_seq":7398,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.103625+0000","last_change":"2024-05-08T19:22:20.007101+0000","last_active":"2024-05-08T19:48:30.103625+0000","last_peered":"2024-05-08T19:48:30.103625+0000","last_clean":"2024-05-08T19:48:30.103625+0000","last_became_active":"2024-05-08T19:22:20.006772+0000","last_became_peered":"2024-05-08T19:22:20.006772+0000","last_unstale":"2024-05-08T19:48:30.103625+0000","last_undegraded":"2024-05-08T19:48:30.103625+0000","last_fullsized":"2024-05-08T19:48:30.103625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7369,"log_dups_size":0,"ondisk_log_size":7369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:23.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7364,"num_write_kb":54049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"26'2320","reported_seq":2347,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.910477+0000","last_change":"2024-05-08T19:22:20.436696+0000","last_active":"2024-05-08T19:48:29.910477+0000","last_peered":"2024-05-08T19:48:29.910477+0000","last_clean":"2024-05-08T19:48:29.910477+0000","last_became_active":"2024-05-08T19:22:20.436373+0000","last_became_peered":"2024-05-08T19:22:20.436373+0000","last_unstale":"2024-05-08T19:48:29.910477+0000","last_undegraded":"2024-05-08T19:48:29.910477+0000","last_fullsized":"2024-05-08T19:48:29.910477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2320,"log_dups_size":0,"ondisk_log_size":2320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"26'8784","reported_seq":9412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.660298+0000","last_change":"2024-05-08T19:22:24.478232+0000","last_active":"2024-05-08T19:48:29.660298+0000","last_peered":"2024-05-08T19:48:29.660298+0000","last_clean":"2024-05-08T19:48:29.660298+0000","last_became_active":"2024-05-08T19:22:24.477941+0000","last_became_peered":"2024-05-08T19:22:24.477941+0000","last_unstale":"2024-05-08T19:48:29.660298+0000","last_undegraded":"2024-05-08T19:48:29.660298+0000","last_fullsized":"2024-05-08T19:48:29.660298+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7146,"log_dups_size":0,"ondisk_log_size":7146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2431530,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":603,"num_read_kb":28586,"num_write":6306,"num_write_kb":901267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"26'6175","reported_seq":6203,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.042604+0000","last_change":"2024-05-08T19:22:20.014076+0000","last_active":"2024-05-08T19:48:30.042604+0000","last_peered":"2024-05-08T19:48:30.042604+0000","last_clean":"2024-05-08T19:48:30.042604+0000","last_became_active":"2024-05-08T19:22:20.013748+0000","last_became_peered":"2024-05-08T19:22:20.013748+0000","last_unstale":"2024-05-08T19:48:30.042604+0000","last_undegraded":"2024-05-08T19:48:30.042604+0000","last_fullsized":"2024-05-08T19:48:30.042604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6175,"log_dups_size":0,"ondisk_log_size":6175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:50.426177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6195,"num_write_kb":41171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"26'2324","reported_seq":2351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.744272+0000","last_change":"2024-05-08T19:22:20.457103+0000","last_active":"2024-05-08T19:48:29.744272+0000","last_peered":"2024-05-08T19:48:29.744272+0000","last_clean":"2024-05-08T19:48:29.744272+0000","last_became_active":"2024-05-08T19:22:20.456850+0000","last_became_peered":"2024-05-08T19:22:20.456850+0000","last_unstale":"2024-05-08T19:48:29.744272+0000","last_undegraded":"2024-05-08T19:48:29.744272+0000","last_fullsized":"2024-05-08T19:48:29.744272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"26'8380","reported_seq":8822,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.028471+0000","last_change":"2024-05-08T19:22:24.614410+0000","last_active":"2024-05-08T19:48:30.028471+0000","last_peered":"2024-05-08T19:48:30.028471+0000","last_clean":"2024-05-08T19:48:30.028471+0000","last_became_active":"2024-05-08T19:22:24.613904+0000","last_became_peered":"2024-05-08T19:22:24.613904+0000","last_unstale":"2024-05-08T19:48:30.028471+0000","last_undegraded":"2024-05-08T19:48:30.028471+0000","last_fullsized":"2024-05-08T19:48:30.028471+0000","mapping_epoch":22,"log_start":"26'412","ondisk_log_start":"26'412","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7968,"log_dups_size":0,"ondisk_log_size":7968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:03.465351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981436,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":417,"num_read_kb":29592,"num_write":5975,"num_write_kb":842872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"26'8391","reported_seq":8419,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.053316+0000","last_change":"2024-05-08T19:22:20.000763+0000","last_active":"2024-05-08T19:48:30.053316+0000","last_peered":"2024-05-08T19:48:30.053316+0000","last_clean":"2024-05-08T19:48:30.053316+0000","last_became_active":"2024-05-08T19:22:20.000454+0000","last_became_peered":"2024-05-08T19:22:20.000454+0000","last_unstale":"2024-05-08T19:48:30.053316+0000","last_undegraded":"2024-05-08T19:48:30.053316+0000","last_fullsized":"2024-05-08T19:48:30.053316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":8391,"log_dups_size":0,"ondisk_log_size":8391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8387,"num_write_kb":54739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'2283","reported_seq":2310,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.616481+0000","last_change":"2024-05-08T19:22:20.456485+0000","last_active":"2024-05-08T19:48:29.616481+0000","last_peered":"2024-05-08T19:48:29.616481+0000","last_clean":"2024-05-08T19:48:29.616481+0000","last_became_active":"2024-05-08T19:22:20.456225+0000","last_became_peered":"2024-05-08T19:22:20.456225+0000","last_unstale":"2024-05-08T19:48:29.616481+0000","last_undegraded":"2024-05-08T19:48:29.616481+0000","last_fullsized":"2024-05-08T19:48:29.616481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2283,"log_dups_size":0,"ondisk_log_size":2283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"26'8581","reported_seq":9400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.098204+0000","last_change":"2024-05-08T19:22:24.473117+0000","last_active":"2024-05-08T19:48:30.098204+0000","last_peered":"2024-05-08T19:48:30.098204+0000","last_clean":"2024-05-08T19:48:30.098204+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:48:30.098204+0000","last_undegraded":"2024-05-08T19:48:30.098204+0000","last_fullsized":"2024-05-08T19:48:30.098204+0000","mapping_epoch":22,"log_start":"26'1358","ondisk_log_start":"26'1358","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7223,"log_dups_size":0,"ondisk_log_size":7223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1783122,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":794,"num_read_kb":57832,"num_write":6077,"num_write_kb":1028205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'7804","reported_seq":7832,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.092708+0000","last_change":"2024-05-08T19:22:20.006312+0000","last_active":"2024-05-08T19:48:30.092708+0000","last_peered":"2024-05-08T19:48:30.092708+0000","last_clean":"2024-05-08T19:48:30.092708+0000","last_became_active":"2024-05-08T19:22:20.005996+0000","last_became_peered":"2024-05-08T19:22:20.005996+0000","last_unstale":"2024-05-08T19:48:30.092708+0000","last_undegraded":"2024-05-08T19:48:30.092708+0000","last_fullsized":"2024-05-08T19:48:30.092708+0000","mapping_epoch":17,"log_start":"26'400","ondisk_log_start":"26'400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7404,"log_dups_size":0,"ondisk_log_size":7404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:13.701454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7797,"num_write_kb":54350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"26'2288","reported_seq":2315,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.619437+0000","last_change":"2024-05-08T19:22:20.452861+0000","last_active":"2024-05-08T19:48:29.619437+0000","last_peered":"2024-05-08T19:48:29.619437+0000","last_clean":"2024-05-08T19:48:29.619437+0000","last_became_active":"2024-05-08T19:22:20.452600+0000","last_became_peered":"2024-05-08T19:22:20.452600+0000","last_unstale":"2024-05-08T19:48:29.619437+0000","last_undegraded":"2024-05-08T19:48:29.619437+0000","last_fullsized":"2024-05-08T19:48:29.619437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2288,"log_dups_size":0,"ondisk_log_size":2288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"26'8431","reported_seq":9147,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.067381+0000","last_change":"2024-05-08T19:22:24.614345+0000","last_active":"2024-05-08T19:48:30.067381+0000","last_peered":"2024-05-08T19:48:30.067381+0000","last_clean":"2024-05-08T19:48:30.067381+0000","last_became_active":"2024-05-08T19:22:24.613948+0000","last_became_peered":"2024-05-08T19:22:24.613948+0000","last_unstale":"2024-05-08T19:48:30.067381+0000","last_undegraded":"2024-05-08T19:48:30.067381+0000","last_fullsized":"2024-05-08T19:48:30.067381+0000","mapping_epoch":22,"log_start":"26'835","ondisk_log_start":"26'835","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7596,"log_dups_size":0,"ondisk_log_size":7596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4095684,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":690,"num_read_kb":34094,"num_write":5981,"num_write_kb":938401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"26'9148","reported_seq":9176,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:26.399812+0000","last_change":"2024-05-08T19:22:20.004844+0000","last_active":"2024-05-08T19:48:26.399812+0000","last_peered":"2024-05-08T19:48:26.399812+0000","last_clean":"2024-05-08T19:48:26.399812+0000","last_became_active":"2024-05-08T19:22:20.004254+0000","last_became_peered":"2024-05-08T19:22:20.004254+0000","last_unstale":"2024-05-08T19:48:26.399812+0000","last_undegraded":"2024-05-08T19:48:26.399812+0000","last_fullsized":"2024-05-08T19:48:26.399812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":9148,"log_dups_size":0,"ondisk_log_size":9148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":9138,"num_write_kb":67371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'2193","reported_seq":2220,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.909023+0000","last_change":"2024-05-08T19:22:20.455712+0000","last_active":"2024-05-08T19:48:29.909023+0000","last_peered":"2024-05-08T19:48:29.909023+0000","last_clean":"2024-05-08T19:48:29.909023+0000","last_became_active":"2024-05-08T19:22:20.455493+0000","last_became_peered":"2024-05-08T19:22:20.455493+0000","last_unstale":"2024-05-08T19:48:29.909023+0000","last_undegraded":"2024-05-08T19:48:29.909023+0000","last_fullsized":"2024-05-08T19:48:29.909023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2193,"log_dups_size":0,"ondisk_log_size":2193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:28.743156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"26'2244","reported_seq":2272,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.842605+0000","last_change":"2024-05-08T19:22:20.459104+0000","last_active":"2024-05-08T19:48:29.842605+0000","last_peered":"2024-05-08T19:48:29.842605+0000","last_clean":"2024-05-08T19:48:29.842605+0000","last_became_active":"2024-05-08T19:22:20.452169+0000","last_became_peered":"2024-05-08T19:22:20.452169+0000","last_unstale":"2024-05-08T19:48:29.842605+0000","last_undegraded":"2024-05-08T19:48:29.842605+0000","last_fullsized":"2024-05-08T19:48:29.842605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2244,"log_dups_size":0,"ondisk_log_size":2244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'2337","reported_seq":2365,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.234543+0000","last_change":"2024-05-08T19:22:20.449335+0000","last_active":"2024-05-08T19:48:29.234543+0000","last_peered":"2024-05-08T19:48:29.234543+0000","last_clean":"2024-05-08T19:48:29.234543+0000","last_became_active":"2024-05-08T19:22:20.449047+0000","last_became_peered":"2024-05-08T19:22:20.449047+0000","last_unstale":"2024-05-08T19:48:29.234543+0000","last_undegraded":"2024-05-08T19:48:29.234543+0000","last_fullsized":"2024-05-08T19:48:29.234543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'2232","reported_seq":2260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.535516+0000","last_change":"2024-05-08T19:22:20.452192+0000","last_active":"2024-05-08T19:48:29.535516+0000","last_peered":"2024-05-08T19:48:29.535516+0000","last_clean":"2024-05-08T19:48:29.535516+0000","last_became_active":"2024-05-08T19:22:20.451625+0000","last_became_peered":"2024-05-08T19:22:20.451625+0000","last_unstale":"2024-05-08T19:48:29.535516+0000","last_undegraded":"2024-05-08T19:48:29.535516+0000","last_fullsized":"2024-05-08T19:48:29.535516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2232,"log_dups_size":0,"ondisk_log_size":2232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'2349","reported_seq":2385,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.790912+0000","last_change":"2024-05-08T19:23:11.054094+0000","last_active":"2024-05-08T19:48:29.790912+0000","last_peered":"2024-05-08T19:48:29.790912+0000","last_clean":"2024-05-08T19:48:29.790912+0000","last_became_active":"2024-05-08T19:23:11.053750+0000","last_became_peered":"2024-05-08T19:23:11.053750+0000","last_unstale":"2024-05-08T19:48:29.790912+0000","last_undegraded":"2024-05-08T19:48:29.790912+0000","last_fullsized":"2024-05-08T19:48:29.790912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:25.968464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'2305","reported_seq":2333,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.339458+0000","last_change":"2024-05-08T19:22:20.444479+0000","last_active":"2024-05-08T19:48:29.339458+0000","last_peered":"2024-05-08T19:48:29.339458+0000","last_clean":"2024-05-08T19:48:29.339458+0000","last_became_active":"2024-05-08T19:22:20.444219+0000","last_became_peered":"2024-05-08T19:22:20.444219+0000","last_unstale":"2024-05-08T19:48:29.339458+0000","last_undegraded":"2024-05-08T19:48:29.339458+0000","last_fullsized":"2024-05-08T19:48:29.339458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2305,"log_dups_size":0,"ondisk_log_size":2305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'2216","reported_seq":2244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.253366+0000","last_change":"2024-05-08T19:22:20.436874+0000","last_active":"2024-05-08T19:48:33.253366+0000","last_peered":"2024-05-08T19:48:33.253366+0000","last_clean":"2024-05-08T19:48:33.253366+0000","last_became_active":"2024-05-08T19:22:20.436626+0000","last_became_peered":"2024-05-08T19:22:20.436626+0000","last_unstale":"2024-05-08T19:48:33.253366+0000","last_undegraded":"2024-05-08T19:48:33.253366+0000","last_fullsized":"2024-05-08T19:48:33.253366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2216,"log_dups_size":0,"ondisk_log_size":2216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'2323","reported_seq":2351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.917145+0000","last_change":"2024-05-08T19:22:20.462445+0000","last_active":"2024-05-08T19:48:29.917145+0000","last_peered":"2024-05-08T19:48:29.917145+0000","last_clean":"2024-05-08T19:48:29.917145+0000","last_became_active":"2024-05-08T19:22:20.461547+0000","last_became_peered":"2024-05-08T19:22:20.461547+0000","last_unstale":"2024-05-08T19:48:29.917145+0000","last_undegraded":"2024-05-08T19:48:29.917145+0000","last_fullsized":"2024-05-08T19:48:29.917145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2323,"log_dups_size":0,"ondisk_log_size":2323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'2302","reported_seq":2329,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.537782+0000","last_change":"2024-05-08T19:22:20.443498+0000","last_active":"2024-05-08T19:48:29.537782+0000","last_peered":"2024-05-08T19:48:29.537782+0000","last_clean":"2024-05-08T19:48:29.537782+0000","last_became_active":"2024-05-08T19:22:20.442667+0000","last_became_peered":"2024-05-08T19:22:20.442667+0000","last_unstale":"2024-05-08T19:48:29.537782+0000","last_undegraded":"2024-05-08T19:48:29.537782+0000","last_fullsized":"2024-05-08T19:48:29.537782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2302,"log_dups_size":0,"ondisk_log_size":2302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'2260","reported_seq":2287,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.792032+0000","last_change":"2024-05-08T19:22:20.448722+0000","last_active":"2024-05-08T19:48:29.792032+0000","last_peered":"2024-05-08T19:48:29.792032+0000","last_clean":"2024-05-08T19:48:29.792032+0000","last_became_active":"2024-05-08T19:22:20.448449+0000","last_became_peered":"2024-05-08T19:22:20.448449+0000","last_unstale":"2024-05-08T19:48:29.792032+0000","last_undegraded":"2024-05-08T19:48:29.792032+0000","last_fullsized":"2024-05-08T19:48:29.792032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2260,"log_dups_size":0,"ondisk_log_size":2260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'2259","reported_seq":2286,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.987384+0000","last_change":"2024-05-08T19:22:20.450677+0000","last_active":"2024-05-08T19:48:29.987384+0000","last_peered":"2024-05-08T19:48:29.987384+0000","last_clean":"2024-05-08T19:48:29.987384+0000","last_became_active":"2024-05-08T19:22:20.450217+0000","last_became_peered":"2024-05-08T19:22:20.450217+0000","last_unstale":"2024-05-08T19:48:29.987384+0000","last_undegraded":"2024-05-08T19:48:29.987384+0000","last_fullsized":"2024-05-08T19:48:29.987384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2259,"log_dups_size":0,"ondisk_log_size":2259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'2292","reported_seq":2319,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.877227+0000","last_change":"2024-05-08T19:22:20.453450+0000","last_active":"2024-05-08T19:48:29.877227+0000","last_peered":"2024-05-08T19:48:29.877227+0000","last_clean":"2024-05-08T19:48:29.877227+0000","last_became_active":"2024-05-08T19:22:20.453191+0000","last_became_peered":"2024-05-08T19:22:20.453191+0000","last_unstale":"2024-05-08T19:48:29.877227+0000","last_undegraded":"2024-05-08T19:48:29.877227+0000","last_fullsized":"2024-05-08T19:48:29.877227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2292,"log_dups_size":0,"ondisk_log_size":2292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'2331","reported_seq":2358,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.913762+0000","last_change":"2024-05-08T19:22:20.452591+0000","last_active":"2024-05-08T19:48:29.913762+0000","last_peered":"2024-05-08T19:48:29.913762+0000","last_clean":"2024-05-08T19:48:29.913762+0000","last_became_active":"2024-05-08T19:22:20.451209+0000","last_became_peered":"2024-05-08T19:22:20.451209+0000","last_unstale":"2024-05-08T19:48:29.913762+0000","last_undegraded":"2024-05-08T19:48:29.913762+0000","last_fullsized":"2024-05-08T19:48:29.913762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2331,"log_dups_size":0,"ondisk_log_size":2331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'2333","reported_seq":2360,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:29.457862+0000","last_change":"2024-05-08T19:22:20.461584+0000","last_active":"2024-05-08T19:48:29.457862+0000","last_peered":"2024-05-08T19:48:29.457862+0000","last_clean":"2024-05-08T19:48:29.457862+0000","last_became_active":"2024-05-08T19:22:20.461097+0000","last_became_peered":"2024-05-08T19:22:20.461097+0000","last_unstale":"2024-05-08T19:48:29.457862+0000","last_undegraded":"2024-05-08T19:48:29.457862+0000","last_fullsized":"2024-05-08T19:48:29.457862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2333,"log_dups_size":0,"ondisk_log_size":2333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":77099303,"num_objects":914,"num_object_clones":0,"num_object_copies":3656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":914,"num_whiteouts":0,"num_read":18592,"num_read_kb":1141288,"num_write":193959,"num_write_kb":30180301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":30146560,"data_stored":163069952,"data_compressed":7706303,"data_compressed_allocated":15364096,"data_compressed_original":148287488,"omap_allocated":0,"internal_metadata":0},"log_size":231066,"ondisk_log_size":231066,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":665,"num_object_clones":0,"num_object_copies":1330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":665,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1773,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146757,"ondisk_log_size":146757,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":247118618,"num_objects":123,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":2935,"num_read_kb":17425,"num_write":211882,"num_write_kb":1495245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":337993728,"data_stored":498315534,"data_compressed":49204011,"data_compressed_allocated":72843264,"data_compressed_original":233226240,"omap_allocated":0,"internal_metadata":0},"log_size":196133,"ondisk_log_size":196133,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575166,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":907676,"kb_used_data":42260,"kb_used_omap":1,"kb_used_meta":865406,"kb_avail":93464164,"statfs":{"total":96636764160,"available":95707303936,"internally_reserved":0,"allocated":43274240,"data_stored":80288163,"data_compressed":6950491,"data_compressed_allocated":10547200,"data_compressed_original":47734784,"omap_allocated":1588,"internal_metadata":886176204},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":1.988,"15min":1.417},"min":{"1min":0.216,"5min":0.216,"15min":0.20699999999999999},"max":{"1min":3.4830000000000001,"5min":26.544,"15min":26.544},"last":13.09},{"interface":"front","average":{"1min":1.2529999999999999,"5min":2.149,"15min":1.702},"min":{"1min":0.28799999999999998,"5min":0.27800000000000002,"15min":0.223},"max":{"1min":6.7789999999999999,"5min":26.713999999999999,"15min":26.713999999999999},"last":12.454000000000001}]},{"osd":1,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.978,"5min":2.367,"15min":1.9390000000000001},"min":{"1min":0.24099999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":12.176,"5min":14.557,"15min":32.259999999999998},"last":3.6160000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":2.0609999999999999,"15min":1.5569999999999999},"min":{"1min":0.26300000000000001,"5min":0.251,"15min":0.25},"max":{"1min":9.5860000000000003,"5min":21.867000000000001,"15min":36.018000000000001},"last":4.6849999999999996}]},{"osd":2,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":2.069,"15min":1.4259999999999999},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":8.3849999999999998,"5min":13.635,"15min":13.635},"last":4.1820000000000004},{"interface":"front","average":{"1min":1.4910000000000001,"5min":2.4500000000000002,"15min":1.718},"min":{"1min":0.29599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":7.024,"5min":19.469999999999999,"15min":19.469999999999999},"last":4.5750000000000002}]},{"osd":3,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":2.4489999999999998,"15min":1.641},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":11.510999999999999,"5min":26.274999999999999,"15min":26.274999999999999},"last":8.5579999999999998},{"interface":"front","average":{"1min":1.1719999999999999,"5min":2.3069999999999999,"15min":1.708},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.30599999999999999},"max":{"1min":6.8259999999999996,"5min":26.501999999999999,"15min":26.501999999999999},"last":7.8220000000000001}]},{"osd":4,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":2,"5min":2.5449999999999999,"15min":1.6619999999999999},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.24399999999999999},"max":{"1min":13.914999999999999,"5min":37.356000000000002,"15min":37.356000000000002},"last":1.464},{"interface":"front","average":{"1min":2.3410000000000002,"5min":2.6589999999999998,"15min":1.6890000000000001},"min":{"1min":0.28799999999999998,"5min":0.253,"15min":0.247},"max":{"1min":16.417000000000002,"5min":31.786000000000001,"15min":31.786000000000001},"last":5.9950000000000001}]},{"osd":5,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":3.2669999999999999,"5min":2.4910000000000001,"15min":1.798},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26300000000000001},"max":{"1min":29.346,"5min":29.346,"15min":35.156999999999996},"last":0.33000000000000002},{"interface":"front","average":{"1min":1.423,"5min":1.976,"15min":1.3},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":9.6170000000000009,"5min":32.988999999999997,"15min":32.988999999999997},"last":1.411}]},{"osd":6,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.8220000000000001,"15min":1.4299999999999999},"min":{"1min":0.33000000000000002,"5min":0.315,"15min":0.27400000000000002},"max":{"1min":6.6799999999999997,"5min":13.763,"15min":16.077999999999999},"last":4.1479999999999997},{"interface":"front","average":{"1min":1.821,"5min":2.2280000000000002,"15min":1.4870000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.27500000000000002},"max":{"1min":12.867000000000001,"5min":17.353999999999999,"15min":17.353999999999999},"last":1.444}]}]},{"osd":6,"up_from":13,"seq":55834575164,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1066964,"kb_used_data":53132,"kb_used_omap":1,"kb_used_meta":1013822,"kb_avail":93304876,"statfs":{"total":96636764160,"available":95544193024,"internally_reserved":0,"allocated":54407168,"data_stored":96876629,"data_compressed":8407298,"data_compressed_allocated":12894208,"data_compressed_original":55537664,"omap_allocated":1593,"internal_metadata":1038154183},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":2.6739999999999999,"5min":2.0550000000000002,"15min":1.466},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":17.488,"5min":17.488,"15min":17.488},"last":0.40200000000000002},{"interface":"front","average":{"1min":3.4830000000000001,"5min":2.9060000000000001,"15min":1.899},"min":{"1min":0.34200000000000003,"5min":0.246,"15min":0.245},"max":{"1min":17.445,"5min":37.295999999999999,"15min":37.295999999999999},"last":0.38700000000000001}]},{"osd":1,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.101,"5min":2.581,"15min":1.8320000000000001},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.22800000000000001},"max":{"1min":20.460000000000001,"5min":22.753,"15min":22.753},"last":0.41299999999999998},{"interface":"front","average":{"1min":3.2210000000000001,"5min":2.7170000000000001,"15min":1.8859999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":18.388000000000002,"5min":37.521000000000001,"15min":37.521000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.879,"5min":2.7669999999999999,"15min":1.903},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.247},"max":{"1min":23.228999999999999,"5min":23.952999999999999,"15min":23.952999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.367,"15min":1.6890000000000001},"min":{"1min":0.35799999999999998,"5min":0.29499999999999998,"15min":0.255},"max":{"1min":14.472,"5min":23.196999999999999,"15min":23.196999999999999},"last":0.439}]},{"osd":3,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.2400000000000002,"5min":2.5579999999999998,"15min":1.994},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.25800000000000001},"max":{"1min":17.577999999999999,"5min":21.975000000000001,"15min":43.082999999999998},"last":0.432},{"interface":"front","average":{"1min":3.6709999999999998,"5min":2.911,"15min":2.1219999999999999},"min":{"1min":0.434,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":17.719000000000001,"5min":23.859000000000002,"15min":43.872999999999998},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.0910000000000002,"5min":2.7829999999999999,"15min":2.4390000000000001},"min":{"1min":0.29999999999999999,"5min":0.26500000000000001,"15min":0.26100000000000001},"max":{"1min":18.416,"5min":23.055,"15min":111.04900000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":4.2690000000000001,"5min":2.8079999999999998,"15min":1.7549999999999999},"min":{"1min":0.34499999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":28.757999999999999,"5min":28.757999999999999,"15min":28.757999999999999},"last":0.32200000000000001}]},{"osd":5,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.2090000000000001,"5min":2.5169999999999999,"15min":1.617},"min":{"1min":0.33900000000000002,"5min":0.309,"15min":0.251},"max":{"1min":14.680999999999999,"5min":39.134,"15min":39.134},"last":0.37},{"interface":"front","average":{"1min":3.2709999999999999,"5min":3.2789999999999999,"15min":2.0249999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":19.527000000000001,"5min":67.576999999999998,"15min":67.576999999999998},"last":0.48499999999999999}]},{"osd":7,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.7450000000000001,"5min":2.52,"15min":1.6259999999999999},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":17.402000000000001,"5min":17.402000000000001,"15min":17.402000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":2.5459999999999998,"5min":1.9119999999999999,"15min":1.4590000000000001},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.29899999999999999},"max":{"1min":14.436999999999999,"5min":14.436999999999999,"15min":17.251000000000001},"last":0.46500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575165,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1193300,"kb_used_data":57356,"kb_used_omap":1,"kb_used_meta":1135934,"kb_avail":93178540,"statfs":{"total":96636764160,"available":95414824960,"internally_reserved":0,"allocated":58732544,"data_stored":104512318,"data_compressed":8856935,"data_compressed_allocated":13938688,"data_compressed_original":59891712,"omap_allocated":1594,"internal_metadata":1163196870},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,3,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.379,"15min":1.147},"min":{"1min":0.214,"5min":0.20300000000000001,"15min":0.186},"max":{"1min":8.6210000000000004,"5min":11.619999999999999,"15min":27.282},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.8440000000000001,"15min":1.1040000000000001},"min":{"1min":0.23699999999999999,"5min":0.217,"15min":0.186},"max":{"1min":10.148,"5min":17.922000000000001,"15min":17.922000000000001},"last":18.614000000000001}]},{"osd":2,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.891,"15min":1.0760000000000001},"min":{"1min":0.21199999999999999,"5min":0.20999999999999999,"15min":0.183},"max":{"1min":16.600000000000001,"5min":17.658000000000001,"15min":17.658000000000001},"last":2.9569999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.3520000000000001,"15min":0.97299999999999998},"min":{"1min":0.29599999999999999,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":7.2709999999999999,"5min":18.058,"15min":18.058},"last":0.71499999999999997}]},{"osd":3,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":2.1960000000000002,"5min":1.712,"15min":1.2150000000000001},"min":{"1min":0.32400000000000001,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":15.871,"5min":18.024999999999999,"15min":18.024999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.244,"5min":1.577,"15min":1.323},"min":{"1min":0.32100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":7.4379999999999997,"5min":10.773,"15min":44.454999999999998},"last":12.01}]},{"osd":4,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":2.7210000000000001,"15min":1.7749999999999999},"min":{"1min":0.311,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":9.4320000000000004,"5min":17.629000000000001,"15min":33.939999999999998},"last":2.9849999999999999},{"interface":"front","average":{"1min":1.839,"5min":2.0680000000000001,"15min":1.744},"min":{"1min":0.378,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":9.5009999999999994,"5min":20.326000000000001,"15min":41.939},"last":4.7220000000000004}]},{"osd":5,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":3.0430000000000001,"5min":2.1030000000000002,"15min":1.5229999999999999},"min":{"1min":0.38100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":27.143000000000001,"5min":27.727,"15min":27.727},"last":11.967000000000001},{"interface":"front","average":{"1min":1.343,"5min":2.5270000000000001,"15min":1.6479999999999999},"min":{"1min":0.35999999999999999,"5min":0.32300000000000001,"15min":0.318},"max":{"1min":9.3970000000000002,"5min":20.289999999999999,"15min":20.289999999999999},"last":2.9350000000000001}]},{"osd":6,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.8100000000000001,"5min":2.5030000000000001,"15min":1.7150000000000001},"min":{"1min":0.48899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":8.5879999999999992,"5min":33.189999999999998,"15min":33.189999999999998},"last":12.039999999999999},{"interface":"front","average":{"1min":3.5880000000000001,"5min":3.2570000000000001,"15min":2.0129999999999999},"min":{"1min":0.39500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":23.395,"5min":35.344000000000001,"15min":35.344000000000001},"last":2.9060000000000001}]},{"osd":7,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":1.762,"15min":1.3620000000000001},"min":{"1min":0.41599999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":9.5440000000000005,"5min":17.890000000000001,"15min":17.890000000000001},"last":4.681},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.492,"15min":1.726},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":15.553000000000001,"5min":21.039999999999999,"15min":21.039999999999999},"last":1.5149999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575164,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":809040,"kb_used_data":42184,"kb_used_omap":1,"kb_used_meta":766846,"kb_avail":93562800,"statfs":{"total":96636764160,"available":95808307200,"internally_reserved":0,"allocated":43196416,"data_stored":97970105,"data_compressed":7494028,"data_compressed_allocated":11452416,"data_compressed_original":66408448,"omap_allocated":1593,"internal_metadata":785250759},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.6200000000000001,"15min":1.7170000000000001},"min":{"1min":0.20799999999999999,"5min":0.189,"15min":0.185},"max":{"1min":12.77,"5min":22.343,"15min":37.991999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":1.236,"5min":1.571,"15min":1.2490000000000001},"min":{"1min":0.23899999999999999,"5min":0.191,"15min":0.191},"max":{"1min":7.8449999999999998,"5min":20.382000000000001,"15min":21.954000000000001},"last":0.23799999999999999}]},{"osd":2,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":1.1759999999999999,"15min":1.101},"min":{"1min":0.27400000000000002,"5min":0.22600000000000001,"15min":0.20899999999999999},"max":{"1min":3.7400000000000002,"5min":17.687999999999999,"15min":19.789999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":1.4510000000000001,"15min":1.1539999999999999},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.20899999999999999},"max":{"1min":3.2109999999999999,"5min":20.419,"15min":22.026},"last":0.29399999999999998}]},{"osd":3,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":2.0950000000000002,"15min":1.7},"min":{"1min":0.24099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":18.613,"5min":34.515000000000001,"15min":34.515000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.98699999999999999,"5min":2.286,"15min":1.619},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.22600000000000001},"max":{"1min":7.6399999999999997,"5min":85.606999999999999,"15min":85.606999999999999},"last":0.40600000000000003}]},{"osd":4,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":2.5800000000000001,"15min":2.1059999999999999},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":14.317,"5min":42.345999999999997,"15min":66.331999999999994},"last":2.9609999999999999},{"interface":"front","average":{"1min":1.6719999999999999,"5min":2.7599999999999998,"15min":2.3010000000000002},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":12.81,"5min":59.832999999999998,"15min":59.832999999999998},"last":6.0839999999999996}]},{"osd":5,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.881,"15min":1.53},"min":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":12.012,"5min":14.026999999999999,"15min":21.981000000000002},"last":16.021999999999998},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.74,"15min":1.538},"min":{"1min":0.33200000000000002,"5min":0.32400000000000001,"15min":0.30599999999999999},"max":{"1min":14.019,"5min":14.019,"15min":25.446999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":3.1000000000000001,"15min":2.0990000000000002},"min":{"1min":0.38300000000000001,"5min":0.33900000000000002,"15min":0.318},"max":{"1min":9.2370000000000001,"5min":82.542000000000002,"15min":82.542000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.131,"5min":2.0569999999999999,"15min":1.8859999999999999},"min":{"1min":0.373,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":6.4420000000000002,"5min":25.914999999999999,"15min":25.914999999999999},"last":16.056000000000001}]},{"osd":7,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":2.242,"15min":1.974},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.34599999999999997},"max":{"1min":6.3460000000000001,"5min":26.669,"15min":26.669},"last":0.754},{"interface":"front","average":{"1min":1.569,"5min":1.732,"15min":1.7210000000000001},"min":{"1min":0.41599999999999998,"5min":0.38400000000000001,"15min":0.33100000000000002},"max":{"1min":13.964,"5min":13.964,"15min":20.146000000000001},"last":14.9}]}]},{"osd":2,"up_from":13,"seq":55834575165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":728684,"kb_used_data":43876,"kb_used_omap":1,"kb_used_meta":684798,"kb_avail":93643156,"statfs":{"total":96636764160,"available":95890591744,"internally_reserved":0,"allocated":44929024,"data_stored":78974029,"data_compressed":6538000,"data_compressed_allocated":10211328,"data_compressed_original":44421120,"omap_allocated":1594,"internal_metadata":701233606},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.849,"5min":1.4379999999999999,"15min":1.135},"min":{"1min":0.19800000000000001,"5min":0.186,"15min":0.16900000000000001},"max":{"1min":15.834,"5min":15.834,"15min":21.475999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1779999999999999,"15min":1.141},"min":{"1min":0.23100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":7.4950000000000001,"5min":14.374000000000001,"15min":30.434999999999999},"last":11.121}]},{"osd":1,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":1.831,"15min":1.5369999999999999},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":15.907,"5min":24.190000000000001,"15min":25.550000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.93799999999999994,"15min":1.032},"min":{"1min":0.215,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":2.8929999999999998,"5min":8.532,"15min":20.591000000000001},"last":4.1529999999999996}]},{"osd":3,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":2.5569999999999999,"5min":2.0609999999999999,"15min":1.6839999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.21099999999999999},"max":{"1min":34.598999999999997,"5min":34.598999999999997,"15min":34.598999999999997},"last":7.641},{"interface":"front","average":{"1min":2.1989999999999998,"5min":2.2829999999999999,"15min":1.633},"min":{"1min":0.29899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":15.789999999999999,"5min":20.491,"15min":25.827000000000002},"last":2.7130000000000001}]},{"osd":4,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":2.4049999999999998,"15min":2.4500000000000002},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.312},"max":{"1min":15.936,"5min":27.963000000000001,"15min":67.506},"last":1.9039999999999999},{"interface":"front","average":{"1min":2.121,"5min":2.4369999999999998,"15min":2.573},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":7.5759999999999996,"5min":37.548999999999999,"15min":111.973},"last":4.968}]},{"osd":5,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":2.1309999999999998,"5min":2.0510000000000002,"15min":1.573},"min":{"1min":0.33500000000000002,"5min":0.314,"15min":0.308},"max":{"1min":13.215999999999999,"5min":37.496000000000002,"15min":37.496000000000002},"last":15.443},{"interface":"front","average":{"1min":2.5379999999999998,"5min":2.2799999999999998,"15min":1.645},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32600000000000001},"max":{"1min":34.545000000000002,"5min":45.997999999999998,"15min":45.997999999999998},"last":4.9249999999999998}]},{"osd":6,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":3.2850000000000001,"5min":2.9300000000000002,"15min":1.984},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":29.954999999999998,"5min":68.453000000000003,"15min":68.453000000000003},"last":5.4580000000000002},{"interface":"front","average":{"1min":2.4860000000000002,"5min":2.859,"15min":1.927},"min":{"1min":0.40699999999999997,"5min":0.34899999999999998,"15min":0.33600000000000002},"max":{"1min":11.115,"5min":63.966000000000001,"15min":63.966000000000001},"last":2.464}]},{"osd":7,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":2.0409999999999999,"15min":1.8720000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.0629999999999997,"5min":27.504000000000001,"15min":32.700000000000003},"last":9.1180000000000003},{"interface":"front","average":{"1min":2.6520000000000001,"5min":2.2450000000000001,"15min":2.0259999999999998},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":29.881,"5min":29.881,"15min":32.840000000000003},"last":4.8949999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575164,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1202252,"kb_used_data":62212,"kb_used_omap":1,"kb_used_meta":1140030,"kb_avail":93169588,"statfs":{"total":96636764160,"available":95405658112,"internally_reserved":0,"allocated":63705088,"data_stored":114855661,"data_compressed":10247405,"data_compressed_allocated":15732736,"data_compressed_original":67055616,"omap_allocated":1591,"internal_metadata":1167391177},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,6,3,8,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.5740000000000001,"15min":1.103},"min":{"1min":0.20899999999999999,"5min":0.192,"15min":0.184},"max":{"1min":7.7149999999999999,"5min":24.539999999999999,"15min":24.539999999999999},"last":8.6839999999999993},{"interface":"front","average":{"1min":1.48,"5min":1.468,"15min":1.476},"min":{"1min":0.21099999999999999,"5min":0.20100000000000001,"15min":0.19900000000000001},"max":{"1min":8.7539999999999996,"5min":12.204000000000001,"15min":95.932000000000002},"last":30.457000000000001}]},{"osd":1,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":2.048,"5min":3.0209999999999999,"15min":2.036},"min":{"1min":0.22600000000000001,"5min":0.193,"15min":0.193},"max":{"1min":18.105,"5min":44.308,"15min":44.308},"last":2.1160000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.99,"15min":1.2889999999999999},"min":{"1min":0.28999999999999998,"5min":0.23100000000000001,"15min":0.22},"max":{"1min":14.875,"5min":38.054000000000002,"15min":38.054000000000002},"last":13.927}]},{"osd":2,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":2.2029999999999998,"5min":1.8839999999999999,"15min":1.522},"min":{"1min":0.26100000000000001,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":15.788,"5min":18.132000000000001,"15min":18.132000000000001},"last":1.9770000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.2769999999999999,"15min":1.1040000000000001},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.26700000000000002},"max":{"1min":4.0629999999999997,"5min":17.364000000000001,"15min":17.364000000000001},"last":13.897}]},{"osd":4,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":2.0459999999999998,"15min":1.6439999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27100000000000002},"max":{"1min":8.6159999999999997,"5min":18.960000000000001,"15min":19.16},"last":18.422999999999998},{"interface":"front","average":{"1min":2.379,"5min":2.351,"15min":2.0609999999999999},"min":{"1min":0.31900000000000001,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":15.739000000000001,"5min":20.808,"15min":27.515999999999998},"last":8.9990000000000006}]},{"osd":5,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.7250000000000001,"5min":2.3050000000000002,"15min":1.8979999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32100000000000001},"max":{"1min":8.7739999999999991,"5min":33.436999999999998,"15min":33.436999999999998},"last":9.0570000000000004},{"interface":"front","average":{"1min":2.1139999999999999,"5min":2.048,"15min":1.5860000000000001},"min":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":13.818,"5min":17.329000000000001,"15min":17.329000000000001},"last":8.7110000000000003}]},{"osd":6,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":2.3500000000000001,"5min":2.3220000000000001,"15min":1.9850000000000001},"min":{"1min":0.38800000000000001,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":25.329000000000001,"5min":25.329000000000001,"15min":30.588000000000001},"last":8.6430000000000007},{"interface":"front","average":{"1min":1.5189999999999999,"5min":2.0659999999999998,"15min":1.804},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.33900000000000002},"max":{"1min":8.5809999999999995,"5min":18.803000000000001,"15min":23.318999999999999},"last":16.077000000000002}]},{"osd":7,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.9630000000000001,"5min":1.8280000000000001,"15min":1.7929999999999999},"min":{"1min":0.40999999999999998,"5min":0.35699999999999998,"15min":0.34699999999999998},"max":{"1min":10.007999999999999,"5min":18.841999999999999,"15min":19.116},"last":13.25},{"interface":"front","average":{"1min":3.129,"5min":2.5910000000000002,"15min":1.9770000000000001},"min":{"1min":0.42699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":19.504999999999999,"5min":33.505000000000003,"15min":33.505000000000003},"last":9.0350000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575164,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":924836,"kb_used_data":27676,"kb_used_omap":1,"kb_used_meta":897150,"kb_avail":93447004,"statfs":{"total":96636764160,"available":95689732096,"internally_reserved":0,"allocated":28340224,"data_stored":58256587,"data_compressed":4973009,"data_compressed_allocated":7712768,"data_compressed_original":37806080,"omap_allocated":1594,"internal_metadata":918682054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1,0,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.355,"5min":2.613,"15min":1.677},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.20599999999999999},"max":{"1min":19.058,"5min":21.062999999999999,"15min":45.375},"last":5.0049999999999999},{"interface":"front","average":{"1min":2.375,"5min":2.206,"15min":1.704},"min":{"1min":0.27500000000000002,"5min":0.23100000000000001,"15min":0.188},"max":{"1min":8.9550000000000001,"5min":19.850999999999999,"15min":35.765000000000001},"last":0.497}]},{"osd":1,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.617,"5min":2.9140000000000001,"15min":2.0609999999999999},"min":{"1min":0.26300000000000001,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":22.718,"5min":22.718,"15min":29.928000000000001},"last":7.9459999999999997},{"interface":"front","average":{"1min":3.3170000000000002,"5min":2.8740000000000001,"15min":1.714},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":19.032,"5min":21.103000000000002,"15min":23.634},"last":1.218}]},{"osd":2,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.2349999999999999,"5min":2.8679999999999999,"15min":1.786},"min":{"1min":0.32400000000000001,"5min":0.28599999999999998,"15min":0.27600000000000002},"max":{"1min":22.774000000000001,"5min":30.512,"15min":30.512},"last":8.0359999999999996},{"interface":"front","average":{"1min":5.0419999999999998,"5min":4.0350000000000001,"15min":2.109},"min":{"1min":0.29499999999999998,"5min":0.27400000000000002,"15min":0.26300000000000001},"max":{"1min":26.567,"5min":82.847999999999999,"15min":82.847999999999999},"last":0.84199999999999997}]},{"osd":3,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":2.1880000000000002,"5min":2.2400000000000002,"15min":1.5960000000000001},"min":{"1min":0.32600000000000001,"5min":0.26600000000000001,"15min":0.23899999999999999},"max":{"1min":8.452,"5min":15.500999999999999,"15min":22.555},"last":0.92200000000000004},{"interface":"front","average":{"1min":3.1230000000000002,"5min":3.1400000000000001,"15min":1.9710000000000001},"min":{"1min":0.37,"5min":0.313,"15min":0.308},"max":{"1min":22.66,"5min":26.259,"15min":26.259},"last":8.0609999999999999}]},{"osd":5,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":4.4569999999999999,"5min":4.1269999999999998,"15min":2.073},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.24399999999999999},"max":{"1min":26.484999999999999,"5min":82.918999999999997,"15min":82.918999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":2.4569999999999999,"5min":2.7490000000000001,"15min":1.8320000000000001},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.249},"max":{"1min":18.288,"5min":25.120000000000001,"15min":25.120000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":2.573,"5min":2.552,"15min":1.671},"min":{"1min":0.313,"5min":0.313,"15min":0.252},"max":{"1min":18.141999999999999,"5min":18.141999999999999,"15min":20.562999999999999},"last":8.0109999999999992},{"interface":"front","average":{"1min":3.8940000000000001,"5min":3.8290000000000002,"15min":2.2440000000000002},"min":{"1min":0.36199999999999999,"5min":0.30499999999999999,"15min":0.29499999999999998},"max":{"1min":21.478000000000002,"5min":83.643000000000001,"15min":83.643000000000001},"last":0.879}]},{"osd":7,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.1389999999999998,"5min":2.3490000000000002,"15min":1.748},"min":{"1min":0.373,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":19.021999999999998,"5min":19.021999999999998,"15min":25.878},"last":0.56000000000000005},{"interface":"front","average":{"1min":2.9780000000000002,"5min":2.4380000000000002,"15min":1.7609999999999999},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.27800000000000002},"max":{"1min":22.75,"5min":22.75,"15min":22.75},"last":7.9850000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575164,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":958980,"kb_used_data":35516,"kb_used_omap":1,"kb_used_meta":923454,"kb_avail":93412860,"statfs":{"total":96636764160,"available":95654768640,"internally_reserved":0,"allocated":36368384,"data_stored":62205095,"data_compressed":4933287,"data_compressed_allocated":7835648,"data_compressed_original":33841152,"omap_allocated":1594,"internal_metadata":945617350},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.911,"15min":1.306},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":6.2060000000000004,"5min":19.097999999999999,"15min":19.097999999999999},"last":6.1260000000000003},{"interface":"front","average":{"1min":1.609,"5min":2.157,"15min":1.508},"min":{"1min":0.28599999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":14.662000000000001,"5min":21.416,"15min":21.416},"last":1.6679999999999999}]},{"osd":1,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":2.0070000000000001,"15min":1.6040000000000001},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":3.4750000000000001,"5min":16.515000000000001,"15min":19.581},"last":1.468},{"interface":"front","average":{"1min":1.153,"5min":1.611,"15min":1.28},"min":{"1min":0.27100000000000002,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":8.4629999999999992,"5min":16.492999999999999,"15min":16.492999999999999},"last":13.266999999999999}]},{"osd":2,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.679,"15min":1.409},"min":{"1min":0.30599999999999999,"5min":0.27300000000000002,"15min":0.25700000000000001},"max":{"1min":5.7770000000000001,"5min":21.186,"15min":21.186},"last":0.496},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.6859999999999999,"15min":1.2609999999999999},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.25700000000000001},"max":{"1min":6.1289999999999996,"5min":22.353999999999999,"15min":22.353999999999999},"last":6.226}]},{"osd":3,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":2.0169999999999999,"15min":1.595},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.28199999999999997},"max":{"1min":14.736000000000001,"5min":16.324999999999999,"15min":17.103999999999999},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.5940000000000001,"5min":2.1800000000000002,"15min":1.6819999999999999},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.29899999999999999},"max":{"1min":15.821999999999999,"5min":18.798999999999999,"15min":23.224},"last":7.7539999999999996}]},{"osd":4,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":2.2869999999999999,"5min":2.206,"15min":1.5},"min":{"1min":0.27600000000000002,"5min":0.25,"15min":0.20799999999999999},"max":{"1min":17.914000000000001,"5min":22.300000000000001,"15min":28.724},"last":6.2000000000000002},{"interface":"front","average":{"1min":2.0960000000000001,"5min":2.4940000000000002,"15min":1.5980000000000001},"min":{"1min":0.371,"5min":0.28100000000000003,"15min":0.22800000000000001},"max":{"1min":22.385999999999999,"5min":25.466999999999999,"15min":25.466999999999999},"last":1.518}]},{"osd":6,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":2.1000000000000001,"15min":1.5129999999999999},"min":{"1min":0.29699999999999999,"5min":0.28699999999999998,"15min":0.23899999999999999},"max":{"1min":9.3539999999999992,"5min":21.294,"15min":21.294},"last":7.7210000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":2.3690000000000002,"15min":1.4590000000000001},"min":{"1min":0.39700000000000002,"5min":0.34300000000000003,"15min":0.24199999999999999},"max":{"1min":6.1820000000000004,"5min":23.731000000000002,"15min":23.731000000000002},"last":6.1660000000000004}]},{"osd":7,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.724,"5min":2.0630000000000002,"15min":1.4370000000000001},"min":{"1min":0.436,"5min":0.29799999999999999,"15min":0.28100000000000003},"max":{"1min":14.711,"5min":21.462,"15min":30.076000000000001},"last":1.845},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.796,"15min":1.29},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.26100000000000001},"max":{"1min":5.7460000000000004,"5min":21.257000000000001,"15min":21.257000000000001},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37617664,"data_stored":55032140,"data_compressed":5468644,"data_compressed_allocated":8114176,"data_compressed_original":25542656,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53616640,"data_stored":78830860,"data_compressed":7659770,"data_compressed_allocated":11517952,"data_compressed_original":36741120,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41410560,"data_stored":58720256,"data_compressed":5586562,"data_compressed_allocated":8433664,"data_compressed_original":25743360,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58433536,"data_stored":88081056,"data_compressed":8987385,"data_compressed_allocated":13205504,"data_compressed_original":42860544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24395776,"data_stored":37748862,"data_compressed":4009381,"data_compressed_allocated":5820416,"data_compressed_original":19185664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33177600,"data_stored":46137434,"data_compressed":4179228,"data_compressed_allocated":6336512,"data_compressed_original":19300352,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50081792,"data_stored":74529800,"data_compressed":7356666,"data_compressed_allocated":10809344,"data_compressed_original":35266560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":39260160,"data_stored":59235126,"data_compressed":5956375,"data_compressed_allocated":8605696,"data_compressed_original":28585984,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3661824,"data_stored":19365888,"data_compressed":915424,"data_compressed_allocated":1843200,"data_compressed_original":17547264,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4268032,"data_stored":22536192,"data_compressed":1064889,"data_compressed_allocated":2142208,"data_compressed_original":20410368,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2895872,"data_stored":15314944,"data_compressed":723954,"data_compressed_allocated":1462272,"data_compressed_original":13881344,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4993024,"data_stored":26660864,"data_compressed":1260020,"data_compressed_allocated":2527232,"data_compressed_original":24195072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3665920,"data_stored":20393984,"data_compressed":963628,"data_compressed_allocated":1892352,"data_compressed_original":18620416,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2912256,"data_stored":15953920,"data_compressed":754059,"data_compressed_allocated":1499136,"data_compressed_original":14540800,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4046848,"data_stored":22233088,"data_compressed":1050632,"data_compressed_allocated":2084864,"data_compressed_original":20271104,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3702784,"data_stored":20611072,"data_compressed":973697,"data_compressed_allocated":1912832,"data_compressed_original":18821120,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T19:48:35.646 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:48:36.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.082+0000 7f9473d8a700 1 Processor -- start 2024-05-08T19:48:36.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.082+0000 7f9473d8a700 1 -- start start 2024-05-08T19:48:36.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.083+0000 7f9473d8a700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f946c06d940 0x7f946c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:36.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.083+0000 7f9473d8a700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f946c06e260 0x7f946c14a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:36.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.083+0000 7f9473d8a700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946c151490 con 0x7f946c070670 2024-05-08T19:48:36.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.083+0000 7f9473d8a700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946c071cc0 con 0x7f946c06d940 2024-05-08T19:48:36.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.083+0000 7f9473d8a700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946c151770 con 0x7f946c06e260 2024-05-08T19:48:36.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.088+0000 7f9471b26700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f946c06d940 0x7f946c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:36.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.088+0000 7f9471b26700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f946c06d940 0x7f946c06dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:50876/0 (socket says 172.21.15.47:50876) 2024-05-08T19:48:36.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.088+0000 7f9471b26700 1 -- 172.21.15.47:0/739924397 learned_addr learned my addr 172.21.15.47:0/739924397 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:36.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.088+0000 7f9471325700 1 --2- 172.21.15.47:0/739924397 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f946c06e260 0x7f946c14a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:36.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.088+0000 7f9471b26700 1 -- 172.21.15.47:0/739924397 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f946c06e260 msgr2=0x7f946c14a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:36.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.088+0000 7f9471b26700 1 --2- 172.21.15.47:0/739924397 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f946c06e260 0x7f946c14a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:36.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.088+0000 7f9471b26700 1 -- 172.21.15.47:0/739924397 >> v1:172.21.15.177:6789/0 conn(0x7f946c070670 legacy=0x7f946c0c0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:36.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.088+0000 7f9471b26700 1 -- 172.21.15.47:0/739924397 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c0711b0 con 0x7f946c06d940 2024-05-08T19:48:36.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.088+0000 7f9471b26700 1 --2- 172.21.15.47:0/739924397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946c06d940 0x7f946c06dd20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f946400d1e0 tx=0x7f946400d4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=703d5953d67389a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:36.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.097+0000 7f9470b24700 1 -- 172.21.15.47:0/739924397 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464010070 con 0x7f946c06d940 2024-05-08T19:48:36.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.097+0000 7f9470b24700 1 -- 172.21.15.47:0/739924397 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946400dc60 con 0x7f946c06d940 2024-05-08T19:48:36.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.097+0000 7f9470b24700 1 -- 172.21.15.47:0/739924397 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464007b60 con 0x7f946c06d940 2024-05-08T19:48:36.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.098+0000 7f9473d8a700 1 -- 172.21.15.47:0/739924397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946c06d940 msgr2=0x7f946c06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:36.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.098+0000 7f9473d8a700 1 --2- 172.21.15.47:0/739924397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946c06d940 0x7f946c06dd20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f946400d1e0 tx=0x7f946400d4f0 comp rx=0 tx=0).stop 2024-05-08T19:48:36.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.098+0000 7f9473d8a700 1 -- 172.21.15.47:0/739924397 shutdown_connections 2024-05-08T19:48:36.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.098+0000 7f9473d8a700 1 --2- 172.21.15.47:0/739924397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946c06d940 0x7f946c06dd20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:36.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.098+0000 7f9473d8a700 1 --2- 172.21.15.47:0/739924397 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f946c06e260 0x7f946c14a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:36.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.098+0000 7f9473d8a700 1 -- 172.21.15.47:0/739924397 >> 172.21.15.47:0/739924397 conn(0x7f946c06a9c0 msgr2=0x7f946c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:36.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.099+0000 7f9473d8a700 1 -- 172.21.15.47:0/739924397 shutdown_connections 2024-05-08T19:48:36.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.099+0000 7f9473d8a700 1 -- 172.21.15.47:0/739924397 wait complete. 2024-05-08T19:48:36.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.100+0000 7f9473d8a700 1 Processor -- start 2024-05-08T19:48:36.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.100+0000 7f9473d8a700 1 -- start start 2024-05-08T19:48:36.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.101+0000 7f9473d8a700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f946c06d940 0x7f946c0c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:36.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.101+0000 7f9473d8a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c070670 0x7f946c0c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:36.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.101+0000 7f9473d8a700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946c14fba0 0x7f946c14e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:36.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.101+0000 7f9473d8a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c13e000 con 0x7f946c070670 2024-05-08T19:48:36.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.101+0000 7f9473d8a700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c150110 con 0x7f946c14fba0 2024-05-08T19:48:36.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.101+0000 7f9473d8a700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946c13d9b0 con 0x7f946c06d940 2024-05-08T19:48:36.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.105+0000 7f9472327700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946c14fba0 0x7f946c14e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:36.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.105+0000 7f9472327700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946c14fba0 0x7f946c14e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:50890/0 (socket says 172.21.15.47:50890) 2024-05-08T19:48:36.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.105+0000 7f9472327700 1 -- 172.21.15.47:0/3376448799 learned_addr learned my addr 172.21.15.47:0/3376448799 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:36.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.108+0000 7f9472327700 1 -- 172.21.15.47:0/3376448799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f946c06d940 msgr2=0x7f946c0c4e30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T19:48:36.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.108+0000 7f9472327700 1 --2- 172.21.15.47:0/3376448799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f946c06d940 0x7f946c0c4e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:36.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.108+0000 7f9472327700 1 -- 172.21.15.47:0/3376448799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c070670 msgr2=0x7f946c0c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:36.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.108+0000 7f9472327700 1 --2- 172.21.15.47:0/3376448799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c070670 0x7f946c0c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:36.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.108+0000 7f9472327700 1 -- 172.21.15.47:0/3376448799 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94640079d0 con 0x7f946c14fba0 2024-05-08T19:48:36.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.108+0000 7f9472327700 1 --2- 172.21.15.47:0/3376448799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946c14fba0 0x7f946c14e880 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f945c00b410 tx=0x7f945c00b7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.110+0000 7f94627fc700 1 -- 172.21.15.47:0/3376448799 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c011830 con 0x7f946c14fba0 2024-05-08T19:48:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.110+0000 7f94627fc700 1 -- 172.21.15.47:0/3376448799 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c011990 con 0x7f946c14fba0 2024-05-08T19:48:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.110+0000 7f94627fc700 1 -- 172.21.15.47:0/3376448799 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c011d40 con 0x7f946c14fba0 2024-05-08T19:48:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.111+0000 7f9473d8a700 1 -- 172.21.15.47:0/3376448799 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946c06ce50 con 0x7f946c14fba0 2024-05-08T19:48:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.111+0000 7f9473d8a700 1 -- 172.21.15.47:0/3376448799 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946c1503f0 con 0x7f946c14fba0 2024-05-08T19:48:36.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.113+0000 7f9473d8a700 1 -- 172.21.15.47:0/3376448799 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94540052f0 con 0x7f946c14fba0 2024-05-08T19:48:36.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.130+0000 7f94627fc700 1 -- 172.21.15.47:0/3376448799 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f945c004020 con 0x7f946c14fba0 2024-05-08T19:48:36.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.130+0000 7f94627fc700 1 --2- 172.21.15.47:0/3376448799 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f945006ad60 0x7f945006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:36.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.130+0000 7f94627fc700 1 -- 172.21.15.47:0/3376448799 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f945c089ba0 con 0x7f946c14fba0 2024-05-08T19:48:36.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.130+0000 7f94627fc700 1 -- 172.21.15.47:0/3376448799 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f945c0b69a0 con 0x7f946c14fba0 2024-05-08T19:48:36.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.133+0000 7f9471b26700 1 --2- 172.21.15.47:0/3376448799 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f945006ad60 0x7f945006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:36.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.152+0000 7f9471b26700 1 --2- 172.21.15.47:0/3376448799 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f945006ad60 0x7f945006d220 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f946400d1e0 tx=0x7f9464012000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:36.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.578+0000 7f9473d8a700 1 -- 172.21.15.47:0/3376448799 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9454005870 con 0x7f946c14fba0 2024-05-08T19:48:36.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.589+0000 7f94627fc700 1 -- 172.21.15.47:0/3376448799 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f945c0549a0 con 0x7f946c14fba0 2024-05-08T19:48:36.595 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:48:36.595 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:23:11.040286+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:48:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.608+0000 7f9473d8a700 1 -- 172.21.15.47:0/3376448799 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f945006ad60 msgr2=0x7f945006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.608+0000 7f9473d8a700 1 --2- 172.21.15.47:0/3376448799 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f945006ad60 0x7f945006d220 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f946400d1e0 tx=0x7f9464012000 comp rx=0 tx=0).stop 2024-05-08T19:48:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.608+0000 7f9473d8a700 1 -- 172.21.15.47:0/3376448799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946c14fba0 msgr2=0x7f946c14e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.608+0000 7f9473d8a700 1 --2- 172.21.15.47:0/3376448799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946c14fba0 0x7f946c14e880 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f945c00b410 tx=0x7f945c00b7d0 comp rx=0 tx=0).stop 2024-05-08T19:48:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.608+0000 7f9473d8a700 1 -- 172.21.15.47:0/3376448799 shutdown_connections 2024-05-08T19:48:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.608+0000 7f9473d8a700 1 --2- 172.21.15.47:0/3376448799 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f945006ad60 0x7f945006d220 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.608+0000 7f9473d8a700 1 --2- 172.21.15.47:0/3376448799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f946c14fba0 0x7f946c14e880 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.608+0000 7f9473d8a700 1 --2- 172.21.15.47:0/3376448799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f946c06d940 0x7f946c0c4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.608+0000 7f9473d8a700 1 --2- 172.21.15.47:0/3376448799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c070670 0x7f946c0c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.608+0000 7f9473d8a700 1 -- 172.21.15.47:0/3376448799 >> 172.21.15.47:0/3376448799 conn(0x7f946c06a9c0 msgr2=0x7f946c148a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.608+0000 7f9473d8a700 1 -- 172.21.15.47:0/3376448799 shutdown_connections 2024-05-08T19:48:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:36.608+0000 7f9473d8a700 1 -- 172.21.15.47:0/3376448799 wait complete. 2024-05-08T19:48:37.629 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T19:48:37.629 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T19:48:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.785+0000 7fc9da362700 1 Processor -- start 2024-05-08T19:48:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.785+0000 7fc9da362700 1 -- start start 2024-05-08T19:48:37.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.786+0000 7fc9da362700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc9d40ada50 0x7fc9d406e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:37.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.786+0000 7fc9da362700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9d40c8050 0x7fc9d40c8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:37.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.786+0000 7fc9da362700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d41536f0 con 0x7fc9d40c6d70 2024-05-08T19:48:37.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.786+0000 7fc9da362700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d4153190 con 0x7fc9d40ada50 2024-05-08T19:48:37.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.786+0000 7fc9da362700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d40c7da0 con 0x7fc9d40c8050 2024-05-08T19:48:37.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.786+0000 7fc9d37fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc9d40ada50 0x7fc9d406e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:37.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.786+0000 7fc9d37fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc9d40ada50 0x7fc9d406e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54176/0 (socket says 172.21.15.47:54176) 2024-05-08T19:48:37.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.786+0000 7fc9d37fe700 1 -- 172.21.15.47:0/3194484330 learned_addr learned my addr 172.21.15.47:0/3194484330 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:37.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.786+0000 7fc9d88ff700 1 --2- 172.21.15.47:0/3194484330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9d40c8050 0x7fc9d40c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.786+0000 7fc9d37fe700 1 -- 172.21.15.47:0/3194484330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9d40c8050 msgr2=0x7fc9d40c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.786+0000 7fc9d37fe700 1 --2- 172.21.15.47:0/3194484330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9d40c8050 0x7fc9d40c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.786+0000 7fc9d37fe700 1 -- 172.21.15.47:0/3194484330 >> v1:172.21.15.177:6789/0 conn(0x7fc9d40c6d70 legacy=0x7fc9d40c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.786+0000 7fc9d37fe700 1 -- 172.21.15.47:0/3194484330 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d4070860 con 0x7fc9d40ada50 2024-05-08T19:48:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.786+0000 7fc9d37fe700 1 --2- 172.21.15.47:0/3194484330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9d40ada50 0x7fc9d406e850 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009920 tx=0x7fc9bc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af53014927a97b21 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.787+0000 7fc9d2ffd700 1 -- 172.21.15.47:0/3194484330 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc00ba20 con 0x7fc9d40ada50 2024-05-08T19:48:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.787+0000 7fc9d2ffd700 1 -- 172.21.15.47:0/3194484330 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc00bb80 con 0x7fc9d40ada50 2024-05-08T19:48:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.787+0000 7fc9d2ffd700 1 -- 172.21.15.47:0/3194484330 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc009e70 con 0x7fc9d40ada50 2024-05-08T19:48:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.787+0000 7fc9da362700 1 -- 172.21.15.47:0/3194484330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9d40ada50 msgr2=0x7fc9d406e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.787+0000 7fc9da362700 1 --2- 172.21.15.47:0/3194484330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9d40ada50 0x7fc9d406e850 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009920 tx=0x7fc9bc009c30 comp rx=0 tx=0).stop 2024-05-08T19:48:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.787+0000 7fc9da362700 1 -- 172.21.15.47:0/3194484330 shutdown_connections 2024-05-08T19:48:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.787+0000 7fc9da362700 1 --2- 172.21.15.47:0/3194484330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9d40c8050 0x7fc9d40c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.787+0000 7fc9da362700 1 --2- 172.21.15.47:0/3194484330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9d40ada50 0x7fc9d406e850 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:37.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.787+0000 7fc9da362700 1 -- 172.21.15.47:0/3194484330 >> 172.21.15.47:0/3194484330 conn(0x7fc9d406b1b0 msgr2=0x7fc9d40a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:37.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.787+0000 7fc9da362700 1 -- 172.21.15.47:0/3194484330 shutdown_connections 2024-05-08T19:48:37.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.787+0000 7fc9da362700 1 -- 172.21.15.47:0/3194484330 wait complete. 2024-05-08T19:48:37.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.788+0000 7fc9da362700 1 Processor -- start 2024-05-08T19:48:37.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.789+0000 7fc9da362700 1 -- start start 2024-05-08T19:48:37.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.789+0000 7fc9da362700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9d40ada50 0x7fc9d40a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:37.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.789+0000 7fc9da362700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9d40c6d70 0x7fc9d4148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:37.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.789+0000 7fc9da362700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d40c8050 0x7fc9d4148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:37.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.789+0000 7fc9da362700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d414b870 con 0x7fc9d40ada50 2024-05-08T19:48:37.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.789+0000 7fc9da362700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d4154470 con 0x7fc9d40c8050 2024-05-08T19:48:37.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.789+0000 7fc9da362700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d4153cd0 con 0x7fc9d40c6d70 2024-05-08T19:48:37.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9d3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9d40ada50 0x7fc9d40a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:37.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9d3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9d40ada50 0x7fc9d40a9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54186/0 (socket says 172.21.15.47:54186) 2024-05-08T19:48:37.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9d3fff700 1 -- 172.21.15.47:0/2324769194 learned_addr learned my addr 172.21.15.47:0/2324769194 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9d88ff700 1 --2- 172.21.15.47:0/2324769194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d40c8050 0x7fc9d4148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9d37fe700 1 --2- 172.21.15.47:0/2324769194 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9d40c6d70 0x7fc9d4148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9d3fff700 1 -- 172.21.15.47:0/2324769194 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9d40c6d70 msgr2=0x7fc9d4148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9d3fff700 1 --2- 172.21.15.47:0/2324769194 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9d40c6d70 0x7fc9d4148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9d3fff700 1 -- 172.21.15.47:0/2324769194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d40c8050 msgr2=0x7fc9d4148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9d3fff700 1 --2- 172.21.15.47:0/2324769194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d40c8050 0x7fc9d4148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9d3fff700 1 -- 172.21.15.47:0/2324769194 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc009550 con 0x7fc9d40ada50 2024-05-08T19:48:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9d3fff700 1 --2- 172.21.15.47:0/2324769194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9d40ada50 0x7fc9d40a9c50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400c510 tx=0x7fc9c400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9d0ff9700 1 -- 172.21.15.47:0/2324769194 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40052d0 con 0x7fc9d40ada50 2024-05-08T19:48:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9d0ff9700 1 -- 172.21.15.47:0/2324769194 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c4005430 con 0x7fc9d40ada50 2024-05-08T19:48:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9da362700 1 -- 172.21.15.47:0/2324769194 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d40aa190 con 0x7fc9d40ada50 2024-05-08T19:48:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9d0ff9700 1 -- 172.21.15.47:0/2324769194 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40038c0 con 0x7fc9d40ada50 2024-05-08T19:48:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.790+0000 7fc9da362700 1 -- 172.21.15.47:0/2324769194 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d4148f80 con 0x7fc9d40ada50 2024-05-08T19:48:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.791+0000 7fc9da362700 1 -- 172.21.15.47:0/2324769194 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc9d4153410 con 0x7fc9d40ada50 2024-05-08T19:48:37.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.792+0000 7fc9d0ff9700 1 -- 172.21.15.47:0/2324769194 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc9c4003a20 con 0x7fc9d40ada50 2024-05-08T19:48:37.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.792+0000 7fc9d0ff9700 1 --2- 172.21.15.47:0/2324769194 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc9b406ac90 0x7fc9b406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:37.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.792+0000 7fc9d0ff9700 1 -- 172.21.15.47:0/2324769194 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc9c40889e0 con 0x7fc9d40ada50 2024-05-08T19:48:37.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.793+0000 7fc9d37fe700 1 --2- 172.21.15.47:0/2324769194 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc9b406ac90 0x7fc9b406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:37.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.793+0000 7fc9d0ff9700 1 --2- 172.21.15.47:0/2324769194 >> [v2:172.21.15.47:6800/46996,v1:172.21.15.47:6801/46996] conn(0x7fc9b4074570 0x7fc9b4076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:37.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.793+0000 7fc9d0ff9700 1 -- 172.21.15.47:0/2324769194 --> [v2:172.21.15.47:6800/46996,v1:172.21.15.47:6801/46996] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9b40770e0 con 0x7fc9b4074570 2024-05-08T19:48:37.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.793+0000 7fc9d0ff9700 1 -- 172.21.15.47:0/2324769194 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9c408d2c0 con 0x7fc9d40ada50 2024-05-08T19:48:37.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.793+0000 7fc9d88ff700 1 --2- 172.21.15.47:0/2324769194 >> [v2:172.21.15.47:6800/46996,v1:172.21.15.47:6801/46996] conn(0x7fc9b4074570 0x7fc9b4076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:37.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.793+0000 7fc9d37fe700 1 --2- 172.21.15.47:0/2324769194 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc9b406ac90 0x7fc9b406d150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009920 tx=0x7fc9bc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:37.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.793+0000 7fc9d88ff700 1 --2- 172.21.15.47:0/2324769194 >> [v2:172.21.15.47:6800/46996,v1:172.21.15.47:6801/46996] conn(0x7fc9b4074570 0x7fc9b4076a10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:37.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.794+0000 7fc9d0ff9700 1 -- 172.21.15.47:0/2324769194 <== osd.0 v2:172.21.15.47:6800/46996 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc9b40770e0 con 0x7fc9b4074570 2024-05-08T19:48:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.809+0000 7fc9da362700 1 -- 172.21.15.47:0/2324769194 --> [v2:172.21.15.47:6800/46996,v1:172.21.15.47:6801/46996] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc9d40c2d60 con 0x7fc9b4074570 2024-05-08T19:48:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.809+0000 7fc9d0ff9700 1 -- 172.21.15.47:0/2324769194 <== osd.0 v2:172.21.15.47:6800/46996 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc9cc0083a0 con 0x7fc9b4074570 2024-05-08T19:48:37.799 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-08T19:48:37.800 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T19:48:37.800 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-08T19:48:37.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.809+0000 7fc9da362700 1 -- 172.21.15.47:0/2324769194 >> [v2:172.21.15.47:6800/46996,v1:172.21.15.47:6801/46996] conn(0x7fc9b4074570 msgr2=0x7fc9b4076a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:37.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.809+0000 7fc9da362700 1 --2- 172.21.15.47:0/2324769194 >> [v2:172.21.15.47:6800/46996,v1:172.21.15.47:6801/46996] conn(0x7fc9b4074570 0x7fc9b4076a10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:37.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.809+0000 7fc9da362700 1 -- 172.21.15.47:0/2324769194 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc9b406ac90 msgr2=0x7fc9b406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:37.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.809+0000 7fc9da362700 1 --2- 172.21.15.47:0/2324769194 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fc9b406ac90 0x7fc9b406d150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009920 tx=0x7fc9bc008030 comp rx=0 tx=0).stop 2024-05-08T19:48:37.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.810+0000 7fc9da362700 1 -- 172.21.15.47:0/2324769194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9d40ada50 msgr2=0x7fc9d40a9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:37.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.810+0000 7fc9da362700 1 --2- 172.21.15.47:0/2324769194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9d40ada50 0x7fc9d40a9c50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400c510 tx=0x7fc9c400c820 comp rx=0 tx=0).stop 2024-05-08T19:48:37.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.810+0000 7fc9d88ff700 1 -- 172.21.15.47:0/2324769194 reap_dead start 2024-05-08T19:48:37.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.810+0000 7fc9da362700 1 -- 172.21.15.47:0/2324769194 shutdown_connections 2024-05-08T19:48:37.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.810+0000 7fc9da362700 1 -- 172.21.15.47:0/2324769194 >> 172.21.15.47:0/2324769194 conn(0x7fc9d406b1b0 msgr2=0x7fc9d40c7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:37.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.810+0000 7fc9da362700 1 -- 172.21.15.47:0/2324769194 shutdown_connections 2024-05-08T19:48:37.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.810+0000 7fc9da362700 1 -- 172.21.15.47:0/2324769194 wait complete. 2024-05-08T19:48:37.812 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T19:48:37.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.950+0000 7f14aa0ee700 1 Processor -- start 2024-05-08T19:48:37.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.950+0000 7f14aa0ee700 1 -- start start 2024-05-08T19:48:37.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.951+0000 7f14aa0ee700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f14a40aab40 0x7f14a40ac250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:37.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.951+0000 7f14aa0ee700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a40c2880 con 0x7f14a40a84b0 2024-05-08T19:48:37.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.951+0000 7f14aa0ee700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a40c2b60 con 0x7f14a414eee0 2024-05-08T19:48:37.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.951+0000 7f14aa0ee700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a40ab450 con 0x7f14a40aab40 2024-05-08T19:48:37.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.951+0000 7f14a3fff700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f14a40a84b0 0x7f14a40c2ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55892/0 (socket says 172.21.15.47:55892) 2024-05-08T19:48:37.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.951+0000 7f14a3fff700 1 -- 172.21.15.47:0/621658771 learned_addr learned my addr 172.21.15.47:0/621658771 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:48:37.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.951+0000 7f14a2ffd700 1 --2- 172.21.15.47:0/621658771 >> v2:172.21.15.177:3300/0 conn(0x7f14a40aab40 0x7f14a40ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:37.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.951+0000 7f14a27fc700 1 -- 172.21.15.47:0/621658771 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287411223 0 0) 0x7f14a40c2880 con 0x7f14a40a84b0 2024-05-08T19:48:37.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.951+0000 7f14a27fc700 1 -- 172.21.15.47:0/621658771 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f148c0035b0 con 0x7f14a40a84b0 2024-05-08T19:48:37.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.951+0000 7f14a27fc700 1 -- 172.21.15.47:0/621658771 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058962896 0 0) 0x7f14a40c2b60 con 0x7f14a414eee0 2024-05-08T19:48:37.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.951+0000 7f14a27fc700 1 -- 172.21.15.47:0/621658771 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14a40c2880 con 0x7f14a414eee0 2024-05-08T19:48:37.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.951+0000 7f14a27fc700 1 -- 172.21.15.47:0/621658771 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2412868784 0 0) 0x7f148c0035b0 con 0x7f14a40a84b0 2024-05-08T19:48:37.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.951+0000 7f14a2ffd700 1 -- 172.21.15.47:0/621658771 >> v1:172.21.15.177:6789/0 conn(0x7f14a414eee0 legacy=0x7f14a40a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:37.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.951+0000 7f14a2ffd700 1 -- 172.21.15.47:0/621658771 >> v1:172.21.15.47:6789/0 conn(0x7f14a40a84b0 legacy=0x7f14a40c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:37.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.951+0000 7f14a2ffd700 1 -- 172.21.15.47:0/621658771 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a41526e0 con 0x7f14a40aab40 2024-05-08T19:48:37.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.952+0000 7f14a2ffd700 1 --2- 172.21.15.47:0/621658771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14a40aab40 0x7f14a40ac250 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1498009840 tx=0x7f1498009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c06a01a3dd7e799e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:37.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.952+0000 7f14a27fc700 1 -- 172.21.15.47:0/621658771 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c0019f0 con 0x7f14a40aab40 2024-05-08T19:48:37.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.952+0000 7f14a27fc700 1 -- 172.21.15.47:0/621658771 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1498004030 con 0x7f14a40aab40 2024-05-08T19:48:37.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.952+0000 7f14a27fc700 1 -- 172.21.15.47:0/621658771 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14980043c0 con 0x7f14a40aab40 2024-05-08T19:48:37.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.952+0000 7f14aa0ee700 1 -- 172.21.15.47:0/621658771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14a40aab40 msgr2=0x7f14a40ac250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:37.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.952+0000 7f14aa0ee700 1 --2- 172.21.15.47:0/621658771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14a40aab40 0x7f14a40ac250 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1498009840 tx=0x7f1498009b50 comp rx=0 tx=0).stop 2024-05-08T19:48:37.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.952+0000 7f14aa0ee700 1 -- 172.21.15.47:0/621658771 shutdown_connections 2024-05-08T19:48:37.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.952+0000 7f14aa0ee700 1 --2- 172.21.15.47:0/621658771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14a40aab40 0x7f14a40ac250 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:37.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.952+0000 7f14aa0ee700 1 -- 172.21.15.47:0/621658771 >> 172.21.15.47:0/621658771 conn(0x7f14a40c3c20 msgr2=0x7f14a40c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:37.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.952+0000 7f14aa0ee700 1 -- 172.21.15.47:0/621658771 shutdown_connections 2024-05-08T19:48:37.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.952+0000 7f14aa0ee700 1 -- 172.21.15.47:0/621658771 wait complete. 2024-05-08T19:48:37.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.953+0000 7f14aa0ee700 1 Processor -- start 2024-05-08T19:48:37.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.954+0000 7f14aa0ee700 1 -- start start 2024-05-08T19:48:37.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.954+0000 7f14aa0ee700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14a40a84b0 0x7f14a4152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:37.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.954+0000 7f14aa0ee700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14a40aab40 0x7f14a41e9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:37.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.954+0000 7f14aa0ee700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14a414eee0 0x7f14a4155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:37.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.954+0000 7f14aa0ee700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a4155ba0 con 0x7f14a414eee0 2024-05-08T19:48:37.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.954+0000 7f14aa0ee700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a41e9590 con 0x7f14a40aab40 2024-05-08T19:48:37.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.954+0000 7f14aa0ee700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a41ebb70 con 0x7f14a40a84b0 2024-05-08T19:48:37.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.954+0000 7f14a3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14a414eee0 0x7f14a4155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:37.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.954+0000 7f14a3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14a414eee0 0x7f14a4155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54194/0 (socket says 172.21.15.47:54194) 2024-05-08T19:48:37.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.954+0000 7f14a3fff700 1 -- 172.21.15.47:0/335813785 learned_addr learned my addr 172.21.15.47:0/335813785 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.954+0000 7f14a2ffd700 1 --2- 172.21.15.47:0/335813785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14a40aab40 0x7f14a41e9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.954+0000 7f14a37fe700 1 --2- 172.21.15.47:0/335813785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14a40a84b0 0x7f14a4152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.955+0000 7f14a3fff700 1 -- 172.21.15.47:0/335813785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14a40a84b0 msgr2=0x7f14a4152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.955+0000 7f14a3fff700 1 --2- 172.21.15.47:0/335813785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14a40a84b0 0x7f14a4152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.955+0000 7f14a3fff700 1 -- 172.21.15.47:0/335813785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14a40aab40 msgr2=0x7f14a41e9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.955+0000 7f14a3fff700 1 --2- 172.21.15.47:0/335813785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14a40aab40 0x7f14a41e9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.955+0000 7f14a3fff700 1 -- 172.21.15.47:0/335813785 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14980094a0 con 0x7f14a414eee0 2024-05-08T19:48:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.955+0000 7f14a3fff700 1 --2- 172.21.15.47:0/335813785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14a414eee0 0x7f14a4155370 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f149c00cc10 tx=0x7f149c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.955+0000 7f148bfff700 1 -- 172.21.15.47:0/335813785 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c00aa40 con 0x7f14a414eee0 2024-05-08T19:48:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.955+0000 7f148bfff700 1 -- 172.21.15.47:0/335813785 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c00aba0 con 0x7f14a414eee0 2024-05-08T19:48:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.955+0000 7f148bfff700 1 -- 172.21.15.47:0/335813785 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c0070d0 con 0x7f14a414eee0 2024-05-08T19:48:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.955+0000 7f14aa0ee700 1 -- 172.21.15.47:0/335813785 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a40c0dc0 con 0x7f14a414eee0 2024-05-08T19:48:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.955+0000 7f14aa0ee700 1 -- 172.21.15.47:0/335813785 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a40c1380 con 0x7f14a414eee0 2024-05-08T19:48:37.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.956+0000 7f14aa0ee700 1 -- 172.21.15.47:0/335813785 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a404ec60 con 0x7f14a414eee0 2024-05-08T19:48:37.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.957+0000 7f148bfff700 1 -- 172.21.15.47:0/335813785 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f149c007230 con 0x7f14a414eee0 2024-05-08T19:48:37.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.957+0000 7f148bfff700 1 --2- 172.21.15.47:0/335813785 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f149006ac90 0x7f149006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:37.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.957+0000 7f148bfff700 1 -- 172.21.15.47:0/335813785 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f149c089110 con 0x7f14a414eee0 2024-05-08T19:48:37.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.957+0000 7f14a37fe700 1 --2- 172.21.15.47:0/335813785 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f149006ac90 0x7f149006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:37.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.958+0000 7f14a37fe700 1 --2- 172.21.15.47:0/335813785 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f149006ac90 0x7f149006d150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f14940011e0 tx=0x7f1494009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:37.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:37.962+0000 7f148bfff700 1 -- 172.21.15.47:0/335813785 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f149c053f30 con 0x7f14a414eee0 2024-05-08T19:48:38.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.168+0000 7f14aa0ee700 1 -- 172.21.15.47:0/335813785 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f14a4072b20 con 0x7f149006ac90 2024-05-08T19:48:38.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.169+0000 7f148bfff700 1 -- 172.21.15.47:0/335813785 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1494001cb0 con 0x7f149006ac90 2024-05-08T19:48:38.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.171+0000 7f14aa0ee700 1 -- 172.21.15.47:0/335813785 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f149006ac90 msgr2=0x7f149006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.171+0000 7f14aa0ee700 1 --2- 172.21.15.47:0/335813785 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f149006ac90 0x7f149006d150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f14940011e0 tx=0x7f1494009040 comp rx=0 tx=0).stop 2024-05-08T19:48:38.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.171+0000 7f14aa0ee700 1 -- 172.21.15.47:0/335813785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14a414eee0 msgr2=0x7f14a4155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.171+0000 7f14aa0ee700 1 --2- 172.21.15.47:0/335813785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14a414eee0 0x7f14a4155370 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f149c00cc10 tx=0x7f149c00cf20 comp rx=0 tx=0).stop 2024-05-08T19:48:38.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.171+0000 7f14aa0ee700 1 -- 172.21.15.47:0/335813785 shutdown_connections 2024-05-08T19:48:38.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.171+0000 7f14aa0ee700 1 --2- 172.21.15.47:0/335813785 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f149006ac90 0x7f149006d150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.171+0000 7f14aa0ee700 1 --2- 172.21.15.47:0/335813785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14a414eee0 0x7f14a4155370 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.171+0000 7f14aa0ee700 1 --2- 172.21.15.47:0/335813785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14a40a84b0 0x7f14a4152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.171+0000 7f14aa0ee700 1 --2- 172.21.15.47:0/335813785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14a40aab40 0x7f14a41e9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.171+0000 7f14aa0ee700 1 -- 172.21.15.47:0/335813785 >> 172.21.15.47:0/335813785 conn(0x7f14a40c3c20 msgr2=0x7f14a4073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:38.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.171+0000 7f14aa0ee700 1 -- 172.21.15.47:0/335813785 shutdown_connections 2024-05-08T19:48:38.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.171+0000 7f14aa0ee700 1 -- 172.21.15.47:0/335813785 wait complete. 2024-05-08T19:48:38.163 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T19:48:38.174 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T19:48:38.174 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T19:48:38.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.313+0000 7fe009d77700 1 Processor -- start 2024-05-08T19:48:38.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.313+0000 7fe009d77700 1 -- start start 2024-05-08T19:48:38.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.314+0000 7fe009d77700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0041557e0 0x7fe00414ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.314+0000 7fe009d77700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0040c2880 con 0x7fe0040c1d90 2024-05-08T19:48:38.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.314+0000 7fe009d77700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0040a8bc0 con 0x7fe0040c2b10 2024-05-08T19:48:38.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.314+0000 7fe009d77700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040c3970 con 0x7fe0041557e0 2024-05-08T19:48:38.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.314+0000 7fe0037fe700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe0040c1d90 0x7fe0040c2170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55908/0 (socket says 172.21.15.47:55908) 2024-05-08T19:48:38.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.314+0000 7fe0037fe700 1 -- 172.21.15.47:0/3463096729 learned_addr learned my addr 172.21.15.47:0/3463096729 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:48:38.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.314+0000 7fe003fff700 1 --2- 172.21.15.47:0/3463096729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0041557e0 0x7fe00414ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.315+0000 7fe0027fc700 1 -- 172.21.15.47:0/3463096729 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15363343 0 0) 0x7fe0040c2880 con 0x7fe0040c1d90 2024-05-08T19:48:38.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.315+0000 7fe0027fc700 1 -- 172.21.15.47:0/3463096729 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff00035b0 con 0x7fe0040c1d90 2024-05-08T19:48:38.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.315+0000 7fe0027fc700 1 -- 172.21.15.47:0/3463096729 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043301349 0 0) 0x7fe0040a8bc0 con 0x7fe0040c2b10 2024-05-08T19:48:38.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.315+0000 7fe0027fc700 1 -- 172.21.15.47:0/3463096729 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0040c2880 con 0x7fe0040c2b10 2024-05-08T19:48:38.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.315+0000 7fe003fff700 1 -- 172.21.15.47:0/3463096729 >> v1:172.21.15.177:6789/0 conn(0x7fe0040c2b10 legacy=0x7fe0040a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.315+0000 7fe003fff700 1 -- 172.21.15.47:0/3463096729 >> v1:172.21.15.47:6789/0 conn(0x7fe0040c1d90 legacy=0x7fe0040c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.315+0000 7fe003fff700 1 -- 172.21.15.47:0/3463096729 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0040c3690 con 0x7fe0041557e0 2024-05-08T19:48:38.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.315+0000 7fe003fff700 1 --2- 172.21.15.47:0/3463096729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0041557e0 0x7fe00414ea40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009dc0 tx=0x7fdffc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1363c729a9c22409 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:38.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.315+0000 7fe0027fc700 1 -- 172.21.15.47:0/3463096729 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00e070 con 0x7fe0041557e0 2024-05-08T19:48:38.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.315+0000 7fe0027fc700 1 -- 172.21.15.47:0/3463096729 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc00bb20 con 0x7fe0041557e0 2024-05-08T19:48:38.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.315+0000 7fe0027fc700 1 -- 172.21.15.47:0/3463096729 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00be90 con 0x7fe0041557e0 2024-05-08T19:48:38.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.316+0000 7fe009d77700 1 -- 172.21.15.47:0/3463096729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0041557e0 msgr2=0x7fe00414ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.316+0000 7fe009d77700 1 --2- 172.21.15.47:0/3463096729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0041557e0 0x7fe00414ea40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009dc0 tx=0x7fdffc00b330 comp rx=0 tx=0).stop 2024-05-08T19:48:38.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.316+0000 7fe009d77700 1 -- 172.21.15.47:0/3463096729 shutdown_connections 2024-05-08T19:48:38.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.316+0000 7fe009d77700 1 --2- 172.21.15.47:0/3463096729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0041557e0 0x7fe00414ea40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.316+0000 7fe009d77700 1 -- 172.21.15.47:0/3463096729 >> 172.21.15.47:0/3463096729 conn(0x7fe0040c3c20 msgr2=0x7fe0040c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:38.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.316+0000 7fe009d77700 1 -- 172.21.15.47:0/3463096729 shutdown_connections 2024-05-08T19:48:38.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.316+0000 7fe009d77700 1 -- 172.21.15.47:0/3463096729 wait complete. 2024-05-08T19:48:38.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.317+0000 7fe009d77700 1 Processor -- start 2024-05-08T19:48:38.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.317+0000 7fe009d77700 1 -- start start 2024-05-08T19:48:38.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe009d77700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0040c1d90 0x7fe004141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe009d77700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0040c2b10 0x7fe0040a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe009d77700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0041557e0 0x7fe00413f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe009d77700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0041491f0 con 0x7fe0040c2b10 2024-05-08T19:48:38.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe009d77700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0041e6020 con 0x7fe0041557e0 2024-05-08T19:48:38.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe009d77700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0041e62e0 con 0x7fe0040c1d90 2024-05-08T19:48:38.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe002ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0040c2b10 0x7fe0040a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe002ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0040c2b10 0x7fe0040a9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54202/0 (socket says 172.21.15.47:54202) 2024-05-08T19:48:38.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe002ffd700 1 -- 172.21.15.47:0/900597559 learned_addr learned my addr 172.21.15.47:0/900597559 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:38.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe0037fe700 1 --2- 172.21.15.47:0/900597559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0040c1d90 0x7fe004141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe003fff700 1 --2- 172.21.15.47:0/900597559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0041557e0 0x7fe00413f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe002ffd700 1 -- 172.21.15.47:0/900597559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0040c1d90 msgr2=0x7fe004141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe002ffd700 1 --2- 172.21.15.47:0/900597559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0040c1d90 0x7fe004141a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe002ffd700 1 -- 172.21.15.47:0/900597559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0041557e0 msgr2=0x7fe00413f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe002ffd700 1 --2- 172.21.15.47:0/900597559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0041557e0 0x7fe00413f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.318+0000 7fe002ffd700 1 -- 172.21.15.47:0/900597559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc009a70 con 0x7fe0040c2b10 2024-05-08T19:48:38.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.319+0000 7fe002ffd700 1 --2- 172.21.15.47:0/900597559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0040c2b10 0x7fe0040a9fa0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdfec00c490 tx=0x7fdfec00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:38.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.319+0000 7fdffbfff700 1 -- 172.21.15.47:0/900597559 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec00cea0 con 0x7fe0040c2b10 2024-05-08T19:48:38.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.319+0000 7fdffbfff700 1 -- 172.21.15.47:0/900597559 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec0052f0 con 0x7fe0040c2b10 2024-05-08T19:48:38.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.319+0000 7fe009d77700 1 -- 172.21.15.47:0/900597559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0041e65c0 con 0x7fe0040c2b10 2024-05-08T19:48:38.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.319+0000 7fdffbfff700 1 -- 172.21.15.47:0/900597559 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec003680 con 0x7fe0040c2b10 2024-05-08T19:48:38.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.319+0000 7fe009d77700 1 -- 172.21.15.47:0/900597559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0041e6b80 con 0x7fe0040c2b10 2024-05-08T19:48:38.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.320+0000 7fe009d77700 1 -- 172.21.15.47:0/900597559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe0041552c0 con 0x7fe0040c2b10 2024-05-08T19:48:38.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.320+0000 7fdffbfff700 1 -- 172.21.15.47:0/900597559 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdfec0037e0 con 0x7fe0040c2b10 2024-05-08T19:48:38.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.321+0000 7fdffbfff700 1 --2- 172.21.15.47:0/900597559 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fdfe406ac90 0x7fdfe406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.321+0000 7fdffbfff700 1 -- 172.21.15.47:0/900597559 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdfec088a20 con 0x7fe0040c2b10 2024-05-08T19:48:38.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.321+0000 7fe0037fe700 1 --2- 172.21.15.47:0/900597559 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fdfe406ac90 0x7fdfe406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.321+0000 7fdffbfff700 1 --2- 172.21.15.47:0/900597559 >> [v2:172.21.15.47:6816/46998,v1:172.21.15.47:6817/46998] conn(0x7fdfe4074570 0x7fdfe4076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.321+0000 7fdffbfff700 1 -- 172.21.15.47:0/900597559 --> [v2:172.21.15.47:6816/46998,v1:172.21.15.47:6817/46998] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdfe40770e0 con 0x7fdfe4074570 2024-05-08T19:48:38.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.321+0000 7fdffbfff700 1 -- 172.21.15.47:0/900597559 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfec08d2c0 con 0x7fe0040c2b10 2024-05-08T19:48:38.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.321+0000 7fe003fff700 1 --2- 172.21.15.47:0/900597559 >> [v2:172.21.15.47:6816/46998,v1:172.21.15.47:6817/46998] conn(0x7fdfe4074570 0x7fdfe4076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.321+0000 7fe0037fe700 1 --2- 172.21.15.47:0/900597559 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fdfe406ac90 0x7fdfe406d150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdff4007fd0 tx=0x7fdff4007dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:38.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.321+0000 7fe003fff700 1 --2- 172.21.15.47:0/900597559 >> [v2:172.21.15.47:6816/46998,v1:172.21.15.47:6817/46998] conn(0x7fdfe4074570 0x7fdfe4076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:38.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.322+0000 7fdffbfff700 1 -- 172.21.15.47:0/900597559 <== osd.1 v2:172.21.15.47:6816/46998 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fdfe40770e0 con 0x7fdfe4074570 2024-05-08T19:48:38.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.337+0000 7fe009d77700 1 -- 172.21.15.47:0/900597559 --> [v2:172.21.15.47:6816/46998,v1:172.21.15.47:6817/46998] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe004154fe0 con 0x7fdfe4074570 2024-05-08T19:48:38.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.337+0000 7fdffbfff700 1 -- 172.21.15.47:0/900597559 <== osd.1 v2:172.21.15.47:6816/46998 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdffc0098f0 con 0x7fdfe4074570 2024-05-08T19:48:38.327 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-08T19:48:38.327 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T19:48:38.327 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-08T19:48:38.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.337+0000 7fe009d77700 1 -- 172.21.15.47:0/900597559 >> [v2:172.21.15.47:6816/46998,v1:172.21.15.47:6817/46998] conn(0x7fdfe4074570 msgr2=0x7fdfe4076a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.337+0000 7fe009d77700 1 --2- 172.21.15.47:0/900597559 >> [v2:172.21.15.47:6816/46998,v1:172.21.15.47:6817/46998] conn(0x7fdfe4074570 0x7fdfe4076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.337+0000 7fe009d77700 1 -- 172.21.15.47:0/900597559 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fdfe406ac90 msgr2=0x7fdfe406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.337+0000 7fe009d77700 1 --2- 172.21.15.47:0/900597559 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fdfe406ac90 0x7fdfe406d150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdff4007fd0 tx=0x7fdff4007dc0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.337+0000 7fe009d77700 1 -- 172.21.15.47:0/900597559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0040c2b10 msgr2=0x7fe0040a9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.337+0000 7fe009d77700 1 --2- 172.21.15.47:0/900597559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0040c2b10 0x7fe0040a9fa0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdfec00c490 tx=0x7fdfec00c7a0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.337+0000 7fe003fff700 1 -- 172.21.15.47:0/900597559 reap_dead start 2024-05-08T19:48:38.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.337+0000 7fe009d77700 1 -- 172.21.15.47:0/900597559 shutdown_connections 2024-05-08T19:48:38.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.337+0000 7fe009d77700 1 -- 172.21.15.47:0/900597559 >> 172.21.15.47:0/900597559 conn(0x7fe0040c3c20 msgr2=0x7fe004071610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:38.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.338+0000 7fe009d77700 1 -- 172.21.15.47:0/900597559 shutdown_connections 2024-05-08T19:48:38.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.338+0000 7fe009d77700 1 -- 172.21.15.47:0/900597559 wait complete. 2024-05-08T19:48:38.340 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T19:48:38.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.477+0000 7f284a84f700 1 Processor -- start 2024-05-08T19:48:38.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.477+0000 7f284a84f700 1 -- start start 2024-05-08T19:48:38.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.477+0000 7f284a84f700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f284414eee0 0x7f28440ac250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.477+0000 7f284a84f700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f28440a84b0 0x7f28440c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.477+0000 7f284a84f700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28440c2880 con 0x7f28440aab40 2024-05-08T19:48:38.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.477+0000 7f284a84f700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28440ab450 con 0x7f28440a84b0 2024-05-08T19:48:38.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.477+0000 7f284a84f700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28440c2b60 con 0x7f284414eee0 2024-05-08T19:48:38.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.478+0000 7f2848dec700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f28440a84b0 0x7f28440c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.478+0000 7f28437fe700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f28440aab40 0x7f28440a9ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55914/0 (socket says 172.21.15.47:55914) 2024-05-08T19:48:38.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.478+0000 7f28437fe700 1 -- 172.21.15.47:0/585280960 learned_addr learned my addr 172.21.15.47:0/585280960 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:48:38.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.478+0000 7f2843fff700 1 --2- 172.21.15.47:0/585280960 >> v2:172.21.15.177:3300/0 conn(0x7f284414eee0 0x7f28440ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.478+0000 7f2848dec700 1 -- 172.21.15.47:0/585280960 >> v2:172.21.15.177:3300/0 conn(0x7f284414eee0 msgr2=0x7f28440ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:38.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.478+0000 7f2848dec700 1 --2- 172.21.15.47:0/585280960 >> v2:172.21.15.177:3300/0 conn(0x7f284414eee0 0x7f28440ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.478+0000 7f2848dec700 1 -- 172.21.15.47:0/585280960 >> v1:172.21.15.47:6789/0 conn(0x7f28440aab40 legacy=0x7f28440a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.478+0000 7f2848dec700 1 -- 172.21.15.47:0/585280960 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28441526e0 con 0x7f28440a84b0 2024-05-08T19:48:38.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.478+0000 7f2842ffd700 1 -- 172.21.15.47:0/585280960 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611394766 0 0) 0x7f28440c2880 con 0x7f28440aab40 2024-05-08T19:48:38.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.478+0000 7f2848dec700 1 --2- 172.21.15.47:0/585280960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440a84b0 0x7f28440c2ff0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f28440c4b50 tx=0x7f283c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10b5220b84fc5cf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:38.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.478+0000 7f2842ffd700 1 -- 172.21.15.47:0/585280960 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c00e070 con 0x7f28440a84b0 2024-05-08T19:48:38.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.478+0000 7f2842ffd700 1 -- 172.21.15.47:0/585280960 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c00bbd0 con 0x7f28440a84b0 2024-05-08T19:48:38.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.478+0000 7f2842ffd700 1 -- 172.21.15.47:0/585280960 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c012430 con 0x7f28440a84b0 2024-05-08T19:48:38.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.479+0000 7f284a84f700 1 -- 172.21.15.47:0/585280960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440a84b0 msgr2=0x7f28440c2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.479+0000 7f284a84f700 1 --2- 172.21.15.47:0/585280960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440a84b0 0x7f28440c2ff0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f28440c4b50 tx=0x7f283c00b330 comp rx=0 tx=0).stop 2024-05-08T19:48:38.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.479+0000 7f284a84f700 1 -- 172.21.15.47:0/585280960 shutdown_connections 2024-05-08T19:48:38.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.479+0000 7f284a84f700 1 --2- 172.21.15.47:0/585280960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440a84b0 0x7f28440c2ff0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.479+0000 7f284a84f700 1 --2- 172.21.15.47:0/585280960 >> v2:172.21.15.177:3300/0 conn(0x7f284414eee0 0x7f28440ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.479+0000 7f284a84f700 1 -- 172.21.15.47:0/585280960 >> 172.21.15.47:0/585280960 conn(0x7f28440c3c20 msgr2=0x7f28440c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:38.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.479+0000 7f284a84f700 1 -- 172.21.15.47:0/585280960 shutdown_connections 2024-05-08T19:48:38.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.479+0000 7f284a84f700 1 -- 172.21.15.47:0/585280960 wait complete. 2024-05-08T19:48:38.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.480+0000 7f284a84f700 1 Processor -- start 2024-05-08T19:48:38.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.480+0000 7f284a84f700 1 -- start start 2024-05-08T19:48:38.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f284a84f700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28440a84b0 0x7f28441ead20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f284a84f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440aab40 0x7f28440c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f284a84f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f284414eee0 0x7f284414a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f284a84f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28440bea10 con 0x7f28440aab40 2024-05-08T19:48:38.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f284a84f700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28440c0bb0 con 0x7f284414eee0 2024-05-08T19:48:38.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f284a84f700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28440c0e50 con 0x7f28440a84b0 2024-05-08T19:48:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f28437fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440aab40 0x7f28440c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f28437fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440aab40 0x7f28440c0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54232/0 (socket says 172.21.15.47:54232) 2024-05-08T19:48:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f28437fe700 1 -- 172.21.15.47:0/3960405913 learned_addr learned my addr 172.21.15.47:0/3960405913 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f2843fff700 1 --2- 172.21.15.47:0/3960405913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28440a84b0 0x7f28441ead20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f2848dec700 1 --2- 172.21.15.47:0/3960405913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f284414eee0 0x7f284414a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f28437fe700 1 -- 172.21.15.47:0/3960405913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28440a84b0 msgr2=0x7f28441ead20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f28437fe700 1 --2- 172.21.15.47:0/3960405913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28440a84b0 0x7f28441ead20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f28437fe700 1 -- 172.21.15.47:0/3960405913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f284414eee0 msgr2=0x7f284414a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f28437fe700 1 --2- 172.21.15.47:0/3960405913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f284414eee0 0x7f284414a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f28437fe700 1 -- 172.21.15.47:0/3960405913 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c009a70 con 0x7f28440aab40 2024-05-08T19:48:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.481+0000 7f28437fe700 1 --2- 172.21.15.47:0/3960405913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440aab40 0x7f28440c0080 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f283800c540 tx=0x7f283800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.482+0000 7f2840ff9700 1 -- 172.21.15.47:0/3960405913 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838004c80 con 0x7f28440aab40 2024-05-08T19:48:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.482+0000 7f2840ff9700 1 -- 172.21.15.47:0/3960405913 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2838004de0 con 0x7f28440aab40 2024-05-08T19:48:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.482+0000 7f284a84f700 1 -- 172.21.15.47:0/3960405913 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28440c1130 con 0x7f28440aab40 2024-05-08T19:48:38.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.482+0000 7f2840ff9700 1 -- 172.21.15.47:0/3960405913 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838007310 con 0x7f28440aab40 2024-05-08T19:48:38.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.482+0000 7f284a84f700 1 -- 172.21.15.47:0/3960405913 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28440bf810 con 0x7f28440aab40 2024-05-08T19:48:38.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.483+0000 7f284a84f700 1 -- 172.21.15.47:0/3960405913 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284404ec60 con 0x7f28440aab40 2024-05-08T19:48:38.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.483+0000 7f2840ff9700 1 -- 172.21.15.47:0/3960405913 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2838007470 con 0x7f28440aab40 2024-05-08T19:48:38.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.483+0000 7f2840ff9700 1 --2- 172.21.15.47:0/3960405913 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f283006ac90 0x7f283006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.484+0000 7f2840ff9700 1 -- 172.21.15.47:0/3960405913 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2838089330 con 0x7f28440aab40 2024-05-08T19:48:38.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.484+0000 7f2843fff700 1 --2- 172.21.15.47:0/3960405913 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f283006ac90 0x7f283006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.484+0000 7f2843fff700 1 --2- 172.21.15.47:0/3960405913 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f283006ac90 0x7f283006d150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2834006b20 tx=0x7f2834008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:38.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.488+0000 7f2840ff9700 1 -- 172.21.15.47:0/3960405913 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2838054140 con 0x7f28440aab40 2024-05-08T19:48:38.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.696+0000 7f284a84f700 1 -- 172.21.15.47:0/3960405913 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2844072b20 con 0x7f283006ac90 2024-05-08T19:48:38.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.697+0000 7f2840ff9700 1 -- 172.21.15.47:0/3960405913 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f28340076b0 con 0x7f283006ac90 2024-05-08T19:48:38.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.699+0000 7f284a84f700 1 -- 172.21.15.47:0/3960405913 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f283006ac90 msgr2=0x7f283006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.699+0000 7f284a84f700 1 --2- 172.21.15.47:0/3960405913 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f283006ac90 0x7f283006d150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2834006b20 tx=0x7f2834008040 comp rx=0 tx=0).stop 2024-05-08T19:48:38.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.699+0000 7f284a84f700 1 -- 172.21.15.47:0/3960405913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440aab40 msgr2=0x7f28440c0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.699+0000 7f284a84f700 1 --2- 172.21.15.47:0/3960405913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440aab40 0x7f28440c0080 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f283800c540 tx=0x7f283800c850 comp rx=0 tx=0).stop 2024-05-08T19:48:38.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.699+0000 7f284a84f700 1 -- 172.21.15.47:0/3960405913 shutdown_connections 2024-05-08T19:48:38.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.699+0000 7f284a84f700 1 --2- 172.21.15.47:0/3960405913 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f283006ac90 0x7f283006d150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.699+0000 7f284a84f700 1 --2- 172.21.15.47:0/3960405913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f284414eee0 0x7f284414a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.699+0000 7f284a84f700 1 --2- 172.21.15.47:0/3960405913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28440a84b0 0x7f28441ead20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.699+0000 7f284a84f700 1 --2- 172.21.15.47:0/3960405913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440aab40 0x7f28440c0080 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.699+0000 7f284a84f700 1 -- 172.21.15.47:0/3960405913 >> 172.21.15.47:0/3960405913 conn(0x7f28440c3c20 msgr2=0x7f28440a8890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:38.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.699+0000 7f284a84f700 1 -- 172.21.15.47:0/3960405913 shutdown_connections 2024-05-08T19:48:38.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.699+0000 7f284a84f700 1 -- 172.21.15.47:0/3960405913 wait complete. 2024-05-08T19:48:38.691 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T19:48:38.702 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T19:48:38.702 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T19:48:38.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.842+0000 7f02ff151700 1 Processor -- start 2024-05-08T19:48:38.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.842+0000 7f02ff151700 1 -- start start 2024-05-08T19:48:38.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.842+0000 7f02ff151700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f02f8154900 0x7f02f806c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.842+0000 7f02ff151700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f02f80c8150 0x7f02f806cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.842+0000 7f02ff151700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f80c8d60 con 0x7f02f8152160 2024-05-08T19:48:38.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.842+0000 7f02ff151700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f806c530 con 0x7f02f80c8150 2024-05-08T19:48:38.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.842+0000 7f02ff151700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f8154e70 con 0x7f02f8154900 2024-05-08T19:48:38.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.843+0000 7f02fd6ee700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f02f80c8150 0x7f02f806cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.843+0000 7f02fd6ee700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f02f80c8150 0x7f02f806cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54246/0 (socket says 172.21.15.47:54246) 2024-05-08T19:48:38.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.843+0000 7f02fd6ee700 1 -- 172.21.15.47:0/2471344316 learned_addr learned my addr 172.21.15.47:0/2471344316 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:38.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.843+0000 7f02f7fff700 1 --2- 172.21.15.47:0/2471344316 >> v2:172.21.15.177:3300/0 conn(0x7f02f8154900 0x7f02f806c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.843+0000 7f02fd6ee700 1 -- 172.21.15.47:0/2471344316 >> v2:172.21.15.177:3300/0 conn(0x7f02f8154900 msgr2=0x7f02f806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:38.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.843+0000 7f02fd6ee700 1 --2- 172.21.15.47:0/2471344316 >> v2:172.21.15.177:3300/0 conn(0x7f02f8154900 0x7f02f806c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.843+0000 7f02fd6ee700 1 -- 172.21.15.47:0/2471344316 >> v1:172.21.15.177:6789/0 conn(0x7f02f8152160 legacy=0x7f02f80c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.843+0000 7f02fd6ee700 1 -- 172.21.15.47:0/2471344316 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f8155150 con 0x7f02f80c8150 2024-05-08T19:48:38.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.843+0000 7f02fd6ee700 1 --2- 172.21.15.47:0/2471344316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f80c8150 0x7f02f806cec0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f02f80cb260 tx=0x7f02f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8724e1baf31ff4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.843+0000 7f02f77fe700 1 -- 172.21.15.47:0/2471344316 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f000e070 con 0x7f02f80c8150 2024-05-08T19:48:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.843+0000 7f02f77fe700 1 -- 172.21.15.47:0/2471344316 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f000b910 con 0x7f02f80c8150 2024-05-08T19:48:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.843+0000 7f02f77fe700 1 -- 172.21.15.47:0/2471344316 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f000bcc0 con 0x7f02f80c8150 2024-05-08T19:48:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.844+0000 7f02ff151700 1 -- 172.21.15.47:0/2471344316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f80c8150 msgr2=0x7f02f806cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.844+0000 7f02ff151700 1 --2- 172.21.15.47:0/2471344316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f80c8150 0x7f02f806cec0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f02f80cb260 tx=0x7f02f000b330 comp rx=0 tx=0).stop 2024-05-08T19:48:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.844+0000 7f02ff151700 1 -- 172.21.15.47:0/2471344316 shutdown_connections 2024-05-08T19:48:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.844+0000 7f02ff151700 1 --2- 172.21.15.47:0/2471344316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f80c8150 0x7f02f806cec0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.844+0000 7f02ff151700 1 --2- 172.21.15.47:0/2471344316 >> v2:172.21.15.177:3300/0 conn(0x7f02f8154900 0x7f02f806c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.844+0000 7f02ff151700 1 -- 172.21.15.47:0/2471344316 >> 172.21.15.47:0/2471344316 conn(0x7f02f80abea0 msgr2=0x7f02f80ac2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.844+0000 7f02ff151700 1 -- 172.21.15.47:0/2471344316 shutdown_connections 2024-05-08T19:48:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.844+0000 7f02ff151700 1 -- 172.21.15.47:0/2471344316 wait complete. 2024-05-08T19:48:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.845+0000 7f02ff151700 1 Processor -- start 2024-05-08T19:48:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.845+0000 7f02ff151700 1 -- start start 2024-05-08T19:48:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02ff151700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f80c8150 0x7f02f80c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02ff151700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f8152160 0x7f02f814d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02ff151700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02f8154900 0x7f02f81df030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02ff151700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f81e0ec0 con 0x7f02f80c8150 2024-05-08T19:48:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02ff151700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80cae30 con 0x7f02f8152160 2024-05-08T19:48:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02ff151700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f81ee290 con 0x7f02f8154900 2024-05-08T19:48:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02fceed700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f80c8150 0x7f02f80c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02f7fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f8152160 0x7f02f814d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02fceed700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f80c8150 0x7f02f80c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54262/0 (socket says 172.21.15.47:54262) 2024-05-08T19:48:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02fceed700 1 -- 172.21.15.47:0/1743679793 learned_addr learned my addr 172.21.15.47:0/1743679793 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02f7fff700 1 --2- 172.21.15.47:0/1743679793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f8152160 0x7f02f814d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:35684/0 (socket says 172.21.15.47:35684) 2024-05-08T19:48:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02fd6ee700 1 --2- 172.21.15.47:0/1743679793 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02f8154900 0x7f02f81df030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02fceed700 1 -- 172.21.15.47:0/1743679793 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02f8154900 msgr2=0x7f02f81df030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02fceed700 1 --2- 172.21.15.47:0/1743679793 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02f8154900 0x7f02f81df030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02fceed700 1 -- 172.21.15.47:0/1743679793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f8152160 msgr2=0x7f02f814d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02fceed700 1 --2- 172.21.15.47:0/1743679793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f8152160 0x7f02f814d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02fceed700 1 -- 172.21.15.47:0/1743679793 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f0009b30 con 0x7f02f80c8150 2024-05-08T19:48:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02f7fff700 1 --2- 172.21.15.47:0/1743679793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f8152160 0x7f02f814d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:48:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.846+0000 7f02fceed700 1 --2- 172.21.15.47:0/1743679793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f80c8150 0x7f02f80c8ef0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00c490 tx=0x7f02ec00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.847+0000 7f02f57fa700 1 -- 172.21.15.47:0/1743679793 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec00cea0 con 0x7f02f80c8150 2024-05-08T19:48:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.847+0000 7f02f57fa700 1 -- 172.21.15.47:0/1743679793 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec0052f0 con 0x7f02f80c8150 2024-05-08T19:48:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.847+0000 7f02ff151700 1 -- 172.21.15.47:0/1743679793 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f81ee570 con 0x7f02f80c8150 2024-05-08T19:48:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.847+0000 7f02f57fa700 1 -- 172.21.15.47:0/1743679793 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec006860 con 0x7f02f80c8150 2024-05-08T19:48:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.847+0000 7f02ff151700 1 -- 172.21.15.47:0/1743679793 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f814d5c0 con 0x7f02f80c8150 2024-05-08T19:48:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.847+0000 7f02ff151700 1 -- 172.21.15.47:0/1743679793 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f02f80ca940 con 0x7f02f80c8150 2024-05-08T19:48:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.848+0000 7f02f57fa700 1 -- 172.21.15.47:0/1743679793 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f02ec003680 con 0x7f02f80c8150 2024-05-08T19:48:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.848+0000 7f02f57fa700 1 --2- 172.21.15.47:0/1743679793 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f02dc06ac90 0x7f02dc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.849+0000 7f02f57fa700 1 -- 172.21.15.47:0/1743679793 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f02ec088800 con 0x7f02f80c8150 2024-05-08T19:48:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.849+0000 7f02f57fa700 1 --2- 172.21.15.47:0/1743679793 >> [v2:172.21.15.47:6808/46997,v1:172.21.15.47:6809/46997] conn(0x7f02dc074570 0x7f02dc076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.849+0000 7f02f57fa700 1 -- 172.21.15.47:0/1743679793 --> [v2:172.21.15.47:6808/46997,v1:172.21.15.47:6809/46997] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f02dc0770e0 con 0x7f02dc074570 2024-05-08T19:48:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.849+0000 7f02f57fa700 1 -- 172.21.15.47:0/1743679793 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02ec08ae60 con 0x7f02f80c8150 2024-05-08T19:48:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.849+0000 7f02f7fff700 1 --2- 172.21.15.47:0/1743679793 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f02dc06ac90 0x7f02dc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.849+0000 7f02fd6ee700 1 --2- 172.21.15.47:0/1743679793 >> [v2:172.21.15.47:6808/46997,v1:172.21.15.47:6809/46997] conn(0x7f02dc074570 0x7f02dc076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.849+0000 7f02fd6ee700 1 --2- 172.21.15.47:0/1743679793 >> [v2:172.21.15.47:6808/46997,v1:172.21.15.47:6809/46997] conn(0x7f02dc074570 0x7f02dc076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:38.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.849+0000 7f02f7fff700 1 --2- 172.21.15.47:0/1743679793 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f02dc06ac90 0x7f02dc06d150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009f30 tx=0x7f02e4009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:38.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.850+0000 7f02f57fa700 1 -- 172.21.15.47:0/1743679793 <== osd.2 v2:172.21.15.47:6808/46997 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f02dc0770e0 con 0x7f02dc074570 2024-05-08T19:48:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.865+0000 7f02ff151700 1 -- 172.21.15.47:0/1743679793 --> [v2:172.21.15.47:6808/46997,v1:172.21.15.47:6809/46997] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f02f806d400 con 0x7f02dc074570 2024-05-08T19:48:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.865+0000 7f02f57fa700 1 -- 172.21.15.47:0/1743679793 <== osd.2 v2:172.21.15.47:6808/46997 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f02f00092e0 con 0x7f02dc074570 2024-05-08T19:48:38.855 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-08T19:48:38.855 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T19:48:38.855 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-08T19:48:38.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.865+0000 7f02ff151700 1 -- 172.21.15.47:0/1743679793 >> [v2:172.21.15.47:6808/46997,v1:172.21.15.47:6809/46997] conn(0x7f02dc074570 msgr2=0x7f02dc076a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.865+0000 7f02ff151700 1 --2- 172.21.15.47:0/1743679793 >> [v2:172.21.15.47:6808/46997,v1:172.21.15.47:6809/46997] conn(0x7f02dc074570 0x7f02dc076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.865+0000 7f02ff151700 1 -- 172.21.15.47:0/1743679793 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f02dc06ac90 msgr2=0x7f02dc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.865+0000 7f02ff151700 1 --2- 172.21.15.47:0/1743679793 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f02dc06ac90 0x7f02dc06d150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009f30 tx=0x7f02e4009210 comp rx=0 tx=0).stop 2024-05-08T19:48:38.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.865+0000 7f02ff151700 1 -- 172.21.15.47:0/1743679793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f80c8150 msgr2=0x7f02f80c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.865+0000 7f02ff151700 1 --2- 172.21.15.47:0/1743679793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f80c8150 0x7f02f80c8ef0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00c490 tx=0x7f02ec00c7a0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.865+0000 7f02fd6ee700 1 -- 172.21.15.47:0/1743679793 reap_dead start 2024-05-08T19:48:38.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.865+0000 7f02ff151700 1 -- 172.21.15.47:0/1743679793 shutdown_connections 2024-05-08T19:48:38.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.865+0000 7f02ff151700 1 -- 172.21.15.47:0/1743679793 >> 172.21.15.47:0/1743679793 conn(0x7f02f80abea0 msgr2=0x7f02f81e1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:38.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.865+0000 7f02ff151700 1 -- 172.21.15.47:0/1743679793 shutdown_connections 2024-05-08T19:48:38.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:38.865+0000 7f02ff151700 1 -- 172.21.15.47:0/1743679793 wait complete. 2024-05-08T19:48:38.868 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T19:48:38.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.003+0000 7fe4c8eba700 1 Processor -- start 2024-05-08T19:48:38.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.004+0000 7fe4c8eba700 1 -- start start 2024-05-08T19:48:38.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.004+0000 7fe4c8eba700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe4c40a9e00 0x7fe4c40c1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:38.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.004+0000 7fe4c8eba700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c41561d0 con 0x7fe4c40c3840 2024-05-08T19:48:38.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.004+0000 7fe4c8eba700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c4155f60 con 0x7fe4c41500f0 2024-05-08T19:48:38.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.004+0000 7fe4c8eba700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c40c3520 con 0x7fe4c40a9e00 2024-05-08T19:48:38.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.005+0000 7fe4c1d9b700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe4c40c3840 0x7fe4c406a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55930/0 (socket says 172.21.15.47:55930) 2024-05-08T19:48:38.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.005+0000 7fe4c1d9b700 1 -- 172.21.15.47:0/1093533727 learned_addr learned my addr 172.21.15.47:0/1093533727 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:48:38.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.005+0000 7fe4c2d9d700 1 --2- 172.21.15.47:0/1093533727 >> v2:172.21.15.177:3300/0 conn(0x7fe4c40a9e00 0x7fe4c40c1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:38.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.005+0000 7fe4c159a700 1 -- 172.21.15.47:0/1093533727 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590264603 0 0) 0x7fe4c41561d0 con 0x7fe4c40c3840 2024-05-08T19:48:38.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.005+0000 7fe4c159a700 1 -- 172.21.15.47:0/1093533727 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4ac0035b0 con 0x7fe4c40c3840 2024-05-08T19:48:38.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.005+0000 7fe4c2d9d700 1 -- 172.21.15.47:0/1093533727 >> v1:172.21.15.177:6789/0 conn(0x7fe4c41500f0 legacy=0x7fe4c40a90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.005+0000 7fe4c2d9d700 1 -- 172.21.15.47:0/1093533727 >> v1:172.21.15.47:6789/0 conn(0x7fe4c40c3840 legacy=0x7fe4c406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.005+0000 7fe4c2d9d700 1 -- 172.21.15.47:0/1093533727 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c40a97d0 con 0x7fe4c40a9e00 2024-05-08T19:48:38.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.005+0000 7fe4c2d9d700 1 --2- 172.21.15.47:0/1093533727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4c40a9e00 0x7fe4c40c1b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009d90 tx=0x7fe4bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd567d3bbd195adf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:38.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.005+0000 7fe4c159a700 1 -- 172.21.15.47:0/1093533727 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc00e070 con 0x7fe4c40a9e00 2024-05-08T19:48:38.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.005+0000 7fe4c159a700 1 -- 172.21.15.47:0/1093533727 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc00bb20 con 0x7fe4c40a9e00 2024-05-08T19:48:38.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.005+0000 7fe4c159a700 1 -- 172.21.15.47:0/1093533727 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc012430 con 0x7fe4c40a9e00 2024-05-08T19:48:38.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.006+0000 7fe4c8eba700 1 -- 172.21.15.47:0/1093533727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4c40a9e00 msgr2=0x7fe4c40c1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:38.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.006+0000 7fe4c8eba700 1 --2- 172.21.15.47:0/1093533727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4c40a9e00 0x7fe4c40c1b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009d90 tx=0x7fe4bc00b330 comp rx=0 tx=0).stop 2024-05-08T19:48:38.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.006+0000 7fe4c8eba700 1 -- 172.21.15.47:0/1093533727 shutdown_connections 2024-05-08T19:48:38.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.006+0000 7fe4c8eba700 1 --2- 172.21.15.47:0/1093533727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4c40a9e00 0x7fe4c40c1b20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:38.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.006+0000 7fe4c8eba700 1 -- 172.21.15.47:0/1093533727 >> 172.21.15.47:0/1093533727 conn(0x7fe4c40c3c20 msgr2=0x7fe4c40c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:38.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.006+0000 7fe4c8eba700 1 -- 172.21.15.47:0/1093533727 shutdown_connections 2024-05-08T19:48:38.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.006+0000 7fe4c8eba700 1 -- 172.21.15.47:0/1093533727 wait complete. 2024-05-08T19:48:38.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.007+0000 7fe4c8eba700 1 Processor -- start 2024-05-08T19:48:38.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.007+0000 7fe4c8eba700 1 -- start start 2024-05-08T19:48:39.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.008+0000 7fe4c8eba700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4c40a9e00 0x7fe4c40c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.008+0000 7fe4c8eba700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4c40c3840 0x7fe4c41e89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.008+0000 7fe4c8eba700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4c41500f0 0x7fe4c413f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.008+0000 7fe4c8eba700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c41e8280 con 0x7fe4c40c3840 2024-05-08T19:48:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.008+0000 7fe4c8eba700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c4154340 con 0x7fe4c40a9e00 2024-05-08T19:48:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.008+0000 7fe4c8eba700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c4153c90 con 0x7fe4c41500f0 2024-05-08T19:48:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.008+0000 7fe4c1d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4c40c3840 0x7fe4c41e89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.008+0000 7fe4c1d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4c40c3840 0x7fe4c41e89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54272/0 (socket says 172.21.15.47:54272) 2024-05-08T19:48:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.008+0000 7fe4c1d9b700 1 -- 172.21.15.47:0/640167713 learned_addr learned my addr 172.21.15.47:0/640167713 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.008+0000 7fe4c259c700 1 --2- 172.21.15.47:0/640167713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4c40a9e00 0x7fe4c40c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.008+0000 7fe4c2d9d700 1 --2- 172.21.15.47:0/640167713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4c41500f0 0x7fe4c413f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.009+0000 7fe4c1d9b700 1 -- 172.21.15.47:0/640167713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4c41500f0 msgr2=0x7fe4c413f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.009+0000 7fe4c1d9b700 1 --2- 172.21.15.47:0/640167713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4c41500f0 0x7fe4c413f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.009+0000 7fe4c1d9b700 1 -- 172.21.15.47:0/640167713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4c40a9e00 msgr2=0x7fe4c40c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.009+0000 7fe4c1d9b700 1 --2- 172.21.15.47:0/640167713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4c40a9e00 0x7fe4c40c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.009+0000 7fe4c1d9b700 1 -- 172.21.15.47:0/640167713 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc009a70 con 0x7fe4c40c3840 2024-05-08T19:48:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.009+0000 7fe4c1d9b700 1 --2- 172.21.15.47:0/640167713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4c40c3840 0x7fe4c41e89b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800c4f0 tx=0x7fe4b800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.009+0000 7fe4b2ffd700 1 -- 172.21.15.47:0/640167713 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8005d70 con 0x7fe4c40c3840 2024-05-08T19:48:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.009+0000 7fe4b2ffd700 1 -- 172.21.15.47:0/640167713 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b80070d0 con 0x7fe4c40c3840 2024-05-08T19:48:39.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.009+0000 7fe4c8eba700 1 -- 172.21.15.47:0/640167713 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c4153f70 con 0x7fe4c40c3840 2024-05-08T19:48:39.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.009+0000 7fe4b2ffd700 1 -- 172.21.15.47:0/640167713 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8007440 con 0x7fe4c40c3840 2024-05-08T19:48:39.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.009+0000 7fe4c8eba700 1 -- 172.21.15.47:0/640167713 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c40c6cc0 con 0x7fe4c40c3840 2024-05-08T19:48:39.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.010+0000 7fe4c8eba700 1 -- 172.21.15.47:0/640167713 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c41e86d0 con 0x7fe4c40c3840 2024-05-08T19:48:39.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.010+0000 7fe4b2ffd700 1 -- 172.21.15.47:0/640167713 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe4b80075a0 con 0x7fe4c40c3840 2024-05-08T19:48:39.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.011+0000 7fe4b2ffd700 1 --2- 172.21.15.47:0/640167713 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe4a406ac90 0x7fe4a406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.011+0000 7fe4b2ffd700 1 -- 172.21.15.47:0/640167713 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe4b8088940 con 0x7fe4c40c3840 2024-05-08T19:48:39.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.011+0000 7fe4c259c700 1 --2- 172.21.15.47:0/640167713 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe4a406ac90 0x7fe4a406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.011+0000 7fe4c259c700 1 --2- 172.21.15.47:0/640167713 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe4a406ac90 0x7fe4a406d150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4007fd0 tx=0x7fe4b4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:39.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.015+0000 7fe4b2ffd700 1 -- 172.21.15.47:0/640167713 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe4c41e86d0 con 0x7fe4c40c3840 2024-05-08T19:48:39.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.225+0000 7fe4c8eba700 1 -- 172.21.15.47:0/640167713 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4c41541b0 con 0x7fe4a406ac90 2024-05-08T19:48:39.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.225+0000 7fe4b2ffd700 1 -- 172.21.15.47:0/640167713 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe4c41541b0 con 0x7fe4a406ac90 2024-05-08T19:48:39.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.228+0000 7fe4c8eba700 1 -- 172.21.15.47:0/640167713 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe4a406ac90 msgr2=0x7fe4a406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.228+0000 7fe4c8eba700 1 --2- 172.21.15.47:0/640167713 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe4a406ac90 0x7fe4a406d150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4007fd0 tx=0x7fe4b4009040 comp rx=0 tx=0).stop 2024-05-08T19:48:39.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.228+0000 7fe4c8eba700 1 -- 172.21.15.47:0/640167713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4c40c3840 msgr2=0x7fe4c41e89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.228+0000 7fe4c8eba700 1 --2- 172.21.15.47:0/640167713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4c40c3840 0x7fe4c41e89b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800c4f0 tx=0x7fe4b800c800 comp rx=0 tx=0).stop 2024-05-08T19:48:39.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.228+0000 7fe4c8eba700 1 -- 172.21.15.47:0/640167713 shutdown_connections 2024-05-08T19:48:39.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.228+0000 7fe4c8eba700 1 --2- 172.21.15.47:0/640167713 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe4a406ac90 0x7fe4a406d150 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.228+0000 7fe4c8eba700 1 --2- 172.21.15.47:0/640167713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4c41500f0 0x7fe4c413f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.228+0000 7fe4c8eba700 1 --2- 172.21.15.47:0/640167713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4c40a9e00 0x7fe4c40c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.228+0000 7fe4c8eba700 1 --2- 172.21.15.47:0/640167713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4c40c3840 0x7fe4c41e89b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.228+0000 7fe4c8eba700 1 -- 172.21.15.47:0/640167713 >> 172.21.15.47:0/640167713 conn(0x7fe4c40c3c20 msgr2=0x7fe4c406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:39.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.228+0000 7fe4c8eba700 1 -- 172.21.15.47:0/640167713 shutdown_connections 2024-05-08T19:48:39.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.228+0000 7fe4c8eba700 1 -- 172.21.15.47:0/640167713 wait complete. 2024-05-08T19:48:39.219 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T19:48:39.230 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T19:48:39.231 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T19:48:39.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.370+0000 7f76569f3700 1 Processor -- start 2024-05-08T19:48:39.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.370+0000 7f76569f3700 1 -- start start 2024-05-08T19:48:39.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.371+0000 7f76569f3700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f765014ff20 0x7f76500c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.371+0000 7f76569f3700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f765006f0b0 0x7f76500c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.371+0000 7f76569f3700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7650152b70 con 0x7f76500c4b80 2024-05-08T19:48:39.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.371+0000 7f76569f3700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7650150300 con 0x7f765006f0b0 2024-05-08T19:48:39.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.371+0000 7f76569f3700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765006f850 con 0x7f765014ff20 2024-05-08T19:48:39.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.371+0000 7f764f7fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f765006f0b0 0x7f76500c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.371+0000 7f7654f90700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f76500c4b80 0x7f7650156070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55942/0 (socket says 172.21.15.47:55942) 2024-05-08T19:48:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.371+0000 7f764f7fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f765006f0b0 0x7f76500c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54284/0 (socket says 172.21.15.47:54284) 2024-05-08T19:48:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.371+0000 7f7654f90700 1 -- 172.21.15.47:0/830011964 learned_addr learned my addr 172.21.15.47:0/830011964 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:48:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.371+0000 7f764ffff700 1 --2- 172.21.15.47:0/830011964 >> v2:172.21.15.177:3300/0 conn(0x7f765014ff20 0x7f76500c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.372+0000 7f764f7fe700 1 -- 172.21.15.47:0/830011964 >> v2:172.21.15.177:3300/0 conn(0x7f765014ff20 msgr2=0x7f76500c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.372+0000 7f764f7fe700 1 --2- 172.21.15.47:0/830011964 >> v2:172.21.15.177:3300/0 conn(0x7f765014ff20 0x7f76500c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.372+0000 7f764f7fe700 1 -- 172.21.15.47:0/830011964 >> v1:172.21.15.47:6789/0 conn(0x7f76500c4b80 legacy=0x7f7650156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.372+0000 7f764f7fe700 1 -- 172.21.15.47:0/830011964 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7650152e50 con 0x7f765006f0b0 2024-05-08T19:48:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.372+0000 7f764effd700 1 -- 172.21.15.47:0/830011964 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657707739 0 0) 0x7f7650152b70 con 0x7f76500c4b80 2024-05-08T19:48:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.372+0000 7f764f7fe700 1 --2- 172.21.15.47:0/830011964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f765006f0b0 0x7f76500c8450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f765006ec20 tx=0x7f7638009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc377ac16be9efe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.372+0000 7f764effd700 1 -- 172.21.15.47:0/830011964 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638011830 con 0x7f765006f0b0 2024-05-08T19:48:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.372+0000 7f764effd700 1 -- 172.21.15.47:0/830011964 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7638011990 con 0x7f765006f0b0 2024-05-08T19:48:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.372+0000 7f764effd700 1 -- 172.21.15.47:0/830011964 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638011d20 con 0x7f765006f0b0 2024-05-08T19:48:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.373+0000 7f76569f3700 1 -- 172.21.15.47:0/830011964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f765006f0b0 msgr2=0x7f76500c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.373+0000 7f76569f3700 1 --2- 172.21.15.47:0/830011964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f765006f0b0 0x7f76500c8450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f765006ec20 tx=0x7f7638009b20 comp rx=0 tx=0).stop 2024-05-08T19:48:39.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.373+0000 7f76569f3700 1 -- 172.21.15.47:0/830011964 shutdown_connections 2024-05-08T19:48:39.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.373+0000 7f76569f3700 1 --2- 172.21.15.47:0/830011964 >> v2:172.21.15.177:3300/0 conn(0x7f765014ff20 0x7f76500c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.373+0000 7f76569f3700 1 --2- 172.21.15.47:0/830011964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f765006f0b0 0x7f76500c8450 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.373+0000 7f76569f3700 1 -- 172.21.15.47:0/830011964 >> 172.21.15.47:0/830011964 conn(0x7f765006a9c0 msgr2=0x7f765006ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:39.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.373+0000 7f76569f3700 1 -- 172.21.15.47:0/830011964 shutdown_connections 2024-05-08T19:48:39.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.373+0000 7f76569f3700 1 -- 172.21.15.47:0/830011964 wait complete. 2024-05-08T19:48:39.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.374+0000 7f76569f3700 1 Processor -- start 2024-05-08T19:48:39.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.374+0000 7f76569f3700 1 -- start start 2024-05-08T19:48:39.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f76569f3700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f765006f0b0 0x7f7650154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f76569f3700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76500c4b80 0x7f7650153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f76569f3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f765014ff20 0x7f76501471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f76569f3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7650154350 con 0x7f765014ff20 2024-05-08T19:48:39.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f76569f3700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765014e270 con 0x7f765006f0b0 2024-05-08T19:48:39.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f76569f3700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765014e550 con 0x7f76500c4b80 2024-05-08T19:48:39.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f7654f90700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f765014ff20 0x7f76501471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f764ffff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f765006f0b0 0x7f7650154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f7654f90700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f765014ff20 0x7f76501471e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54294/0 (socket says 172.21.15.47:54294) 2024-05-08T19:48:39.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f7654f90700 1 -- 172.21.15.47:0/2469332376 learned_addr learned my addr 172.21.15.47:0/2469332376 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:39.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f764f7fe700 1 --2- 172.21.15.47:0/2469332376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76500c4b80 0x7f7650153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f7654f90700 1 -- 172.21.15.47:0/2469332376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76500c4b80 msgr2=0x7f7650153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f7654f90700 1 --2- 172.21.15.47:0/2469332376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76500c4b80 0x7f7650153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f7654f90700 1 -- 172.21.15.47:0/2469332376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f765006f0b0 msgr2=0x7f7650154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f7654f90700 1 --2- 172.21.15.47:0/2469332376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f765006f0b0 0x7f7650154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f7654f90700 1 -- 172.21.15.47:0/2469332376 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76380094a0 con 0x7f765014ff20 2024-05-08T19:48:39.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f764ffff700 1 --2- 172.21.15.47:0/2469332376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f765006f0b0 0x7f7650154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:48:39.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.375+0000 7f7654f90700 1 --2- 172.21.15.47:0/2469332376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f765014ff20 0x7f76501471e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7648002230 tx=0x7f764800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:39.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.376+0000 7f764cff9700 1 -- 172.21.15.47:0/2469332376 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764800aac0 con 0x7f765014ff20 2024-05-08T19:48:39.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.376+0000 7f764cff9700 1 -- 172.21.15.47:0/2469332376 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764800ac40 con 0x7f765014ff20 2024-05-08T19:48:39.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.376+0000 7f76569f3700 1 -- 172.21.15.47:0/2469332376 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7650154640 con 0x7f765014ff20 2024-05-08T19:48:39.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.376+0000 7f764cff9700 1 -- 172.21.15.47:0/2469332376 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76480070d0 con 0x7f765014ff20 2024-05-08T19:48:39.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.376+0000 7f76569f3700 1 -- 172.21.15.47:0/2469332376 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765014e830 con 0x7f765014ff20 2024-05-08T19:48:39.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.376+0000 7f76569f3700 1 -- 172.21.15.47:0/2469332376 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76501536f0 con 0x7f765014ff20 2024-05-08T19:48:39.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.377+0000 7f764cff9700 1 -- 172.21.15.47:0/2469332376 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7648007250 con 0x7f765014ff20 2024-05-08T19:48:39.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.377+0000 7f764cff9700 1 --2- 172.21.15.47:0/2469332376 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f763006ac90 0x7f763006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.378+0000 7f764cff9700 1 -- 172.21.15.47:0/2469332376 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7648089480 con 0x7f765014ff20 2024-05-08T19:48:39.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.378+0000 7f764ffff700 1 --2- 172.21.15.47:0/2469332376 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f763006ac90 0x7f763006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.378+0000 7f764cff9700 1 --2- 172.21.15.47:0/2469332376 >> [v2:172.21.15.47:6824/47010,v1:172.21.15.47:6825/47010] conn(0x7f7630074570 0x7f7630076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.378+0000 7f764cff9700 1 -- 172.21.15.47:0/2469332376 --> [v2:172.21.15.47:6824/47010,v1:172.21.15.47:6825/47010] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76300770e0 con 0x7f7630074570 2024-05-08T19:48:39.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.378+0000 7f764cff9700 1 -- 172.21.15.47:0/2469332376 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f764808bb40 con 0x7f765014ff20 2024-05-08T19:48:39.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.378+0000 7f764f7fe700 1 --2- 172.21.15.47:0/2469332376 >> [v2:172.21.15.47:6824/47010,v1:172.21.15.47:6825/47010] conn(0x7f7630074570 0x7f7630076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.378+0000 7f764ffff700 1 --2- 172.21.15.47:0/2469332376 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f763006ac90 0x7f763006d150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7640009f30 tx=0x7f7640009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:39.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.378+0000 7f764f7fe700 1 --2- 172.21.15.47:0/2469332376 >> [v2:172.21.15.47:6824/47010,v1:172.21.15.47:6825/47010] conn(0x7f7630074570 0x7f7630076a10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:39.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.379+0000 7f764cff9700 1 -- 172.21.15.47:0/2469332376 <== osd.3 v2:172.21.15.47:6824/47010 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f76300770e0 con 0x7f7630074570 2024-05-08T19:48:39.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.394+0000 7f76569f3700 1 -- 172.21.15.47:0/2469332376 --> [v2:172.21.15.47:6824/47010,v1:172.21.15.47:6825/47010] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7650153410 con 0x7f7630074570 2024-05-08T19:48:39.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.394+0000 7f764cff9700 1 -- 172.21.15.47:0/2469332376 <== osd.3 v2:172.21.15.47:6824/47010 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7638022040 con 0x7f7630074570 2024-05-08T19:48:39.384 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-08T19:48:39.384 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T19:48:39.384 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-08T19:48:39.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.394+0000 7f76569f3700 1 -- 172.21.15.47:0/2469332376 >> [v2:172.21.15.47:6824/47010,v1:172.21.15.47:6825/47010] conn(0x7f7630074570 msgr2=0x7f7630076a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.394+0000 7f76569f3700 1 --2- 172.21.15.47:0/2469332376 >> [v2:172.21.15.47:6824/47010,v1:172.21.15.47:6825/47010] conn(0x7f7630074570 0x7f7630076a10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.394+0000 7f76569f3700 1 -- 172.21.15.47:0/2469332376 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f763006ac90 msgr2=0x7f763006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.394+0000 7f76569f3700 1 --2- 172.21.15.47:0/2469332376 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f763006ac90 0x7f763006d150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7640009f30 tx=0x7f7640009210 comp rx=0 tx=0).stop 2024-05-08T19:48:39.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.394+0000 7f76569f3700 1 -- 172.21.15.47:0/2469332376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f765014ff20 msgr2=0x7f76501471e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.394+0000 7f76569f3700 1 --2- 172.21.15.47:0/2469332376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f765014ff20 0x7f76501471e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7648002230 tx=0x7f764800cf50 comp rx=0 tx=0).stop 2024-05-08T19:48:39.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.394+0000 7f7654f90700 1 -- 172.21.15.47:0/2469332376 reap_dead start 2024-05-08T19:48:39.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.394+0000 7f76569f3700 1 -- 172.21.15.47:0/2469332376 shutdown_connections 2024-05-08T19:48:39.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.394+0000 7f76569f3700 1 -- 172.21.15.47:0/2469332376 >> 172.21.15.47:0/2469332376 conn(0x7f765006a9c0 msgr2=0x7f7650149780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:39.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.394+0000 7f76569f3700 1 -- 172.21.15.47:0/2469332376 shutdown_connections 2024-05-08T19:48:39.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.394+0000 7f76569f3700 1 -- 172.21.15.47:0/2469332376 wait complete. 2024-05-08T19:48:39.396 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T19:48:39.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.533+0000 7fefb6caf700 1 Processor -- start 2024-05-08T19:48:39.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.533+0000 7fefb6caf700 1 -- start start 2024-05-08T19:48:39.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefb6caf700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fefb00c74e0 0x7fefb0070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefb6caf700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefb00c78c0 0x7fefb006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefb6caf700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb0153430 con 0x7fefb00c46c0 2024-05-08T19:48:39.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefb6caf700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb0071250 con 0x7fefb00c74e0 2024-05-08T19:48:39.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefb6caf700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb0153960 con 0x7fefb00c78c0 2024-05-08T19:48:39.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefb524c700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fefb00c46c0 0x7fefb00c2ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55956/0 (socket says 172.21.15.47:55956) 2024-05-08T19:48:39.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefb524c700 1 -- 172.21.15.47:0/2933538582 learned_addr learned my addr 172.21.15.47:0/2933538582 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:48:39.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefb4a4b700 1 --2- 172.21.15.47:0/2933538582 >> v2:172.21.15.177:3300/0 conn(0x7fefb00c74e0 0x7fefb0070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefaffff700 1 --2- 172.21.15.47:0/2933538582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefb00c78c0 0x7fefb006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefaf7fe700 1 -- 172.21.15.47:0/2933538582 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381282099 0 0) 0x7fefb0153430 con 0x7fefb00c46c0 2024-05-08T19:48:39.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefaf7fe700 1 -- 172.21.15.47:0/2933538582 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefa00035b0 con 0x7fefb00c46c0 2024-05-08T19:48:39.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefb4a4b700 1 -- 172.21.15.47:0/2933538582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefb00c78c0 msgr2=0x7fefb006ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:39.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefb4a4b700 1 --2- 172.21.15.47:0/2933538582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefb00c78c0 0x7fefb006ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefb4a4b700 1 -- 172.21.15.47:0/2933538582 >> v1:172.21.15.47:6789/0 conn(0x7fefb00c46c0 legacy=0x7fefb00c2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefb4a4b700 1 -- 172.21.15.47:0/2933538582 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb006eaf0 con 0x7fefb00c74e0 2024-05-08T19:48:39.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.534+0000 7fefaffff700 1 --2- 172.21.15.47:0/2933538582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefb00c78c0 0x7fefb006ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:48:39.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.535+0000 7fefb4a4b700 1 --2- 172.21.15.47:0/2933538582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefb00c74e0 0x7fefb0070d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009840 tx=0x7fefa4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f446863433137561 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:39.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.535+0000 7fefaf7fe700 1 -- 172.21.15.47:0/2933538582 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4011830 con 0x7fefb00c74e0 2024-05-08T19:48:39.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.535+0000 7fefaf7fe700 1 -- 172.21.15.47:0/2933538582 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa4011990 con 0x7fefb00c74e0 2024-05-08T19:48:39.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.535+0000 7fefaf7fe700 1 -- 172.21.15.47:0/2933538582 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4011d20 con 0x7fefb00c74e0 2024-05-08T19:48:39.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.535+0000 7fefb6caf700 1 -- 172.21.15.47:0/2933538582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefb00c74e0 msgr2=0x7fefb0070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.535+0000 7fefb6caf700 1 --2- 172.21.15.47:0/2933538582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefb00c74e0 0x7fefb0070d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009840 tx=0x7fefa4009b50 comp rx=0 tx=0).stop 2024-05-08T19:48:39.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.535+0000 7fefb6caf700 1 -- 172.21.15.47:0/2933538582 shutdown_connections 2024-05-08T19:48:39.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.535+0000 7fefb6caf700 1 --2- 172.21.15.47:0/2933538582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefb00c74e0 0x7fefb0070d10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.535+0000 7fefb6caf700 1 --2- 172.21.15.47:0/2933538582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefb00c78c0 0x7fefb006ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.535+0000 7fefb6caf700 1 -- 172.21.15.47:0/2933538582 >> 172.21.15.47:0/2933538582 conn(0x7fefb00a9ea0 msgr2=0x7fefb00aa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:39.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.535+0000 7fefb6caf700 1 -- 172.21.15.47:0/2933538582 shutdown_connections 2024-05-08T19:48:39.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.535+0000 7fefb6caf700 1 -- 172.21.15.47:0/2933538582 wait complete. 2024-05-08T19:48:39.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.537+0000 7fefb6caf700 1 Processor -- start 2024-05-08T19:48:39.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.537+0000 7fefb6caf700 1 -- start start 2024-05-08T19:48:39.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.538+0000 7fefb6caf700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefb00c46c0 0x7fefb0149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.538+0000 7fefb6caf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefb00c74e0 0x7fefb0147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.538+0000 7fefb6caf700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefb00c78c0 0x7fefb01475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.538+0000 7fefb6caf700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb00ac4e0 con 0x7fefb00c74e0 2024-05-08T19:48:39.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.538+0000 7fefb6caf700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb00ac240 con 0x7fefb00c78c0 2024-05-08T19:48:39.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.538+0000 7fefb6caf700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb0147b10 con 0x7fefb00c46c0 2024-05-08T19:48:39.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.538+0000 7fefaffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefb00c74e0 0x7fefb0147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.538+0000 7fefaffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefb00c74e0 0x7fefb0147090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54304/0 (socket says 172.21.15.47:54304) 2024-05-08T19:48:39.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.538+0000 7fefaffff700 1 -- 172.21.15.47:0/2912861932 learned_addr learned my addr 172.21.15.47:0/2912861932 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:39.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.538+0000 7fefb4a4b700 1 --2- 172.21.15.47:0/2912861932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefb00c46c0 0x7fefb0149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.538+0000 7fefb524c700 1 --2- 172.21.15.47:0/2912861932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefb00c78c0 0x7fefb01475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.538+0000 7fefaffff700 1 -- 172.21.15.47:0/2912861932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefb00c46c0 msgr2=0x7fefb0149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.538+0000 7fefaffff700 1 --2- 172.21.15.47:0/2912861932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefb00c46c0 0x7fefb0149620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.539+0000 7fefaffff700 1 -- 172.21.15.47:0/2912861932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefb00c78c0 msgr2=0x7fefb01475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.539+0000 7fefaffff700 1 --2- 172.21.15.47:0/2912861932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefb00c78c0 0x7fefb01475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.539+0000 7fefaffff700 1 -- 172.21.15.47:0/2912861932 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c0094a0 con 0x7fefb00c74e0 2024-05-08T19:48:39.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.539+0000 7fefaffff700 1 --2- 172.21.15.47:0/2912861932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefb00c74e0 0x7fefb0147090 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00ebb0 tx=0x7fef9c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:39.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.539+0000 7fefad7fa700 1 -- 172.21.15.47:0/2912861932 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c00c850 con 0x7fefb00c74e0 2024-05-08T19:48:39.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.539+0000 7fefad7fa700 1 -- 172.21.15.47:0/2912861932 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c00c9b0 con 0x7fefb00c74e0 2024-05-08T19:48:39.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.539+0000 7fefb6caf700 1 -- 172.21.15.47:0/2912861932 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa40094a0 con 0x7fefb00c74e0 2024-05-08T19:48:39.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.539+0000 7fefad7fa700 1 -- 172.21.15.47:0/2912861932 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c00cd40 con 0x7fefb00c74e0 2024-05-08T19:48:39.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.539+0000 7fefb6caf700 1 -- 172.21.15.47:0/2912861932 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb014b4e0 con 0x7fefb00c74e0 2024-05-08T19:48:39.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.540+0000 7fefb6caf700 1 -- 172.21.15.47:0/2912861932 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb004ec60 con 0x7fefb00c74e0 2024-05-08T19:48:39.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.540+0000 7fefad7fa700 1 -- 172.21.15.47:0/2912861932 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fef9c013470 con 0x7fefb00c74e0 2024-05-08T19:48:39.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.541+0000 7fefad7fa700 1 --2- 172.21.15.47:0/2912861932 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fef9406ac90 0x7fef9406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.541+0000 7fefad7fa700 1 -- 172.21.15.47:0/2912861932 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fef9c0896d0 con 0x7fefb00c74e0 2024-05-08T19:48:39.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.541+0000 7fefb4a4b700 1 --2- 172.21.15.47:0/2912861932 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fef9406ac90 0x7fef9406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.541+0000 7fefb4a4b700 1 --2- 172.21.15.47:0/2912861932 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fef9406ac90 0x7fef9406d150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fefa4000c00 tx=0x7fefa4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:39.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.545+0000 7fefad7fa700 1 -- 172.21.15.47:0/2912861932 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fef9c0544f0 con 0x7fefb00c74e0 2024-05-08T19:48:39.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.754+0000 7fefb6caf700 1 -- 172.21.15.47:0/2912861932 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fefb00ade20 con 0x7fef9406ac90 2024-05-08T19:48:39.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.754+0000 7fefad7fa700 1 -- 172.21.15.47:0/2912861932 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fefa4011630 con 0x7fef9406ac90 2024-05-08T19:48:39.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.757+0000 7fefb6caf700 1 -- 172.21.15.47:0/2912861932 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fef9406ac90 msgr2=0x7fef9406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.757+0000 7fefb6caf700 1 --2- 172.21.15.47:0/2912861932 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fef9406ac90 0x7fef9406d150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fefa4000c00 tx=0x7fefa4008030 comp rx=0 tx=0).stop 2024-05-08T19:48:39.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.757+0000 7fefb6caf700 1 -- 172.21.15.47:0/2912861932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefb00c74e0 msgr2=0x7fefb0147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.757+0000 7fefb6caf700 1 --2- 172.21.15.47:0/2912861932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefb00c74e0 0x7fefb0147090 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00ebb0 tx=0x7fef9c00eec0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.757+0000 7fefb6caf700 1 -- 172.21.15.47:0/2912861932 shutdown_connections 2024-05-08T19:48:39.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.757+0000 7fefb6caf700 1 --2- 172.21.15.47:0/2912861932 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fef9406ac90 0x7fef9406d150 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.757+0000 7fefb6caf700 1 --2- 172.21.15.47:0/2912861932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefb00c78c0 0x7fefb01475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.757+0000 7fefb6caf700 1 --2- 172.21.15.47:0/2912861932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefb00c46c0 0x7fefb0149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.757+0000 7fefb6caf700 1 --2- 172.21.15.47:0/2912861932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefb00c74e0 0x7fefb0147090 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.757+0000 7fefb6caf700 1 -- 172.21.15.47:0/2912861932 >> 172.21.15.47:0/2912861932 conn(0x7fefb00a9ea0 msgr2=0x7fefb00aa280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:39.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.757+0000 7fefb6caf700 1 -- 172.21.15.47:0/2912861932 shutdown_connections 2024-05-08T19:48:39.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.757+0000 7fefb6caf700 1 -- 172.21.15.47:0/2912861932 wait complete. 2024-05-08T19:48:39.748 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T19:48:39.760 INFO:tasks.ceph:Scrubbing osd.4 2024-05-08T19:48:39.760 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-08T19:48:39.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.900+0000 7f1bc51b8700 1 Processor -- start 2024-05-08T19:48:39.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.900+0000 7f1bc51b8700 1 -- start start 2024-05-08T19:48:39.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.901+0000 7f1bc51b8700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1bc006ac30 0x7f1bc00a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.901+0000 7f1bc51b8700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc01532f0 con 0x7f1bc014fbf0 2024-05-08T19:48:39.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.901+0000 7f1bc51b8700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc01529c0 con 0x7f1bc00c2230 2024-05-08T19:48:39.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.901+0000 7f1bc51b8700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc00aac10 con 0x7f1bc006ac30 2024-05-08T19:48:39.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.901+0000 7f1bbe59c700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f1bc014fbf0 0x7f1bc00c1b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55960/0 (socket says 172.21.15.47:55960) 2024-05-08T19:48:39.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.901+0000 7f1bbe59c700 1 -- 172.21.15.47:0/743866656 learned_addr learned my addr 172.21.15.47:0/743866656 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:48:39.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.901+0000 7f1bbed9d700 1 --2- 172.21.15.47:0/743866656 >> v2:172.21.15.177:3300/0 conn(0x7f1bc006ac30 0x7f1bc00a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.902+0000 7f1bbdd9b700 1 -- 172.21.15.47:0/743866656 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942389724 0 0) 0x7f1bc01532f0 con 0x7f1bc014fbf0 2024-05-08T19:48:39.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.902+0000 7f1bbdd9b700 1 -- 172.21.15.47:0/743866656 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bac0035b0 con 0x7f1bc014fbf0 2024-05-08T19:48:39.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.902+0000 7f1bbed9d700 1 -- 172.21.15.47:0/743866656 >> v1:172.21.15.177:6789/0 conn(0x7f1bc00c2230 legacy=0x7f1bc015d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.902+0000 7f1bbed9d700 1 -- 172.21.15.47:0/743866656 >> v1:172.21.15.47:6789/0 conn(0x7f1bc014fbf0 legacy=0x7f1bc00c1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.902+0000 7f1bbed9d700 1 -- 172.21.15.47:0/743866656 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc0152ca0 con 0x7f1bc006ac30 2024-05-08T19:48:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.902+0000 7f1bbed9d700 1 --2- 172.21.15.47:0/743866656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc006ac30 0x7f1bc00a9db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009840 tx=0x7f1ba8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d977e367b609639f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.902+0000 7f1bbdd9b700 1 -- 172.21.15.47:0/743866656 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8011830 con 0x7f1bc006ac30 2024-05-08T19:48:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.902+0000 7f1bbdd9b700 1 -- 172.21.15.47:0/743866656 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba8011990 con 0x7f1bc006ac30 2024-05-08T19:48:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.902+0000 7f1bbdd9b700 1 -- 172.21.15.47:0/743866656 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8011d00 con 0x7f1bc006ac30 2024-05-08T19:48:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.903+0000 7f1bc51b8700 1 -- 172.21.15.47:0/743866656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc006ac30 msgr2=0x7f1bc00a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.903+0000 7f1bc51b8700 1 --2- 172.21.15.47:0/743866656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc006ac30 0x7f1bc00a9db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009840 tx=0x7f1ba8009b50 comp rx=0 tx=0).stop 2024-05-08T19:48:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.903+0000 7f1bc51b8700 1 -- 172.21.15.47:0/743866656 shutdown_connections 2024-05-08T19:48:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.903+0000 7f1bc51b8700 1 --2- 172.21.15.47:0/743866656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc006ac30 0x7f1bc00a9db0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.903+0000 7f1bc51b8700 1 -- 172.21.15.47:0/743866656 >> 172.21.15.47:0/743866656 conn(0x7f1bc00c3c20 msgr2=0x7f1bc00c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.903+0000 7f1bc51b8700 1 -- 172.21.15.47:0/743866656 shutdown_connections 2024-05-08T19:48:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.903+0000 7f1bc51b8700 1 -- 172.21.15.47:0/743866656 wait complete. 2024-05-08T19:48:39.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.904+0000 7f1bc51b8700 1 Processor -- start 2024-05-08T19:48:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.904+0000 7f1bc51b8700 1 -- start start 2024-05-08T19:48:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bc51b8700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc006ac30 0x7f1bc00abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bc51b8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1bc00c2230 0x7f1bc00c07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bc51b8700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bc014fbf0 0x7f1bc01ea8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bc51b8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc01ea450 con 0x7f1bc00c2230 2024-05-08T19:48:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bc51b8700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00abfe0 con 0x7f1bc006ac30 2024-05-08T19:48:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bc51b8700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc006f420 con 0x7f1bc014fbf0 2024-05-08T19:48:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bbe59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1bc00c2230 0x7f1bc00c07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bbe59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1bc00c2230 0x7f1bc00c07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54316/0 (socket says 172.21.15.47:54316) 2024-05-08T19:48:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bbe59c700 1 -- 172.21.15.47:0/3743901559 learned_addr learned my addr 172.21.15.47:0/3743901559 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bbed9d700 1 --2- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc006ac30 0x7f1bc00abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bbf59e700 1 --2- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bc014fbf0 0x7f1bc01ea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bbe59c700 1 -- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bc014fbf0 msgr2=0x7f1bc01ea8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bbe59c700 1 --2- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bc014fbf0 0x7f1bc01ea8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bbe59c700 1 -- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc006ac30 msgr2=0x7f1bc00abaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bbe59c700 1 --2- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc006ac30 0x7f1bc00abaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bbe59c700 1 -- 172.21.15.47:0/3743901559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba80094a0 con 0x7f1bc00c2230 2024-05-08T19:48:39.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bbed9d700 1 --2- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc006ac30 0x7f1bc00abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:48:39.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.905+0000 7f1bbe59c700 1 --2- 172.21.15.47:0/3743901559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1bc00c2230 0x7f1bc00c07c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0001eb0 tx=0x7f1bb000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:39.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.906+0000 7f1bb77fe700 1 -- 172.21.15.47:0/3743901559 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0005d70 con 0x7f1bc00c2230 2024-05-08T19:48:39.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.906+0000 7f1bb77fe700 1 -- 172.21.15.47:0/3743901559 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb00070d0 con 0x7f1bc00c2230 2024-05-08T19:48:39.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.906+0000 7f1bc51b8700 1 -- 172.21.15.47:0/3743901559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc00c5930 con 0x7f1bc00c2230 2024-05-08T19:48:39.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.906+0000 7f1bb77fe700 1 -- 172.21.15.47:0/3743901559 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0007460 con 0x7f1bc00c2230 2024-05-08T19:48:39.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.906+0000 7f1bc51b8700 1 -- 172.21.15.47:0/3743901559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc006f140 con 0x7f1bc00c2230 2024-05-08T19:48:39.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.906+0000 7f1bc51b8700 1 -- 172.21.15.47:0/3743901559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1bc0156c50 con 0x7f1bc00c2230 2024-05-08T19:48:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.907+0000 7f1bb77fe700 1 -- 172.21.15.47:0/3743901559 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1bb00075c0 con 0x7f1bc00c2230 2024-05-08T19:48:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.907+0000 7f1bb77fe700 1 --2- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1ba006ac90 0x7f1ba006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.908+0000 7f1bb77fe700 1 -- 172.21.15.47:0/3743901559 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1bb0088a20 con 0x7f1bc00c2230 2024-05-08T19:48:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.908+0000 7f1bbed9d700 1 --2- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1ba006ac90 0x7f1ba006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.908+0000 7f1bb77fe700 1 --2- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:6802/47187,v1:172.21.15.177:6804/47187] conn(0x7f1ba0074570 0x7f1ba0076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.908+0000 7f1bb77fe700 1 -- 172.21.15.47:0/3743901559 --> [v2:172.21.15.177:6802/47187,v1:172.21.15.177:6804/47187] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ba00770e0 con 0x7f1ba0074570 2024-05-08T19:48:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.908+0000 7f1bb77fe700 1 -- 172.21.15.47:0/3743901559 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bb008d2c0 con 0x7f1bc00c2230 2024-05-08T19:48:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.908+0000 7f1bbf59e700 1 --2- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:6802/47187,v1:172.21.15.177:6804/47187] conn(0x7f1ba0074570 0x7f1ba0076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.908+0000 7f1bbed9d700 1 --2- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1ba006ac90 0x7f1ba006d150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8000c00 tx=0x7f1ba8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.908+0000 7f1bbf59e700 1 --2- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:6802/47187,v1:172.21.15.177:6804/47187] conn(0x7f1ba0074570 0x7f1ba0076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.909+0000 7f1bb77fe700 1 -- 172.21.15.47:0/3743901559 <== osd.4 v2:172.21.15.177:6802/47187 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1ba00770e0 con 0x7f1ba0074570 2024-05-08T19:48:39.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.924+0000 7f1bc51b8700 1 -- 172.21.15.47:0/3743901559 --> [v2:172.21.15.177:6802/47187,v1:172.21.15.177:6804/47187] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1bc0153780 con 0x7f1ba0074570 2024-05-08T19:48:39.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.924+0000 7f1bb77fe700 1 -- 172.21.15.47:0/3743901559 <== osd.4 v2:172.21.15.177:6802/47187 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1bb8001fe0 con 0x7f1ba0074570 2024-05-08T19:48:39.914 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-08T19:48:39.914 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T19:48:39.914 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-08T19:48:39.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.924+0000 7f1bc51b8700 1 -- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:6802/47187,v1:172.21.15.177:6804/47187] conn(0x7f1ba0074570 msgr2=0x7f1ba0076a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.924+0000 7f1bc51b8700 1 --2- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:6802/47187,v1:172.21.15.177:6804/47187] conn(0x7f1ba0074570 0x7f1ba0076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.924+0000 7f1bc51b8700 1 -- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1ba006ac90 msgr2=0x7f1ba006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.924+0000 7f1bc51b8700 1 --2- 172.21.15.47:0/3743901559 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f1ba006ac90 0x7f1ba006d150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8000c00 tx=0x7f1ba8008030 comp rx=0 tx=0).stop 2024-05-08T19:48:39.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.924+0000 7f1bc51b8700 1 -- 172.21.15.47:0/3743901559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1bc00c2230 msgr2=0x7f1bc00c07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:39.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.924+0000 7f1bc51b8700 1 --2- 172.21.15.47:0/3743901559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1bc00c2230 0x7f1bc00c07c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0001eb0 tx=0x7f1bb000c7b0 comp rx=0 tx=0).stop 2024-05-08T19:48:39.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.924+0000 7f1bbf59e700 1 -- 172.21.15.47:0/3743901559 reap_dead start 2024-05-08T19:48:39.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.924+0000 7f1bc51b8700 1 -- 172.21.15.47:0/3743901559 shutdown_connections 2024-05-08T19:48:39.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.924+0000 7f1bc51b8700 1 -- 172.21.15.47:0/3743901559 >> 172.21.15.47:0/3743901559 conn(0x7f1bc00c3c20 msgr2=0x7f1bc0150d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:39.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.924+0000 7f1bc51b8700 1 -- 172.21.15.47:0/3743901559 shutdown_connections 2024-05-08T19:48:39.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:39.924+0000 7f1bc51b8700 1 -- 172.21.15.47:0/3743901559 wait complete. 2024-05-08T19:48:39.926 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-08T19:48:40.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.063+0000 7f25dbc70700 1 Processor -- start 2024-05-08T19:48:40.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.063+0000 7f25dbc70700 1 -- start start 2024-05-08T19:48:40.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.064+0000 7f25dbc70700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f25d414ff90 0x7f25d40ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.064+0000 7f25dbc70700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25d406e730 0x7f25d41527d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.064+0000 7f25dbc70700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d4153420 con 0x7f25d40a9d70 2024-05-08T19:48:40.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.064+0000 7f25dbc70700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d40a8830 con 0x7f25d414ff90 2024-05-08T19:48:40.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.064+0000 7f25dbc70700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d406f820 con 0x7f25d406e730 2024-05-08T19:48:40.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.064+0000 7f25d9a0c700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f25d414ff90 0x7f25d40ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.064+0000 7f25d9a0c700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f25d414ff90 0x7f25d40ac5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54328/0 (socket says 172.21.15.47:54328) 2024-05-08T19:48:40.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.064+0000 7f25d9a0c700 1 -- 172.21.15.47:0/2368768895 learned_addr learned my addr 172.21.15.47:0/2368768895 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:40.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.064+0000 7f25d920b700 1 --2- 172.21.15.47:0/2368768895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25d406e730 0x7f25d41527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.065+0000 7f25d9a0c700 1 -- 172.21.15.47:0/2368768895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25d406e730 msgr2=0x7f25d41527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:40.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.065+0000 7f25d9a0c700 1 --2- 172.21.15.47:0/2368768895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25d406e730 0x7f25d41527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.065+0000 7f25d9a0c700 1 -- 172.21.15.47:0/2368768895 >> v1:172.21.15.177:6789/0 conn(0x7f25d40a9d70 legacy=0x7f25d4152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.065+0000 7f25d9a0c700 1 -- 172.21.15.47:0/2368768895 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d40a8550 con 0x7f25d414ff90 2024-05-08T19:48:40.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.065+0000 7f25d9a0c700 1 --2- 172.21.15.47:0/2368768895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25d414ff90 0x7f25d40ac5f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009920 tx=0x7f25d0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db91b6d908b35770 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:40.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.065+0000 7f25d8a0a700 1 -- 172.21.15.47:0/2368768895 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0011830 con 0x7f25d414ff90 2024-05-08T19:48:40.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.065+0000 7f25d8a0a700 1 -- 172.21.15.47:0/2368768895 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d0011990 con 0x7f25d414ff90 2024-05-08T19:48:40.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.065+0000 7f25d8a0a700 1 -- 172.21.15.47:0/2368768895 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0011d20 con 0x7f25d414ff90 2024-05-08T19:48:40.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.066+0000 7f25dbc70700 1 -- 172.21.15.47:0/2368768895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25d414ff90 msgr2=0x7f25d40ac5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.066+0000 7f25dbc70700 1 --2- 172.21.15.47:0/2368768895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25d414ff90 0x7f25d40ac5f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009920 tx=0x7f25d0009c30 comp rx=0 tx=0).stop 2024-05-08T19:48:40.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.066+0000 7f25dbc70700 1 -- 172.21.15.47:0/2368768895 shutdown_connections 2024-05-08T19:48:40.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.066+0000 7f25dbc70700 1 --2- 172.21.15.47:0/2368768895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25d414ff90 0x7f25d40ac5f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.066+0000 7f25dbc70700 1 --2- 172.21.15.47:0/2368768895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25d406e730 0x7f25d41527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.066+0000 7f25dbc70700 1 -- 172.21.15.47:0/2368768895 >> 172.21.15.47:0/2368768895 conn(0x7f25d40c71c0 msgr2=0x7f25d40c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:40.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.066+0000 7f25dbc70700 1 -- 172.21.15.47:0/2368768895 shutdown_connections 2024-05-08T19:48:40.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.066+0000 7f25dbc70700 1 -- 172.21.15.47:0/2368768895 wait complete. 2024-05-08T19:48:40.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.068+0000 7f25dbc70700 1 Processor -- start 2024-05-08T19:48:40.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.068+0000 7f25dbc70700 1 -- start start 2024-05-08T19:48:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.069+0000 7f25dbc70700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25d406e730 0x7f25d4148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.069+0000 7f25dbc70700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25d40a9d70 0x7f25d40c05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.069+0000 7f25dbc70700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25d414ff90 0x7f25d4151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.069+0000 7f25dbc70700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d414c160 con 0x7f25d414ff90 2024-05-08T19:48:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.069+0000 7f25dbc70700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d4152150 con 0x7f25d40a9d70 2024-05-08T19:48:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.069+0000 7f25dbc70700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d41ea320 con 0x7f25d406e730 2024-05-08T19:48:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.069+0000 7f25d9a0c700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25d406e730 0x7f25d4148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.069+0000 7f25da20d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25d414ff90 0x7f25d4151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.069+0000 7f25d9a0c700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25d406e730 0x7f25d4148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.47:53914/0 (socket says 172.21.15.47:53914) 2024-05-08T19:48:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.069+0000 7f25d9a0c700 1 -- 172.21.15.47:0/2277241741 learned_addr learned my addr 172.21.15.47:0/2277241741 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.069+0000 7f25d920b700 1 --2- 172.21.15.47:0/2277241741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25d40a9d70 0x7f25d40c05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.069+0000 7f25d9a0c700 1 -- 172.21.15.47:0/2277241741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25d40a9d70 msgr2=0x7f25d40c05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.069+0000 7f25d9a0c700 1 --2- 172.21.15.47:0/2277241741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25d40a9d70 0x7f25d40c05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.069+0000 7f25d9a0c700 1 -- 172.21.15.47:0/2277241741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25d414ff90 msgr2=0x7f25d4151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.069+0000 7f25d9a0c700 1 --2- 172.21.15.47:0/2277241741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25d414ff90 0x7f25d4151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.070+0000 7f25d9a0c700 1 -- 172.21.15.47:0/2277241741 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d0009550 con 0x7f25d406e730 2024-05-08T19:48:40.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.070+0000 7f25d9a0c700 1 --2- 172.21.15.47:0/2277241741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25d406e730 0x7f25d4148ed0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009130 tx=0x7f25d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:40.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.070+0000 7f25ca7fc700 1 -- 172.21.15.47:0/2277241741 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0004510 con 0x7f25d406e730 2024-05-08T19:48:40.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.070+0000 7f25ca7fc700 1 -- 172.21.15.47:0/2277241741 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d001e070 con 0x7f25d406e730 2024-05-08T19:48:40.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.070+0000 7f25ca7fc700 1 -- 172.21.15.47:0/2277241741 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d00038e0 con 0x7f25d406e730 2024-05-08T19:48:40.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.070+0000 7f25dbc70700 1 -- 172.21.15.47:0/2277241741 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d4150640 con 0x7f25d406e730 2024-05-08T19:48:40.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.070+0000 7f25dbc70700 1 -- 172.21.15.47:0/2277241741 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d4150c00 con 0x7f25d406e730 2024-05-08T19:48:40.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.071+0000 7f25dbc70700 1 -- 172.21.15.47:0/2277241741 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d4149410 con 0x7f25d406e730 2024-05-08T19:48:40.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.072+0000 7f25ca7fc700 1 -- 172.21.15.47:0/2277241741 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f25d0003a40 con 0x7f25d406e730 2024-05-08T19:48:40.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.072+0000 7f25ca7fc700 1 --2- 172.21.15.47:0/2277241741 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f25b806ac90 0x7f25b806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.073+0000 7f25ca7fc700 1 -- 172.21.15.47:0/2277241741 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f25d008a3d0 con 0x7f25d406e730 2024-05-08T19:48:40.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.073+0000 7f25d920b700 1 --2- 172.21.15.47:0/2277241741 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f25b806ac90 0x7f25b806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.074+0000 7f25d920b700 1 --2- 172.21.15.47:0/2277241741 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f25b806ac90 0x7f25b806d150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f25d40c1110 tx=0x7f25c4009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:40.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.081+0000 7f25ca7fc700 1 -- 172.21.15.47:0/2277241741 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f25d0055280 con 0x7f25d406e730 2024-05-08T19:48:40.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.292+0000 7f25dbc70700 1 -- 172.21.15.47:0/2277241741 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f25d414f7f0 con 0x7f25b806ac90 2024-05-08T19:48:40.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.292+0000 7f25ca7fc700 1 -- 172.21.15.47:0/2277241741 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f25d414f7f0 con 0x7f25b806ac90 2024-05-08T19:48:40.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.294+0000 7f25dbc70700 1 -- 172.21.15.47:0/2277241741 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f25b806ac90 msgr2=0x7f25b806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.294+0000 7f25dbc70700 1 --2- 172.21.15.47:0/2277241741 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f25b806ac90 0x7f25b806d150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f25d40c1110 tx=0x7f25c4009210 comp rx=0 tx=0).stop 2024-05-08T19:48:40.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.294+0000 7f25dbc70700 1 -- 172.21.15.47:0/2277241741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25d406e730 msgr2=0x7f25d4148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.295+0000 7f25dbc70700 1 --2- 172.21.15.47:0/2277241741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25d406e730 0x7f25d4148ed0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009130 tx=0x7f25d0004750 comp rx=0 tx=0).stop 2024-05-08T19:48:40.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.295+0000 7f25dbc70700 1 -- 172.21.15.47:0/2277241741 shutdown_connections 2024-05-08T19:48:40.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.295+0000 7f25dbc70700 1 --2- 172.21.15.47:0/2277241741 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f25b806ac90 0x7f25b806d150 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.295+0000 7f25dbc70700 1 --2- 172.21.15.47:0/2277241741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25d414ff90 0x7f25d4151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.295+0000 7f25dbc70700 1 --2- 172.21.15.47:0/2277241741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f25d406e730 0x7f25d4148ed0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.295+0000 7f25dbc70700 1 --2- 172.21.15.47:0/2277241741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25d40a9d70 0x7f25d40c05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.295+0000 7f25dbc70700 1 -- 172.21.15.47:0/2277241741 >> 172.21.15.47:0/2277241741 conn(0x7f25d40c71c0 msgr2=0x7f25d40715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:40.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.295+0000 7f25dbc70700 1 -- 172.21.15.47:0/2277241741 shutdown_connections 2024-05-08T19:48:40.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.295+0000 7f25dbc70700 1 -- 172.21.15.47:0/2277241741 wait complete. 2024-05-08T19:48:40.286 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 4 to deep-scrub 2024-05-08T19:48:40.297 INFO:tasks.ceph:Scrubbing osd.5 2024-05-08T19:48:40.297 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-08T19:48:40.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.440+0000 7fcd691e2700 1 Processor -- start 2024-05-08T19:48:40.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.440+0000 7fcd691e2700 1 -- start start 2024-05-08T19:48:40.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.440+0000 7fcd691e2700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd64152230 0x7fcd640c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.440+0000 7fcd691e2700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcd64070470 0x7fcd640c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.440+0000 7fcd691e2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd640c2fc0 con 0x7fcd640c62b0 2024-05-08T19:48:40.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.440+0000 7fcd691e2700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd640c3e20 con 0x7fcd64070470 2024-05-08T19:48:40.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.440+0000 7fcd691e2700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd64152610 con 0x7fcd64152230 2024-05-08T19:48:40.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.441+0000 7fcd6259c700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcd64070470 0x7fcd640c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.441+0000 7fcd6259c700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcd64070470 0x7fcd640c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54334/0 (socket says 172.21.15.47:54334) 2024-05-08T19:48:40.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.441+0000 7fcd6259c700 1 -- 172.21.15.47:0/3613132707 learned_addr learned my addr 172.21.15.47:0/3613132707 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:40.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.441+0000 7fcd62d9d700 1 --2- 172.21.15.47:0/3613132707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd64152230 0x7fcd640c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.441+0000 7fcd6259c700 1 -- 172.21.15.47:0/3613132707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd64152230 msgr2=0x7fcd640c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:40.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.441+0000 7fcd6259c700 1 --2- 172.21.15.47:0/3613132707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd64152230 0x7fcd640c2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.441+0000 7fcd6259c700 1 -- 172.21.15.47:0/3613132707 >> v1:172.21.15.177:6789/0 conn(0x7fcd640c62b0 legacy=0x7fcd640c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.441+0000 7fcd6259c700 1 -- 172.21.15.47:0/3613132707 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd640702a0 con 0x7fcd64070470 2024-05-08T19:48:40.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.441+0000 7fcd6259c700 1 --2- 172.21.15.47:0/3613132707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd64070470 0x7fcd640c3440 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009920 tx=0x7fcd54009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08538a132808a63 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:40.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.441+0000 7fcd61d9b700 1 -- 172.21.15.47:0/3613132707 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54011830 con 0x7fcd64070470 2024-05-08T19:48:40.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.441+0000 7fcd61d9b700 1 -- 172.21.15.47:0/3613132707 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd54011990 con 0x7fcd64070470 2024-05-08T19:48:40.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.441+0000 7fcd61d9b700 1 -- 172.21.15.47:0/3613132707 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54011d20 con 0x7fcd64070470 2024-05-08T19:48:40.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.442+0000 7fcd691e2700 1 -- 172.21.15.47:0/3613132707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd64070470 msgr2=0x7fcd640c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.442+0000 7fcd691e2700 1 --2- 172.21.15.47:0/3613132707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd64070470 0x7fcd640c3440 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009920 tx=0x7fcd54009c30 comp rx=0 tx=0).stop 2024-05-08T19:48:40.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.442+0000 7fcd691e2700 1 -- 172.21.15.47:0/3613132707 shutdown_connections 2024-05-08T19:48:40.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.442+0000 7fcd691e2700 1 --2- 172.21.15.47:0/3613132707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd64152230 0x7fcd640c2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.442+0000 7fcd691e2700 1 --2- 172.21.15.47:0/3613132707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd64070470 0x7fcd640c3440 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.442+0000 7fcd691e2700 1 -- 172.21.15.47:0/3613132707 >> 172.21.15.47:0/3613132707 conn(0x7fcd6406b1b0 msgr2=0x7fcd640a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:40.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.442+0000 7fcd691e2700 1 -- 172.21.15.47:0/3613132707 shutdown_connections 2024-05-08T19:48:40.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.442+0000 7fcd691e2700 1 -- 172.21.15.47:0/3613132707 wait complete. 2024-05-08T19:48:40.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.443+0000 7fcd691e2700 1 Processor -- start 2024-05-08T19:48:40.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.443+0000 7fcd691e2700 1 -- start start 2024-05-08T19:48:40.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd691e2700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd64070470 0x7fcd640adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd691e2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd640c62b0 0x7fcd6414ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd691e2700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd64152230 0x7fcd641579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd691e2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd640acc00 con 0x7fcd640c62b0 2024-05-08T19:48:40.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd691e2700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd640ae480 con 0x7fcd64152230 2024-05-08T19:48:40.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd691e2700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd640ae230 con 0x7fcd64070470 2024-05-08T19:48:40.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd6259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd640c62b0 0x7fcd6414ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd62d9d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd64070470 0x7fcd640adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd6359e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd64152230 0x7fcd641579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd6259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd640c62b0 0x7fcd6414ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54346/0 (socket says 172.21.15.47:54346) 2024-05-08T19:48:40.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd6259c700 1 -- 172.21.15.47:0/1920900600 learned_addr learned my addr 172.21.15.47:0/1920900600 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:40.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd62d9d700 1 -- 172.21.15.47:0/1920900600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd64152230 msgr2=0x7fcd641579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd62d9d700 1 --2- 172.21.15.47:0/1920900600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd64152230 0x7fcd641579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd62d9d700 1 -- 172.21.15.47:0/1920900600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd640c62b0 msgr2=0x7fcd6414ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd62d9d700 1 --2- 172.21.15.47:0/1920900600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd640c62b0 0x7fcd6414ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd62d9d700 1 -- 172.21.15.47:0/1920900600 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd54009550 con 0x7fcd64070470 2024-05-08T19:48:40.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.444+0000 7fcd6259c700 1 --2- 172.21.15.47:0/1920900600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd640c62b0 0x7fcd6414ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:48:40.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.445+0000 7fcd62d9d700 1 --2- 172.21.15.47:0/1920900600 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd64070470 0x7fcd640adcf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800e870 tx=0x7fcd5800eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:40.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.445+0000 7fcd4b7fe700 1 -- 172.21.15.47:0/1920900600 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58013680 con 0x7fcd64070470 2024-05-08T19:48:40.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.445+0000 7fcd4b7fe700 1 -- 172.21.15.47:0/1920900600 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd580137e0 con 0x7fcd64070470 2024-05-08T19:48:40.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.445+0000 7fcd691e2700 1 -- 172.21.15.47:0/1920900600 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6414bd20 con 0x7fcd64070470 2024-05-08T19:48:40.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.445+0000 7fcd4b7fe700 1 -- 172.21.15.47:0/1920900600 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58013b90 con 0x7fcd64070470 2024-05-08T19:48:40.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.445+0000 7fcd691e2700 1 -- 172.21.15.47:0/1920900600 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd641ea910 con 0x7fcd64070470 2024-05-08T19:48:40.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.446+0000 7fcd691e2700 1 -- 172.21.15.47:0/1920900600 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd640c1ff0 con 0x7fcd64070470 2024-05-08T19:48:40.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.447+0000 7fcd4b7fe700 1 -- 172.21.15.47:0/1920900600 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcd58013cf0 con 0x7fcd64070470 2024-05-08T19:48:40.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.447+0000 7fcd4b7fe700 1 --2- 172.21.15.47:0/1920900600 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fcd5006ac90 0x7fcd5006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.447+0000 7fcd4b7fe700 1 -- 172.21.15.47:0/1920900600 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcd58089730 con 0x7fcd64070470 2024-05-08T19:48:40.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.447+0000 7fcd6259c700 1 --2- 172.21.15.47:0/1920900600 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fcd5006ac90 0x7fcd5006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.447+0000 7fcd4b7fe700 1 --2- 172.21.15.47:0/1920900600 >> [v2:172.21.15.177:6820/47198,v1:172.21.15.177:6822/47198] conn(0x7fcd50074570 0x7fcd50076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.447+0000 7fcd4b7fe700 1 -- 172.21.15.47:0/1920900600 --> [v2:172.21.15.177:6820/47198,v1:172.21.15.177:6822/47198] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd500770e0 con 0x7fcd50074570 2024-05-08T19:48:40.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.447+0000 7fcd4b7fe700 1 -- 172.21.15.47:0/1920900600 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd58089aa0 con 0x7fcd64070470 2024-05-08T19:48:40.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.447+0000 7fcd6359e700 1 --2- 172.21.15.47:0/1920900600 >> [v2:172.21.15.177:6820/47198,v1:172.21.15.177:6822/47198] conn(0x7fcd50074570 0x7fcd50076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.448+0000 7fcd6259c700 1 --2- 172.21.15.47:0/1920900600 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fcd5006ac90 0x7fcd5006d150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009130 tx=0x7fcd54008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:40.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.448+0000 7fcd6359e700 1 --2- 172.21.15.47:0/1920900600 >> [v2:172.21.15.177:6820/47198,v1:172.21.15.177:6822/47198] conn(0x7fcd50074570 0x7fcd50076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:40.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.448+0000 7fcd4b7fe700 1 -- 172.21.15.47:0/1920900600 <== osd.5 v2:172.21.15.177:6820/47198 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fcd500770e0 con 0x7fcd50074570 2024-05-08T19:48:40.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.463+0000 7fcd691e2700 1 -- 172.21.15.47:0/1920900600 --> [v2:172.21.15.177:6820/47198,v1:172.21.15.177:6822/47198] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcd640c22d0 con 0x7fcd50074570 2024-05-08T19:48:40.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.464+0000 7fcd4b7fe700 1 -- 172.21.15.47:0/1920900600 <== osd.5 v2:172.21.15.177:6820/47198 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcd5c001fc0 con 0x7fcd50074570 2024-05-08T19:48:40.454 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-08T19:48:40.454 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T19:48:40.454 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-08T19:48:40.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.464+0000 7fcd691e2700 1 -- 172.21.15.47:0/1920900600 >> [v2:172.21.15.177:6820/47198,v1:172.21.15.177:6822/47198] conn(0x7fcd50074570 msgr2=0x7fcd50076a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.464+0000 7fcd691e2700 1 --2- 172.21.15.47:0/1920900600 >> [v2:172.21.15.177:6820/47198,v1:172.21.15.177:6822/47198] conn(0x7fcd50074570 0x7fcd50076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.464+0000 7fcd691e2700 1 -- 172.21.15.47:0/1920900600 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fcd5006ac90 msgr2=0x7fcd5006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.464+0000 7fcd691e2700 1 --2- 172.21.15.47:0/1920900600 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fcd5006ac90 0x7fcd5006d150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009130 tx=0x7fcd54008030 comp rx=0 tx=0).stop 2024-05-08T19:48:40.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.464+0000 7fcd691e2700 1 -- 172.21.15.47:0/1920900600 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd64070470 msgr2=0x7fcd640adcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.464+0000 7fcd691e2700 1 --2- 172.21.15.47:0/1920900600 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd64070470 0x7fcd640adcf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800e870 tx=0x7fcd5800eb80 comp rx=0 tx=0).stop 2024-05-08T19:48:40.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.464+0000 7fcd6359e700 1 -- 172.21.15.47:0/1920900600 reap_dead start 2024-05-08T19:48:40.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.464+0000 7fcd691e2700 1 -- 172.21.15.47:0/1920900600 shutdown_connections 2024-05-08T19:48:40.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.464+0000 7fcd691e2700 1 -- 172.21.15.47:0/1920900600 >> 172.21.15.47:0/1920900600 conn(0x7fcd6406b1b0 msgr2=0x7fcd64151520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:40.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.464+0000 7fcd691e2700 1 -- 172.21.15.47:0/1920900600 shutdown_connections 2024-05-08T19:48:40.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.464+0000 7fcd691e2700 1 -- 172.21.15.47:0/1920900600 wait complete. 2024-05-08T19:48:40.466 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-08T19:48:40.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.603+0000 7f05e3b8c700 1 Processor -- start 2024-05-08T19:48:40.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.603+0000 7f05e3b8c700 1 -- start start 2024-05-08T19:48:40.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.604+0000 7f05e3b8c700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f05dc14ebe0 0x7f05dc0716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.604+0000 7f05e3b8c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f05dc151690 0x7f05dc151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.604+0000 7f05e3b8c700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05dc155830 con 0x7f05dc0c37f0 2024-05-08T19:48:40.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.604+0000 7f05e3b8c700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05dc0c1c60 con 0x7f05dc14ebe0 2024-05-08T19:48:40.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.604+0000 7f05e3b8c700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05dc072bc0 con 0x7f05dc151690 2024-05-08T19:48:40.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.604+0000 7f05e1928700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f05dc14ebe0 0x7f05dc0716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.604+0000 7f05e1928700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f05dc14ebe0 0x7f05dc0716f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54362/0 (socket says 172.21.15.47:54362) 2024-05-08T19:48:40.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.604+0000 7f05e1928700 1 -- 172.21.15.47:0/904668020 learned_addr learned my addr 172.21.15.47:0/904668020 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:40.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.604+0000 7f05e2129700 1 --2- 172.21.15.47:0/904668020 >> v2:172.21.15.177:3300/0 conn(0x7f05dc151690 0x7f05dc151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.604+0000 7f05e1928700 1 -- 172.21.15.47:0/904668020 >> v2:172.21.15.177:3300/0 conn(0x7f05dc151690 msgr2=0x7f05dc151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:40.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.604+0000 7f05e1928700 1 --2- 172.21.15.47:0/904668020 >> v2:172.21.15.177:3300/0 conn(0x7f05dc151690 0x7f05dc151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.604+0000 7f05e1928700 1 -- 172.21.15.47:0/904668020 >> v1:172.21.15.177:6789/0 conn(0x7f05dc0c37f0 legacy=0x7f05dc071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.604+0000 7f05e1928700 1 -- 172.21.15.47:0/904668020 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc155b10 con 0x7f05dc14ebe0 2024-05-08T19:48:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.605+0000 7f05e1928700 1 --2- 172.21.15.47:0/904668020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05dc14ebe0 0x7f05dc0716f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f05dc071680 tx=0x7f05d800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923a93fc3eab5e07 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.605+0000 7f05e0926700 1 -- 172.21.15.47:0/904668020 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d800dc70 con 0x7f05dc14ebe0 2024-05-08T19:48:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.605+0000 7f05e0926700 1 -- 172.21.15.47:0/904668020 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d800ddd0 con 0x7f05dc14ebe0 2024-05-08T19:48:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.605+0000 7f05e0926700 1 -- 172.21.15.47:0/904668020 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8010690 con 0x7f05dc14ebe0 2024-05-08T19:48:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.605+0000 7f05e3b8c700 1 -- 172.21.15.47:0/904668020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05dc14ebe0 msgr2=0x7f05dc0716f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.605+0000 7f05e3b8c700 1 --2- 172.21.15.47:0/904668020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05dc14ebe0 0x7f05dc0716f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f05dc071680 tx=0x7f05d800be70 comp rx=0 tx=0).stop 2024-05-08T19:48:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.605+0000 7f05e3b8c700 1 -- 172.21.15.47:0/904668020 shutdown_connections 2024-05-08T19:48:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.605+0000 7f05e3b8c700 1 --2- 172.21.15.47:0/904668020 >> v2:172.21.15.177:3300/0 conn(0x7f05dc151690 0x7f05dc151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.605+0000 7f05e3b8c700 1 --2- 172.21.15.47:0/904668020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05dc14ebe0 0x7f05dc0716f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.605+0000 7f05e3b8c700 1 -- 172.21.15.47:0/904668020 >> 172.21.15.47:0/904668020 conn(0x7f05dc0c71c0 msgr2=0x7f05dc0c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.605+0000 7f05e3b8c700 1 -- 172.21.15.47:0/904668020 shutdown_connections 2024-05-08T19:48:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.605+0000 7f05e3b8c700 1 -- 172.21.15.47:0/904668020 wait complete. 2024-05-08T19:48:40.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.607+0000 7f05e3b8c700 1 Processor -- start 2024-05-08T19:48:40.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.607+0000 7f05e3b8c700 1 -- start start 2024-05-08T19:48:40.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.607+0000 7f05e3b8c700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05dc0c37f0 0x7f05dc0a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.607+0000 7f05e3b8c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05dc14ebe0 0x7f05dc0ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.607+0000 7f05e3b8c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05dc151690 0x7f05dc152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.607+0000 7f05e3b8c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc0bc300 con 0x7f05dc14ebe0 2024-05-08T19:48:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.607+0000 7f05e3b8c700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc0a9320 con 0x7f05dc151690 2024-05-08T19:48:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.607+0000 7f05e3b8c700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc0aada0 con 0x7f05dc0c37f0 2024-05-08T19:48:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.607+0000 7f05e1127700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05dc14ebe0 0x7f05dc0ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.607+0000 7f05e1127700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05dc14ebe0 0x7f05dc0ab880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54364/0 (socket says 172.21.15.47:54364) 2024-05-08T19:48:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.607+0000 7f05e1127700 1 -- 172.21.15.47:0/4144852704 learned_addr learned my addr 172.21.15.47:0/4144852704 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.607+0000 7f05e2129700 1 --2- 172.21.15.47:0/4144852704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05dc151690 0x7f05dc152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.607+0000 7f05e1928700 1 --2- 172.21.15.47:0/4144852704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05dc0c37f0 0x7f05dc0a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.608+0000 7f05e1127700 1 -- 172.21.15.47:0/4144852704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05dc0c37f0 msgr2=0x7f05dc0a8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.608+0000 7f05e1127700 1 --2- 172.21.15.47:0/4144852704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05dc0c37f0 0x7f05dc0a8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.608+0000 7f05e1127700 1 -- 172.21.15.47:0/4144852704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05dc151690 msgr2=0x7f05dc152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.608+0000 7f05e1127700 1 --2- 172.21.15.47:0/4144852704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05dc151690 0x7f05dc152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.608+0000 7f05e1127700 1 -- 172.21.15.47:0/4144852704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d800b7f0 con 0x7f05dc14ebe0 2024-05-08T19:48:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.608+0000 7f05e1127700 1 --2- 172.21.15.47:0/4144852704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05dc14ebe0 0x7f05dc0ab880 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00c490 tx=0x7f05cc00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.608+0000 7f05d27fc700 1 -- 172.21.15.47:0/4144852704 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc00cea0 con 0x7f05dc14ebe0 2024-05-08T19:48:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.608+0000 7f05d27fc700 1 -- 172.21.15.47:0/4144852704 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc0052f0 con 0x7f05dc14ebe0 2024-05-08T19:48:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.608+0000 7f05e3b8c700 1 -- 172.21.15.47:0/4144852704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05dc0ab080 con 0x7f05dc14ebe0 2024-05-08T19:48:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.608+0000 7f05d27fc700 1 -- 172.21.15.47:0/4144852704 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc006860 con 0x7f05dc14ebe0 2024-05-08T19:48:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.608+0000 7f05e3b8c700 1 -- 172.21.15.47:0/4144852704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05dc0bd1b0 con 0x7f05dc14ebe0 2024-05-08T19:48:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.609+0000 7f05e3b8c700 1 -- 172.21.15.47:0/4144852704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05dc0ab5a0 con 0x7f05dc14ebe0 2024-05-08T19:48:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.609+0000 7f05d27fc700 1 -- 172.21.15.47:0/4144852704 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f05cc003680 con 0x7f05dc14ebe0 2024-05-08T19:48:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.610+0000 7f05d27fc700 1 --2- 172.21.15.47:0/4144852704 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f05c006ac90 0x7f05c006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.610+0000 7f05d27fc700 1 -- 172.21.15.47:0/4144852704 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f05cc088800 con 0x7f05dc14ebe0 2024-05-08T19:48:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.610+0000 7f05e1928700 1 --2- 172.21.15.47:0/4144852704 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f05c006ac90 0x7f05c006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.610+0000 7f05e1928700 1 --2- 172.21.15.47:0/4144852704 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f05c006ac90 0x7f05c006d150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f05d800beb0 tx=0x7f05d8013000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:40.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.614+0000 7f05d27fc700 1 -- 172.21.15.47:0/4144852704 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f05dc0ab5a0 con 0x7f05dc14ebe0 2024-05-08T19:48:40.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.827+0000 7f05e3b8c700 1 -- 172.21.15.47:0/4144852704 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f05dc152850 con 0x7f05c006ac90 2024-05-08T19:48:40.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.827+0000 7f05d27fc700 1 -- 172.21.15.47:0/4144852704 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f05dc152850 con 0x7f05c006ac90 2024-05-08T19:48:40.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.830+0000 7f05e3b8c700 1 -- 172.21.15.47:0/4144852704 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f05c006ac90 msgr2=0x7f05c006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.830+0000 7f05e3b8c700 1 --2- 172.21.15.47:0/4144852704 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f05c006ac90 0x7f05c006d150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f05d800beb0 tx=0x7f05d8013000 comp rx=0 tx=0).stop 2024-05-08T19:48:40.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.830+0000 7f05e3b8c700 1 -- 172.21.15.47:0/4144852704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05dc14ebe0 msgr2=0x7f05dc0ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.830+0000 7f05e3b8c700 1 --2- 172.21.15.47:0/4144852704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05dc14ebe0 0x7f05dc0ab880 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00c490 tx=0x7f05cc00c7a0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.830+0000 7f05e3b8c700 1 -- 172.21.15.47:0/4144852704 shutdown_connections 2024-05-08T19:48:40.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.830+0000 7f05e3b8c700 1 --2- 172.21.15.47:0/4144852704 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f05c006ac90 0x7f05c006d150 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.830+0000 7f05e3b8c700 1 --2- 172.21.15.47:0/4144852704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05dc151690 0x7f05dc152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.830+0000 7f05e3b8c700 1 --2- 172.21.15.47:0/4144852704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05dc0c37f0 0x7f05dc0a8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.830+0000 7f05e3b8c700 1 --2- 172.21.15.47:0/4144852704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05dc14ebe0 0x7f05dc0ab880 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.830+0000 7f05e3b8c700 1 -- 172.21.15.47:0/4144852704 >> 172.21.15.47:0/4144852704 conn(0x7f05dc0c71c0 msgr2=0x7f05dc14f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:40.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.830+0000 7f05e3b8c700 1 -- 172.21.15.47:0/4144852704 shutdown_connections 2024-05-08T19:48:40.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.830+0000 7f05e3b8c700 1 -- 172.21.15.47:0/4144852704 wait complete. 2024-05-08T19:48:40.822 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 5 to deep-scrub 2024-05-08T19:48:40.832 INFO:tasks.ceph:Scrubbing osd.6 2024-05-08T19:48:40.832 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-08T19:48:40.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.973+0000 7f55653b3700 1 Processor -- start 2024-05-08T19:48:40.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.973+0000 7f55653b3700 1 -- start start 2024-05-08T19:48:40.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.974+0000 7f55653b3700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f55601526f0 0x7f556006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.974+0000 7f55653b3700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f556006bf10 0x7f55600c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.974+0000 7f55653b3700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55600ab720 con 0x7f55600c2be0 2024-05-08T19:48:40.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.974+0000 7f55653b3700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55600aba00 con 0x7f55601526f0 2024-05-08T19:48:40.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.974+0000 7f55653b3700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55600abce0 con 0x7f556006bf10 2024-05-08T19:48:40.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.974+0000 7f555e7fc700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f55601526f0 0x7f556006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.974+0000 7f555e7fc700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f55601526f0 0x7f556006b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54370/0 (socket says 172.21.15.47:54370) 2024-05-08T19:48:40.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.974+0000 7f555e7fc700 1 -- 172.21.15.47:0/2374970613 learned_addr learned my addr 172.21.15.47:0/2374970613 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:40.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.974+0000 7f555f7fe700 1 --2- 172.21.15.47:0/2374970613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f556006bf10 0x7f55600c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.975+0000 7f555e7fc700 1 -- 172.21.15.47:0/2374970613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f556006bf10 msgr2=0x7f55600c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:40.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.975+0000 7f555e7fc700 1 --2- 172.21.15.47:0/2374970613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f556006bf10 0x7f55600c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.975+0000 7f555e7fc700 1 -- 172.21.15.47:0/2374970613 >> v1:172.21.15.177:6789/0 conn(0x7f55600c2be0 legacy=0x7f55600aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.975+0000 7f555e7fc700 1 -- 172.21.15.47:0/2374970613 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600c4760 con 0x7f55601526f0 2024-05-08T19:48:40.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.975+0000 7f555dffb700 1 -- 172.21.15.47:0/2374970613 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549186771 0 0) 0x7f55600ab720 con 0x7f55600c2be0 2024-05-08T19:48:40.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.975+0000 7f555e7fc700 1 --2- 172.21.15.47:0/2374970613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55601526f0 0x7f556006b9d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f55500098f0 tx=0x7f5550009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde1345b20e6c4e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:40.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.975+0000 7f555dffb700 1 -- 172.21.15.47:0/2374970613 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550011830 con 0x7f55601526f0 2024-05-08T19:48:40.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.975+0000 7f555dffb700 1 -- 172.21.15.47:0/2374970613 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5550011990 con 0x7f55601526f0 2024-05-08T19:48:40.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.975+0000 7f555dffb700 1 -- 172.21.15.47:0/2374970613 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550011d20 con 0x7f55601526f0 2024-05-08T19:48:40.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.975+0000 7f55653b3700 1 -- 172.21.15.47:0/2374970613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55601526f0 msgr2=0x7f556006b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.975+0000 7f55653b3700 1 --2- 172.21.15.47:0/2374970613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55601526f0 0x7f556006b9d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f55500098f0 tx=0x7f5550009c00 comp rx=0 tx=0).stop 2024-05-08T19:48:40.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.976+0000 7f55653b3700 1 -- 172.21.15.47:0/2374970613 shutdown_connections 2024-05-08T19:48:40.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.976+0000 7f55653b3700 1 --2- 172.21.15.47:0/2374970613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f556006bf10 0x7f55600c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.976+0000 7f55653b3700 1 --2- 172.21.15.47:0/2374970613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55601526f0 0x7f556006b9d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.976+0000 7f55653b3700 1 -- 172.21.15.47:0/2374970613 >> 172.21.15.47:0/2374970613 conn(0x7f55600c3360 msgr2=0x7f55600c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:40.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.976+0000 7f55653b3700 1 -- 172.21.15.47:0/2374970613 shutdown_connections 2024-05-08T19:48:40.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.976+0000 7f55653b3700 1 -- 172.21.15.47:0/2374970613 wait complete. 2024-05-08T19:48:40.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.977+0000 7f55653b3700 1 Processor -- start 2024-05-08T19:48:40.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.977+0000 7f55653b3700 1 -- start start 2024-05-08T19:48:40.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.977+0000 7f55653b3700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f556006bf10 0x7f55601edf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.977+0000 7f55653b3700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55600c2be0 0x7f55601eaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f55653b3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55601526f0 0x7f556006e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f55653b3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556014f410 con 0x7f55601526f0 2024-05-08T19:48:40.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f55653b3700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55601ee490 con 0x7f55600c2be0 2024-05-08T19:48:40.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f55653b3700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55601eaf90 con 0x7f556006bf10 2024-05-08T19:48:40.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f555f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55601526f0 0x7f556006e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f555f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55601526f0 0x7f556006e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54372/0 (socket says 172.21.15.47:54372) 2024-05-08T19:48:40.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f555f7fe700 1 -- 172.21.15.47:0/1419757414 learned_addr learned my addr 172.21.15.47:0/1419757414 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:40.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f555e7fc700 1 --2- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55600c2be0 0x7f55601eaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f555effd700 1 --2- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f556006bf10 0x7f55601edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f555f7fe700 1 -- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f556006bf10 msgr2=0x7f55601edf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f555f7fe700 1 --2- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f556006bf10 0x7f55601edf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f555f7fe700 1 -- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55600c2be0 msgr2=0x7f55601eaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f555f7fe700 1 --2- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55600c2be0 0x7f55601eaa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f555f7fe700 1 -- 172.21.15.47:0/1419757414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5550009550 con 0x7f55601526f0 2024-05-08T19:48:40.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f555f7fe700 1 --2- 172.21.15.47:0/1419757414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55601526f0 0x7f556006e360 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5558009dd0 tx=0x7f555800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:40.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f55477fe700 1 -- 172.21.15.47:0/1419757414 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558009c40 con 0x7f55601526f0 2024-05-08T19:48:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f55477fe700 1 -- 172.21.15.47:0/1419757414 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555800f040 con 0x7f55601526f0 2024-05-08T19:48:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f55477fe700 1 -- 172.21.15.47:0/1419757414 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800ce70 con 0x7f55601526f0 2024-05-08T19:48:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f55653b3700 1 -- 172.21.15.47:0/1419757414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55601e9fd0 con 0x7f55601526f0 2024-05-08T19:48:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.978+0000 7f55653b3700 1 -- 172.21.15.47:0/1419757414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556009b3d0 con 0x7f55601526f0 2024-05-08T19:48:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.979+0000 7f55653b3700 1 -- 172.21.15.47:0/1419757414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f55600c54a0 con 0x7f55601526f0 2024-05-08T19:48:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.980+0000 7f55477fe700 1 -- 172.21.15.47:0/1419757414 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5558014480 con 0x7f55601526f0 2024-05-08T19:48:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.980+0000 7f55477fe700 1 --2- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f554c06ac90 0x7f554c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.980+0000 7f55477fe700 1 -- 172.21.15.47:0/1419757414 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f555808a5a0 con 0x7f55601526f0 2024-05-08T19:48:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.980+0000 7f555effd700 1 --2- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f554c06ac90 0x7f554c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.980+0000 7f55477fe700 1 --2- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:6800/47188,v1:172.21.15.177:6801/47188] conn(0x7f554c074570 0x7f554c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.980+0000 7f55477fe700 1 -- 172.21.15.47:0/1419757414 --> [v2:172.21.15.177:6800/47188,v1:172.21.15.177:6801/47188] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f554c0770e0 con 0x7f554c074570 2024-05-08T19:48:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.980+0000 7f55477fe700 1 -- 172.21.15.47:0/1419757414 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f555808a910 con 0x7f55601526f0 2024-05-08T19:48:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.981+0000 7f555e7fc700 1 --2- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:6800/47188,v1:172.21.15.177:6801/47188] conn(0x7f554c074570 0x7f554c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:40.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.981+0000 7f555effd700 1 --2- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f554c06ac90 0x7f554c06d150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5554007fd0 tx=0x7f5554009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:40.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.981+0000 7f555e7fc700 1 --2- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:6800/47188,v1:172.21.15.177:6801/47188] conn(0x7f554c074570 0x7f554c076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:40.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.982+0000 7f55477fe700 1 -- 172.21.15.47:0/1419757414 <== osd.6 v2:172.21.15.177:6800/47188 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f554c0770e0 con 0x7f554c074570 2024-05-08T19:48:40.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.997+0000 7f55653b3700 1 -- 172.21.15.47:0/1419757414 --> [v2:172.21.15.177:6800/47188,v1:172.21.15.177:6801/47188] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f556009b5c0 con 0x7f554c074570 2024-05-08T19:48:40.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.997+0000 7f55477fe700 1 -- 172.21.15.47:0/1419757414 <== osd.6 v2:172.21.15.177:6800/47188 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f556009b5c0 con 0x7f554c074570 2024-05-08T19:48:40.987 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-08T19:48:40.987 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T19:48:40.988 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-08T19:48:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.997+0000 7f55653b3700 1 -- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:6800/47188,v1:172.21.15.177:6801/47188] conn(0x7f554c074570 msgr2=0x7f554c076a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.997+0000 7f55653b3700 1 --2- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:6800/47188,v1:172.21.15.177:6801/47188] conn(0x7f554c074570 0x7f554c076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.997+0000 7f55653b3700 1 -- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f554c06ac90 msgr2=0x7f554c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.997+0000 7f55653b3700 1 --2- 172.21.15.47:0/1419757414 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f554c06ac90 0x7f554c06d150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5554007fd0 tx=0x7f5554009040 comp rx=0 tx=0).stop 2024-05-08T19:48:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.997+0000 7f55653b3700 1 -- 172.21.15.47:0/1419757414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55601526f0 msgr2=0x7f556006e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.997+0000 7f55653b3700 1 --2- 172.21.15.47:0/1419757414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55601526f0 0x7f556006e360 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5558009dd0 tx=0x7f555800c3a0 comp rx=0 tx=0).stop 2024-05-08T19:48:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.997+0000 7f555f7fe700 1 -- 172.21.15.47:0/1419757414 reap_dead start 2024-05-08T19:48:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.997+0000 7f55653b3700 1 -- 172.21.15.47:0/1419757414 shutdown_connections 2024-05-08T19:48:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.997+0000 7f55653b3700 1 -- 172.21.15.47:0/1419757414 >> 172.21.15.47:0/1419757414 conn(0x7f55600c3360 msgr2=0x7f5560151b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.997+0000 7f55653b3700 1 -- 172.21.15.47:0/1419757414 shutdown_connections 2024-05-08T19:48:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:40.997+0000 7f55653b3700 1 -- 172.21.15.47:0/1419757414 wait complete. 2024-05-08T19:48:41.000 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-08T19:48:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.137+0000 7f4719a45700 1 Processor -- start 2024-05-08T19:48:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.137+0000 7f4719a45700 1 -- start start 2024-05-08T19:48:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.138+0000 7f4719a45700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f471406c0d0 0x7f47140c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.138+0000 7f4719a45700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471406c4e0 con 0x7f4714151e20 2024-05-08T19:48:41.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.138+0000 7f4719a45700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471406bc40 con 0x7f47140c4b30 2024-05-08T19:48:41.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.138+0000 7f4719a45700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47140c61d0 con 0x7f471406c0d0 2024-05-08T19:48:41.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.138+0000 7f4712ffd700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4714151e20 0x7f4714155310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55976/0 (socket says 172.21.15.47:55976) 2024-05-08T19:48:41.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.138+0000 7f4712ffd700 1 -- 172.21.15.47:0/3464318668 learned_addr learned my addr 172.21.15.47:0/3464318668 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:48:41.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.138+0000 7f47137fe700 1 --2- 172.21.15.47:0/3464318668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f471406c0d0 0x7f47140c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.138+0000 7f4711ffb700 1 -- 172.21.15.47:0/3464318668 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714690743 0 0) 0x7f470c001490 con 0x7f4714151e20 2024-05-08T19:48:41.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.138+0000 7f4711ffb700 1 -- 172.21.15.47:0/3464318668 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46fc0035b0 con 0x7f4714151e20 2024-05-08T19:48:41.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.138+0000 7f4711ffb700 1 -- 172.21.15.47:0/3464318668 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355187476 0 0) 0x7f471406bc40 con 0x7f47140c4b30 2024-05-08T19:48:41.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.139+0000 7f4711ffb700 1 -- 172.21.15.47:0/3464318668 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f470c001490 con 0x7f47140c4b30 2024-05-08T19:48:41.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.139+0000 7f47137fe700 1 -- 172.21.15.47:0/3464318668 >> v1:172.21.15.177:6789/0 conn(0x7f47140c4b30 legacy=0x7f4714155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.139+0000 7f47137fe700 1 -- 172.21.15.47:0/3464318668 >> v1:172.21.15.47:6789/0 conn(0x7f4714151e20 legacy=0x7f4714155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.139+0000 7f47137fe700 1 -- 172.21.15.47:0/3464318668 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47140c50d0 con 0x7f471406c0d0 2024-05-08T19:48:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.139+0000 7f47137fe700 1 --2- 172.21.15.47:0/3464318668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f471406c0d0 0x7f47140c71a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4704009870 tx=0x7f4704009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be5e20a531ecf0cd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.139+0000 7f4711ffb700 1 -- 172.21.15.47:0/3464318668 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704011830 con 0x7f471406c0d0 2024-05-08T19:48:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.139+0000 7f4711ffb700 1 -- 172.21.15.47:0/3464318668 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4704011990 con 0x7f471406c0d0 2024-05-08T19:48:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.139+0000 7f4711ffb700 1 -- 172.21.15.47:0/3464318668 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704011d20 con 0x7f471406c0d0 2024-05-08T19:48:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.140+0000 7f4719a45700 1 -- 172.21.15.47:0/3464318668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f471406c0d0 msgr2=0x7f47140c71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.140+0000 7f4719a45700 1 --2- 172.21.15.47:0/3464318668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f471406c0d0 0x7f47140c71a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4704009870 tx=0x7f4704009b80 comp rx=0 tx=0).stop 2024-05-08T19:48:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.140+0000 7f4719a45700 1 -- 172.21.15.47:0/3464318668 shutdown_connections 2024-05-08T19:48:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.140+0000 7f4719a45700 1 --2- 172.21.15.47:0/3464318668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f471406c0d0 0x7f47140c71a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.140+0000 7f4719a45700 1 -- 172.21.15.47:0/3464318668 >> 172.21.15.47:0/3464318668 conn(0x7f47140ac140 msgr2=0x7f47140ac550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.140+0000 7f4719a45700 1 -- 172.21.15.47:0/3464318668 shutdown_connections 2024-05-08T19:48:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.140+0000 7f4719a45700 1 -- 172.21.15.47:0/3464318668 wait complete. 2024-05-08T19:48:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.141+0000 7f4719a45700 1 Processor -- start 2024-05-08T19:48:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.141+0000 7f4719a45700 1 -- start start 2024-05-08T19:48:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f4719a45700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f471406c0d0 0x7f47140c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f4719a45700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f47140c4b30 0x7f47140c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f4719a45700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4714151e20 0x7f47141ed750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f4719a45700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47140aeeb0 con 0x7f4714151e20 2024-05-08T19:48:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f4719a45700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47141ee3f0 con 0x7f471406c0d0 2024-05-08T19:48:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f4719a45700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47140af920 con 0x7f47140c4b30 2024-05-08T19:48:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f47137fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4714151e20 0x7f47141ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f47137fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4714151e20 0x7f47141ed750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54384/0 (socket says 172.21.15.47:54384) 2024-05-08T19:48:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f47127fc700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f47140c4b30 0x7f47140c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f47137fe700 1 -- 172.21.15.47:0/3885222485 learned_addr learned my addr 172.21.15.47:0/3885222485 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f4712ffd700 1 --2- 172.21.15.47:0/3885222485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f471406c0d0 0x7f47140c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f47137fe700 1 -- 172.21.15.47:0/3885222485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f47140c4b30 msgr2=0x7f47140c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f47137fe700 1 --2- 172.21.15.47:0/3885222485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f47140c4b30 0x7f47140c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f47137fe700 1 -- 172.21.15.47:0/3885222485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f471406c0d0 msgr2=0x7f47140c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f47137fe700 1 --2- 172.21.15.47:0/3885222485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f471406c0d0 0x7f47140c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f47137fe700 1 -- 172.21.15.47:0/3885222485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47040094a0 con 0x7f4714151e20 2024-05-08T19:48:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f47137fe700 1 --2- 172.21.15.47:0/3885222485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4714151e20 0x7f47141ed750 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f47040097c0 tx=0x7f4704004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f46fbfff700 1 -- 172.21.15.47:0/3885222485 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470401a6e0 con 0x7f4714151e20 2024-05-08T19:48:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f46fbfff700 1 -- 172.21.15.47:0/3885222485 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470401a840 con 0x7f4714151e20 2024-05-08T19:48:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f46fbfff700 1 -- 172.21.15.47:0/3885222485 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470401abf0 con 0x7f4714151e20 2024-05-08T19:48:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.142+0000 7f4719a45700 1 -- 172.21.15.47:0/3885222485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47140afc00 con 0x7f4714151e20 2024-05-08T19:48:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.143+0000 7f4719a45700 1 -- 172.21.15.47:0/3885222485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47140c0ec0 con 0x7f4714151e20 2024-05-08T19:48:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.143+0000 7f4719a45700 1 -- 172.21.15.47:0/3885222485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47140aec10 con 0x7f4714151e20 2024-05-08T19:48:41.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.144+0000 7f46fbfff700 1 -- 172.21.15.47:0/3885222485 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4704022070 con 0x7f4714151e20 2024-05-08T19:48:41.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.144+0000 7f46fbfff700 1 --2- 172.21.15.47:0/3885222485 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f470006ac90 0x7f470006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.144+0000 7f46fbfff700 1 -- 172.21.15.47:0/3885222485 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f470408a560 con 0x7f4714151e20 2024-05-08T19:48:41.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.144+0000 7f4712ffd700 1 --2- 172.21.15.47:0/3885222485 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f470006ac90 0x7f470006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.145+0000 7f4712ffd700 1 --2- 172.21.15.47:0/3885222485 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f470006ac90 0x7f470006d150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f470c0016f0 tx=0x7f470c001b80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:41.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.149+0000 7f46fbfff700 1 -- 172.21.15.47:0/3885222485 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f47140aec10 con 0x7f4714151e20 2024-05-08T19:48:41.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.359+0000 7f4719a45700 1 -- 172.21.15.47:0/3885222485 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f47140c10e0 con 0x7f470006ac90 2024-05-08T19:48:41.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.360+0000 7f46fbfff700 1 -- 172.21.15.47:0/3885222485 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f470c001e50 con 0x7f470006ac90 2024-05-08T19:48:41.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.362+0000 7f4719a45700 1 -- 172.21.15.47:0/3885222485 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f470006ac90 msgr2=0x7f470006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.362+0000 7f4719a45700 1 --2- 172.21.15.47:0/3885222485 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f470006ac90 0x7f470006d150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f470c0016f0 tx=0x7f470c001b80 comp rx=0 tx=0).stop 2024-05-08T19:48:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.362+0000 7f4719a45700 1 -- 172.21.15.47:0/3885222485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4714151e20 msgr2=0x7f47141ed750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.362+0000 7f4719a45700 1 --2- 172.21.15.47:0/3885222485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4714151e20 0x7f47141ed750 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f47040097c0 tx=0x7f4704004750 comp rx=0 tx=0).stop 2024-05-08T19:48:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.362+0000 7f4719a45700 1 -- 172.21.15.47:0/3885222485 shutdown_connections 2024-05-08T19:48:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.362+0000 7f4719a45700 1 --2- 172.21.15.47:0/3885222485 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f470006ac90 0x7f470006d150 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.362+0000 7f4719a45700 1 --2- 172.21.15.47:0/3885222485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4714151e20 0x7f47141ed750 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.362+0000 7f4719a45700 1 --2- 172.21.15.47:0/3885222485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f471406c0d0 0x7f47140c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.362+0000 7f4719a45700 1 --2- 172.21.15.47:0/3885222485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f47140c4b30 0x7f47140c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.362+0000 7f4719a45700 1 -- 172.21.15.47:0/3885222485 >> 172.21.15.47:0/3885222485 conn(0x7f47140ac140 msgr2=0x7f47140c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.362+0000 7f4719a45700 1 -- 172.21.15.47:0/3885222485 shutdown_connections 2024-05-08T19:48:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.362+0000 7f4719a45700 1 -- 172.21.15.47:0/3885222485 wait complete. 2024-05-08T19:48:41.354 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 6 to deep-scrub 2024-05-08T19:48:41.365 INFO:tasks.ceph:Scrubbing osd.7 2024-05-08T19:48:41.365 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-08T19:48:41.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.504+0000 7f66217c9700 1 Processor -- start 2024-05-08T19:48:41.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.504+0000 7f66217c9700 1 -- start start 2024-05-08T19:48:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.505+0000 7f66217c9700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f661c0c1d90 0x7f661c0c2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.505+0000 7f66217c9700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f661c1557e0 0x7f661c14ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.505+0000 7f66217c9700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661c0a8bc0 con 0x7f661c0c2b10 2024-05-08T19:48:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.505+0000 7f66217c9700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661c0c3970 con 0x7f661c1557e0 2024-05-08T19:48:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.505+0000 7f66217c9700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661c0c3690 con 0x7f661c0c1d90 2024-05-08T19:48:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.505+0000 7f661b7fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f661c1557e0 0x7f661c14ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.505+0000 7f661b7fe700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f661c1557e0 0x7f661c14ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54388/0 (socket says 172.21.15.47:54388) 2024-05-08T19:48:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.505+0000 7f661b7fe700 1 -- 172.21.15.47:0/3452864191 learned_addr learned my addr 172.21.15.47:0/3452864191 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.506+0000 7f661affd700 1 --2- 172.21.15.47:0/3452864191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f661c0c1d90 0x7f661c0c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.506+0000 7f661b7fe700 1 -- 172.21.15.47:0/3452864191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f661c0c1d90 msgr2=0x7f661c0c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.506+0000 7f661b7fe700 1 --2- 172.21.15.47:0/3452864191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f661c0c1d90 0x7f661c0c2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.506+0000 7f661b7fe700 1 -- 172.21.15.47:0/3452864191 >> v1:172.21.15.177:6789/0 conn(0x7f661c0c2b10 legacy=0x7f661c0a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.506+0000 7f661b7fe700 1 -- 172.21.15.47:0/3452864191 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c154d00 con 0x7f661c1557e0 2024-05-08T19:48:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.506+0000 7f661b7fe700 1 --2- 172.21.15.47:0/3452864191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f661c1557e0 0x7f661c14ea40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6614009e50 tx=0x7f661400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4523edc15f37556 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:41.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.506+0000 7f6619ffb700 1 -- 172.21.15.47:0/3452864191 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661400e070 con 0x7f661c1557e0 2024-05-08T19:48:41.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.506+0000 7f6619ffb700 1 -- 172.21.15.47:0/3452864191 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661400b910 con 0x7f661c1557e0 2024-05-08T19:48:41.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.506+0000 7f6619ffb700 1 -- 172.21.15.47:0/3452864191 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661400bcc0 con 0x7f661c1557e0 2024-05-08T19:48:41.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.507+0000 7f66217c9700 1 -- 172.21.15.47:0/3452864191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f661c1557e0 msgr2=0x7f661c14ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.507+0000 7f66217c9700 1 --2- 172.21.15.47:0/3452864191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f661c1557e0 0x7f661c14ea40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6614009e50 tx=0x7f661400b330 comp rx=0 tx=0).stop 2024-05-08T19:48:41.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.507+0000 7f66217c9700 1 -- 172.21.15.47:0/3452864191 shutdown_connections 2024-05-08T19:48:41.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.507+0000 7f66217c9700 1 --2- 172.21.15.47:0/3452864191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f661c1557e0 0x7f661c14ea40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.507+0000 7f66217c9700 1 --2- 172.21.15.47:0/3452864191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f661c0c1d90 0x7f661c0c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.507+0000 7f66217c9700 1 -- 172.21.15.47:0/3452864191 >> 172.21.15.47:0/3452864191 conn(0x7f661c0c3c20 msgr2=0x7f661c0c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:41.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.507+0000 7f66217c9700 1 -- 172.21.15.47:0/3452864191 shutdown_connections 2024-05-08T19:48:41.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.507+0000 7f66217c9700 1 -- 172.21.15.47:0/3452864191 wait complete. 2024-05-08T19:48:41.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.508+0000 7f66217c9700 1 Processor -- start 2024-05-08T19:48:41.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.508+0000 7f66217c9700 1 -- start start 2024-05-08T19:48:41.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f66217c9700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f661c0c1d90 0x7f661c150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f66217c9700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f661c0c2b10 0x7f661c1ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f66217c9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f661c1557e0 0x7f661c0acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f66217c9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c150db0 con 0x7f661c1557e0 2024-05-08T19:48:41.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f66217c9700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c0c6410 con 0x7f661c0c2b10 2024-05-08T19:48:41.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f66217c9700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661c0abe60 con 0x7f661c0c1d90 2024-05-08T19:48:41.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f661b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f661c1557e0 0x7f661c0acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f661affd700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f661c0c1d90 0x7f661c150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f661b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f661c1557e0 0x7f661c0acc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54392/0 (socket says 172.21.15.47:54392) 2024-05-08T19:48:41.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f661b7fe700 1 -- 172.21.15.47:0/2249945460 learned_addr learned my addr 172.21.15.47:0/2249945460 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:41.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f661a7fc700 1 --2- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f661c0c2b10 0x7f661c1ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f661b7fe700 1 -- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f661c0c1d90 msgr2=0x7f661c150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f661b7fe700 1 --2- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f661c0c1d90 0x7f661c150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f661b7fe700 1 -- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f661c0c2b10 msgr2=0x7f661c1ea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f661b7fe700 1 --2- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f661c0c2b10 0x7f661c1ea0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f661b7fe700 1 -- 172.21.15.47:0/2249945460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6614009b30 con 0x7f661c1557e0 2024-05-08T19:48:41.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f661affd700 1 --2- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f661c0c1d90 0x7f661c150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:48:41.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f661b7fe700 1 --2- 172.21.15.47:0/2249945460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f661c1557e0 0x7f661c0acc50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f661c067640 tx=0x7f6614004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:41.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f66137fe700 1 -- 172.21.15.47:0/2249945460 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6614004840 con 0x7f661c1557e0 2024-05-08T19:48:41.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.509+0000 7f66137fe700 1 -- 172.21.15.47:0/2249945460 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66140092e0 con 0x7f661c1557e0 2024-05-08T19:48:41.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.510+0000 7f66217c9700 1 -- 172.21.15.47:0/2249945460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661c0ac140 con 0x7f661c1557e0 2024-05-08T19:48:41.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.510+0000 7f66137fe700 1 -- 172.21.15.47:0/2249945460 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661401c630 con 0x7f661c1557e0 2024-05-08T19:48:41.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.510+0000 7f66217c9700 1 -- 172.21.15.47:0/2249945460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661c150860 con 0x7f661c1557e0 2024-05-08T19:48:41.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.510+0000 7f66217c9700 1 -- 172.21.15.47:0/2249945460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f661c0c3340 con 0x7f661c1557e0 2024-05-08T19:48:41.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.511+0000 7f66137fe700 1 -- 172.21.15.47:0/2249945460 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f661401c790 con 0x7f661c1557e0 2024-05-08T19:48:41.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.511+0000 7f66137fe700 1 --2- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f65fc06ac90 0x7f65fc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.512+0000 7f66137fe700 1 -- 172.21.15.47:0/2249945460 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f661408b3b0 con 0x7f661c1557e0 2024-05-08T19:48:41.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.512+0000 7f66137fe700 1 --2- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:6816/47211,v1:172.21.15.177:6817/47211] conn(0x7f65fc074570 0x7f65fc076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.512+0000 7f661affd700 1 --2- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f65fc06ac90 0x7f65fc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.512+0000 7f66137fe700 1 -- 172.21.15.47:0/2249945460 --> [v2:172.21.15.177:6816/47211,v1:172.21.15.177:6817/47211] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f65fc0770e0 con 0x7f65fc074570 2024-05-08T19:48:41.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.512+0000 7f66137fe700 1 -- 172.21.15.47:0/2249945460 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f661408b720 con 0x7f661c1557e0 2024-05-08T19:48:41.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.512+0000 7f661a7fc700 1 --2- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:6816/47211,v1:172.21.15.177:6817/47211] conn(0x7f65fc074570 0x7f65fc076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.512+0000 7f661affd700 1 --2- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f65fc06ac90 0x7f65fc06d150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6604009fd0 tx=0x7f6604009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:41.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.512+0000 7f661a7fc700 1 --2- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:6816/47211,v1:172.21.15.177:6817/47211] conn(0x7f65fc074570 0x7f65fc076a10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:41.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.513+0000 7f66137fe700 1 -- 172.21.15.47:0/2249945460 <== osd.7 v2:172.21.15.177:6816/47211 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f65fc0770e0 con 0x7f65fc074570 2024-05-08T19:48:41.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.528+0000 7f66217c9700 1 -- 172.21.15.47:0/2249945460 --> [v2:172.21.15.177:6816/47211,v1:172.21.15.177:6817/47211] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f661c1552c0 con 0x7f65fc074570 2024-05-08T19:48:41.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.528+0000 7f66137fe700 1 -- 172.21.15.47:0/2249945460 <== osd.7 v2:172.21.15.177:6816/47211 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f660c001560 con 0x7f65fc074570 2024-05-08T19:48:41.519 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-08T19:48:41.519 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T19:48:41.519 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-08T19:48:41.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.529+0000 7f66217c9700 1 -- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:6816/47211,v1:172.21.15.177:6817/47211] conn(0x7f65fc074570 msgr2=0x7f65fc076a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.529+0000 7f66217c9700 1 --2- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:6816/47211,v1:172.21.15.177:6817/47211] conn(0x7f65fc074570 0x7f65fc076a10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.529+0000 7f66217c9700 1 -- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f65fc06ac90 msgr2=0x7f65fc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.529+0000 7f66217c9700 1 --2- 172.21.15.47:0/2249945460 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f65fc06ac90 0x7f65fc06d150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6604009fd0 tx=0x7f6604009210 comp rx=0 tx=0).stop 2024-05-08T19:48:41.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.529+0000 7f66217c9700 1 -- 172.21.15.47:0/2249945460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f661c1557e0 msgr2=0x7f661c0acc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.529+0000 7f66217c9700 1 --2- 172.21.15.47:0/2249945460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f661c1557e0 0x7f661c0acc50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f661c067640 tx=0x7f6614004ad0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.529+0000 7f661b7fe700 1 -- 172.21.15.47:0/2249945460 reap_dead start 2024-05-08T19:48:41.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.529+0000 7f66217c9700 1 -- 172.21.15.47:0/2249945460 shutdown_connections 2024-05-08T19:48:41.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.529+0000 7f66217c9700 1 -- 172.21.15.47:0/2249945460 >> 172.21.15.47:0/2249945460 conn(0x7f661c0c3c20 msgr2=0x7f661c0c1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:41.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.529+0000 7f66217c9700 1 -- 172.21.15.47:0/2249945460 shutdown_connections 2024-05-08T19:48:41.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.529+0000 7f66217c9700 1 -- 172.21.15.47:0/2249945460 wait complete. 2024-05-08T19:48:41.531 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-08T19:48:41.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.669+0000 7fb9ef4c8700 1 Processor -- start 2024-05-08T19:48:41.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.670+0000 7fb9ef4c8700 1 -- start start 2024-05-08T19:48:41.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.670+0000 7fb9ef4c8700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9e80c74e0 0x7fb9e8070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.670+0000 7fb9ef4c8700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9e80c78c0 0x7fb9e806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.670+0000 7fb9ef4c8700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e8153430 con 0x7fb9e80c46c0 2024-05-08T19:48:41.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.670+0000 7fb9ef4c8700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e8071250 con 0x7fb9e80c78c0 2024-05-08T19:48:41.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.670+0000 7fb9ef4c8700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e8153960 con 0x7fb9e80c74e0 2024-05-08T19:48:41.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.670+0000 7fb9eca63700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9e80c78c0 0x7fb9e806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.670+0000 7fb9eca63700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9e80c78c0 0x7fb9e806ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54396/0 (socket says 172.21.15.47:54396) 2024-05-08T19:48:41.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.670+0000 7fb9eca63700 1 -- 172.21.15.47:0/3110576096 learned_addr learned my addr 172.21.15.47:0/3110576096 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:41.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.671+0000 7fb9ed264700 1 --2- 172.21.15.47:0/3110576096 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9e80c74e0 0x7fb9e8070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.671+0000 7fb9eca63700 1 -- 172.21.15.47:0/3110576096 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9e80c74e0 msgr2=0x7fb9e8070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:41.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.671+0000 7fb9eca63700 1 --2- 172.21.15.47:0/3110576096 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9e80c74e0 0x7fb9e8070d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.671+0000 7fb9eca63700 1 -- 172.21.15.47:0/3110576096 >> v1:172.21.15.177:6789/0 conn(0x7fb9e80c46c0 legacy=0x7fb9e80c2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:41.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.671+0000 7fb9eca63700 1 -- 172.21.15.47:0/3110576096 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e806eaf0 con 0x7fb9e80c78c0 2024-05-08T19:48:41.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.671+0000 7fb9eca63700 1 --2- 172.21.15.47:0/3110576096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e80c78c0 0x7fb9e806ef60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0098f0 tx=0x7fb9dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7844747dcb98e4f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:41.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.671+0000 7fb9dbfff700 1 -- 172.21.15.47:0/3110576096 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc00b8a0 con 0x7fb9e80c78c0 2024-05-08T19:48:41.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.671+0000 7fb9dbfff700 1 -- 172.21.15.47:0/3110576096 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc00ba00 con 0x7fb9e80c78c0 2024-05-08T19:48:41.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.671+0000 7fb9dbfff700 1 -- 172.21.15.47:0/3110576096 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc00bd90 con 0x7fb9e80c78c0 2024-05-08T19:48:41.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.672+0000 7fb9ef4c8700 1 -- 172.21.15.47:0/3110576096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e80c78c0 msgr2=0x7fb9e806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.672+0000 7fb9ef4c8700 1 --2- 172.21.15.47:0/3110576096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e80c78c0 0x7fb9e806ef60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0098f0 tx=0x7fb9dc009c00 comp rx=0 tx=0).stop 2024-05-08T19:48:41.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.672+0000 7fb9ef4c8700 1 -- 172.21.15.47:0/3110576096 shutdown_connections 2024-05-08T19:48:41.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.672+0000 7fb9ef4c8700 1 --2- 172.21.15.47:0/3110576096 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9e80c74e0 0x7fb9e8070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.672+0000 7fb9ef4c8700 1 --2- 172.21.15.47:0/3110576096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e80c78c0 0x7fb9e806ef60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.672+0000 7fb9ef4c8700 1 -- 172.21.15.47:0/3110576096 >> 172.21.15.47:0/3110576096 conn(0x7fb9e80a9ea0 msgr2=0x7fb9e80aa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:41.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.672+0000 7fb9ef4c8700 1 -- 172.21.15.47:0/3110576096 shutdown_connections 2024-05-08T19:48:41.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.672+0000 7fb9ef4c8700 1 -- 172.21.15.47:0/3110576096 wait complete. 2024-05-08T19:48:41.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.673+0000 7fb9ef4c8700 1 Processor -- start 2024-05-08T19:48:41.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.673+0000 7fb9ef4c8700 1 -- start start 2024-05-08T19:48:41.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ef4c8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e80c46c0 0x7fb9e81ee350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ef4c8700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9e80c74e0 0x7fb9e80ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ef4c8700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9e80c78c0 0x7fb9e81ea780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ef4c8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e809af20 con 0x7fb9e80c46c0 2024-05-08T19:48:41.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ef4c8700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e81ea350 con 0x7fb9e80c78c0 2024-05-08T19:48:41.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ef4c8700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e81ee890 con 0x7fb9e80c74e0 2024-05-08T19:48:41.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ed264700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e80c46c0 0x7fb9e81ee350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ed264700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e80c46c0 0x7fb9e81ee350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54412/0 (socket says 172.21.15.47:54412) 2024-05-08T19:48:41.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ed264700 1 -- 172.21.15.47:0/4216439494 learned_addr learned my addr 172.21.15.47:0/4216439494 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:41.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9eda65700 1 --2- 172.21.15.47:0/4216439494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9e80c78c0 0x7fb9e81ea780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9eca63700 1 --2- 172.21.15.47:0/4216439494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9e80c74e0 0x7fb9e80ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ed264700 1 -- 172.21.15.47:0/4216439494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9e80c74e0 msgr2=0x7fb9e80ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ed264700 1 --2- 172.21.15.47:0/4216439494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9e80c74e0 0x7fb9e80ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ed264700 1 -- 172.21.15.47:0/4216439494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9e80c78c0 msgr2=0x7fb9e81ea780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ed264700 1 --2- 172.21.15.47:0/4216439494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9e80c78c0 0x7fb9e81ea780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ed264700 1 -- 172.21.15.47:0/4216439494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc009550 con 0x7fb9e80c46c0 2024-05-08T19:48:41.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ed264700 1 --2- 172.21.15.47:0/4216439494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e80c46c0 0x7fb9e81ee350 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400e840 tx=0x7fb9e400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:41.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9d9ffb700 1 -- 172.21.15.47:0/4216439494 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e400c070 con 0x7fb9e80c46c0 2024-05-08T19:48:41.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9d9ffb700 1 -- 172.21.15.47:0/4216439494 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e4013610 con 0x7fb9e80c46c0 2024-05-08T19:48:41.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9ef4c8700 1 -- 172.21.15.47:0/4216439494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e809a870 con 0x7fb9e80c46c0 2024-05-08T19:48:41.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.674+0000 7fb9d9ffb700 1 -- 172.21.15.47:0/4216439494 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e40139c0 con 0x7fb9e80c46c0 2024-05-08T19:48:41.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.675+0000 7fb9ef4c8700 1 -- 172.21.15.47:0/4216439494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e81568a0 con 0x7fb9e80c46c0 2024-05-08T19:48:41.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.676+0000 7fb9ef4c8700 1 -- 172.21.15.47:0/4216439494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e81ea5d0 con 0x7fb9e80c46c0 2024-05-08T19:48:41.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.676+0000 7fb9d9ffb700 1 -- 172.21.15.47:0/4216439494 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb9e4013b20 con 0x7fb9e80c46c0 2024-05-08T19:48:41.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.676+0000 7fb9d9ffb700 1 --2- 172.21.15.47:0/4216439494 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb9cc06ac90 0x7fb9cc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:41.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.677+0000 7fb9d9ffb700 1 -- 172.21.15.47:0/4216439494 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb9e4089480 con 0x7fb9e80c46c0 2024-05-08T19:48:41.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.677+0000 7fb9eca63700 1 --2- 172.21.15.47:0/4216439494 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb9cc06ac90 0x7fb9cc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:41.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.677+0000 7fb9eca63700 1 --2- 172.21.15.47:0/4216439494 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb9cc06ac90 0x7fb9cc06d150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0098f0 tx=0x7fb9dc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:41.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.681+0000 7fb9d9ffb700 1 -- 172.21.15.47:0/4216439494 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb9e4054210 con 0x7fb9e80c46c0 2024-05-08T19:48:41.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.890+0000 7fb9ef4c8700 1 -- 172.21.15.47:0/4216439494 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9e80ade20 con 0x7fb9cc06ac90 2024-05-08T19:48:41.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.891+0000 7fb9d9ffb700 1 -- 172.21.15.47:0/4216439494 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb9dc00bb70 con 0x7fb9cc06ac90 2024-05-08T19:48:41.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.893+0000 7fb9ef4c8700 1 -- 172.21.15.47:0/4216439494 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb9cc06ac90 msgr2=0x7fb9cc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.893+0000 7fb9ef4c8700 1 --2- 172.21.15.47:0/4216439494 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb9cc06ac90 0x7fb9cc06d150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0098f0 tx=0x7fb9dc008030 comp rx=0 tx=0).stop 2024-05-08T19:48:41.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.893+0000 7fb9ef4c8700 1 -- 172.21.15.47:0/4216439494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e80c46c0 msgr2=0x7fb9e81ee350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:41.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.893+0000 7fb9ef4c8700 1 --2- 172.21.15.47:0/4216439494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e80c46c0 0x7fb9e81ee350 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400e840 tx=0x7fb9e400eb50 comp rx=0 tx=0).stop 2024-05-08T19:48:41.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.894+0000 7fb9ef4c8700 1 -- 172.21.15.47:0/4216439494 shutdown_connections 2024-05-08T19:48:41.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.894+0000 7fb9ef4c8700 1 --2- 172.21.15.47:0/4216439494 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fb9cc06ac90 0x7fb9cc06d150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.894+0000 7fb9ef4c8700 1 --2- 172.21.15.47:0/4216439494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e80c46c0 0x7fb9e81ee350 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.894+0000 7fb9ef4c8700 1 --2- 172.21.15.47:0/4216439494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9e80c78c0 0x7fb9e81ea780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.894+0000 7fb9ef4c8700 1 --2- 172.21.15.47:0/4216439494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9e80c74e0 0x7fb9e80ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:41.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.894+0000 7fb9ef4c8700 1 -- 172.21.15.47:0/4216439494 >> 172.21.15.47:0/4216439494 conn(0x7fb9e80a9ea0 msgr2=0x7fb9e806eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:41.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.894+0000 7fb9ef4c8700 1 -- 172.21.15.47:0/4216439494 shutdown_connections 2024-05-08T19:48:41.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:41.894+0000 7fb9ef4c8700 1 -- 172.21.15.47:0/4216439494 wait complete. 2024-05-08T19:48:41.885 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 7 to deep-scrub 2024-05-08T19:48:41.896 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T19:48:42.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.034+0000 7fcea0950700 1 Processor -- start 2024-05-08T19:48:42.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.034+0000 7fcea0950700 1 -- start start 2024-05-08T19:48:42.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.035+0000 7fcea0950700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fce9c152150 0x7fce9c0a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:42.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.035+0000 7fcea0950700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce9c154930 0x7fce9c06a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:42.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.035+0000 7fcea0950700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9c0c2be0 con 0x7fce9c0a9bc0 2024-05-08T19:48:42.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.035+0000 7fcea0950700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9c158ed0 con 0x7fce9c152150 2024-05-08T19:48:42.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.035+0000 7fcea0950700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c158330 con 0x7fce9c154930 2024-05-08T19:48:42.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.035+0000 7fce9a59c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fce9c152150 0x7fce9c0a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:42.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.035+0000 7fce99d9b700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fce9c0a9bc0 0x7fce9c1587c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.47:50200/0 (socket says 172.21.15.47:50200) 2024-05-08T19:48:42.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.035+0000 7fce99d9b700 1 -- 172.21.15.47:0/3321290552 learned_addr learned my addr 172.21.15.47:0/3321290552 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:48:42.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.036+0000 7fce9ad9d700 1 --2- 172.21.15.47:0/3321290552 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce9c154930 0x7fce9c06a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:42.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.036+0000 7fce9a59c700 1 -- 172.21.15.47:0/3321290552 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce9c154930 msgr2=0x7fce9c06a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:48:42.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.036+0000 7fce9a59c700 1 --2- 172.21.15.47:0/3321290552 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce9c154930 0x7fce9c06a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:42.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.036+0000 7fce9a59c700 1 -- 172.21.15.47:0/3321290552 >> v1:172.21.15.177:6789/0 conn(0x7fce9c0a9bc0 legacy=0x7fce9c1587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:42.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.036+0000 7fce9a59c700 1 -- 172.21.15.47:0/3321290552 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c154de0 con 0x7fce9c152150 2024-05-08T19:48:42.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.036+0000 7fce9ad9d700 1 --2- 172.21.15.47:0/3321290552 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce9c154930 0x7fce9c06a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:48:42.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.036+0000 7fce9a59c700 1 --2- 172.21.15.47:0/3321290552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce9c152150 0x7fce9c0a84b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fce8c009840 tx=0x7fce8c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffef0c914e8bef38 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:42.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.037+0000 7fce9959a700 1 -- 172.21.15.47:0/3321290552 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c004230 con 0x7fce9c152150 2024-05-08T19:48:42.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.037+0000 7fce9959a700 1 -- 172.21.15.47:0/3321290552 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8c004390 con 0x7fce9c152150 2024-05-08T19:48:42.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.037+0000 7fce9959a700 1 -- 172.21.15.47:0/3321290552 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c0036a0 con 0x7fce9c152150 2024-05-08T19:48:42.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.038+0000 7fcea0950700 1 -- 172.21.15.47:0/3321290552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce9c152150 msgr2=0x7fce9c0a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:42.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.038+0000 7fcea0950700 1 --2- 172.21.15.47:0/3321290552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce9c152150 0x7fce9c0a84b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fce8c009840 tx=0x7fce8c009b50 comp rx=0 tx=0).stop 2024-05-08T19:48:42.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.038+0000 7fcea0950700 1 -- 172.21.15.47:0/3321290552 shutdown_connections 2024-05-08T19:48:42.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.038+0000 7fcea0950700 1 --2- 172.21.15.47:0/3321290552 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce9c154930 0x7fce9c06a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:42.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.038+0000 7fcea0950700 1 --2- 172.21.15.47:0/3321290552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce9c152150 0x7fce9c0a84b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:42.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.038+0000 7fcea0950700 1 -- 172.21.15.47:0/3321290552 >> 172.21.15.47:0/3321290552 conn(0x7fce9c0c3c20 msgr2=0x7fce9c0c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:42.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.038+0000 7fcea0950700 1 -- 172.21.15.47:0/3321290552 shutdown_connections 2024-05-08T19:48:42.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.038+0000 7fcea0950700 1 -- 172.21.15.47:0/3321290552 wait complete. 2024-05-08T19:48:42.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.040+0000 7fcea0950700 1 Processor -- start 2024-05-08T19:48:42.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.040+0000 7fcea0950700 1 -- start start 2024-05-08T19:48:42.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fcea0950700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce9c0a9bc0 0x7fce9c146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:42.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fcea0950700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce9c152150 0x7fce9c0c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:42.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fcea0950700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c154930 0x7fce9c0c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:42.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fcea0950700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c147610 con 0x7fce9c154930 2024-05-08T19:48:42.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fcea0950700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c0c54e0 con 0x7fce9c0a9bc0 2024-05-08T19:48:42.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fcea0950700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c0c6220 con 0x7fce9c152150 2024-05-08T19:48:42.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fce9a59c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce9c0a9bc0 0x7fce9c146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:42.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fce9a59c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce9c0a9bc0 0x7fce9c146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.47:35812/0 (socket says 172.21.15.47:35812) 2024-05-08T19:48:42.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fce9a59c700 1 -- 172.21.15.47:0/1653649746 learned_addr learned my addr 172.21.15.47:0/1653649746 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:48:42.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fce99d9b700 1 --2- 172.21.15.47:0/1653649746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce9c152150 0x7fce9c0c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:42.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fce9ad9d700 1 --2- 172.21.15.47:0/1653649746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c154930 0x7fce9c0c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:42.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fce9a59c700 1 -- 172.21.15.47:0/1653649746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce9c152150 msgr2=0x7fce9c0c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:42.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fce9a59c700 1 --2- 172.21.15.47:0/1653649746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce9c152150 0x7fce9c0c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:42.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fce9a59c700 1 -- 172.21.15.47:0/1653649746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c154930 msgr2=0x7fce9c0c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:42.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fce9a59c700 1 --2- 172.21.15.47:0/1653649746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c154930 0x7fce9c0c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:42.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fce9a59c700 1 -- 172.21.15.47:0/1653649746 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c0094a0 con 0x7fce9c0a9bc0 2024-05-08T19:48:42.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.041+0000 7fce9ad9d700 1 --2- 172.21.15.47:0/1653649746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c154930 0x7fce9c0c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:48:42.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.042+0000 7fce9a59c700 1 --2- 172.21.15.47:0/1653649746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce9c0a9bc0 0x7fce9c146500 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0090b0 tx=0x7fce8c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:42.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.042+0000 7fce8affd700 1 -- 172.21.15.47:0/1653649746 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c0045f0 con 0x7fce9c0a9bc0 2024-05-08T19:48:42.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.042+0000 7fce8affd700 1 -- 172.21.15.47:0/1653649746 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8c01f070 con 0x7fce9c0a9bc0 2024-05-08T19:48:42.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.042+0000 7fcea0950700 1 -- 172.21.15.47:0/1653649746 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9c1497a0 con 0x7fce9c0a9bc0 2024-05-08T19:48:42.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.042+0000 7fce8affd700 1 -- 172.21.15.47:0/1653649746 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c011870 con 0x7fce9c0a9bc0 2024-05-08T19:48:42.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.042+0000 7fcea0950700 1 -- 172.21.15.47:0/1653649746 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c146ea0 con 0x7fce9c0a9bc0 2024-05-08T19:48:42.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.043+0000 7fcea0950700 1 -- 172.21.15.47:0/1653649746 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce800052f0 con 0x7fce9c0a9bc0 2024-05-08T19:48:42.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.044+0000 7fce8affd700 1 -- 172.21.15.47:0/1653649746 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fce8c0119d0 con 0x7fce9c0a9bc0 2024-05-08T19:48:42.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.045+0000 7fce8affd700 1 --2- 172.21.15.47:0/1653649746 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fce7c06ac90 0x7fce7c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:48:42.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.045+0000 7fce8affd700 1 -- 172.21.15.47:0/1653649746 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fce8c021070 con 0x7fce9c0a9bc0 2024-05-08T19:48:42.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.045+0000 7fce99d9b700 1 --2- 172.21.15.47:0/1653649746 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fce7c06ac90 0x7fce7c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:48:42.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.045+0000 7fce99d9b700 1 --2- 172.21.15.47:0/1653649746 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fce7c06ac90 0x7fce7c06d150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fce90000f80 tx=0x7fce90000f10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:48:42.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.050+0000 7fce8affd700 1 -- 172.21.15.47:0/1653649746 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fce8c055dd0 con 0x7fce9c0a9bc0 2024-05-08T19:48:42.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.259+0000 7fcea0950700 1 -- 172.21.15.47:0/1653649746 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce80000bc0 con 0x7fce7c06ac90 2024-05-08T19:48:42.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.269+0000 7fce8affd700 1 -- 172.21.15.47:0/1653649746 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370026 (secure 0 0 0) 0x7fce80000bc0 con 0x7fce7c06ac90 2024-05-08T19:48:42.264 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:48:42.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.273+0000 7fcea0950700 1 -- 172.21.15.47:0/1653649746 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fce7c06ac90 msgr2=0x7fce7c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:42.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.273+0000 7fcea0950700 1 --2- 172.21.15.47:0/1653649746 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fce7c06ac90 0x7fce7c06d150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fce90000f80 tx=0x7fce90000f10 comp rx=0 tx=0).stop 2024-05-08T19:48:42.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.273+0000 7fcea0950700 1 -- 172.21.15.47:0/1653649746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce9c0a9bc0 msgr2=0x7fce9c146500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:48:42.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.273+0000 7fcea0950700 1 --2- 172.21.15.47:0/1653649746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce9c0a9bc0 0x7fce9c146500 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0090b0 tx=0x7fce8c004750 comp rx=0 tx=0).stop 2024-05-08T19:48:42.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.273+0000 7fcea0950700 1 -- 172.21.15.47:0/1653649746 shutdown_connections 2024-05-08T19:48:42.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.273+0000 7fcea0950700 1 --2- 172.21.15.47:0/1653649746 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fce7c06ac90 0x7fce7c06d150 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:42.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.273+0000 7fcea0950700 1 --2- 172.21.15.47:0/1653649746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c154930 0x7fce9c0c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:42.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.273+0000 7fcea0950700 1 --2- 172.21.15.47:0/1653649746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce9c0a9bc0 0x7fce9c146500 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:42.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.273+0000 7fcea0950700 1 --2- 172.21.15.47:0/1653649746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce9c152150 0x7fce9c0c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:48:42.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.273+0000 7fcea0950700 1 -- 172.21.15.47:0/1653649746 >> 172.21.15.47:0/1653649746 conn(0x7fce9c0c3c20 msgr2=0x7fce9c0a8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:48:42.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.273+0000 7fcea0950700 1 -- 172.21.15.47:0/1653649746 shutdown_connections 2024-05-08T19:48:42.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:48:42.273+0000 7fcea0950700 1 -- 172.21.15.47:0/1653649746 wait complete. 2024-05-08T19:48:42.268 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-08T19:48:42.276 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":812,"stamp":"2024-05-08T19:48:40.602323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":265236510,"num_objects":344,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":21643,"num_read_kb":1158813,"num_write":409175,"num_write_kb":31681876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575178,"ondisk_log_size":575178,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7794940,"kb_used_data":332964,"kb_used_omap":12,"kb_used_meta":7461875,"kb_avail":747179780,"statfs":{"total":773094113280,"available":765112094720,"internally_reserved":0,"allocated":340955136,"data_stored":529895592,"data_compressed":50690766,"data_compressed_allocated":75542528,"data_compressed_original":265871360,"omap_allocated":12741,"internal_metadata":7640960571},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,3,0,4,1,0,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":75,"apply_latency_ms":75,"commit_latency_ns":75000000,"apply_latency_ns":75000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-339675008,"num_objects":-3640,"num_object_clones":0,"num_object_copies":-12154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3640,"num_whiteouts":0,"num_read":11,"num_read_kb":239,"num_write":3816,"num_write_kb":4805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-112,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007706"},"pg_stats":[{"pgid":"3.3f","version":"26'2251","reported_seq":2279,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.025684+0000","last_change":"2024-05-08T19:22:20.461758+0000","last_active":"2024-05-08T19:48:36.025684+0000","last_peered":"2024-05-08T19:48:36.025684+0000","last_clean":"2024-05-08T19:48:36.025684+0000","last_became_active":"2024-05-08T19:22:20.461515+0000","last_became_peered":"2024-05-08T19:22:20.461515+0000","last_unstale":"2024-05-08T19:48:36.025684+0000","last_undegraded":"2024-05-08T19:48:36.025684+0000","last_fullsized":"2024-05-08T19:48:36.025684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2251,"log_dups_size":0,"ondisk_log_size":2251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'2273","reported_seq":2302,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.647941+0000","last_change":"2024-05-08T19:22:20.434929+0000","last_active":"2024-05-08T19:48:36.647941+0000","last_peered":"2024-05-08T19:48:36.647941+0000","last_clean":"2024-05-08T19:48:36.647941+0000","last_became_active":"2024-05-08T19:22:20.434629+0000","last_became_peered":"2024-05-08T19:22:20.434629+0000","last_unstale":"2024-05-08T19:48:36.647941+0000","last_undegraded":"2024-05-08T19:48:36.647941+0000","last_fullsized":"2024-05-08T19:48:36.647941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2273,"log_dups_size":0,"ondisk_log_size":2273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"26'2375","reported_seq":2404,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.531030+0000","last_change":"2024-05-08T19:22:20.449450+0000","last_active":"2024-05-08T19:48:36.531030+0000","last_peered":"2024-05-08T19:48:36.531030+0000","last_clean":"2024-05-08T19:48:36.531030+0000","last_became_active":"2024-05-08T19:22:20.449184+0000","last_became_peered":"2024-05-08T19:22:20.449184+0000","last_unstale":"2024-05-08T19:48:36.531030+0000","last_undegraded":"2024-05-08T19:48:36.531030+0000","last_fullsized":"2024-05-08T19:48:36.531030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2375,"log_dups_size":0,"ondisk_log_size":2375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"26'2352","reported_seq":2379,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.717963+0000","last_change":"2024-05-08T19:22:20.449919+0000","last_active":"2024-05-08T19:48:35.717963+0000","last_peered":"2024-05-08T19:48:35.717963+0000","last_clean":"2024-05-08T19:48:35.717963+0000","last_became_active":"2024-05-08T19:22:20.449637+0000","last_became_peered":"2024-05-08T19:22:20.449637+0000","last_unstale":"2024-05-08T19:48:35.717963+0000","last_undegraded":"2024-05-08T19:48:35.717963+0000","last_fullsized":"2024-05-08T19:48:35.717963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'2307","reported_seq":2333,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.480407+0000","last_change":"2024-05-08T19:22:20.449676+0000","last_active":"2024-05-08T19:48:36.480407+0000","last_peered":"2024-05-08T19:48:36.480407+0000","last_clean":"2024-05-08T19:48:36.480407+0000","last_became_active":"2024-05-08T19:22:20.449347+0000","last_became_peered":"2024-05-08T19:22:20.449347+0000","last_unstale":"2024-05-08T19:48:36.480407+0000","last_undegraded":"2024-05-08T19:48:36.480407+0000","last_fullsized":"2024-05-08T19:48:36.480407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2307,"log_dups_size":0,"ondisk_log_size":2307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:29.419061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'2223","reported_seq":2244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.662618+0000","last_change":"2024-05-08T19:23:11.053315+0000","last_active":"2024-05-08T19:48:36.662618+0000","last_peered":"2024-05-08T19:48:36.662618+0000","last_clean":"2024-05-08T19:48:36.662618+0000","last_became_active":"2024-05-08T19:23:11.052928+0000","last_became_peered":"2024-05-08T19:23:11.052928+0000","last_unstale":"2024-05-08T19:48:36.662618+0000","last_undegraded":"2024-05-08T19:48:36.662618+0000","last_fullsized":"2024-05-08T19:48:36.662618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2223,"log_dups_size":0,"ondisk_log_size":2223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"26'2288","reported_seq":2314,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.316490+0000","last_change":"2024-05-08T19:22:20.446830+0000","last_active":"2024-05-08T19:48:36.316490+0000","last_peered":"2024-05-08T19:48:36.316490+0000","last_clean":"2024-05-08T19:48:36.316490+0000","last_became_active":"2024-05-08T19:22:20.446520+0000","last_became_peered":"2024-05-08T19:22:20.446520+0000","last_unstale":"2024-05-08T19:48:36.316490+0000","last_undegraded":"2024-05-08T19:48:36.316490+0000","last_fullsized":"2024-05-08T19:48:36.316490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2288,"log_dups_size":0,"ondisk_log_size":2288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:25.101779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'2286","reported_seq":2312,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.815307+0000","last_change":"2024-05-08T19:22:20.447313+0000","last_active":"2024-05-08T19:48:35.815307+0000","last_peered":"2024-05-08T19:48:35.815307+0000","last_clean":"2024-05-08T19:48:35.815307+0000","last_became_active":"2024-05-08T19:22:20.447031+0000","last_became_peered":"2024-05-08T19:22:20.447031+0000","last_unstale":"2024-05-08T19:48:35.815307+0000","last_undegraded":"2024-05-08T19:48:35.815307+0000","last_fullsized":"2024-05-08T19:48:35.815307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2286,"log_dups_size":0,"ondisk_log_size":2286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"26'2353","reported_seq":2379,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.540783+0000","last_change":"2024-05-08T19:22:20.447186+0000","last_active":"2024-05-08T19:48:36.540783+0000","last_peered":"2024-05-08T19:48:36.540783+0000","last_clean":"2024-05-08T19:48:36.540783+0000","last_became_active":"2024-05-08T19:22:20.446803+0000","last_became_peered":"2024-05-08T19:22:20.446803+0000","last_unstale":"2024-05-08T19:48:36.540783+0000","last_undegraded":"2024-05-08T19:48:36.540783+0000","last_fullsized":"2024-05-08T19:48:36.540783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2353,"log_dups_size":0,"ondisk_log_size":2353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'2368","reported_seq":2394,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.708468+0000","last_change":"2024-05-08T19:22:20.462899+0000","last_active":"2024-05-08T19:48:35.708468+0000","last_peered":"2024-05-08T19:48:35.708468+0000","last_clean":"2024-05-08T19:48:35.708468+0000","last_became_active":"2024-05-08T19:22:20.461395+0000","last_became_peered":"2024-05-08T19:22:20.461395+0000","last_unstale":"2024-05-08T19:48:35.708468+0000","last_undegraded":"2024-05-08T19:48:35.708468+0000","last_fullsized":"2024-05-08T19:48:35.708468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2368,"log_dups_size":0,"ondisk_log_size":2368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:30.398533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"26'2233","reported_seq":2259,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.936067+0000","last_change":"2024-05-08T19:22:20.459545+0000","last_active":"2024-05-08T19:48:35.936067+0000","last_peered":"2024-05-08T19:48:35.936067+0000","last_clean":"2024-05-08T19:48:35.936067+0000","last_became_active":"2024-05-08T19:22:20.459253+0000","last_became_peered":"2024-05-08T19:22:20.459253+0000","last_unstale":"2024-05-08T19:48:35.936067+0000","last_undegraded":"2024-05-08T19:48:35.936067+0000","last_fullsized":"2024-05-08T19:48:35.936067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2233,"log_dups_size":0,"ondisk_log_size":2233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"26'2222","reported_seq":2248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.929449+0000","last_change":"2024-05-08T19:22:20.462193+0000","last_active":"2024-05-08T19:48:35.929449+0000","last_peered":"2024-05-08T19:48:35.929449+0000","last_clean":"2024-05-08T19:48:35.929449+0000","last_became_active":"2024-05-08T19:22:20.461852+0000","last_became_peered":"2024-05-08T19:22:20.461852+0000","last_unstale":"2024-05-08T19:48:35.929449+0000","last_undegraded":"2024-05-08T19:48:35.929449+0000","last_fullsized":"2024-05-08T19:48:35.929449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2222,"log_dups_size":0,"ondisk_log_size":2222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:51.431376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"26'2270","reported_seq":2296,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.583688+0000","last_change":"2024-05-08T19:22:20.453169+0000","last_active":"2024-05-08T19:48:35.583688+0000","last_peered":"2024-05-08T19:48:35.583688+0000","last_clean":"2024-05-08T19:48:35.583688+0000","last_became_active":"2024-05-08T19:22:20.452884+0000","last_became_peered":"2024-05-08T19:22:20.452884+0000","last_unstale":"2024-05-08T19:48:35.583688+0000","last_undegraded":"2024-05-08T19:48:35.583688+0000","last_fullsized":"2024-05-08T19:48:35.583688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2270,"log_dups_size":0,"ondisk_log_size":2270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"26'2298","reported_seq":2326,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.515762+0000","last_change":"2024-05-08T19:22:20.435745+0000","last_active":"2024-05-08T19:48:36.515762+0000","last_peered":"2024-05-08T19:48:36.515762+0000","last_clean":"2024-05-08T19:48:36.515762+0000","last_became_active":"2024-05-08T19:22:20.435456+0000","last_became_peered":"2024-05-08T19:22:20.435456+0000","last_unstale":"2024-05-08T19:48:36.515762+0000","last_undegraded":"2024-05-08T19:48:36.515762+0000","last_fullsized":"2024-05-08T19:48:36.515762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"26'2373","reported_seq":2401,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.607506+0000","last_change":"2024-05-08T19:22:20.444615+0000","last_active":"2024-05-08T19:48:36.607506+0000","last_peered":"2024-05-08T19:48:36.607506+0000","last_clean":"2024-05-08T19:48:36.607506+0000","last_became_active":"2024-05-08T19:22:20.444369+0000","last_became_peered":"2024-05-08T19:22:20.444369+0000","last_unstale":"2024-05-08T19:48:36.607506+0000","last_undegraded":"2024-05-08T19:48:36.607506+0000","last_fullsized":"2024-05-08T19:48:36.607506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2373,"log_dups_size":0,"ondisk_log_size":2373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'2272","reported_seq":2299,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.131043+0000","last_change":"2024-05-08T19:22:20.445391+0000","last_active":"2024-05-08T19:48:35.131043+0000","last_peered":"2024-05-08T19:48:35.131043+0000","last_clean":"2024-05-08T19:48:35.131043+0000","last_became_active":"2024-05-08T19:22:20.444996+0000","last_became_peered":"2024-05-08T19:22:20.444996+0000","last_unstale":"2024-05-08T19:48:35.131043+0000","last_undegraded":"2024-05-08T19:48:35.131043+0000","last_fullsized":"2024-05-08T19:48:35.131043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2272,"log_dups_size":0,"ondisk_log_size":2272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:29.480194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"26'2333","reported_seq":2360,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.399935+0000","last_change":"2024-05-08T19:22:20.451170+0000","last_active":"2024-05-08T19:48:35.399935+0000","last_peered":"2024-05-08T19:48:35.399935+0000","last_clean":"2024-05-08T19:48:35.399935+0000","last_became_active":"2024-05-08T19:22:20.450843+0000","last_became_peered":"2024-05-08T19:22:20.450843+0000","last_unstale":"2024-05-08T19:48:35.399935+0000","last_undegraded":"2024-05-08T19:48:35.399935+0000","last_fullsized":"2024-05-08T19:48:35.399935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2333,"log_dups_size":0,"ondisk_log_size":2333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'2298","reported_seq":2326,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.615125+0000","last_change":"2024-05-08T19:22:20.462503+0000","last_active":"2024-05-08T19:48:36.615125+0000","last_peered":"2024-05-08T19:48:36.615125+0000","last_clean":"2024-05-08T19:48:36.615125+0000","last_became_active":"2024-05-08T19:22:20.462266+0000","last_became_peered":"2024-05-08T19:22:20.462266+0000","last_unstale":"2024-05-08T19:48:36.615125+0000","last_undegraded":"2024-05-08T19:48:36.615125+0000","last_fullsized":"2024-05-08T19:48:36.615125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"26'2369","reported_seq":2396,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.444936+0000","last_change":"2024-05-08T19:22:20.454128+0000","last_active":"2024-05-08T19:48:36.444936+0000","last_peered":"2024-05-08T19:48:36.444936+0000","last_clean":"2024-05-08T19:48:36.444936+0000","last_became_active":"2024-05-08T19:22:20.453834+0000","last_became_peered":"2024-05-08T19:22:20.453834+0000","last_unstale":"2024-05-08T19:48:36.444936+0000","last_undegraded":"2024-05-08T19:48:36.444936+0000","last_fullsized":"2024-05-08T19:48:36.444936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:23.193366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"26'8912","reported_seq":8987,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.818918+0000","last_change":"2024-05-08T19:22:24.616532+0000","last_active":"2024-05-08T19:48:35.818918+0000","last_peered":"2024-05-08T19:48:35.818918+0000","last_clean":"2024-05-08T19:48:35.818918+0000","last_became_active":"2024-05-08T19:22:24.616128+0000","last_became_peered":"2024-05-08T19:22:24.616128+0000","last_unstale":"2024-05-08T19:48:35.818918+0000","last_undegraded":"2024-05-08T19:48:35.818918+0000","last_fullsized":"2024-05-08T19:48:35.818918+0000","mapping_epoch":22,"log_start":"26'2512","ondisk_log_start":"26'2512","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6400,"log_dups_size":0,"ondisk_log_size":6400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:44.356550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":794610,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":3400,"num_write":6568,"num_write_kb":966197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"26'2349","reported_seq":2379,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.020621+0000","last_change":"2024-05-08T19:22:20.012743+0000","last_active":"2024-05-08T19:48:30.020621+0000","last_peered":"2024-05-08T19:48:30.020621+0000","last_clean":"2024-05-08T19:48:30.020621+0000","last_became_active":"2024-05-08T19:22:20.012453+0000","last_became_peered":"2024-05-08T19:22:20.012453+0000","last_unstale":"2024-05-08T19:48:30.020621+0000","last_undegraded":"2024-05-08T19:48:30.020621+0000","last_fullsized":"2024-05-08T19:48:30.020621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2351,"num_write_kb":17974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'2317","reported_seq":2345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.447545+0000","last_change":"2024-05-08T19:22:20.464578+0000","last_active":"2024-05-08T19:48:35.447545+0000","last_peered":"2024-05-08T19:48:35.447545+0000","last_clean":"2024-05-08T19:48:35.447545+0000","last_became_active":"2024-05-08T19:22:20.464396+0000","last_became_peered":"2024-05-08T19:22:20.464396+0000","last_unstale":"2024-05-08T19:48:35.447545+0000","last_undegraded":"2024-05-08T19:48:35.447545+0000","last_fullsized":"2024-05-08T19:48:35.447545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2317,"log_dups_size":0,"ondisk_log_size":2317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"26'8793","reported_seq":9459,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.016612+0000","last_change":"2024-05-08T19:22:24.469561+0000","last_active":"2024-05-08T19:48:36.016612+0000","last_peered":"2024-05-08T19:48:36.016612+0000","last_clean":"2024-05-08T19:48:36.016612+0000","last_became_active":"2024-05-08T19:22:24.469161+0000","last_became_peered":"2024-05-08T19:22:24.469161+0000","last_unstale":"2024-05-08T19:48:36.016612+0000","last_undegraded":"2024-05-08T19:48:36.016612+0000","last_fullsized":"2024-05-08T19:48:36.016612+0000","mapping_epoch":22,"log_start":"26'1644","ondisk_log_start":"26'1644","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7149,"log_dups_size":0,"ondisk_log_size":7149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:50.011809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401280,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":642,"num_read_kb":43100,"num_write":6349,"num_write_kb":920646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"26'8076","reported_seq":8106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.089123+0000","last_change":"2024-05-08T19:22:20.006198+0000","last_active":"2024-05-08T19:48:30.089123+0000","last_peered":"2024-05-08T19:48:30.089123+0000","last_clean":"2024-05-08T19:48:30.089123+0000","last_became_active":"2024-05-08T19:22:20.005723+0000","last_became_peered":"2024-05-08T19:22:20.005723+0000","last_unstale":"2024-05-08T19:48:30.089123+0000","last_undegraded":"2024-05-08T19:48:30.089123+0000","last_fullsized":"2024-05-08T19:48:30.089123+0000","mapping_epoch":17,"log_start":"26'1600","ondisk_log_start":"26'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6476,"log_dups_size":0,"ondisk_log_size":6476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:18.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8075,"num_write_kb":50504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'2316","reported_seq":2345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.654692+0000","last_change":"2024-05-08T19:22:20.451485+0000","last_active":"2024-05-08T19:48:36.654692+0000","last_peered":"2024-05-08T19:48:36.654692+0000","last_clean":"2024-05-08T19:48:36.654692+0000","last_became_active":"2024-05-08T19:22:20.446380+0000","last_became_peered":"2024-05-08T19:22:20.446380+0000","last_unstale":"2024-05-08T19:48:36.654692+0000","last_undegraded":"2024-05-08T19:48:36.654692+0000","last_fullsized":"2024-05-08T19:48:36.654692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2316,"log_dups_size":0,"ondisk_log_size":2316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"26'8182","reported_seq":8810,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.006213+0000","last_change":"2024-05-08T19:22:24.465354+0000","last_active":"2024-05-08T19:48:36.006213+0000","last_peered":"2024-05-08T19:48:36.006213+0000","last_clean":"2024-05-08T19:48:36.006213+0000","last_became_active":"2024-05-08T19:22:24.464669+0000","last_became_peered":"2024-05-08T19:22:24.464669+0000","last_unstale":"2024-05-08T19:48:36.006213+0000","last_undegraded":"2024-05-08T19:48:36.006213+0000","last_fullsized":"2024-05-08T19:48:36.006213+0000","mapping_epoch":22,"log_start":"26'1003","ondisk_log_start":"26'1003","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7179,"log_dups_size":0,"ondisk_log_size":7179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:29.398413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344689,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":604,"num_read_kb":22018,"num_write":5716,"num_write_kb":861918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'9226","reported_seq":9253,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.136315+0000","last_change":"2024-05-08T19:22:20.014506+0000","last_active":"2024-05-08T19:48:33.136315+0000","last_peered":"2024-05-08T19:48:33.136315+0000","last_clean":"2024-05-08T19:48:33.136315+0000","last_became_active":"2024-05-08T19:22:20.014239+0000","last_became_peered":"2024-05-08T19:22:20.014239+0000","last_unstale":"2024-05-08T19:48:33.136315+0000","last_undegraded":"2024-05-08T19:48:33.136315+0000","last_fullsized":"2024-05-08T19:48:33.136315+0000","mapping_epoch":17,"log_start":"26'2400","ondisk_log_start":"26'2400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6826,"log_dups_size":0,"ondisk_log_size":6826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:23.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":9240,"num_write_kb":71812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'2400","reported_seq":2421,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.243732+0000","last_change":"2024-05-08T19:23:11.054407+0000","last_active":"2024-05-08T19:48:36.243732+0000","last_peered":"2024-05-08T19:48:36.243732+0000","last_clean":"2024-05-08T19:48:36.243732+0000","last_became_active":"2024-05-08T19:23:11.054036+0000","last_became_peered":"2024-05-08T19:23:11.054036+0000","last_unstale":"2024-05-08T19:48:36.243732+0000","last_undegraded":"2024-05-08T19:48:36.243732+0000","last_fullsized":"2024-05-08T19:48:36.243732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2400,"log_dups_size":0,"ondisk_log_size":2400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"26'8208","reported_seq":8474,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.255435+0000","last_change":"2024-05-08T19:22:24.479649+0000","last_active":"2024-05-08T19:48:36.255435+0000","last_peered":"2024-05-08T19:48:36.255435+0000","last_clean":"2024-05-08T19:48:36.255435+0000","last_became_active":"2024-05-08T19:22:24.479255+0000","last_became_peered":"2024-05-08T19:22:24.479255+0000","last_unstale":"2024-05-08T19:48:36.255435+0000","last_undegraded":"2024-05-08T19:48:36.255435+0000","last_fullsized":"2024-05-08T19:48:36.255435+0000","mapping_epoch":22,"log_start":"26'1000","ondisk_log_start":"26'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7208,"log_dups_size":0,"ondisk_log_size":7208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:07.621948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576350,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":242,"num_read_kb":15390,"num_write":5830,"num_write_kb":1051850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6114","reported_seq":6141,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.126207+0000","last_change":"2024-05-08T19:22:20.014093+0000","last_active":"2024-05-08T19:48:33.126207+0000","last_peered":"2024-05-08T19:48:33.126207+0000","last_clean":"2024-05-08T19:48:33.126207+0000","last_became_active":"2024-05-08T19:22:20.013793+0000","last_became_peered":"2024-05-08T19:22:20.013793+0000","last_unstale":"2024-05-08T19:48:33.126207+0000","last_undegraded":"2024-05-08T19:48:33.126207+0000","last_fullsized":"2024-05-08T19:48:33.126207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6114,"log_dups_size":0,"ondisk_log_size":6114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6127,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'2302","reported_seq":2328,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.499805+0000","last_change":"2024-05-08T19:22:20.455505+0000","last_active":"2024-05-08T19:48:35.499805+0000","last_peered":"2024-05-08T19:48:35.499805+0000","last_clean":"2024-05-08T19:48:35.499805+0000","last_became_active":"2024-05-08T19:22:20.455148+0000","last_became_peered":"2024-05-08T19:22:20.455148+0000","last_unstale":"2024-05-08T19:48:35.499805+0000","last_undegraded":"2024-05-08T19:48:35.499805+0000","last_fullsized":"2024-05-08T19:48:35.499805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2302,"log_dups_size":0,"ondisk_log_size":2302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"26'8418","reported_seq":9278,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.615344+0000","last_change":"2024-05-08T19:22:24.465009+0000","last_active":"2024-05-08T19:48:35.615344+0000","last_peered":"2024-05-08T19:48:35.615344+0000","last_clean":"2024-05-08T19:48:35.615344+0000","last_became_active":"2024-05-08T19:22:24.464422+0000","last_became_peered":"2024-05-08T19:22:24.464422+0000","last_unstale":"2024-05-08T19:48:35.615344+0000","last_undegraded":"2024-05-08T19:48:35.615344+0000","last_fullsized":"2024-05-08T19:48:35.615344+0000","mapping_epoch":22,"log_start":"26'2000","ondisk_log_start":"26'2000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6418,"log_dups_size":0,"ondisk_log_size":6418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:12.830755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847328,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":836,"num_read_kb":58598,"num_write":5976,"num_write_kb":988108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"26'8500","reported_seq":8527,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.071356+0000","last_change":"2024-05-08T19:22:20.011515+0000","last_active":"2024-05-08T19:48:30.071356+0000","last_peered":"2024-05-08T19:48:30.071356+0000","last_clean":"2024-05-08T19:48:30.071356+0000","last_became_active":"2024-05-08T19:22:20.011183+0000","last_became_peered":"2024-05-08T19:22:20.011183+0000","last_unstale":"2024-05-08T19:48:30.071356+0000","last_undegraded":"2024-05-08T19:48:30.071356+0000","last_fullsized":"2024-05-08T19:48:30.071356+0000","mapping_epoch":17,"log_start":"26'2100","ondisk_log_start":"26'2100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6400,"log_dups_size":0,"ondisk_log_size":6400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8494,"num_write_kb":66920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'2341","reported_seq":2367,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.881880+0000","last_change":"2024-05-08T19:22:20.439371+0000","last_active":"2024-05-08T19:48:35.881880+0000","last_peered":"2024-05-08T19:48:35.881880+0000","last_clean":"2024-05-08T19:48:35.881880+0000","last_became_active":"2024-05-08T19:22:20.439096+0000","last_became_peered":"2024-05-08T19:22:20.439096+0000","last_unstale":"2024-05-08T19:48:35.881880+0000","last_undegraded":"2024-05-08T19:48:35.881880+0000","last_fullsized":"2024-05-08T19:48:35.881880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2341,"log_dups_size":0,"ondisk_log_size":2341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:56.795619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'8654","reported_seq":9385,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.649187+0000","last_change":"2024-05-08T19:23:11.529967+0000","last_active":"2024-05-08T19:48:36.649187+0000","last_peered":"2024-05-08T19:48:36.649187+0000","last_clean":"2024-05-08T19:48:36.649187+0000","last_became_active":"2024-05-08T19:23:11.529451+0000","last_became_peered":"2024-05-08T19:23:11.529451+0000","last_unstale":"2024-05-08T19:48:36.649187+0000","last_undegraded":"2024-05-08T19:48:36.649187+0000","last_fullsized":"2024-05-08T19:48:36.649187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":8654,"log_dups_size":0,"ondisk_log_size":8654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":696,"num_read_kb":42234,"num_write":6185,"num_write_kb":1013081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"26'10409","reported_seq":10436,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.113974+0000","last_change":"2024-05-08T19:22:20.004185+0000","last_active":"2024-05-08T19:48:33.113974+0000","last_peered":"2024-05-08T19:48:33.113974+0000","last_clean":"2024-05-08T19:48:33.113974+0000","last_became_active":"2024-05-08T19:22:20.003513+0000","last_became_peered":"2024-05-08T19:22:20.003513+0000","last_unstale":"2024-05-08T19:48:33.113974+0000","last_undegraded":"2024-05-08T19:48:33.113974+0000","last_fullsized":"2024-05-08T19:48:33.113974+0000","mapping_epoch":17,"log_start":"26'2500","ondisk_log_start":"26'2500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7909,"log_dups_size":0,"ondisk_log_size":7909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10404,"num_write_kb":72564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'2281","reported_seq":2308,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.653811+0000","last_change":"2024-05-08T19:22:20.446538+0000","last_active":"2024-05-08T19:48:36.653811+0000","last_peered":"2024-05-08T19:48:36.653811+0000","last_clean":"2024-05-08T19:48:36.653811+0000","last_became_active":"2024-05-08T19:22:20.445238+0000","last_became_peered":"2024-05-08T19:22:20.445238+0000","last_unstale":"2024-05-08T19:48:36.653811+0000","last_undegraded":"2024-05-08T19:48:36.653811+0000","last_fullsized":"2024-05-08T19:48:36.653811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2281,"log_dups_size":0,"ondisk_log_size":2281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'8265","reported_seq":10732,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.117872+0000","last_change":"2024-05-08T19:22:24.479665+0000","last_active":"2024-05-08T19:48:36.117872+0000","last_peered":"2024-05-08T19:48:36.117872+0000","last_clean":"2024-05-08T19:48:36.117872+0000","last_became_active":"2024-05-08T19:22:24.478998+0000","last_became_peered":"2024-05-08T19:22:24.478998+0000","last_unstale":"2024-05-08T19:48:36.117872+0000","last_undegraded":"2024-05-08T19:48:36.117872+0000","last_fullsized":"2024-05-08T19:48:36.117872+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7965,"log_dups_size":0,"ondisk_log_size":7965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:55.287155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85059,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2441,"num_read_kb":165440,"num_write":5906,"num_write_kb":873319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"26'5851","reported_seq":5878,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.065548+0000","last_change":"2024-05-08T19:22:20.002850+0000","last_active":"2024-05-08T19:48:30.065548+0000","last_peered":"2024-05-08T19:48:30.065548+0000","last_clean":"2024-05-08T19:48:30.065548+0000","last_became_active":"2024-05-08T19:22:20.002534+0000","last_became_peered":"2024-05-08T19:22:20.002534+0000","last_unstale":"2024-05-08T19:48:30.065548+0000","last_undegraded":"2024-05-08T19:48:30.065548+0000","last_fullsized":"2024-05-08T19:48:30.065548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5851,"log_dups_size":0,"ondisk_log_size":5851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5849,"num_write_kb":40670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"26'2368","reported_seq":2394,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.808507+0000","last_change":"2024-05-08T19:22:20.436698+0000","last_active":"2024-05-08T19:48:35.808507+0000","last_peered":"2024-05-08T19:48:35.808507+0000","last_clean":"2024-05-08T19:48:35.808507+0000","last_became_active":"2024-05-08T19:22:20.436431+0000","last_became_peered":"2024-05-08T19:22:20.436431+0000","last_unstale":"2024-05-08T19:48:35.808507+0000","last_undegraded":"2024-05-08T19:48:35.808507+0000","last_fullsized":"2024-05-08T19:48:35.808507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2368,"log_dups_size":0,"ondisk_log_size":2368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'8472","reported_seq":9203,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.663642+0000","last_change":"2024-05-08T19:22:24.617420+0000","last_active":"2024-05-08T19:48:36.663642+0000","last_peered":"2024-05-08T19:48:36.663642+0000","last_clean":"2024-05-08T19:48:36.663642+0000","last_became_active":"2024-05-08T19:22:24.617030+0000","last_became_peered":"2024-05-08T19:22:24.617030+0000","last_unstale":"2024-05-08T19:48:36.663642+0000","last_undegraded":"2024-05-08T19:48:36.663642+0000","last_fullsized":"2024-05-08T19:48:36.663642+0000","mapping_epoch":22,"log_start":"26'1302","ondisk_log_start":"26'1302","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7170,"log_dups_size":0,"ondisk_log_size":7170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":49016,"num_write":6130,"num_write_kb":1037918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"26'9202","reported_seq":9229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:06.453681+0000","last_change":"2024-05-08T19:22:20.003949+0000","last_active":"2024-05-08T19:48:06.453681+0000","last_peered":"2024-05-08T19:48:06.453681+0000","last_clean":"2024-05-08T19:48:06.453681+0000","last_became_active":"2024-05-08T19:22:20.003365+0000","last_became_peered":"2024-05-08T19:22:20.003365+0000","last_unstale":"2024-05-08T19:48:06.453681+0000","last_undegraded":"2024-05-08T19:48:06.453681+0000","last_fullsized":"2024-05-08T19:48:06.453681+0000","mapping_epoch":17,"log_start":"26'1700","ondisk_log_start":"26'1700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7502,"log_dups_size":0,"ondisk_log_size":7502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9189,"num_write_kb":63509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"26'2305","reported_seq":2332,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.590924+0000","last_change":"2024-05-08T19:22:20.437480+0000","last_active":"2024-05-08T19:48:36.590924+0000","last_peered":"2024-05-08T19:48:36.590924+0000","last_clean":"2024-05-08T19:48:36.590924+0000","last_became_active":"2024-05-08T19:22:20.437214+0000","last_became_peered":"2024-05-08T19:22:20.437214+0000","last_unstale":"2024-05-08T19:48:36.590924+0000","last_undegraded":"2024-05-08T19:48:36.590924+0000","last_fullsized":"2024-05-08T19:48:36.590924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2305,"log_dups_size":0,"ondisk_log_size":2305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"26'8417","reported_seq":8885,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.733608+0000","last_change":"2024-05-08T19:22:24.615730+0000","last_active":"2024-05-08T19:48:35.733608+0000","last_peered":"2024-05-08T19:48:35.733608+0000","last_clean":"2024-05-08T19:48:35.733608+0000","last_became_active":"2024-05-08T19:22:24.615351+0000","last_became_peered":"2024-05-08T19:22:24.615351+0000","last_unstale":"2024-05-08T19:48:35.733608+0000","last_undegraded":"2024-05-08T19:48:35.733608+0000","last_fullsized":"2024-05-08T19:48:35.733608+0000","mapping_epoch":22,"log_start":"26'2014","ondisk_log_start":"26'2014","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6403,"log_dups_size":0,"ondisk_log_size":6403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1308043,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":443,"num_read_kb":19968,"num_write":5944,"num_write_kb":994501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"26'7041","reported_seq":7906,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.087066+0000","last_change":"2024-05-08T19:22:20.002400+0000","last_active":"2024-05-08T19:48:30.087066+0000","last_peered":"2024-05-08T19:48:30.087066+0000","last_clean":"2024-05-08T19:48:30.087066+0000","last_became_active":"2024-05-08T19:22:20.001990+0000","last_became_peered":"2024-05-08T19:22:20.001990+0000","last_unstale":"2024-05-08T19:48:30.087066+0000","last_undegraded":"2024-05-08T19:48:30.087066+0000","last_fullsized":"2024-05-08T19:48:30.087066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7041,"log_dups_size":0,"ondisk_log_size":7041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":838,"num_read_kb":4635,"num_write":7034,"num_write_kb":49678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"26'2314","reported_seq":2340,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.288042+0000","last_change":"2024-05-08T19:22:20.447742+0000","last_active":"2024-05-08T19:48:35.288042+0000","last_peered":"2024-05-08T19:48:35.288042+0000","last_clean":"2024-05-08T19:48:35.288042+0000","last_became_active":"2024-05-08T19:22:20.447475+0000","last_became_peered":"2024-05-08T19:22:20.447475+0000","last_unstale":"2024-05-08T19:48:35.288042+0000","last_undegraded":"2024-05-08T19:48:35.288042+0000","last_fullsized":"2024-05-08T19:48:35.288042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2314,"log_dups_size":0,"ondisk_log_size":2314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'7955","reported_seq":8443,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.596515+0000","last_change":"2024-05-08T19:23:11.054182+0000","last_active":"2024-05-08T19:48:35.596515+0000","last_peered":"2024-05-08T19:48:35.596515+0000","last_clean":"2024-05-08T19:48:35.596515+0000","last_became_active":"2024-05-08T19:23:11.053733+0000","last_became_peered":"2024-05-08T19:23:11.053733+0000","last_unstale":"2024-05-08T19:48:35.596515+0000","last_undegraded":"2024-05-08T19:48:35.596515+0000","last_fullsized":"2024-05-08T19:48:35.596515+0000","mapping_epoch":25,"log_start":"26'1500","ondisk_log_start":"26'1500","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6455,"log_dups_size":0,"ondisk_log_size":6455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:25.669682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486306,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":17282,"num_write":5563,"num_write_kb":1020101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"26'6224","reported_seq":6251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.124951+0000","last_change":"2024-05-08T19:22:20.001272+0000","last_active":"2024-05-08T19:48:33.124951+0000","last_peered":"2024-05-08T19:48:33.124951+0000","last_clean":"2024-05-08T19:48:33.124951+0000","last_became_active":"2024-05-08T19:22:20.000981+0000","last_became_peered":"2024-05-08T19:22:20.000981+0000","last_unstale":"2024-05-08T19:48:33.124951+0000","last_undegraded":"2024-05-08T19:48:33.124951+0000","last_fullsized":"2024-05-08T19:48:33.124951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6224,"log_dups_size":0,"ondisk_log_size":6224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:57.476972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6227,"num_write_kb":45123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"26'2337","reported_seq":2364,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.606120+0000","last_change":"2024-05-08T19:22:20.446938+0000","last_active":"2024-05-08T19:48:36.606120+0000","last_peered":"2024-05-08T19:48:36.606120+0000","last_clean":"2024-05-08T19:48:36.606120+0000","last_became_active":"2024-05-08T19:22:20.446644+0000","last_became_peered":"2024-05-08T19:22:20.446644+0000","last_unstale":"2024-05-08T19:48:36.606120+0000","last_undegraded":"2024-05-08T19:48:36.606120+0000","last_fullsized":"2024-05-08T19:48:36.606120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"26'8305","reported_seq":8825,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.327473+0000","last_change":"2024-05-08T19:22:24.465089+0000","last_active":"2024-05-08T19:48:36.327473+0000","last_peered":"2024-05-08T19:48:36.327473+0000","last_clean":"2024-05-08T19:48:36.327473+0000","last_became_active":"2024-05-08T19:22:24.464178+0000","last_became_peered":"2024-05-08T19:22:24.464178+0000","last_unstale":"2024-05-08T19:48:36.327473+0000","last_undegraded":"2024-05-08T19:48:36.327473+0000","last_fullsized":"2024-05-08T19:48:36.327473+0000","mapping_epoch":22,"log_start":"26'1100","ondisk_log_start":"26'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7205,"log_dups_size":0,"ondisk_log_size":7205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:24.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247128,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":495,"num_read_kb":27360,"num_write":5872,"num_write_kb":879779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'6727","reported_seq":6755,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.690678+0000","last_change":"2024-05-08T19:22:20.001300+0000","last_active":"2024-05-08T19:48:36.690678+0000","last_peered":"2024-05-08T19:48:36.690678+0000","last_clean":"2024-05-08T19:48:36.690678+0000","last_became_active":"2024-05-08T19:22:20.000985+0000","last_became_peered":"2024-05-08T19:22:20.000985+0000","last_unstale":"2024-05-08T19:48:36.690678+0000","last_undegraded":"2024-05-08T19:48:36.690678+0000","last_fullsized":"2024-05-08T19:48:36.690678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6727,"log_dups_size":0,"ondisk_log_size":6727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":6744,"num_write_kb":41825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'2332","reported_seq":2359,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.329658+0000","last_change":"2024-05-08T19:22:20.447801+0000","last_active":"2024-05-08T19:48:36.329658+0000","last_peered":"2024-05-08T19:48:36.329658+0000","last_clean":"2024-05-08T19:48:36.329658+0000","last_became_active":"2024-05-08T19:22:20.447538+0000","last_became_peered":"2024-05-08T19:22:20.447538+0000","last_unstale":"2024-05-08T19:48:36.329658+0000","last_undegraded":"2024-05-08T19:48:36.329658+0000","last_fullsized":"2024-05-08T19:48:36.329658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2332,"log_dups_size":0,"ondisk_log_size":2332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:14.706653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"26'8591","reported_seq":9134,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.639212+0000","last_change":"2024-05-08T19:22:24.479544+0000","last_active":"2024-05-08T19:48:36.639212+0000","last_peered":"2024-05-08T19:48:36.639212+0000","last_clean":"2024-05-08T19:48:36.639212+0000","last_became_active":"2024-05-08T19:22:24.479071+0000","last_became_peered":"2024-05-08T19:22:24.479071+0000","last_unstale":"2024-05-08T19:48:36.639212+0000","last_undegraded":"2024-05-08T19:48:36.639212+0000","last_fullsized":"2024-05-08T19:48:36.639212+0000","mapping_epoch":22,"log_start":"26'1203","ondisk_log_start":"26'1203","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7388,"log_dups_size":0,"ondisk_log_size":7388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":517,"num_read_kb":30942,"num_write":6185,"num_write_kb":930944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'10873","reported_seq":11529,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:31.427563+0000","last_change":"2024-05-08T19:22:20.011799+0000","last_active":"2024-05-08T19:48:31.427563+0000","last_peered":"2024-05-08T19:48:31.427563+0000","last_clean":"2024-05-08T19:48:31.427563+0000","last_became_active":"2024-05-08T19:22:20.011331+0000","last_became_peered":"2024-05-08T19:22:20.011331+0000","last_unstale":"2024-05-08T19:48:31.427563+0000","last_undegraded":"2024-05-08T19:48:31.427563+0000","last_fullsized":"2024-05-08T19:48:31.427563+0000","mapping_epoch":17,"log_start":"26'2900","ondisk_log_start":"26'2900","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7973,"log_dups_size":0,"ondisk_log_size":7973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":630,"num_read_kb":4505,"num_write":10868,"num_write_kb":72956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"26'2256","reported_seq":2282,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.448972+0000","last_change":"2024-05-08T19:22:20.447583+0000","last_active":"2024-05-08T19:48:36.448972+0000","last_peered":"2024-05-08T19:48:36.448972+0000","last_clean":"2024-05-08T19:48:36.448972+0000","last_became_active":"2024-05-08T19:22:20.447243+0000","last_became_peered":"2024-05-08T19:22:20.447243+0000","last_unstale":"2024-05-08T19:48:36.448972+0000","last_undegraded":"2024-05-08T19:48:36.448972+0000","last_fullsized":"2024-05-08T19:48:36.448972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2256,"log_dups_size":0,"ondisk_log_size":2256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'8677","reported_seq":9078,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.673516+0000","last_change":"2024-05-08T19:22:24.615622+0000","last_active":"2024-05-08T19:48:35.673516+0000","last_peered":"2024-05-08T19:48:35.673516+0000","last_clean":"2024-05-08T19:48:35.673516+0000","last_became_active":"2024-05-08T19:22:24.614790+0000","last_became_peered":"2024-05-08T19:22:24.614790+0000","last_unstale":"2024-05-08T19:48:35.673516+0000","last_undegraded":"2024-05-08T19:48:35.673516+0000","last_fullsized":"2024-05-08T19:48:35.673516+0000","mapping_epoch":22,"log_start":"26'1126","ondisk_log_start":"26'1126","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7551,"log_dups_size":0,"ondisk_log_size":7551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1142664,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":377,"num_read_kb":22514,"num_write":6347,"num_write_kb":865965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"26'4998","reported_seq":5027,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.125610+0000","last_change":"2024-05-08T19:22:20.006367+0000","last_active":"2024-05-08T19:48:33.125610+0000","last_peered":"2024-05-08T19:48:33.125610+0000","last_clean":"2024-05-08T19:48:33.125610+0000","last_became_active":"2024-05-08T19:22:20.005738+0000","last_became_peered":"2024-05-08T19:22:20.005738+0000","last_unstale":"2024-05-08T19:48:33.125610+0000","last_undegraded":"2024-05-08T19:48:33.125610+0000","last_fullsized":"2024-05-08T19:48:33.125610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4998,"log_dups_size":0,"ondisk_log_size":4998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5000,"num_write_kb":36069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"26'2337","reported_seq":2365,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.587605+0000","last_change":"2024-05-08T19:22:20.448713+0000","last_active":"2024-05-08T19:48:36.587605+0000","last_peered":"2024-05-08T19:48:36.587605+0000","last_clean":"2024-05-08T19:48:36.587605+0000","last_became_active":"2024-05-08T19:22:20.448268+0000","last_became_peered":"2024-05-08T19:22:20.448268+0000","last_unstale":"2024-05-08T19:48:36.587605+0000","last_undegraded":"2024-05-08T19:48:36.587605+0000","last_fullsized":"2024-05-08T19:48:36.587605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"26'8196","reported_seq":8320,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.787331+0000","last_change":"2024-05-08T19:22:24.614076+0000","last_active":"2024-05-08T19:48:35.787331+0000","last_peered":"2024-05-08T19:48:35.787331+0000","last_clean":"2024-05-08T19:48:35.787331+0000","last_became_active":"2024-05-08T19:22:24.613698+0000","last_became_peered":"2024-05-08T19:22:24.613698+0000","last_unstale":"2024-05-08T19:48:35.787331+0000","last_undegraded":"2024-05-08T19:48:35.787331+0000","last_fullsized":"2024-05-08T19:48:35.787331+0000","mapping_epoch":22,"log_start":"26'1759","ondisk_log_start":"26'1759","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6437,"log_dups_size":0,"ondisk_log_size":6437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:26.030709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1520094,"num_objects":19,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":99,"num_read_kb":5304,"num_write":5816,"num_write_kb":1072126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'2639","reported_seq":2667,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.109661+0000","last_change":"2024-05-08T19:22:20.011480+0000","last_active":"2024-05-08T19:48:33.109661+0000","last_peered":"2024-05-08T19:48:33.109661+0000","last_clean":"2024-05-08T19:48:33.109661+0000","last_became_active":"2024-05-08T19:22:20.011188+0000","last_became_peered":"2024-05-08T19:22:20.011188+0000","last_unstale":"2024-05-08T19:48:33.109661+0000","last_undegraded":"2024-05-08T19:48:33.109661+0000","last_fullsized":"2024-05-08T19:48:33.109661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2639,"log_dups_size":0,"ondisk_log_size":2639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:43.497321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2646,"num_write_kb":22132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'2373","reported_seq":2400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.514542+0000","last_change":"2024-05-08T19:22:20.455818+0000","last_active":"2024-05-08T19:48:36.514542+0000","last_peered":"2024-05-08T19:48:36.514542+0000","last_clean":"2024-05-08T19:48:36.514542+0000","last_became_active":"2024-05-08T19:22:20.455562+0000","last_became_peered":"2024-05-08T19:22:20.455562+0000","last_unstale":"2024-05-08T19:48:36.514542+0000","last_undegraded":"2024-05-08T19:48:36.514542+0000","last_fullsized":"2024-05-08T19:48:36.514542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2373,"log_dups_size":0,"ondisk_log_size":2373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"26'8216","reported_seq":8392,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.596518+0000","last_change":"2024-05-08T19:22:24.616812+0000","last_active":"2024-05-08T19:48:35.596518+0000","last_peered":"2024-05-08T19:48:35.596518+0000","last_clean":"2024-05-08T19:48:35.596518+0000","last_became_active":"2024-05-08T19:22:24.615618+0000","last_became_peered":"2024-05-08T19:22:24.615618+0000","last_unstale":"2024-05-08T19:48:35.596518+0000","last_undegraded":"2024-05-08T19:48:35.596518+0000","last_fullsized":"2024-05-08T19:48:35.596518+0000","mapping_epoch":22,"log_start":"26'1815","ondisk_log_start":"26'1815","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6401,"log_dups_size":0,"ondisk_log_size":6401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:21.559278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":879636,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":152,"num_read_kb":3194,"num_write":5714,"num_write_kb":833306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"26'3930","reported_seq":3958,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:59.629602+0000","last_change":"2024-05-08T19:22:20.004327+0000","last_active":"2024-05-08T19:47:59.629602+0000","last_peered":"2024-05-08T19:47:59.629602+0000","last_clean":"2024-05-08T19:47:59.629602+0000","last_became_active":"2024-05-08T19:22:20.003725+0000","last_became_peered":"2024-05-08T19:22:20.003725+0000","last_unstale":"2024-05-08T19:47:59.629602+0000","last_undegraded":"2024-05-08T19:47:59.629602+0000","last_fullsized":"2024-05-08T19:47:59.629602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":3930,"log_dups_size":0,"ondisk_log_size":3930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:42.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3928,"num_write_kb":31166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"26'2244","reported_seq":2271,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.971110+0000","last_change":"2024-05-08T19:22:20.459536+0000","last_active":"2024-05-08T19:48:35.971110+0000","last_peered":"2024-05-08T19:48:35.971110+0000","last_clean":"2024-05-08T19:48:35.971110+0000","last_became_active":"2024-05-08T19:22:20.452496+0000","last_became_peered":"2024-05-08T19:22:20.452496+0000","last_unstale":"2024-05-08T19:48:35.971110+0000","last_undegraded":"2024-05-08T19:48:35.971110+0000","last_fullsized":"2024-05-08T19:48:35.971110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2244,"log_dups_size":0,"ondisk_log_size":2244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:55.216179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"26'8446","reported_seq":9051,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.569851+0000","last_change":"2024-05-08T19:22:24.478351+0000","last_active":"2024-05-08T19:48:36.569851+0000","last_peered":"2024-05-08T19:48:36.569851+0000","last_clean":"2024-05-08T19:48:36.569851+0000","last_became_active":"2024-05-08T19:22:24.477728+0000","last_became_peered":"2024-05-08T19:22:24.477728+0000","last_unstale":"2024-05-08T19:48:36.569851+0000","last_undegraded":"2024-05-08T19:48:36.569851+0000","last_fullsized":"2024-05-08T19:48:36.569851+0000","mapping_epoch":22,"log_start":"26'1217","ondisk_log_start":"26'1217","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7229,"log_dups_size":0,"ondisk_log_size":7229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":39960,"num_write":6024,"num_write_kb":827712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"26'5265","reported_seq":5294,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.105431+0000","last_change":"2024-05-08T19:22:20.008346+0000","last_active":"2024-05-08T19:48:33.105431+0000","last_peered":"2024-05-08T19:48:33.105431+0000","last_clean":"2024-05-08T19:48:33.105431+0000","last_became_active":"2024-05-08T19:22:20.007985+0000","last_became_peered":"2024-05-08T19:22:20.007985+0000","last_unstale":"2024-05-08T19:48:33.105431+0000","last_undegraded":"2024-05-08T19:48:33.105431+0000","last_fullsized":"2024-05-08T19:48:33.105431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5265,"log_dups_size":0,"ondisk_log_size":5265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":5295,"num_write_kb":36936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"26'2365","reported_seq":2392,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.616075+0000","last_change":"2024-05-08T19:22:20.458860+0000","last_active":"2024-05-08T19:48:36.616075+0000","last_peered":"2024-05-08T19:48:36.616075+0000","last_clean":"2024-05-08T19:48:36.616075+0000","last_became_active":"2024-05-08T19:22:20.458588+0000","last_became_peered":"2024-05-08T19:22:20.458588+0000","last_unstale":"2024-05-08T19:48:36.616075+0000","last_undegraded":"2024-05-08T19:48:36.616075+0000","last_fullsized":"2024-05-08T19:48:36.616075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2365,"log_dups_size":0,"ondisk_log_size":2365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"26'8531","reported_seq":10200,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.321076+0000","last_change":"2024-05-08T19:22:24.464132+0000","last_active":"2024-05-08T19:48:36.321076+0000","last_peered":"2024-05-08T19:48:36.321076+0000","last_clean":"2024-05-08T19:48:36.321076+0000","last_became_active":"2024-05-08T19:22:24.463741+0000","last_became_peered":"2024-05-08T19:22:24.463741+0000","last_unstale":"2024-05-08T19:48:36.321076+0000","last_undegraded":"2024-05-08T19:48:36.321076+0000","last_fullsized":"2024-05-08T19:48:36.321076+0000","mapping_epoch":22,"log_start":"26'1304","ondisk_log_start":"26'1304","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7227,"log_dups_size":0,"ondisk_log_size":7227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:13.044112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162102,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1644,"num_read_kb":83588,"num_write":6133,"num_write_kb":944540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"26'5911","reported_seq":5939,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.074768+0000","last_change":"2024-05-08T19:22:20.005994+0000","last_active":"2024-05-08T19:48:30.074768+0000","last_peered":"2024-05-08T19:48:30.074768+0000","last_clean":"2024-05-08T19:48:30.074768+0000","last_became_active":"2024-05-08T19:22:20.005680+0000","last_became_peered":"2024-05-08T19:22:20.005680+0000","last_unstale":"2024-05-08T19:48:30.074768+0000","last_undegraded":"2024-05-08T19:48:30.074768+0000","last_fullsized":"2024-05-08T19:48:30.074768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5911,"log_dups_size":0,"ondisk_log_size":5911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:18.387895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5920,"num_write_kb":40735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"26'2309","reported_seq":2336,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.568818+0000","last_change":"2024-05-08T19:22:20.449812+0000","last_active":"2024-05-08T19:48:36.568818+0000","last_peered":"2024-05-08T19:48:36.568818+0000","last_clean":"2024-05-08T19:48:36.568818+0000","last_became_active":"2024-05-08T19:22:20.449512+0000","last_became_peered":"2024-05-08T19:22:20.449512+0000","last_unstale":"2024-05-08T19:48:36.568818+0000","last_undegraded":"2024-05-08T19:48:36.568818+0000","last_fullsized":"2024-05-08T19:48:36.568818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2309,"log_dups_size":0,"ondisk_log_size":2309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"26'8843","reported_seq":9128,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.638536+0000","last_change":"2024-05-08T19:22:24.478647+0000","last_active":"2024-05-08T19:48:36.638536+0000","last_peered":"2024-05-08T19:48:36.638536+0000","last_clean":"2024-05-08T19:48:36.638536+0000","last_became_active":"2024-05-08T19:22:24.478248+0000","last_became_peered":"2024-05-08T19:22:24.478248+0000","last_unstale":"2024-05-08T19:48:36.638536+0000","last_undegraded":"2024-05-08T19:48:36.638536+0000","last_fullsized":"2024-05-08T19:48:36.638536+0000","mapping_epoch":22,"log_start":"26'1512","ondisk_log_start":"26'1512","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7331,"log_dups_size":0,"ondisk_log_size":7331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":14826,"num_write":6450,"num_write_kb":856300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"26'7014","reported_seq":7044,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.111785+0000","last_change":"2024-05-08T19:22:20.003344+0000","last_active":"2024-05-08T19:48:33.111785+0000","last_peered":"2024-05-08T19:48:33.111785+0000","last_clean":"2024-05-08T19:48:33.111785+0000","last_became_active":"2024-05-08T19:22:20.003055+0000","last_became_peered":"2024-05-08T19:22:20.003055+0000","last_unstale":"2024-05-08T19:48:33.111785+0000","last_undegraded":"2024-05-08T19:48:33.111785+0000","last_fullsized":"2024-05-08T19:48:33.111785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7014,"log_dups_size":0,"ondisk_log_size":7014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7021,"num_write_kb":53638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"26'2296","reported_seq":2324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.561230+0000","last_change":"2024-05-08T19:22:20.450523+0000","last_active":"2024-05-08T19:48:35.561230+0000","last_peered":"2024-05-08T19:48:35.561230+0000","last_clean":"2024-05-08T19:48:35.561230+0000","last_became_active":"2024-05-08T19:22:20.449693+0000","last_became_peered":"2024-05-08T19:22:20.449693+0000","last_unstale":"2024-05-08T19:48:35.561230+0000","last_undegraded":"2024-05-08T19:48:35.561230+0000","last_fullsized":"2024-05-08T19:48:35.561230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2296,"log_dups_size":0,"ondisk_log_size":2296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'8998","reported_seq":9170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.608015+0000","last_change":"2024-05-08T19:22:24.472926+0000","last_active":"2024-05-08T19:48:36.608015+0000","last_peered":"2024-05-08T19:48:36.608015+0000","last_clean":"2024-05-08T19:48:36.608015+0000","last_became_active":"2024-05-08T19:22:24.472518+0000","last_became_peered":"2024-05-08T19:22:24.472518+0000","last_unstale":"2024-05-08T19:48:36.608015+0000","last_undegraded":"2024-05-08T19:48:36.608015+0000","last_fullsized":"2024-05-08T19:48:36.608015+0000","mapping_epoch":22,"log_start":"26'1583","ondisk_log_start":"26'1583","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7415,"log_dups_size":0,"ondisk_log_size":7415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":5460,"num_write":6563,"num_write_kb":1024036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"26'7864","reported_seq":7893,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.077571+0000","last_change":"2024-05-08T19:22:20.007824+0000","last_active":"2024-05-08T19:48:30.077571+0000","last_peered":"2024-05-08T19:48:30.077571+0000","last_clean":"2024-05-08T19:48:30.077571+0000","last_became_active":"2024-05-08T19:22:20.007542+0000","last_became_peered":"2024-05-08T19:22:20.007542+0000","last_unstale":"2024-05-08T19:48:30.077571+0000","last_undegraded":"2024-05-08T19:48:30.077571+0000","last_fullsized":"2024-05-08T19:48:30.077571+0000","mapping_epoch":17,"log_start":"26'300","ondisk_log_start":"26'300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7564,"log_dups_size":0,"ondisk_log_size":7564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7858,"num_write_kb":54448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'2322","reported_seq":2350,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.057619+0000","last_change":"2024-05-08T19:22:20.443326+0000","last_active":"2024-05-08T19:48:36.057619+0000","last_peered":"2024-05-08T19:48:36.057619+0000","last_clean":"2024-05-08T19:48:36.057619+0000","last_became_active":"2024-05-08T19:22:20.443049+0000","last_became_peered":"2024-05-08T19:22:20.443049+0000","last_unstale":"2024-05-08T19:48:36.057619+0000","last_undegraded":"2024-05-08T19:48:36.057619+0000","last_fullsized":"2024-05-08T19:48:36.057619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2322,"log_dups_size":0,"ondisk_log_size":2322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:04.174914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"26'8111","reported_seq":9094,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.658543+0000","last_change":"2024-05-08T19:23:11.532565+0000","last_active":"2024-05-08T19:48:36.658543+0000","last_peered":"2024-05-08T19:48:36.658543+0000","last_clean":"2024-05-08T19:48:36.658543+0000","last_became_active":"2024-05-08T19:23:11.532148+0000","last_became_peered":"2024-05-08T19:23:11.532148+0000","last_unstale":"2024-05-08T19:48:36.658543+0000","last_undegraded":"2024-05-08T19:48:36.658543+0000","last_fullsized":"2024-05-08T19:48:36.658543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":8111,"log_dups_size":0,"ondisk_log_size":8111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":959,"num_read_kb":67642,"num_write":5666,"num_write_kb":895823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'2313","reported_seq":2343,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:38.698745+0000","last_change":"2024-05-08T19:22:20.449968+0000","last_active":"2024-05-08T19:48:38.698745+0000","last_peered":"2024-05-08T19:48:38.698745+0000","last_clean":"2024-05-08T19:48:38.698745+0000","last_became_active":"2024-05-08T19:22:20.449709+0000","last_became_peered":"2024-05-08T19:22:20.449709+0000","last_unstale":"2024-05-08T19:48:38.698745+0000","last_undegraded":"2024-05-08T19:48:38.698745+0000","last_fullsized":"2024-05-08T19:48:38.698745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2313,"log_dups_size":0,"ondisk_log_size":2313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'7717","reported_seq":8693,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.096346+0000","last_change":"2024-05-08T19:48:40.096442+0000","last_active":"2024-05-08T19:48:40.096346+0000","last_peered":"2024-05-08T19:48:40.096346+0000","last_clean":"2024-05-08T19:48:40.096346+0000","last_became_active":"2024-05-08T19:22:20.004404+0000","last_became_peered":"2024-05-08T19:22:20.004404+0000","last_unstale":"2024-05-08T19:48:40.096346+0000","last_undegraded":"2024-05-08T19:48:40.096346+0000","last_fullsized":"2024-05-08T19:48:40.096346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7717","last_scrub_stamp":"2024-05-08T19:48:40.096323+0000","last_deep_scrub":"26'7717","last_deep_scrub_stamp":"2024-05-08T19:48:40.096323+0000","last_clean_scrub_stamp":"2024-05-08T19:48:40.096323+0000","objects_scrubbed":2,"log_size":7717,"log_dups_size":0,"ondisk_log_size":7717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:30.861928+0000","scrub_duration":0.037188867,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":935,"num_read_kb":4706,"num_write":7717,"num_write_kb":54235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"26'8480","reported_seq":9036,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.259620+0000","last_change":"2024-05-08T19:22:24.617952+0000","last_active":"2024-05-08T19:48:36.259620+0000","last_peered":"2024-05-08T19:48:36.259620+0000","last_clean":"2024-05-08T19:48:36.259620+0000","last_became_active":"2024-05-08T19:22:24.617627+0000","last_became_peered":"2024-05-08T19:22:24.617627+0000","last_unstale":"2024-05-08T19:48:36.259620+0000","last_undegraded":"2024-05-08T19:48:36.259620+0000","last_fullsized":"2024-05-08T19:48:36.259620+0000","mapping_epoch":22,"log_start":"26'574","ondisk_log_start":"26'574","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7906,"log_dups_size":0,"ondisk_log_size":7906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:57.825616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1295704,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":530,"num_read_kb":27006,"num_write":6142,"num_write_kb":958865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"26'2359","reported_seq":2387,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.390073+0000","last_change":"2024-05-08T19:22:20.447152+0000","last_active":"2024-05-08T19:48:35.390073+0000","last_peered":"2024-05-08T19:48:35.390073+0000","last_clean":"2024-05-08T19:48:35.390073+0000","last_became_active":"2024-05-08T19:22:20.446864+0000","last_became_peered":"2024-05-08T19:22:20.446864+0000","last_unstale":"2024-05-08T19:48:35.390073+0000","last_undegraded":"2024-05-08T19:48:35.390073+0000","last_fullsized":"2024-05-08T19:48:35.390073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2359,"log_dups_size":0,"ondisk_log_size":2359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:38.239737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'5126","reported_seq":5155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:47:24.156639+0000","last_change":"2024-05-08T19:22:20.003790+0000","last_active":"2024-05-08T19:47:24.156639+0000","last_peered":"2024-05-08T19:47:24.156639+0000","last_clean":"2024-05-08T19:47:24.156639+0000","last_became_active":"2024-05-08T19:22:20.003441+0000","last_became_peered":"2024-05-08T19:22:20.003441+0000","last_unstale":"2024-05-08T19:47:24.156639+0000","last_undegraded":"2024-05-08T19:47:24.156639+0000","last_fullsized":"2024-05-08T19:47:24.156639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5126,"log_dups_size":0,"ondisk_log_size":5126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:43.925011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5120,"num_write_kb":36122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:46:27.527762+0000","last_change":"2024-05-08T19:22:17.117278+0000","last_active":"2024-05-08T19:46:27.527762+0000","last_peered":"2024-05-08T19:46:27.527762+0000","last_clean":"2024-05-08T19:46:27.527762+0000","last_became_active":"2024-05-08T19:22:17.116272+0000","last_became_peered":"2024-05-08T19:22:17.116272+0000","last_unstale":"2024-05-08T19:46:27.527762+0000","last_undegraded":"2024-05-08T19:46:27.527762+0000","last_fullsized":"2024-05-08T19:46:27.527762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:15.924359+0000","last_clean_scrub_stamp":"2024-05-08T19:22:15.924359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:37.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'8661","reported_seq":8768,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.661662+0000","last_change":"2024-05-08T19:22:24.617594+0000","last_active":"2024-05-08T19:48:36.661662+0000","last_peered":"2024-05-08T19:48:36.661662+0000","last_clean":"2024-05-08T19:48:36.661662+0000","last_became_active":"2024-05-08T19:22:24.616486+0000","last_became_peered":"2024-05-08T19:22:24.616486+0000","last_unstale":"2024-05-08T19:48:36.661662+0000","last_undegraded":"2024-05-08T19:48:36.661662+0000","last_fullsized":"2024-05-08T19:48:36.661662+0000","mapping_epoch":22,"log_start":"26'1423","ondisk_log_start":"26'1423","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7238,"log_dups_size":0,"ondisk_log_size":7238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":5028,"num_write":6258,"num_write_kb":895883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"26'2257","reported_seq":2286,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.671672+0000","last_change":"2024-05-08T19:22:20.445458+0000","last_active":"2024-05-08T19:48:36.671672+0000","last_peered":"2024-05-08T19:48:36.671672+0000","last_clean":"2024-05-08T19:48:36.671672+0000","last_became_active":"2024-05-08T19:22:20.445191+0000","last_became_peered":"2024-05-08T19:22:20.445191+0000","last_unstale":"2024-05-08T19:48:36.671672+0000","last_undegraded":"2024-05-08T19:48:36.671672+0000","last_fullsized":"2024-05-08T19:48:36.671672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2257,"log_dups_size":0,"ondisk_log_size":2257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'8075","reported_seq":8105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.101481+0000","last_change":"2024-05-08T19:22:20.015288+0000","last_active":"2024-05-08T19:48:30.101481+0000","last_peered":"2024-05-08T19:48:30.101481+0000","last_clean":"2024-05-08T19:48:30.101481+0000","last_became_active":"2024-05-08T19:22:20.015062+0000","last_became_peered":"2024-05-08T19:22:20.015062+0000","last_unstale":"2024-05-08T19:48:30.101481+0000","last_undegraded":"2024-05-08T19:48:30.101481+0000","last_fullsized":"2024-05-08T19:48:30.101481+0000","mapping_epoch":17,"log_start":"26'1200","ondisk_log_start":"26'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6875,"log_dups_size":0,"ondisk_log_size":6875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:12.577297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8080,"num_write_kb":54571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'8514","reported_seq":9514,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.275901+0000","last_change":"2024-05-08T19:22:24.614066+0000","last_active":"2024-05-08T19:48:36.275901+0000","last_peered":"2024-05-08T19:48:36.275901+0000","last_clean":"2024-05-08T19:48:36.275901+0000","last_became_active":"2024-05-08T19:22:24.613661+0000","last_became_peered":"2024-05-08T19:22:24.613661+0000","last_unstale":"2024-05-08T19:48:36.275901+0000","last_undegraded":"2024-05-08T19:48:36.275901+0000","last_fullsized":"2024-05-08T19:48:36.275901+0000","mapping_epoch":22,"log_start":"26'1305","ondisk_log_start":"26'1305","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7209,"log_dups_size":0,"ondisk_log_size":7209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":973,"num_read_kb":68996,"num_write":6084,"num_write_kb":873899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"26'6279","reported_seq":6308,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.314159+0000","last_change":"2024-05-08T19:22:20.015193+0000","last_active":"2024-05-08T19:48:33.314159+0000","last_peered":"2024-05-08T19:48:33.314159+0000","last_clean":"2024-05-08T19:48:33.314159+0000","last_became_active":"2024-05-08T19:22:20.014926+0000","last_became_peered":"2024-05-08T19:22:20.014926+0000","last_unstale":"2024-05-08T19:48:33.314159+0000","last_undegraded":"2024-05-08T19:48:33.314159+0000","last_fullsized":"2024-05-08T19:48:33.314159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6279,"log_dups_size":0,"ondisk_log_size":6279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:13.701454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7230166,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6275,"num_write_kb":44044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"26'2390","reported_seq":2419,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.591384+0000","last_change":"2024-05-08T19:22:20.446453+0000","last_active":"2024-05-08T19:48:36.591384+0000","last_peered":"2024-05-08T19:48:36.591384+0000","last_clean":"2024-05-08T19:48:36.591384+0000","last_became_active":"2024-05-08T19:22:20.446194+0000","last_became_peered":"2024-05-08T19:22:20.446194+0000","last_unstale":"2024-05-08T19:48:36.591384+0000","last_undegraded":"2024-05-08T19:48:36.591384+0000","last_fullsized":"2024-05-08T19:48:36.591384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2390,"log_dups_size":0,"ondisk_log_size":2390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'8353","reported_seq":8747,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.783177+0000","last_change":"2024-05-08T19:22:24.615481+0000","last_active":"2024-05-08T19:48:35.783177+0000","last_peered":"2024-05-08T19:48:35.783177+0000","last_clean":"2024-05-08T19:48:35.783177+0000","last_became_active":"2024-05-08T19:22:24.615069+0000","last_became_peered":"2024-05-08T19:22:24.615069+0000","last_unstale":"2024-05-08T19:48:35.783177+0000","last_undegraded":"2024-05-08T19:48:35.783177+0000","last_fullsized":"2024-05-08T19:48:35.783177+0000","mapping_epoch":22,"log_start":"26'1929","ondisk_log_start":"26'1929","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6424,"log_dups_size":0,"ondisk_log_size":6424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:28.211177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":717534,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":368,"num_read_kb":23786,"num_write":5976,"num_write_kb":964471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'5784","reported_seq":6305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.495719+0000","last_change":"2024-05-08T19:22:20.001642+0000","last_active":"2024-05-08T19:48:36.495719+0000","last_peered":"2024-05-08T19:48:36.495719+0000","last_clean":"2024-05-08T19:48:36.495719+0000","last_became_active":"2024-05-08T19:22:20.001339+0000","last_became_peered":"2024-05-08T19:22:20.001339+0000","last_unstale":"2024-05-08T19:48:36.495719+0000","last_undegraded":"2024-05-08T19:48:36.495719+0000","last_fullsized":"2024-05-08T19:48:36.495719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5784,"log_dups_size":0,"ondisk_log_size":5784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11721836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":3579,"num_write":6369,"num_write_kb":46119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"26'2254","reported_seq":2276,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.636744+0000","last_change":"2024-05-08T19:23:11.387164+0000","last_active":"2024-05-08T19:48:36.636744+0000","last_peered":"2024-05-08T19:48:36.636744+0000","last_clean":"2024-05-08T19:48:36.636744+0000","last_became_active":"2024-05-08T19:23:11.386882+0000","last_became_peered":"2024-05-08T19:23:11.386882+0000","last_unstale":"2024-05-08T19:48:36.636744+0000","last_undegraded":"2024-05-08T19:48:36.636744+0000","last_fullsized":"2024-05-08T19:48:36.636744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2254,"log_dups_size":0,"ondisk_log_size":2254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"26'8453","reported_seq":8882,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.260905+0000","last_change":"2024-05-08T19:22:24.614812+0000","last_active":"2024-05-08T19:48:36.260905+0000","last_peered":"2024-05-08T19:48:36.260905+0000","last_clean":"2024-05-08T19:48:36.260905+0000","last_became_active":"2024-05-08T19:22:24.614433+0000","last_became_peered":"2024-05-08T19:22:24.614433+0000","last_unstale":"2024-05-08T19:48:36.260905+0000","last_undegraded":"2024-05-08T19:48:36.260905+0000","last_fullsized":"2024-05-08T19:48:36.260905+0000","mapping_epoch":22,"log_start":"26'1215","ondisk_log_start":"26'1215","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7238,"log_dups_size":0,"ondisk_log_size":7238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:07.924115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138260,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":32316,"num_write":6065,"num_write_kb":878068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'4078","reported_seq":4107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.131637+0000","last_change":"2024-05-08T19:22:20.012651+0000","last_active":"2024-05-08T19:48:33.131637+0000","last_peered":"2024-05-08T19:48:33.131637+0000","last_clean":"2024-05-08T19:48:33.131637+0000","last_became_active":"2024-05-08T19:22:20.012383+0000","last_became_peered":"2024-05-08T19:22:20.012383+0000","last_unstale":"2024-05-08T19:48:33.131637+0000","last_undegraded":"2024-05-08T19:48:33.131637+0000","last_fullsized":"2024-05-08T19:48:33.131637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4078,"log_dups_size":0,"ondisk_log_size":4078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:55.790420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":4095,"num_write_kb":27507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'2300","reported_seq":2329,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.167357+0000","last_change":"2024-05-08T19:22:20.436459+0000","last_active":"2024-05-08T19:48:36.167357+0000","last_peered":"2024-05-08T19:48:36.167357+0000","last_clean":"2024-05-08T19:48:36.167357+0000","last_became_active":"2024-05-08T19:22:20.435680+0000","last_became_peered":"2024-05-08T19:22:20.435680+0000","last_unstale":"2024-05-08T19:48:36.167357+0000","last_undegraded":"2024-05-08T19:48:36.167357+0000","last_fullsized":"2024-05-08T19:48:36.167357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2300,"log_dups_size":0,"ondisk_log_size":2300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"26'8817","reported_seq":9055,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.251908+0000","last_change":"2024-05-08T19:22:24.473208+0000","last_active":"2024-05-08T19:48:36.251908+0000","last_peered":"2024-05-08T19:48:36.251908+0000","last_clean":"2024-05-08T19:48:36.251908+0000","last_became_active":"2024-05-08T19:22:24.472782+0000","last_became_peered":"2024-05-08T19:22:24.472782+0000","last_unstale":"2024-05-08T19:48:36.251908+0000","last_undegraded":"2024-05-08T19:48:36.251908+0000","last_fullsized":"2024-05-08T19:48:36.251908+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7179,"log_dups_size":0,"ondisk_log_size":7179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":518858,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":213,"num_read_kb":12280,"num_write":6452,"num_write_kb":1036607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2845","reported_seq":2874,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.125216+0000","last_change":"2024-05-08T19:22:20.014848+0000","last_active":"2024-05-08T19:48:33.125216+0000","last_peered":"2024-05-08T19:48:33.125216+0000","last_clean":"2024-05-08T19:48:33.125216+0000","last_became_active":"2024-05-08T19:22:20.013739+0000","last_became_peered":"2024-05-08T19:22:20.013739+0000","last_unstale":"2024-05-08T19:48:33.125216+0000","last_undegraded":"2024-05-08T19:48:33.125216+0000","last_fullsized":"2024-05-08T19:48:33.125216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2845,"log_dups_size":0,"ondisk_log_size":2845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:03.169714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2848,"num_write_kb":22358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"26'2333","reported_seq":2360,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.283745+0000","last_change":"2024-05-08T19:22:20.447451+0000","last_active":"2024-05-08T19:48:36.283745+0000","last_peered":"2024-05-08T19:48:36.283745+0000","last_clean":"2024-05-08T19:48:36.283745+0000","last_became_active":"2024-05-08T19:22:20.447180+0000","last_became_peered":"2024-05-08T19:22:20.447180+0000","last_unstale":"2024-05-08T19:48:36.283745+0000","last_undegraded":"2024-05-08T19:48:36.283745+0000","last_fullsized":"2024-05-08T19:48:36.283745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2333,"log_dups_size":0,"ondisk_log_size":2333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:24.138617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"26'8924","reported_seq":9895,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.112356+0000","last_change":"2024-05-08T19:22:24.614091+0000","last_active":"2024-05-08T19:48:36.112356+0000","last_peered":"2024-05-08T19:48:36.112356+0000","last_clean":"2024-05-08T19:48:36.112356+0000","last_became_active":"2024-05-08T19:22:24.613677+0000","last_became_peered":"2024-05-08T19:22:24.613677+0000","last_unstale":"2024-05-08T19:48:36.112356+0000","last_undegraded":"2024-05-08T19:48:36.112356+0000","last_fullsized":"2024-05-08T19:48:36.112356+0000","mapping_epoch":22,"log_start":"26'1529","ondisk_log_start":"26'1529","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7395,"log_dups_size":0,"ondisk_log_size":7395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":945,"num_read_kb":70780,"num_write":6622,"num_write_kb":1028558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"26'4273","reported_seq":4303,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.107822+0000","last_change":"2024-05-08T19:22:20.011528+0000","last_active":"2024-05-08T19:48:33.107822+0000","last_peered":"2024-05-08T19:48:33.107822+0000","last_clean":"2024-05-08T19:48:33.107822+0000","last_became_active":"2024-05-08T19:22:20.011262+0000","last_became_peered":"2024-05-08T19:22:20.011262+0000","last_unstale":"2024-05-08T19:48:33.107822+0000","last_undegraded":"2024-05-08T19:48:33.107822+0000","last_fullsized":"2024-05-08T19:48:33.107822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":4273,"log_dups_size":0,"ondisk_log_size":4273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4270,"num_write_kb":27446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"26'2421","reported_seq":2449,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.631334+0000","last_change":"2024-05-08T19:22:20.438689+0000","last_active":"2024-05-08T19:48:35.631334+0000","last_peered":"2024-05-08T19:48:35.631334+0000","last_clean":"2024-05-08T19:48:35.631334+0000","last_became_active":"2024-05-08T19:22:20.438434+0000","last_became_peered":"2024-05-08T19:22:20.438434+0000","last_unstale":"2024-05-08T19:48:35.631334+0000","last_undegraded":"2024-05-08T19:48:35.631334+0000","last_fullsized":"2024-05-08T19:48:35.631334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2421,"log_dups_size":0,"ondisk_log_size":2421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"26'8248","reported_seq":8512,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.919395+0000","last_change":"2024-05-08T19:22:24.473569+0000","last_active":"2024-05-08T19:48:35.919395+0000","last_peered":"2024-05-08T19:48:35.919395+0000","last_clean":"2024-05-08T19:48:35.919395+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:48:35.919395+0000","last_undegraded":"2024-05-08T19:48:35.919395+0000","last_fullsized":"2024-05-08T19:48:35.919395+0000","mapping_epoch":22,"log_start":"26'1006","ondisk_log_start":"26'1006","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7242,"log_dups_size":0,"ondisk_log_size":7242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:22.875469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77076,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":239,"num_read_kb":13756,"num_write":5780,"num_write_kb":975965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"26'7369","reported_seq":7399,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:34.434323+0000","last_change":"2024-05-08T19:22:20.007101+0000","last_active":"2024-05-08T19:48:34.434323+0000","last_peered":"2024-05-08T19:48:34.434323+0000","last_clean":"2024-05-08T19:48:34.434323+0000","last_became_active":"2024-05-08T19:22:20.006772+0000","last_became_peered":"2024-05-08T19:22:20.006772+0000","last_unstale":"2024-05-08T19:48:34.434323+0000","last_undegraded":"2024-05-08T19:48:34.434323+0000","last_fullsized":"2024-05-08T19:48:34.434323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7369,"log_dups_size":0,"ondisk_log_size":7369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7364,"num_write_kb":54049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"26'2336","reported_seq":2363,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.683839+0000","last_change":"2024-05-08T19:22:20.436696+0000","last_active":"2024-05-08T19:48:35.683839+0000","last_peered":"2024-05-08T19:48:35.683839+0000","last_clean":"2024-05-08T19:48:35.683839+0000","last_became_active":"2024-05-08T19:22:20.436373+0000","last_became_peered":"2024-05-08T19:22:20.436373+0000","last_unstale":"2024-05-08T19:48:35.683839+0000","last_undegraded":"2024-05-08T19:48:35.683839+0000","last_fullsized":"2024-05-08T19:48:35.683839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2336,"log_dups_size":0,"ondisk_log_size":2336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:22.162487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"26'8812","reported_seq":9440,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.019368+0000","last_change":"2024-05-08T19:22:24.478232+0000","last_active":"2024-05-08T19:48:36.019368+0000","last_peered":"2024-05-08T19:48:36.019368+0000","last_clean":"2024-05-08T19:48:36.019368+0000","last_became_active":"2024-05-08T19:22:24.477941+0000","last_became_peered":"2024-05-08T19:22:24.477941+0000","last_unstale":"2024-05-08T19:48:36.019368+0000","last_undegraded":"2024-05-08T19:48:36.019368+0000","last_fullsized":"2024-05-08T19:48:36.019368+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7174,"log_dups_size":0,"ondisk_log_size":7174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:56.806039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247128,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":603,"num_read_kb":28586,"num_write":6335,"num_write_kb":901267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"26'6179","reported_seq":6207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.134848+0000","last_change":"2024-05-08T19:22:20.014076+0000","last_active":"2024-05-08T19:48:33.134848+0000","last_peered":"2024-05-08T19:48:33.134848+0000","last_clean":"2024-05-08T19:48:33.134848+0000","last_became_active":"2024-05-08T19:22:20.013748+0000","last_became_peered":"2024-05-08T19:22:20.013748+0000","last_unstale":"2024-05-08T19:48:33.134848+0000","last_undegraded":"2024-05-08T19:48:33.134848+0000","last_fullsized":"2024-05-08T19:48:33.134848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6179,"log_dups_size":0,"ondisk_log_size":6179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:50.426177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6199,"num_write_kb":41171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"26'2344","reported_seq":2371,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.061893+0000","last_change":"2024-05-08T19:22:20.457103+0000","last_active":"2024-05-08T19:48:36.061893+0000","last_peered":"2024-05-08T19:48:36.061893+0000","last_clean":"2024-05-08T19:48:36.061893+0000","last_became_active":"2024-05-08T19:22:20.456850+0000","last_became_peered":"2024-05-08T19:22:20.456850+0000","last_unstale":"2024-05-08T19:48:36.061893+0000","last_undegraded":"2024-05-08T19:48:36.061893+0000","last_fullsized":"2024-05-08T19:48:36.061893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2344,"log_dups_size":0,"ondisk_log_size":2344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:40.843349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"26'8415","reported_seq":8857,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.078783+0000","last_change":"2024-05-08T19:22:24.614410+0000","last_active":"2024-05-08T19:48:36.078783+0000","last_peered":"2024-05-08T19:48:36.078783+0000","last_clean":"2024-05-08T19:48:36.078783+0000","last_became_active":"2024-05-08T19:22:24.613904+0000","last_became_peered":"2024-05-08T19:22:24.613904+0000","last_unstale":"2024-05-08T19:48:36.078783+0000","last_undegraded":"2024-05-08T19:48:36.078783+0000","last_fullsized":"2024-05-08T19:48:36.078783+0000","mapping_epoch":22,"log_start":"26'512","ondisk_log_start":"26'512","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7903,"log_dups_size":0,"ondisk_log_size":7903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:03.465351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162102,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":417,"num_read_kb":29592,"num_write":6011,"num_write_kb":842872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"26'8392","reported_seq":8421,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.117398+0000","last_change":"2024-05-08T19:22:20.000763+0000","last_active":"2024-05-08T19:48:33.117398+0000","last_peered":"2024-05-08T19:48:33.117398+0000","last_clean":"2024-05-08T19:48:33.117398+0000","last_became_active":"2024-05-08T19:22:20.000454+0000","last_became_peered":"2024-05-08T19:22:20.000454+0000","last_unstale":"2024-05-08T19:48:33.117398+0000","last_undegraded":"2024-05-08T19:48:33.117398+0000","last_fullsized":"2024-05-08T19:48:33.117398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":8392,"log_dups_size":0,"ondisk_log_size":8392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8388,"num_write_kb":54739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'2302","reported_seq":2329,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.020158+0000","last_change":"2024-05-08T19:22:20.456485+0000","last_active":"2024-05-08T19:48:36.020158+0000","last_peered":"2024-05-08T19:48:36.020158+0000","last_clean":"2024-05-08T19:48:36.020158+0000","last_became_active":"2024-05-08T19:22:20.456225+0000","last_became_peered":"2024-05-08T19:22:20.456225+0000","last_unstale":"2024-05-08T19:48:36.020158+0000","last_undegraded":"2024-05-08T19:48:36.020158+0000","last_fullsized":"2024-05-08T19:48:36.020158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2302,"log_dups_size":0,"ondisk_log_size":2302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.507795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"26'8603","reported_seq":9423,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.436904+0000","last_change":"2024-05-08T19:22:24.473117+0000","last_active":"2024-05-08T19:48:36.436904+0000","last_peered":"2024-05-08T19:48:36.436904+0000","last_clean":"2024-05-08T19:48:36.436904+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:48:36.436904+0000","last_undegraded":"2024-05-08T19:48:36.436904+0000","last_fullsized":"2024-05-08T19:48:36.436904+0000","mapping_epoch":22,"log_start":"26'1458","ondisk_log_start":"26'1458","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":794,"num_read_kb":57832,"num_write":6099,"num_write_kb":1028205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'7804","reported_seq":7833,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.101905+0000","last_change":"2024-05-08T19:22:20.006312+0000","last_active":"2024-05-08T19:48:33.101905+0000","last_peered":"2024-05-08T19:48:33.101905+0000","last_clean":"2024-05-08T19:48:33.101905+0000","last_became_active":"2024-05-08T19:22:20.005996+0000","last_became_peered":"2024-05-08T19:22:20.005996+0000","last_unstale":"2024-05-08T19:48:33.101905+0000","last_undegraded":"2024-05-08T19:48:33.101905+0000","last_fullsized":"2024-05-08T19:48:33.101905+0000","mapping_epoch":17,"log_start":"26'400","ondisk_log_start":"26'400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":7404,"log_dups_size":0,"ondisk_log_size":7404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7797,"num_write_kb":54350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"26'2303","reported_seq":2330,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.274802+0000","last_change":"2024-05-08T19:22:20.452861+0000","last_active":"2024-05-08T19:48:35.274802+0000","last_peered":"2024-05-08T19:48:35.274802+0000","last_clean":"2024-05-08T19:48:35.274802+0000","last_became_active":"2024-05-08T19:22:20.452600+0000","last_became_peered":"2024-05-08T19:22:20.452600+0000","last_unstale":"2024-05-08T19:48:35.274802+0000","last_undegraded":"2024-05-08T19:48:35.274802+0000","last_fullsized":"2024-05-08T19:48:35.274802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2303,"log_dups_size":0,"ondisk_log_size":2303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:58.672865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"26'8447","reported_seq":9163,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.435250+0000","last_change":"2024-05-08T19:22:24.614345+0000","last_active":"2024-05-08T19:48:35.435250+0000","last_peered":"2024-05-08T19:48:35.435250+0000","last_clean":"2024-05-08T19:48:35.435250+0000","last_became_active":"2024-05-08T19:22:24.613948+0000","last_became_peered":"2024-05-08T19:22:24.613948+0000","last_unstale":"2024-05-08T19:48:35.435250+0000","last_undegraded":"2024-05-08T19:48:35.435250+0000","last_fullsized":"2024-05-08T19:48:35.435250+0000","mapping_epoch":22,"log_start":"26'935","ondisk_log_start":"26'935","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7512,"log_dups_size":0,"ondisk_log_size":7512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:49.666397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3053999,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":690,"num_read_kb":34094,"num_write":5997,"num_write_kb":938918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"26'9149","reported_seq":9178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.111373+0000","last_change":"2024-05-08T19:22:20.004844+0000","last_active":"2024-05-08T19:48:33.111373+0000","last_peered":"2024-05-08T19:48:33.111373+0000","last_clean":"2024-05-08T19:48:33.111373+0000","last_became_active":"2024-05-08T19:22:20.004254+0000","last_became_peered":"2024-05-08T19:22:20.004254+0000","last_unstale":"2024-05-08T19:48:33.111373+0000","last_undegraded":"2024-05-08T19:48:33.111373+0000","last_fullsized":"2024-05-08T19:48:33.111373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":9149,"log_dups_size":0,"ondisk_log_size":9149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":9139,"num_write_kb":67371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'2210","reported_seq":2237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.515662+0000","last_change":"2024-05-08T19:22:20.455712+0000","last_active":"2024-05-08T19:48:35.515662+0000","last_peered":"2024-05-08T19:48:35.515662+0000","last_clean":"2024-05-08T19:48:35.515662+0000","last_became_active":"2024-05-08T19:22:20.455493+0000","last_became_peered":"2024-05-08T19:22:20.455493+0000","last_unstale":"2024-05-08T19:48:35.515662+0000","last_undegraded":"2024-05-08T19:48:35.515662+0000","last_fullsized":"2024-05-08T19:48:35.515662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2210,"log_dups_size":0,"ondisk_log_size":2210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:28.743156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"26'2263","reported_seq":2291,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.019892+0000","last_change":"2024-05-08T19:22:20.459104+0000","last_active":"2024-05-08T19:48:36.019892+0000","last_peered":"2024-05-08T19:48:36.019892+0000","last_clean":"2024-05-08T19:48:36.019892+0000","last_became_active":"2024-05-08T19:22:20.452169+0000","last_became_peered":"2024-05-08T19:22:20.452169+0000","last_unstale":"2024-05-08T19:48:36.019892+0000","last_undegraded":"2024-05-08T19:48:36.019892+0000","last_fullsized":"2024-05-08T19:48:36.019892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2263,"log_dups_size":0,"ondisk_log_size":2263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:25.102017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'2366","reported_seq":2395,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.638874+0000","last_change":"2024-05-08T19:22:20.449335+0000","last_active":"2024-05-08T19:48:36.638874+0000","last_peered":"2024-05-08T19:48:36.638874+0000","last_clean":"2024-05-08T19:48:36.638874+0000","last_became_active":"2024-05-08T19:22:20.449047+0000","last_became_peered":"2024-05-08T19:22:20.449047+0000","last_unstale":"2024-05-08T19:48:36.638874+0000","last_undegraded":"2024-05-08T19:48:36.638874+0000","last_fullsized":"2024-05-08T19:48:36.638874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2366,"log_dups_size":0,"ondisk_log_size":2366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'2252","reported_seq":2280,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.188294+0000","last_change":"2024-05-08T19:22:20.452192+0000","last_active":"2024-05-08T19:48:35.188294+0000","last_peered":"2024-05-08T19:48:35.188294+0000","last_clean":"2024-05-08T19:48:35.188294+0000","last_became_active":"2024-05-08T19:22:20.451625+0000","last_became_peered":"2024-05-08T19:22:20.451625+0000","last_unstale":"2024-05-08T19:48:35.188294+0000","last_undegraded":"2024-05-08T19:48:35.188294+0000","last_fullsized":"2024-05-08T19:48:35.188294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2252,"log_dups_size":0,"ondisk_log_size":2252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.918890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'2371","reported_seq":2408,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.942438+0000","last_change":"2024-05-08T19:23:11.054094+0000","last_active":"2024-05-08T19:48:35.942438+0000","last_peered":"2024-05-08T19:48:35.942438+0000","last_clean":"2024-05-08T19:48:35.942438+0000","last_became_active":"2024-05-08T19:23:11.053750+0000","last_became_peered":"2024-05-08T19:23:11.053750+0000","last_unstale":"2024-05-08T19:48:35.942438+0000","last_undegraded":"2024-05-08T19:48:35.942438+0000","last_fullsized":"2024-05-08T19:48:35.942438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2371,"log_dups_size":0,"ondisk_log_size":2371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'2318","reported_seq":2346,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.196449+0000","last_change":"2024-05-08T19:22:20.444479+0000","last_active":"2024-05-08T19:48:35.196449+0000","last_peered":"2024-05-08T19:48:35.196449+0000","last_clean":"2024-05-08T19:48:35.196449+0000","last_became_active":"2024-05-08T19:22:20.444219+0000","last_became_peered":"2024-05-08T19:22:20.444219+0000","last_unstale":"2024-05-08T19:48:35.196449+0000","last_undegraded":"2024-05-08T19:48:35.196449+0000","last_fullsized":"2024-05-08T19:48:35.196449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2318,"log_dups_size":0,"ondisk_log_size":2318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'2227","reported_seq":2256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.672228+0000","last_change":"2024-05-08T19:22:20.436874+0000","last_active":"2024-05-08T19:48:36.672228+0000","last_peered":"2024-05-08T19:48:36.672228+0000","last_clean":"2024-05-08T19:48:36.672228+0000","last_became_active":"2024-05-08T19:22:20.436626+0000","last_became_peered":"2024-05-08T19:22:20.436626+0000","last_unstale":"2024-05-08T19:48:36.672228+0000","last_undegraded":"2024-05-08T19:48:36.672228+0000","last_fullsized":"2024-05-08T19:48:36.672228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2227,"log_dups_size":0,"ondisk_log_size":2227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'2347","reported_seq":2375,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.978417+0000","last_change":"2024-05-08T19:22:20.462445+0000","last_active":"2024-05-08T19:48:35.978417+0000","last_peered":"2024-05-08T19:48:35.978417+0000","last_clean":"2024-05-08T19:48:35.978417+0000","last_became_active":"2024-05-08T19:22:20.461547+0000","last_became_peered":"2024-05-08T19:22:20.461547+0000","last_unstale":"2024-05-08T19:48:35.978417+0000","last_undegraded":"2024-05-08T19:48:35.978417+0000","last_fullsized":"2024-05-08T19:48:35.978417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2347,"log_dups_size":0,"ondisk_log_size":2347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'2316","reported_seq":2343,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.815991+0000","last_change":"2024-05-08T19:22:20.443498+0000","last_active":"2024-05-08T19:48:35.815991+0000","last_peered":"2024-05-08T19:48:35.815991+0000","last_clean":"2024-05-08T19:48:35.815991+0000","last_became_active":"2024-05-08T19:22:20.442667+0000","last_became_peered":"2024-05-08T19:22:20.442667+0000","last_unstale":"2024-05-08T19:48:35.815991+0000","last_undegraded":"2024-05-08T19:48:35.815991+0000","last_fullsized":"2024-05-08T19:48:35.815991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2316,"log_dups_size":0,"ondisk_log_size":2316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:16.614295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'2272","reported_seq":2299,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.043557+0000","last_change":"2024-05-08T19:22:20.448722+0000","last_active":"2024-05-08T19:48:35.043557+0000","last_peered":"2024-05-08T19:48:35.043557+0000","last_clean":"2024-05-08T19:48:35.043557+0000","last_became_active":"2024-05-08T19:22:20.448449+0000","last_became_peered":"2024-05-08T19:22:20.448449+0000","last_unstale":"2024-05-08T19:48:35.043557+0000","last_undegraded":"2024-05-08T19:48:35.043557+0000","last_fullsized":"2024-05-08T19:48:35.043557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2272,"log_dups_size":0,"ondisk_log_size":2272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:28.497185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'2280","reported_seq":2307,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.773798+0000","last_change":"2024-05-08T19:22:20.450677+0000","last_active":"2024-05-08T19:48:35.773798+0000","last_peered":"2024-05-08T19:48:35.773798+0000","last_clean":"2024-05-08T19:48:35.773798+0000","last_became_active":"2024-05-08T19:22:20.450217+0000","last_became_peered":"2024-05-08T19:22:20.450217+0000","last_unstale":"2024-05-08T19:48:35.773798+0000","last_undegraded":"2024-05-08T19:48:35.773798+0000","last_fullsized":"2024-05-08T19:48:35.773798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2280,"log_dups_size":0,"ondisk_log_size":2280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:12.037128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'2318","reported_seq":2345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.687638+0000","last_change":"2024-05-08T19:22:20.453450+0000","last_active":"2024-05-08T19:48:35.687638+0000","last_peered":"2024-05-08T19:48:35.687638+0000","last_clean":"2024-05-08T19:48:35.687638+0000","last_became_active":"2024-05-08T19:22:20.453191+0000","last_became_peered":"2024-05-08T19:22:20.453191+0000","last_unstale":"2024-05-08T19:48:35.687638+0000","last_undegraded":"2024-05-08T19:48:35.687638+0000","last_fullsized":"2024-05-08T19:48:35.687638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2318,"log_dups_size":0,"ondisk_log_size":2318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:03.241209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'2354","reported_seq":2382,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.250642+0000","last_change":"2024-05-08T19:22:20.452591+0000","last_active":"2024-05-08T19:48:36.250642+0000","last_peered":"2024-05-08T19:48:36.250642+0000","last_clean":"2024-05-08T19:48:36.250642+0000","last_became_active":"2024-05-08T19:22:20.451209+0000","last_became_peered":"2024-05-08T19:22:20.451209+0000","last_unstale":"2024-05-08T19:48:36.250642+0000","last_undegraded":"2024-05-08T19:48:36.250642+0000","last_fullsized":"2024-05-08T19:48:36.250642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2354,"log_dups_size":0,"ondisk_log_size":2354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'2352","reported_seq":2379,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.912928+0000","last_change":"2024-05-08T19:22:20.461584+0000","last_active":"2024-05-08T19:48:35.912928+0000","last_peered":"2024-05-08T19:48:35.912928+0000","last_clean":"2024-05-08T19:48:35.912928+0000","last_became_active":"2024-05-08T19:22:20.461097+0000","last_became_peered":"2024-05-08T19:22:20.461097+0000","last_unstale":"2024-05-08T19:48:35.912928+0000","last_undegraded":"2024-05-08T19:48:35.912928+0000","last_fullsized":"2024-05-08T19:48:35.912928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:19.259559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":15005950,"num_objects":145,"num_object_clones":0,"num_object_copies":580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":18592,"num_read_kb":1141288,"num_write":194758,"num_write_kb":30181748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3923968,"data_stored":24031232,"data_compressed":1131952,"data_compressed_allocated":2109440,"data_compressed_original":22216704,"omap_allocated":0,"internal_metadata":0},"log_size":230861,"ondisk_log_size":230861,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2327,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148017,"ondisk_log_size":148017,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":249640192,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":2935,"num_read_kb":17425,"num_write":211931,"num_write_kb":1497712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":333017088,"data_stored":495086080,"data_compressed":49083366,"data_compressed_allocated":72515584,"data_compressed_original":234647552,"omap_allocated":0,"internal_metadata":0},"log_size":196183,"ondisk_log_size":196183,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575167,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":901808,"kb_used_data":36392,"kb_used_omap":1,"kb_used_meta":865406,"kb_avail":93470032,"statfs":{"total":96636764160,"available":95713312768,"internally_reserved":0,"allocated":37265408,"data_stored":58266505,"data_compressed":5895427,"data_compressed_allocated":8474624,"data_compressed_original":29650944,"omap_allocated":1588,"internal_metadata":886176204},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":1.988,"15min":1.417},"min":{"1min":0.216,"5min":0.216,"15min":0.20699999999999999},"max":{"1min":3.4830000000000001,"5min":26.544,"15min":26.544},"last":2.0870000000000002},{"interface":"front","average":{"1min":1.2529999999999999,"5min":2.149,"15min":1.702},"min":{"1min":0.28799999999999998,"5min":0.27800000000000002,"15min":0.223},"max":{"1min":6.7789999999999999,"5min":26.713999999999999,"15min":26.713999999999999},"last":4.6120000000000001}]},{"osd":1,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.978,"5min":2.367,"15min":1.9390000000000001},"min":{"1min":0.24099999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":12.176,"5min":14.557,"15min":32.259999999999998},"last":4.6479999999999997},{"interface":"front","average":{"1min":1.3520000000000001,"5min":2.0609999999999999,"15min":1.5569999999999999},"min":{"1min":0.26300000000000001,"5min":0.251,"15min":0.25},"max":{"1min":9.5860000000000003,"5min":21.867000000000001,"15min":36.018000000000001},"last":6.7190000000000003}]},{"osd":2,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":2.069,"15min":1.4259999999999999},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":8.3849999999999998,"5min":13.635,"15min":13.635},"last":7.8710000000000004},{"interface":"front","average":{"1min":1.4910000000000001,"5min":2.4500000000000002,"15min":1.718},"min":{"1min":0.29599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":7.024,"5min":19.469999999999999,"15min":19.469999999999999},"last":4.6639999999999997}]},{"osd":3,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":2.4489999999999998,"15min":1.641},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":11.510999999999999,"5min":26.274999999999999,"15min":26.274999999999999},"last":16.587},{"interface":"front","average":{"1min":1.1719999999999999,"5min":2.3069999999999999,"15min":1.708},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.30599999999999999},"max":{"1min":6.8259999999999996,"5min":26.501999999999999,"15min":26.501999999999999},"last":1.121}]},{"osd":4,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":2,"5min":2.5449999999999999,"15min":1.6619999999999999},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.24399999999999999},"max":{"1min":13.914999999999999,"5min":37.356000000000002,"15min":37.356000000000002},"last":9.2289999999999992},{"interface":"front","average":{"1min":2.3410000000000002,"5min":2.6589999999999998,"15min":1.6890000000000001},"min":{"1min":0.28799999999999998,"5min":0.253,"15min":0.247},"max":{"1min":16.417000000000002,"5min":31.786000000000001,"15min":31.786000000000001},"last":1.673}]},{"osd":5,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":3.2669999999999999,"5min":2.4910000000000001,"15min":1.798},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26300000000000001},"max":{"1min":29.346,"5min":29.346,"15min":35.156999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":1.423,"5min":1.976,"15min":1.3},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":9.6170000000000009,"5min":32.988999999999997,"15min":32.988999999999997},"last":5.5339999999999998}]},{"osd":6,"last update":"Wed May 8 19:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.8220000000000001,"15min":1.4299999999999999},"min":{"1min":0.33000000000000002,"5min":0.315,"15min":0.27400000000000002},"max":{"1min":6.6799999999999997,"5min":13.763,"15min":16.077999999999999},"last":7.9089999999999998},{"interface":"front","average":{"1min":1.821,"5min":2.2280000000000002,"15min":1.4870000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.27500000000000002},"max":{"1min":12.867000000000001,"5min":17.353999999999999,"15min":17.353999999999999},"last":4.0940000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575165,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1083004,"kb_used_data":51124,"kb_used_omap":1,"kb_used_meta":1031870,"kb_avail":93288836,"statfs":{"total":96636764160,"available":95527768064,"internally_reserved":0,"allocated":52350976,"data_stored":86100825,"data_compressed":7908041,"data_compressed_allocated":11857920,"data_compressed_original":45780992,"omap_allocated":1593,"internal_metadata":1056635335},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":2.6739999999999999,"5min":2.0550000000000002,"15min":1.466},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":17.488,"5min":17.488,"15min":17.488},"last":0.27200000000000002},{"interface":"front","average":{"1min":3.4830000000000001,"5min":2.9060000000000001,"15min":1.899},"min":{"1min":0.34200000000000003,"5min":0.246,"15min":0.245},"max":{"1min":17.445,"5min":37.295999999999999,"15min":37.295999999999999},"last":0.39900000000000002}]},{"osd":1,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.101,"5min":2.581,"15min":1.8320000000000001},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.22800000000000001},"max":{"1min":20.460000000000001,"5min":22.753,"15min":22.753},"last":0.28699999999999998},{"interface":"front","average":{"1min":3.2210000000000001,"5min":2.7170000000000001,"15min":1.8859999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":18.388000000000002,"5min":37.521000000000001,"15min":37.521000000000001},"last":0.371}]},{"osd":2,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.879,"5min":2.7669999999999999,"15min":1.903},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.247},"max":{"1min":23.228999999999999,"5min":23.952999999999999,"15min":23.952999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.367,"15min":1.6890000000000001},"min":{"1min":0.35799999999999998,"5min":0.29499999999999998,"15min":0.255},"max":{"1min":14.472,"5min":23.196999999999999,"15min":23.196999999999999},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.2400000000000002,"5min":2.5579999999999998,"15min":1.994},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.25800000000000001},"max":{"1min":17.577999999999999,"5min":21.975000000000001,"15min":43.082999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":3.6709999999999998,"5min":2.911,"15min":2.1219999999999999},"min":{"1min":0.434,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":17.719000000000001,"5min":23.859000000000002,"15min":43.872999999999998},"last":0.47099999999999997}]},{"osd":4,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.0910000000000002,"5min":2.7829999999999999,"15min":2.4390000000000001},"min":{"1min":0.29999999999999999,"5min":0.26500000000000001,"15min":0.26100000000000001},"max":{"1min":18.416,"5min":23.055,"15min":111.04900000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":4.2690000000000001,"5min":2.8079999999999998,"15min":1.7549999999999999},"min":{"1min":0.34499999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":28.757999999999999,"5min":28.757999999999999,"15min":28.757999999999999},"last":0.502}]},{"osd":5,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.2090000000000001,"5min":2.5169999999999999,"15min":1.617},"min":{"1min":0.33900000000000002,"5min":0.309,"15min":0.251},"max":{"1min":14.680999999999999,"5min":39.134,"15min":39.134},"last":0.41799999999999998},{"interface":"front","average":{"1min":3.2709999999999999,"5min":3.2789999999999999,"15min":2.0249999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":19.527000000000001,"5min":67.576999999999998,"15min":67.576999999999998},"last":0.42699999999999999}]},{"osd":7,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.7450000000000001,"5min":2.52,"15min":1.6259999999999999},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":17.402000000000001,"5min":17.402000000000001,"15min":17.402000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":2.5459999999999998,"5min":1.9119999999999999,"15min":1.4590000000000001},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.29899999999999999},"max":{"1min":14.436999999999999,"5min":14.436999999999999,"15min":17.251000000000001},"last":0.441}]}]},{"osd":1,"up_from":13,"seq":55834575166,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1188576,"kb_used_data":52632,"kb_used_omap":1,"kb_used_meta":1135934,"kb_avail":93183264,"statfs":{"total":96636764160,"available":95419662336,"internally_reserved":0,"allocated":53895168,"data_stored":78944601,"data_compressed":7659770,"data_compressed_allocated":11517952,"data_compressed_original":36741120,"omap_allocated":1594,"internal_metadata":1163196870},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.379,"15min":1.147},"min":{"1min":0.214,"5min":0.20300000000000001,"15min":0.186},"max":{"1min":8.6210000000000004,"5min":11.619999999999999,"15min":27.282},"last":0.34899999999999998},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.8440000000000001,"15min":1.1040000000000001},"min":{"1min":0.23699999999999999,"5min":0.217,"15min":0.186},"max":{"1min":10.148,"5min":17.922000000000001,"15min":17.922000000000001},"last":0.30299999999999999}]},{"osd":2,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.891,"15min":1.0760000000000001},"min":{"1min":0.21199999999999999,"5min":0.20999999999999999,"15min":0.183},"max":{"1min":16.600000000000001,"5min":17.658000000000001,"15min":17.658000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.3520000000000001,"15min":0.97299999999999998},"min":{"1min":0.29599999999999999,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":7.2709999999999999,"5min":18.058,"15min":18.058},"last":0.38600000000000001}]},{"osd":3,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":2.1960000000000002,"5min":1.712,"15min":1.2150000000000001},"min":{"1min":0.32400000000000001,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":15.871,"5min":18.024999999999999,"15min":18.024999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.577,"15min":1.323},"min":{"1min":0.32100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":7.4379999999999997,"5min":10.773,"15min":44.454999999999998},"last":0.40799999999999997}]},{"osd":4,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":2.7210000000000001,"15min":1.7749999999999999},"min":{"1min":0.311,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":9.4320000000000004,"5min":17.629000000000001,"15min":33.939999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":1.839,"5min":2.0680000000000001,"15min":1.744},"min":{"1min":0.378,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":9.5009999999999994,"5min":20.326000000000001,"15min":41.939},"last":0.47499999999999998}]},{"osd":5,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":3.0430000000000001,"5min":2.1030000000000002,"15min":1.5229999999999999},"min":{"1min":0.38100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":27.143000000000001,"5min":27.727,"15min":27.727},"last":0.51400000000000001},{"interface":"front","average":{"1min":1.343,"5min":2.5270000000000001,"15min":1.6479999999999999},"min":{"1min":0.35999999999999999,"5min":0.32300000000000001,"15min":0.318},"max":{"1min":9.3970000000000002,"5min":20.289999999999999,"15min":20.289999999999999},"last":0.59699999999999998}]},{"osd":6,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.8100000000000001,"5min":2.5030000000000001,"15min":1.7150000000000001},"min":{"1min":0.48899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":8.5879999999999992,"5min":33.189999999999998,"15min":33.189999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":3.5880000000000001,"5min":3.2570000000000001,"15min":2.0129999999999999},"min":{"1min":0.39500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":23.395,"5min":35.344000000000001,"15min":35.344000000000001},"last":0.627}]},{"osd":7,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":1.762,"15min":1.3620000000000001},"min":{"1min":0.41599999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":9.5440000000000005,"5min":17.890000000000001,"15min":17.890000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.492,"15min":1.726},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":15.553000000000001,"5min":21.039999999999999,"15min":21.039999999999999},"last":0.61099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575166,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":805416,"kb_used_data":34464,"kb_used_omap":1,"kb_used_meta":770942,"kb_avail":93566424,"statfs":{"total":96636764160,"available":95812018176,"internally_reserved":0,"allocated":35291136,"data_stored":54072257,"data_compressed":5457884,"data_compressed_allocated":7987200,"data_compressed_original":26951680,"omap_allocated":1593,"internal_metadata":789445063},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.6200000000000001,"15min":1.7170000000000001},"min":{"1min":0.20799999999999999,"5min":0.189,"15min":0.185},"max":{"1min":12.77,"5min":22.343,"15min":37.991999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.571,"15min":1.2490000000000001},"min":{"1min":0.23899999999999999,"5min":0.191,"15min":0.191},"max":{"1min":7.8449999999999998,"5min":20.382000000000001,"15min":21.954000000000001},"last":0.33600000000000002}]},{"osd":2,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":1.1759999999999999,"15min":1.101},"min":{"1min":0.27400000000000002,"5min":0.22600000000000001,"15min":0.20899999999999999},"max":{"1min":3.7400000000000002,"5min":17.687999999999999,"15min":19.789999999999999},"last":0.316},{"interface":"front","average":{"1min":0.63700000000000001,"5min":1.4510000000000001,"15min":1.1539999999999999},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.20899999999999999},"max":{"1min":3.2109999999999999,"5min":20.419,"15min":22.026},"last":0.39300000000000002}]},{"osd":3,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":2.0950000000000002,"15min":1.7},"min":{"1min":0.24099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":18.613,"5min":34.515000000000001,"15min":34.515000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":2.286,"15min":1.619},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.22600000000000001},"max":{"1min":7.6399999999999997,"5min":85.606999999999999,"15min":85.606999999999999},"last":0.35599999999999998}]},{"osd":4,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":2.5800000000000001,"15min":2.1059999999999999},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":14.317,"5min":42.345999999999997,"15min":66.331999999999994},"last":0.40999999999999998},{"interface":"front","average":{"1min":1.6719999999999999,"5min":2.7599999999999998,"15min":2.3010000000000002},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":12.81,"5min":59.832999999999998,"15min":59.832999999999998},"last":0.54300000000000004}]},{"osd":5,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.881,"15min":1.53},"min":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":12.012,"5min":14.026999999999999,"15min":21.981000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.74,"15min":1.538},"min":{"1min":0.33200000000000002,"5min":0.32400000000000001,"15min":0.30599999999999999},"max":{"1min":14.019,"5min":14.019,"15min":25.446999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":3.1000000000000001,"15min":2.0990000000000002},"min":{"1min":0.38300000000000001,"5min":0.33900000000000002,"15min":0.318},"max":{"1min":9.2370000000000001,"5min":82.542000000000002,"15min":82.542000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.131,"5min":2.0569999999999999,"15min":1.8859999999999999},"min":{"1min":0.373,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":6.4420000000000002,"5min":25.914999999999999,"15min":25.914999999999999},"last":0.58499999999999996}]},{"osd":7,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":2.242,"15min":1.974},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.34599999999999997},"max":{"1min":6.3460000000000001,"5min":26.669,"15min":26.669},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.569,"5min":1.732,"15min":1.7210000000000001},"min":{"1min":0.41599999999999998,"5min":0.38400000000000001,"15min":0.33100000000000002},"max":{"1min":13.964,"5min":13.964,"15min":20.146000000000001},"last":0.49099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575167,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":729616,"kb_used_data":40712,"kb_used_omap":1,"kb_used_meta":688894,"kb_avail":93642224,"statfs":{"total":96636764160,"available":95889637376,"internally_reserved":0,"allocated":41689088,"data_stored":58833997,"data_compressed":5586562,"data_compressed_allocated":8433664,"data_compressed_original":25743360,"omap_allocated":1594,"internal_metadata":705427910},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.849,"5min":1.4379999999999999,"15min":1.135},"min":{"1min":0.19800000000000001,"5min":0.186,"15min":0.16900000000000001},"max":{"1min":15.834,"5min":15.834,"15min":21.475999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1779999999999999,"15min":1.141},"min":{"1min":0.23100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":7.4950000000000001,"5min":14.374000000000001,"15min":30.434999999999999},"last":0.51900000000000002}]},{"osd":1,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":1.831,"15min":1.5369999999999999},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":15.907,"5min":24.190000000000001,"15min":25.550000000000001},"last":0.436},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.93799999999999994,"15min":1.032},"min":{"1min":0.215,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":2.8929999999999998,"5min":8.532,"15min":20.591000000000001},"last":0.62}]},{"osd":3,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":2.5569999999999999,"5min":2.0609999999999999,"15min":1.6839999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.21099999999999999},"max":{"1min":34.598999999999997,"5min":34.598999999999997,"15min":34.598999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":2.1989999999999998,"5min":2.2829999999999999,"15min":1.633},"min":{"1min":0.29899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":15.789999999999999,"5min":20.491,"15min":25.827000000000002},"last":0.48499999999999999}]},{"osd":4,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":2.4049999999999998,"15min":2.4500000000000002},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.312},"max":{"1min":15.936,"5min":27.963000000000001,"15min":67.506},"last":0.55800000000000005},{"interface":"front","average":{"1min":2.121,"5min":2.4369999999999998,"15min":2.573},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":7.5759999999999996,"5min":37.548999999999999,"15min":111.973},"last":0.64900000000000002}]},{"osd":5,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":2.1309999999999998,"5min":2.0510000000000002,"15min":1.573},"min":{"1min":0.33500000000000002,"5min":0.314,"15min":0.308},"max":{"1min":13.215999999999999,"5min":37.496000000000002,"15min":37.496000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":2.5379999999999998,"5min":2.2799999999999998,"15min":1.645},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32600000000000001},"max":{"1min":34.545000000000002,"5min":45.997999999999998,"15min":45.997999999999998},"last":0.502}]},{"osd":6,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":3.2850000000000001,"5min":2.9300000000000002,"15min":1.984},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":29.954999999999998,"5min":68.453000000000003,"15min":68.453000000000003},"last":0.629},{"interface":"front","average":{"1min":2.4860000000000002,"5min":2.859,"15min":1.927},"min":{"1min":0.40699999999999997,"5min":0.34899999999999998,"15min":0.33600000000000002},"max":{"1min":11.115,"5min":63.966000000000001,"15min":63.966000000000001},"last":0.60999999999999999}]},{"osd":7,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":2.0409999999999999,"15min":1.8720000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.0629999999999997,"5min":27.504000000000001,"15min":32.700000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":2.6520000000000001,"5min":2.2450000000000001,"15min":2.0259999999999998},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":29.881,"5min":29.881,"15min":32.840000000000003},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575165,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203324,"kb_used_data":59164,"kb_used_omap":1,"kb_used_meta":1144126,"kb_avail":93168516,"statfs":{"total":96636764160,"available":95404560384,"internally_reserved":0,"allocated":60583936,"data_stored":98619117,"data_compressed":9479234,"data_compressed_allocated":14163968,"data_compressed_original":52371456,"omap_allocated":1591,"internal_metadata":1171585481},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.5740000000000001,"15min":1.103},"min":{"1min":0.20899999999999999,"5min":0.192,"15min":0.184},"max":{"1min":7.7149999999999999,"5min":24.539999999999999,"15min":24.539999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":1.48,"5min":1.468,"15min":1.476},"min":{"1min":0.21099999999999999,"5min":0.20100000000000001,"15min":0.19900000000000001},"max":{"1min":8.7539999999999996,"5min":12.204000000000001,"15min":95.932000000000002},"last":0.40200000000000002}]},{"osd":1,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":2.048,"5min":3.0209999999999999,"15min":2.036},"min":{"1min":0.22600000000000001,"5min":0.193,"15min":0.193},"max":{"1min":18.105,"5min":44.308,"15min":44.308},"last":0.437},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.99,"15min":1.2889999999999999},"min":{"1min":0.28999999999999998,"5min":0.23100000000000001,"15min":0.22},"max":{"1min":14.875,"5min":38.054000000000002,"15min":38.054000000000002},"last":0.37}]},{"osd":2,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":2.2029999999999998,"5min":1.8839999999999999,"15min":1.522},"min":{"1min":0.26100000000000001,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":15.788,"5min":18.132000000000001,"15min":18.132000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.2769999999999999,"15min":1.1040000000000001},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.26700000000000002},"max":{"1min":4.0629999999999997,"5min":17.364000000000001,"15min":17.364000000000001},"last":0.33200000000000002}]},{"osd":4,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":2.0459999999999998,"15min":1.6439999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27100000000000002},"max":{"1min":8.6159999999999997,"5min":18.960000000000001,"15min":19.16},"last":0.56399999999999995},{"interface":"front","average":{"1min":2.379,"5min":2.351,"15min":2.0609999999999999},"min":{"1min":0.31900000000000001,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":15.739000000000001,"5min":20.808,"15min":27.515999999999998},"last":0.48599999999999999}]},{"osd":5,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.7250000000000001,"5min":2.3050000000000002,"15min":1.8979999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32100000000000001},"max":{"1min":8.7739999999999991,"5min":33.436999999999998,"15min":33.436999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":2.1139999999999999,"5min":2.048,"15min":1.5860000000000001},"min":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":13.818,"5min":17.329000000000001,"15min":17.329000000000001},"last":0.53600000000000003}]},{"osd":6,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":2.3500000000000001,"5min":2.3220000000000001,"15min":1.9850000000000001},"min":{"1min":0.38800000000000001,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":25.329000000000001,"5min":25.329000000000001,"15min":30.588000000000001},"last":0.497},{"interface":"front","average":{"1min":1.5189999999999999,"5min":2.0659999999999998,"15min":1.804},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.33900000000000002},"max":{"1min":8.5809999999999995,"5min":18.803000000000001,"15min":23.318999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.9630000000000001,"5min":1.8280000000000001,"15min":1.7929999999999999},"min":{"1min":0.40999999999999998,"5min":0.35699999999999998,"15min":0.34699999999999998},"max":{"1min":10.007999999999999,"5min":18.841999999999999,"15min":19.116},"last":0.47299999999999998},{"interface":"front","average":{"1min":3.129,"5min":2.5910000000000002,"15min":1.9770000000000001},"min":{"1min":0.42699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":19.504999999999999,"5min":33.505000000000003,"15min":33.505000000000003},"last":0.58099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575165,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":925908,"kb_used_data":24652,"kb_used_omap":1,"kb_used_meta":901246,"kb_avail":93445932,"statfs":{"total":96636764160,"available":95688634368,"internally_reserved":0,"allocated":25243648,"data_stored":41913547,"data_compressed":4200069,"data_compressed_allocated":6152192,"data_compressed_original":22999040,"omap_allocated":1594,"internal_metadata":922876358},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,0,1,0,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.355,"5min":2.613,"15min":1.677},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.20599999999999999},"max":{"1min":19.058,"5min":21.062999999999999,"15min":45.375},"last":0.76800000000000002},{"interface":"front","average":{"1min":2.375,"5min":2.206,"15min":1.704},"min":{"1min":0.27500000000000002,"5min":0.23100000000000001,"15min":0.188},"max":{"1min":8.9550000000000001,"5min":19.850999999999999,"15min":35.765000000000001},"last":0.48699999999999999}]},{"osd":1,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.617,"5min":2.9140000000000001,"15min":2.0609999999999999},"min":{"1min":0.26300000000000001,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":22.718,"5min":22.718,"15min":29.928000000000001},"last":3.891},{"interface":"front","average":{"1min":3.3170000000000002,"5min":2.8740000000000001,"15min":1.714},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":19.032,"5min":21.103000000000002,"15min":23.634},"last":0.69999999999999996}]},{"osd":2,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.2349999999999999,"5min":2.8679999999999999,"15min":1.786},"min":{"1min":0.32400000000000001,"5min":0.28599999999999998,"15min":0.27600000000000002},"max":{"1min":22.774000000000001,"5min":30.512,"15min":30.512},"last":3.9409999999999998},{"interface":"front","average":{"1min":5.0419999999999998,"5min":4.0350000000000001,"15min":2.109},"min":{"1min":0.29499999999999998,"5min":0.27400000000000002,"15min":0.26300000000000001},"max":{"1min":26.567,"5min":82.847999999999999,"15min":82.847999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":2.1880000000000002,"5min":2.2400000000000002,"15min":1.5960000000000001},"min":{"1min":0.32600000000000001,"5min":0.26600000000000001,"15min":0.23899999999999999},"max":{"1min":8.452,"5min":15.500999999999999,"15min":22.555},"last":0.46600000000000003},{"interface":"front","average":{"1min":3.1230000000000002,"5min":3.1400000000000001,"15min":1.9710000000000001},"min":{"1min":0.37,"5min":0.313,"15min":0.308},"max":{"1min":22.66,"5min":26.259,"15min":26.259},"last":3.9239999999999999}]},{"osd":5,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":4.4569999999999999,"5min":4.1269999999999998,"15min":2.073},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.24399999999999999},"max":{"1min":26.484999999999999,"5min":82.918999999999997,"15min":82.918999999999997},"last":2.2130000000000001},{"interface":"front","average":{"1min":2.4569999999999999,"5min":2.7490000000000001,"15min":1.8320000000000001},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.249},"max":{"1min":18.288,"5min":25.120000000000001,"15min":25.120000000000001},"last":0.92000000000000004}]},{"osd":6,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":2.573,"5min":2.552,"15min":1.671},"min":{"1min":0.313,"5min":0.313,"15min":0.252},"max":{"1min":18.141999999999999,"5min":18.141999999999999,"15min":20.562999999999999},"last":3.9700000000000002},{"interface":"front","average":{"1min":3.8940000000000001,"5min":3.8290000000000002,"15min":2.2440000000000002},"min":{"1min":0.36199999999999999,"5min":0.30499999999999999,"15min":0.29499999999999998},"max":{"1min":21.478000000000002,"5min":83.643000000000001,"15min":83.643000000000001},"last":1.5009999999999999}]},{"osd":7,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.1389999999999998,"5min":2.3490000000000002,"15min":1.748},"min":{"1min":0.373,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":19.021999999999998,"5min":19.021999999999998,"15min":25.878},"last":0.435},{"interface":"front","average":{"1min":2.9780000000000002,"5min":2.4380000000000002,"15min":1.7609999999999999},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.27800000000000002},"max":{"1min":22.75,"5min":22.75,"15min":22.75},"last":3.9550000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575165,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":957288,"kb_used_data":33824,"kb_used_omap":1,"kb_used_meta":923454,"kb_avail":93414552,"statfs":{"total":96636764160,"available":95656501248,"internally_reserved":0,"allocated":34635776,"data_stored":53144743,"data_compressed":4503779,"data_compressed_allocated":6955008,"data_compressed_original":25632768,"omap_allocated":1594,"internal_metadata":945617350},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.911,"15min":1.306},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":6.2060000000000004,"5min":19.097999999999999,"15min":19.097999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.609,"5min":2.157,"15min":1.508},"min":{"1min":0.28599999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":14.662000000000001,"5min":21.416,"15min":21.416},"last":0.92200000000000004}]},{"osd":1,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":2.0070000000000001,"15min":1.6040000000000001},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":3.4750000000000001,"5min":16.515000000000001,"15min":19.581},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.153,"5min":1.611,"15min":1.28},"min":{"1min":0.27100000000000002,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":8.4629999999999992,"5min":16.492999999999999,"15min":16.492999999999999},"last":0.83999999999999997}]},{"osd":2,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.679,"15min":1.409},"min":{"1min":0.30599999999999999,"5min":0.27300000000000002,"15min":0.25700000000000001},"max":{"1min":5.7770000000000001,"5min":21.186,"15min":21.186},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.6859999999999999,"15min":1.2609999999999999},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.25700000000000001},"max":{"1min":6.1289999999999996,"5min":22.353999999999999,"15min":22.353999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":2.0169999999999999,"15min":1.595},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.28199999999999997},"max":{"1min":14.736000000000001,"5min":16.324999999999999,"15min":17.103999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.5940000000000001,"5min":2.1800000000000002,"15min":1.6819999999999999},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.29899999999999999},"max":{"1min":15.821999999999999,"5min":18.798999999999999,"15min":23.224},"last":0.81399999999999995}]},{"osd":4,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":2.2869999999999999,"5min":2.206,"15min":1.5},"min":{"1min":0.27600000000000002,"5min":0.25,"15min":0.20799999999999999},"max":{"1min":17.914000000000001,"5min":22.300000000000001,"15min":28.724},"last":0.67100000000000004},{"interface":"front","average":{"1min":2.0960000000000001,"5min":2.4940000000000002,"15min":1.5980000000000001},"min":{"1min":0.371,"5min":0.28100000000000003,"15min":0.22800000000000001},"max":{"1min":22.385999999999999,"5min":25.466999999999999,"15min":25.466999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":2.1000000000000001,"15min":1.5129999999999999},"min":{"1min":0.29699999999999999,"5min":0.28699999999999998,"15min":0.23899999999999999},"max":{"1min":9.3539999999999992,"5min":21.294,"15min":21.294},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.1579999999999999,"5min":2.3690000000000002,"15min":1.4590000000000001},"min":{"1min":0.39700000000000002,"5min":0.34300000000000003,"15min":0.24199999999999999},"max":{"1min":6.1820000000000004,"5min":23.731000000000002,"15min":23.731000000000002},"last":0.63700000000000001}]},{"osd":7,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.724,"5min":2.0630000000000002,"15min":1.4370000000000001},"min":{"1min":0.436,"5min":0.29799999999999999,"15min":0.28100000000000003},"max":{"1min":14.711,"5min":21.462,"15min":30.076000000000001},"last":0.753},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.796,"15min":1.29},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.26100000000000001},"max":{"1min":5.7460000000000004,"5min":21.257000000000001,"15min":21.257000000000001},"last":0.65400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34947072,"data_stored":53368148,"data_compressed":5425493,"data_compressed_allocated":7942144,"data_compressed_original":26378240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53616640,"data_stored":78830860,"data_compressed":7659770,"data_compressed_allocated":11517952,"data_compressed_original":36741120,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41410560,"data_stored":58720256,"data_compressed":5586562,"data_compressed_allocated":8433664,"data_compressed_original":25743360,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58433536,"data_stored":88081056,"data_compressed":8987385,"data_compressed_allocated":13205504,"data_compressed_original":42860544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24395776,"data_stored":37748862,"data_compressed":4009381,"data_compressed_allocated":5820416,"data_compressed_original":19185664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33177600,"data_stored":46137434,"data_compressed":4179228,"data_compressed_allocated":6336512,"data_compressed_original":19300352,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50114560,"data_stored":74637068,"data_compressed":7372511,"data_compressed_allocated":10829824,"data_compressed_original":35360768,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36921344,"data_stored":57562396,"data_compressed":5863036,"data_compressed_allocated":8429568,"data_compressed_original":29077504,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1650688,"data_stored":9261056,"data_compressed":436862,"data_compressed_allocated":847872,"data_compressed_original":8458240,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":520192,"data_stored":3788800,"data_compressed":178298,"data_compressed_allocated":307200,"data_compressed_original":3575808,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1073152,"data_stored":6340608,"data_compressed":298410,"data_compressed_allocated":565248,"data_compressed_original":5832704,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":4640768,"data_compressed":218382,"data_compressed_allocated":389120,"data_compressed_original":4349952,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T19:48:42.286 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.286 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.286 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.286 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.286 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.286 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.286 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.286 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.287 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.287 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.287 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.287 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.287 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.287 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.287 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.287 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.287 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.287 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.288 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.288 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.288 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.288 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.288 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.288 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.288 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.288 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.288 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.289 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.289 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.289 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.289 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.289 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.289 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.289 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.289 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.289 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.290 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.290 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.290 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.290 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.290 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.290 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.290 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.290 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.291 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.291 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.291 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.291 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.291 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.291 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.291 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.291 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.291 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.291 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.292 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.292 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.292 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.292 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.292 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.292 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.292 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.292 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.293 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.293 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.293 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.293 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.293 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.293 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.293 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.293 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.293 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.294 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.294 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.294 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.294 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.294 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.294 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.294 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.294 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.294 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.294 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.295 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T19:22:15.924359+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.295 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.295 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.295 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.295 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.295 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.295 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.295 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.296 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.296 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.296 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.296 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.296 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.296 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.296 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.296 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.297 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.297 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.297 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.297 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.297 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.297 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.297 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.297 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.297 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.297 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.298 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.298 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.298 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.298 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.298 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.298 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.298 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.298 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.299 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.299 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.299 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.299 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.299 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.299 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.299 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.299 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.299 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.300 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.300 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.300 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.300 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:48:42.300 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T19:49:02.301 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T19:49:02.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.451+0000 7f61fab86700 1 Processor -- start 2024-05-08T19:49:02.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.451+0000 7f61fab86700 1 -- start start 2024-05-08T19:49:02.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.452+0000 7f61fab86700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61f41521c0 0x7f61f40720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:02.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.452+0000 7f61fab86700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f61f4071710 0x7f61f4154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:02.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.452+0000 7f61fab86700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f40c0be0 con 0x7f61f40725e0 2024-05-08T19:49:02.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.452+0000 7f61fab86700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f406b470 con 0x7f61f4071710 2024-05-08T19:49:02.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.452+0000 7f61fab86700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40c1250 con 0x7f61f41521c0 2024-05-08T19:49:02.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.452+0000 7f61f9123700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f61f40725e0 0x7f61f41551f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:36886/0 (socket says 172.21.15.47:36886) 2024-05-08T19:49:02.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.452+0000 7f61f9123700 1 -- 172.21.15.47:0/4177593536 learned_addr learned my addr 172.21.15.47:0/4177593536 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:49:02.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.452+0000 7f61f3fff700 1 --2- 172.21.15.47:0/4177593536 >> v2:172.21.15.177:3300/0 conn(0x7f61f4071710 0x7f61f4154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:02.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.452+0000 7f61f8922700 1 --2- 172.21.15.47:0/4177593536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61f41521c0 0x7f61f40720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.452+0000 7f61f37fe700 1 -- 172.21.15.47:0/4177593536 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729409489 0 0) 0x7f61f40c0be0 con 0x7f61f40725e0 2024-05-08T19:49:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.452+0000 7f61f37fe700 1 -- 172.21.15.47:0/4177593536 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e40035b0 con 0x7f61f40725e0 2024-05-08T19:49:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f37fe700 1 -- 172.21.15.47:0/4177593536 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2045936694 0 0) 0x7f61e40035b0 con 0x7f61f40725e0 2024-05-08T19:49:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f37fe700 1 -- 172.21.15.47:0/4177593536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61f41521c0 msgr2=0x7f61f40720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:49:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f37fe700 1 --2- 172.21.15.47:0/4177593536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61f41521c0 0x7f61f40720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f37fe700 1 -- 172.21.15.47:0/4177593536 >> v2:172.21.15.177:3300/0 conn(0x7f61f4071710 msgr2=0x7f61f4154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:49:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f37fe700 1 --2- 172.21.15.47:0/4177593536 >> v2:172.21.15.177:3300/0 conn(0x7f61f4071710 0x7f61f4154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f37fe700 1 -- 172.21.15.47:0/4177593536 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f406b710 con 0x7f61f40725e0 2024-05-08T19:49:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f37fe700 1 -- 172.21.15.47:0/4177593536 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f61ec0019f0 con 0x7f61f40725e0 2024-05-08T19:49:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f8922700 1 --2- 172.21.15.47:0/4177593536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61f41521c0 0x7f61f40720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:49:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f37fe700 1 -- 172.21.15.47:0/4177593536 >> v1:172.21.15.47:6789/0 conn(0x7f61f40725e0 legacy=0x7f61f41551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f37fe700 1 --2- 172.21.15.47:0/4177593536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61e4003a00 0x7f61e4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f37fe700 1 --2- 172.21.15.47:0/4177593536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61f41521c0 0x7f61e4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:02.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f37fe700 1 --2- 172.21.15.47:0/4177593536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61e4004d90 0x7f61e4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:02.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f37fe700 1 -- 172.21.15.47:0/4177593536 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f406b470 con 0x7f61e4003a00 2024-05-08T19:49:02.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f37fe700 1 -- 172.21.15.47:0/4177593536 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40c1250 con 0x7f61e4004d90 2024-05-08T19:49:02.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f37fe700 1 -- 172.21.15.47:0/4177593536 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e400ba10 con 0x7f61f41521c0 2024-05-08T19:49:02.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f3fff700 1 --2- 172.21.15.47:0/4177593536 >> v2:172.21.15.177:3300/0 conn(0x7f61f4071710 0x7f61f4154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:49:02.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f8922700 1 --2- 172.21.15.47:0/4177593536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61e4003a00 0x7f61e4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:02.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f9123700 1 --2- 172.21.15.47:0/4177593536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61e4004d90 0x7f61e4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:02.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f3fff700 1 --2- 172.21.15.47:0/4177593536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61f41521c0 0x7f61e4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:02.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f8922700 1 -- 172.21.15.47:0/4177593536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61f41521c0 msgr2=0x7f61e4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:49:02.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f8922700 1 --2- 172.21.15.47:0/4177593536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61f41521c0 0x7f61e4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:02.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f8922700 1 -- 172.21.15.47:0/4177593536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61e4004d90 msgr2=0x7f61e4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:49:02.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f8922700 1 --2- 172.21.15.47:0/4177593536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61e4004d90 0x7f61e4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:02.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f8922700 1 -- 172.21.15.47:0/4177593536 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e80094a0 con 0x7f61e4003a00 2024-05-08T19:49:02.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f3fff700 1 --2- 172.21.15.47:0/4177593536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61f41521c0 0x7f61e4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:49:02.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.453+0000 7f61f8922700 1 --2- 172.21.15.47:0/4177593536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61e4003a00 0x7f61e4003e20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009d30 tx=0x7f61e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875a2c71c4d143b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:49:02.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.454+0000 7f61f37fe700 1 -- 172.21.15.47:0/4177593536 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8009e80 con 0x7f61e4003a00 2024-05-08T19:49:02.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.454+0000 7f61f37fe700 1 -- 172.21.15.47:0/4177593536 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e800e940 con 0x7f61e4003a00 2024-05-08T19:49:02.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.454+0000 7f61f37fe700 1 -- 172.21.15.47:0/4177593536 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e800ecb0 con 0x7f61e4003a00 2024-05-08T19:49:02.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.454+0000 7f61fab86700 1 -- 172.21.15.47:0/4177593536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61e4003a00 msgr2=0x7f61e4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:02.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.454+0000 7f61fab86700 1 --2- 172.21.15.47:0/4177593536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61e4003a00 0x7f61e4003e20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009d30 tx=0x7f61e4005880 comp rx=0 tx=0).stop 2024-05-08T19:49:02.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.454+0000 7f61f9123700 1 -- 172.21.15.47:0/4177593536 reap_dead start 2024-05-08T19:49:02.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.454+0000 7f61fab86700 1 -- 172.21.15.47:0/4177593536 shutdown_connections 2024-05-08T19:49:02.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.454+0000 7f61fab86700 1 -- 172.21.15.47:0/4177593536 >> 172.21.15.47:0/4177593536 conn(0x7f61f40c7120 msgr2=0x7f61f40c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:49:02.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.454+0000 7f61fab86700 1 -- 172.21.15.47:0/4177593536 shutdown_connections 2024-05-08T19:49:02.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.454+0000 7f61fab86700 1 -- 172.21.15.47:0/4177593536 wait complete. 2024-05-08T19:49:02.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.455+0000 7f61fab86700 1 Processor -- start 2024-05-08T19:49:02.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.455+0000 7f61fab86700 1 -- start start 2024-05-08T19:49:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.456+0000 7f61fab86700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61e4003a00 0x7f61f41ebde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.456+0000 7f61fab86700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61f41ea970 0x7f61f40aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.456+0000 7f61fab86700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f40ab3c0 0x7f61f41508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.456+0000 7f61fab86700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40a9b90 con 0x7f61f41ea970 2024-05-08T19:49:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.456+0000 7f61fab86700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40a9de0 con 0x7f61f40ab3c0 2024-05-08T19:49:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.456+0000 7f61fab86700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40aa0c0 con 0x7f61e4003a00 2024-05-08T19:49:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.456+0000 7f61f3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61f41ea970 0x7f61f40aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.456+0000 7f61f3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61f41ea970 0x7f61f40aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52898/0 (socket says 172.21.15.47:52898) 2024-05-08T19:49:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.456+0000 7f61f3fff700 1 -- 172.21.15.47:0/1555477318 learned_addr learned my addr 172.21.15.47:0/1555477318 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:49:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.457+0000 7f61f8922700 1 --2- 172.21.15.47:0/1555477318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61e4003a00 0x7f61f41ebde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.457+0000 7f61f9123700 1 --2- 172.21.15.47:0/1555477318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f40ab3c0 0x7f61f41508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.457+0000 7f61f3fff700 1 -- 172.21.15.47:0/1555477318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61e4003a00 msgr2=0x7f61f41ebde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:02.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.457+0000 7f61f3fff700 1 --2- 172.21.15.47:0/1555477318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61e4003a00 0x7f61f41ebde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:02.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.457+0000 7f61f3fff700 1 -- 172.21.15.47:0/1555477318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f40ab3c0 msgr2=0x7f61f41508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:02.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.457+0000 7f61f3fff700 1 --2- 172.21.15.47:0/1555477318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f40ab3c0 0x7f61f41508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:02.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.457+0000 7f61f3fff700 1 -- 172.21.15.47:0/1555477318 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f40aa3a0 con 0x7f61f41ea970 2024-05-08T19:49:02.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.457+0000 7f61f3fff700 1 --2- 172.21.15.47:0/1555477318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61f41ea970 0x7f61f40aae80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f61e0011880 tx=0x7f61e0011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:49:02.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.457+0000 7f61f17fa700 1 -- 172.21.15.47:0/1555477318 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000fae0 con 0x7f61f41ea970 2024-05-08T19:49:02.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.457+0000 7f61f17fa700 1 -- 172.21.15.47:0/1555477318 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e000fc40 con 0x7f61f41ea970 2024-05-08T19:49:02.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.457+0000 7f61fab86700 1 -- 172.21.15.47:0/1555477318 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f40aa680 con 0x7f61f41ea970 2024-05-08T19:49:02.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.457+0000 7f61f17fa700 1 -- 172.21.15.47:0/1555477318 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0011e80 con 0x7f61f41ea970 2024-05-08T19:49:02.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.457+0000 7f61fab86700 1 -- 172.21.15.47:0/1555477318 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f40ac130 con 0x7f61f41ea970 2024-05-08T19:49:02.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.458+0000 7f61fab86700 1 -- 172.21.15.47:0/1555477318 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f40aacd0 con 0x7f61f41ea970 2024-05-08T19:49:02.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.458+0000 7f61f17fa700 1 -- 172.21.15.47:0/1555477318 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f61e0015460 con 0x7f61f41ea970 2024-05-08T19:49:02.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.459+0000 7f61f17fa700 1 --2- 172.21.15.47:0/1555477318 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f61d806ac90 0x7f61d806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:02.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.459+0000 7f61f17fa700 1 -- 172.21.15.47:0/1555477318 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f61e0089f50 con 0x7f61f41ea970 2024-05-08T19:49:02.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.459+0000 7f61f8922700 1 --2- 172.21.15.47:0/1555477318 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f61d806ac90 0x7f61d806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:02.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.460+0000 7f61f8922700 1 --2- 172.21.15.47:0/1555477318 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f61d806ac90 0x7f61d806d150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f61e8000c00 tx=0x7f61e8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:49:02.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.464+0000 7f61f17fa700 1 -- 172.21.15.47:0/1555477318 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f61e0054e00 con 0x7f61f41ea970 2024-05-08T19:49:02.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.666+0000 7f61fab86700 1 -- 172.21.15.47:0/1555477318 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61f4155900 con 0x7f61d806ac90 2024-05-08T19:49:02.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.676+0000 7f61f17fa700 1 -- 172.21.15.47:0/1555477318 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369607 (secure 0 0 0) 0x7f61e8006a50 con 0x7f61d806ac90 2024-05-08T19:49:02.674 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:49:02.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.680+0000 7f61fab86700 1 -- 172.21.15.47:0/1555477318 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f61d806ac90 msgr2=0x7f61d806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:02.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.680+0000 7f61fab86700 1 --2- 172.21.15.47:0/1555477318 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f61d806ac90 0x7f61d806d150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f61e8000c00 tx=0x7f61e8008030 comp rx=0 tx=0).stop 2024-05-08T19:49:02.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.680+0000 7f61fab86700 1 -- 172.21.15.47:0/1555477318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61f41ea970 msgr2=0x7f61f40aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:02.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.680+0000 7f61fab86700 1 --2- 172.21.15.47:0/1555477318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61f41ea970 0x7f61f40aae80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f61e0011880 tx=0x7f61e0011c40 comp rx=0 tx=0).stop 2024-05-08T19:49:02.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.681+0000 7f61fab86700 1 -- 172.21.15.47:0/1555477318 shutdown_connections 2024-05-08T19:49:02.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.681+0000 7f61fab86700 1 --2- 172.21.15.47:0/1555477318 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f61d806ac90 0x7f61d806d150 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:02.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.681+0000 7f61fab86700 1 --2- 172.21.15.47:0/1555477318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f40ab3c0 0x7f61f41508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:02.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.681+0000 7f61fab86700 1 --2- 172.21.15.47:0/1555477318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61e4003a00 0x7f61f41ebde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:02.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.681+0000 7f61fab86700 1 --2- 172.21.15.47:0/1555477318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61f41ea970 0x7f61f40aae80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:02.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.681+0000 7f61fab86700 1 -- 172.21.15.47:0/1555477318 >> 172.21.15.47:0/1555477318 conn(0x7f61f40c7120 msgr2=0x7f61f414e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:49:02.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.681+0000 7f61fab86700 1 -- 172.21.15.47:0/1555477318 shutdown_connections 2024-05-08T19:49:02.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:02.681+0000 7f61fab86700 1 -- 172.21.15.47:0/1555477318 wait complete. 2024-05-08T19:49:02.679 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-08T19:49:02.683 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":823,"stamp":"2024-05-08T19:49:02.608652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":241843090,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":21643,"num_read_kb":1158813,"num_write":409439,"num_write_kb":31681879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":879928,"num_omap_keys":1340,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575409,"ondisk_log_size":575409,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7788680,"kb_used_data":318536,"kb_used_omap":12,"kb_used_meta":7470067,"kb_avail":747186040,"statfs":{"total":773094113280,"available":765118504960,"internally_reserved":0,"allocated":326180864,"data_stored":484596108,"data_compressed":48004430,"data_compressed_allocated":70860800,"data_compressed_original":230662144,"omap_allocated":12741,"internal_metadata":7649349179},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":337344,"num_omap_keys":513,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003355"},"pg_stats":[{"pgid":"3.3f","version":"26'2251","reported_seq":2280,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.354731+0000","last_change":"2024-05-08T19:22:20.461758+0000","last_active":"2024-05-08T19:48:36.354731+0000","last_peered":"2024-05-08T19:48:36.354731+0000","last_clean":"2024-05-08T19:48:36.354731+0000","last_became_active":"2024-05-08T19:22:20.461515+0000","last_became_peered":"2024-05-08T19:22:20.461515+0000","last_unstale":"2024-05-08T19:48:36.354731+0000","last_undegraded":"2024-05-08T19:48:36.354731+0000","last_fullsized":"2024-05-08T19:48:36.354731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2251,"log_dups_size":0,"ondisk_log_size":2251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'2273","reported_seq":2302,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.647941+0000","last_change":"2024-05-08T19:22:20.434929+0000","last_active":"2024-05-08T19:48:36.647941+0000","last_peered":"2024-05-08T19:48:36.647941+0000","last_clean":"2024-05-08T19:48:36.647941+0000","last_became_active":"2024-05-08T19:22:20.434629+0000","last_became_peered":"2024-05-08T19:22:20.434629+0000","last_unstale":"2024-05-08T19:48:36.647941+0000","last_undegraded":"2024-05-08T19:48:36.647941+0000","last_fullsized":"2024-05-08T19:48:36.647941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2273,"log_dups_size":0,"ondisk_log_size":2273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"26'2375","reported_seq":2404,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.531030+0000","last_change":"2024-05-08T19:22:20.449450+0000","last_active":"2024-05-08T19:48:36.531030+0000","last_peered":"2024-05-08T19:48:36.531030+0000","last_clean":"2024-05-08T19:48:36.531030+0000","last_became_active":"2024-05-08T19:22:20.449184+0000","last_became_peered":"2024-05-08T19:22:20.449184+0000","last_unstale":"2024-05-08T19:48:36.531030+0000","last_undegraded":"2024-05-08T19:48:36.531030+0000","last_fullsized":"2024-05-08T19:48:36.531030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2375,"log_dups_size":0,"ondisk_log_size":2375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"26'2359","reported_seq":2389,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.650919+0000","last_change":"2024-05-08T19:22:20.449919+0000","last_active":"2024-05-08T19:48:36.650919+0000","last_peered":"2024-05-08T19:48:36.650919+0000","last_clean":"2024-05-08T19:48:36.650919+0000","last_became_active":"2024-05-08T19:22:20.449637+0000","last_became_peered":"2024-05-08T19:22:20.449637+0000","last_unstale":"2024-05-08T19:48:36.650919+0000","last_undegraded":"2024-05-08T19:48:36.650919+0000","last_fullsized":"2024-05-08T19:48:36.650919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2359,"log_dups_size":0,"ondisk_log_size":2359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'2307","reported_seq":2334,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.644813+0000","last_change":"2024-05-08T19:22:20.449676+0000","last_active":"2024-05-08T19:48:36.644813+0000","last_peered":"2024-05-08T19:48:36.644813+0000","last_clean":"2024-05-08T19:48:36.644813+0000","last_became_active":"2024-05-08T19:22:20.449347+0000","last_became_peered":"2024-05-08T19:22:20.449347+0000","last_unstale":"2024-05-08T19:48:36.644813+0000","last_undegraded":"2024-05-08T19:48:36.644813+0000","last_fullsized":"2024-05-08T19:48:36.644813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2307,"log_dups_size":0,"ondisk_log_size":2307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'2223","reported_seq":2255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:58.858078+0000","last_change":"2024-05-08T19:48:58.858191+0000","last_active":"2024-05-08T19:48:58.858078+0000","last_peered":"2024-05-08T19:48:58.858078+0000","last_clean":"2024-05-08T19:48:58.858078+0000","last_became_active":"2024-05-08T19:23:11.052928+0000","last_became_peered":"2024-05-08T19:23:11.052928+0000","last_unstale":"2024-05-08T19:48:58.858078+0000","last_undegraded":"2024-05-08T19:48:58.858078+0000","last_fullsized":"2024-05-08T19:48:58.858078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2223","last_scrub_stamp":"2024-05-08T19:48:58.858050+0000","last_deep_scrub":"26'2223","last_deep_scrub_stamp":"2024-05-08T19:48:58.858050+0000","last_clean_scrub_stamp":"2024-05-08T19:48:58.858050+0000","objects_scrubbed":0,"log_size":2223,"log_dups_size":0,"ondisk_log_size":2223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:59.957413+0000","scrub_duration":0.001763433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"26'2288","reported_seq":2315,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.320165+0000","last_change":"2024-05-08T19:22:20.446830+0000","last_active":"2024-05-08T19:48:36.320165+0000","last_peered":"2024-05-08T19:48:36.320165+0000","last_clean":"2024-05-08T19:48:36.320165+0000","last_became_active":"2024-05-08T19:22:20.446520+0000","last_became_peered":"2024-05-08T19:22:20.446520+0000","last_unstale":"2024-05-08T19:48:36.320165+0000","last_undegraded":"2024-05-08T19:48:36.320165+0000","last_fullsized":"2024-05-08T19:48:36.320165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2288,"log_dups_size":0,"ondisk_log_size":2288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'2289","reported_seq":2316,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.615952+0000","last_change":"2024-05-08T19:22:20.447313+0000","last_active":"2024-05-08T19:48:36.615952+0000","last_peered":"2024-05-08T19:48:36.615952+0000","last_clean":"2024-05-08T19:48:36.615952+0000","last_became_active":"2024-05-08T19:22:20.447031+0000","last_became_peered":"2024-05-08T19:22:20.447031+0000","last_unstale":"2024-05-08T19:48:36.615952+0000","last_undegraded":"2024-05-08T19:48:36.615952+0000","last_fullsized":"2024-05-08T19:48:36.615952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2289,"log_dups_size":0,"ondisk_log_size":2289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"26'2353","reported_seq":2380,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.549852+0000","last_change":"2024-05-08T19:22:20.447186+0000","last_active":"2024-05-08T19:48:36.549852+0000","last_peered":"2024-05-08T19:48:36.549852+0000","last_clean":"2024-05-08T19:48:36.549852+0000","last_became_active":"2024-05-08T19:22:20.446803+0000","last_became_peered":"2024-05-08T19:22:20.446803+0000","last_unstale":"2024-05-08T19:48:36.549852+0000","last_undegraded":"2024-05-08T19:48:36.549852+0000","last_fullsized":"2024-05-08T19:48:36.549852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2353,"log_dups_size":0,"ondisk_log_size":2353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'2369","reported_seq":2396,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.554046+0000","last_change":"2024-05-08T19:22:20.462899+0000","last_active":"2024-05-08T19:48:36.554046+0000","last_peered":"2024-05-08T19:48:36.554046+0000","last_clean":"2024-05-08T19:48:36.554046+0000","last_became_active":"2024-05-08T19:22:20.461395+0000","last_became_peered":"2024-05-08T19:22:20.461395+0000","last_unstale":"2024-05-08T19:48:36.554046+0000","last_undegraded":"2024-05-08T19:48:36.554046+0000","last_fullsized":"2024-05-08T19:48:36.554046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"26'2237","reported_seq":2265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.361338+0000","last_change":"2024-05-08T19:22:20.459545+0000","last_active":"2024-05-08T19:48:41.361338+0000","last_peered":"2024-05-08T19:48:41.361338+0000","last_clean":"2024-05-08T19:48:41.361338+0000","last_became_active":"2024-05-08T19:22:20.459253+0000","last_became_peered":"2024-05-08T19:22:20.459253+0000","last_unstale":"2024-05-08T19:48:41.361338+0000","last_undegraded":"2024-05-08T19:48:41.361338+0000","last_fullsized":"2024-05-08T19:48:41.361338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"26'2223","reported_seq":2262,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:53.275993+0000","last_change":"2024-05-08T19:48:53.275993+0000","last_active":"2024-05-08T19:48:53.275993+0000","last_peered":"2024-05-08T19:48:53.275993+0000","last_clean":"2024-05-08T19:48:53.275993+0000","last_became_active":"2024-05-08T19:22:20.461852+0000","last_became_peered":"2024-05-08T19:22:20.461852+0000","last_unstale":"2024-05-08T19:48:53.275993+0000","last_undegraded":"2024-05-08T19:48:53.275993+0000","last_fullsized":"2024-05-08T19:48:53.275993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2223","last_scrub_stamp":"2024-05-08T19:48:53.275860+0000","last_deep_scrub":"26'2223","last_deep_scrub_stamp":"2024-05-08T19:48:53.275860+0000","last_clean_scrub_stamp":"2024-05-08T19:48:53.275860+0000","objects_scrubbed":0,"log_size":2223,"log_dups_size":0,"ondisk_log_size":2223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:11.565803+0000","scrub_duration":0.0016971060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"26'2273","reported_seq":2312,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.733749+0000","last_change":"2024-05-08T19:48:49.733749+0000","last_active":"2024-05-08T19:48:49.733749+0000","last_peered":"2024-05-08T19:48:49.733749+0000","last_clean":"2024-05-08T19:48:49.733749+0000","last_became_active":"2024-05-08T19:22:20.452884+0000","last_became_peered":"2024-05-08T19:22:20.452884+0000","last_unstale":"2024-05-08T19:48:49.733749+0000","last_undegraded":"2024-05-08T19:48:49.733749+0000","last_fullsized":"2024-05-08T19:48:49.733749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2273","last_scrub_stamp":"2024-05-08T19:48:49.733627+0000","last_deep_scrub":"26'2273","last_deep_scrub_stamp":"2024-05-08T19:48:49.733627+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.733627+0000","objects_scrubbed":0,"log_size":2273,"log_dups_size":0,"ondisk_log_size":2273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:35.123448+0000","scrub_duration":0.011898308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"26'2298","reported_seq":2337,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.685749+0000","last_change":"2024-05-08T19:48:54.685845+0000","last_active":"2024-05-08T19:48:54.685749+0000","last_peered":"2024-05-08T19:48:54.685749+0000","last_clean":"2024-05-08T19:48:54.685749+0000","last_became_active":"2024-05-08T19:22:20.435456+0000","last_became_peered":"2024-05-08T19:22:20.435456+0000","last_unstale":"2024-05-08T19:48:54.685749+0000","last_undegraded":"2024-05-08T19:48:54.685749+0000","last_fullsized":"2024-05-08T19:48:54.685749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2298","last_scrub_stamp":"2024-05-08T19:48:54.685720+0000","last_deep_scrub":"26'2298","last_deep_scrub_stamp":"2024-05-08T19:48:54.685720+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.685720+0000","objects_scrubbed":0,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:55.785082+0000","scrub_duration":0.0058416680000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"26'2373","reported_seq":2412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.575902+0000","last_change":"2024-05-08T19:48:40.575994+0000","last_active":"2024-05-08T19:48:40.575902+0000","last_peered":"2024-05-08T19:48:40.575902+0000","last_clean":"2024-05-08T19:48:40.575902+0000","last_became_active":"2024-05-08T19:22:20.444369+0000","last_became_peered":"2024-05-08T19:22:20.444369+0000","last_unstale":"2024-05-08T19:48:40.575902+0000","last_undegraded":"2024-05-08T19:48:40.575902+0000","last_fullsized":"2024-05-08T19:48:40.575902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2373","last_scrub_stamp":"2024-05-08T19:48:40.575879+0000","last_deep_scrub":"26'2373","last_deep_scrub_stamp":"2024-05-08T19:48:40.575879+0000","last_clean_scrub_stamp":"2024-05-08T19:48:40.575879+0000","objects_scrubbed":0,"log_size":2373,"log_dups_size":0,"ondisk_log_size":2373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:57.404103+0000","scrub_duration":0.0065170310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'2274","reported_seq":2302,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.976700+0000","last_change":"2024-05-08T19:22:20.445391+0000","last_active":"2024-05-08T19:48:35.976700+0000","last_peered":"2024-05-08T19:48:35.976700+0000","last_clean":"2024-05-08T19:48:35.976700+0000","last_became_active":"2024-05-08T19:22:20.444996+0000","last_became_peered":"2024-05-08T19:22:20.444996+0000","last_unstale":"2024-05-08T19:48:35.976700+0000","last_undegraded":"2024-05-08T19:48:35.976700+0000","last_fullsized":"2024-05-08T19:48:35.976700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2274,"log_dups_size":0,"ondisk_log_size":2274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"26'2337","reported_seq":2365,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.099390+0000","last_change":"2024-05-08T19:22:20.451170+0000","last_active":"2024-05-08T19:48:36.099390+0000","last_peered":"2024-05-08T19:48:36.099390+0000","last_clean":"2024-05-08T19:48:36.099390+0000","last_became_active":"2024-05-08T19:22:20.450843+0000","last_became_peered":"2024-05-08T19:22:20.450843+0000","last_unstale":"2024-05-08T19:48:36.099390+0000","last_undegraded":"2024-05-08T19:48:36.099390+0000","last_fullsized":"2024-05-08T19:48:36.099390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'2298","reported_seq":2337,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:52.831688+0000","last_change":"2024-05-08T19:48:52.831797+0000","last_active":"2024-05-08T19:48:52.831688+0000","last_peered":"2024-05-08T19:48:52.831688+0000","last_clean":"2024-05-08T19:48:52.831688+0000","last_became_active":"2024-05-08T19:22:20.462266+0000","last_became_peered":"2024-05-08T19:22:20.462266+0000","last_unstale":"2024-05-08T19:48:52.831688+0000","last_undegraded":"2024-05-08T19:48:52.831688+0000","last_fullsized":"2024-05-08T19:48:52.831688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2298","last_scrub_stamp":"2024-05-08T19:48:52.831661+0000","last_deep_scrub":"26'2298","last_deep_scrub_stamp":"2024-05-08T19:48:52.831661+0000","last_clean_scrub_stamp":"2024-05-08T19:48:52.831661+0000","objects_scrubbed":0,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:42.814623+0000","scrub_duration":0.0019874760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"26'2369","reported_seq":2397,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.631677+0000","last_change":"2024-05-08T19:22:20.454128+0000","last_active":"2024-05-08T19:48:36.631677+0000","last_peered":"2024-05-08T19:48:36.631677+0000","last_clean":"2024-05-08T19:48:36.631677+0000","last_became_active":"2024-05-08T19:22:20.453834+0000","last_became_peered":"2024-05-08T19:22:20.453834+0000","last_unstale":"2024-05-08T19:48:36.631677+0000","last_undegraded":"2024-05-08T19:48:36.631677+0000","last_fullsized":"2024-05-08T19:48:36.631677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"26'8922","reported_seq":8998,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.596176+0000","last_change":"2024-05-08T19:22:24.616532+0000","last_active":"2024-05-08T19:48:36.596176+0000","last_peered":"2024-05-08T19:48:36.596176+0000","last_clean":"2024-05-08T19:48:36.596176+0000","last_became_active":"2024-05-08T19:22:24.616128+0000","last_became_peered":"2024-05-08T19:22:24.616128+0000","last_unstale":"2024-05-08T19:48:36.596176+0000","last_undegraded":"2024-05-08T19:48:36.596176+0000","last_fullsized":"2024-05-08T19:48:36.596176+0000","mapping_epoch":22,"log_start":"26'2512","ondisk_log_start":"26'2512","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6410,"log_dups_size":0,"ondisk_log_size":6410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":3400,"num_write":6578,"num_write_kb":966197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"26'2352","reported_seq":2393,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:43.584025+0000","last_change":"2024-05-08T19:48:43.584133+0000","last_active":"2024-05-08T19:48:43.584025+0000","last_peered":"2024-05-08T19:48:43.584025+0000","last_clean":"2024-05-08T19:48:43.584025+0000","last_became_active":"2024-05-08T19:22:20.012453+0000","last_became_peered":"2024-05-08T19:22:20.012453+0000","last_unstale":"2024-05-08T19:48:43.584025+0000","last_undegraded":"2024-05-08T19:48:43.584025+0000","last_fullsized":"2024-05-08T19:48:43.584025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2352","last_scrub_stamp":"2024-05-08T19:48:43.583999+0000","last_deep_scrub":"26'2352","last_deep_scrub_stamp":"2024-05-08T19:48:43.583999+0000","last_clean_scrub_stamp":"2024-05-08T19:48:43.583999+0000","objects_scrubbed":3,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:26.944633+0000","scrub_duration":0.023303528,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2351,"num_write_kb":17974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":558,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'2321","reported_seq":2351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:39.756224+0000","last_change":"2024-05-08T19:22:20.464578+0000","last_active":"2024-05-08T19:48:39.756224+0000","last_peered":"2024-05-08T19:48:39.756224+0000","last_clean":"2024-05-08T19:48:39.756224+0000","last_became_active":"2024-05-08T19:22:20.464396+0000","last_became_peered":"2024-05-08T19:22:20.464396+0000","last_unstale":"2024-05-08T19:48:39.756224+0000","last_undegraded":"2024-05-08T19:48:39.756224+0000","last_fullsized":"2024-05-08T19:48:39.756224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2321,"log_dups_size":0,"ondisk_log_size":2321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"26'8798","reported_seq":9476,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:56.284482+0000","last_change":"2024-05-08T19:48:56.284630+0000","last_active":"2024-05-08T19:48:56.284482+0000","last_peered":"2024-05-08T19:48:56.284482+0000","last_clean":"2024-05-08T19:48:56.284482+0000","last_became_active":"2024-05-08T19:22:24.469161+0000","last_became_peered":"2024-05-08T19:22:24.469161+0000","last_unstale":"2024-05-08T19:48:56.284482+0000","last_undegraded":"2024-05-08T19:48:56.284482+0000","last_fullsized":"2024-05-08T19:48:56.284482+0000","mapping_epoch":22,"log_start":"26'1644","ondisk_log_start":"26'1644","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8798","last_scrub_stamp":"2024-05-08T19:48:56.284453+0000","last_deep_scrub":"26'8798","last_deep_scrub_stamp":"2024-05-08T19:48:56.284453+0000","last_clean_scrub_stamp":"2024-05-08T19:48:56.284453+0000","objects_scrubbed":0,"log_size":7154,"log_dups_size":0,"ondisk_log_size":7154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:57.383815+0000","scrub_duration":0.029791432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":642,"num_read_kb":43100,"num_write":6354,"num_write_kb":920646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"26'8079","reported_seq":8121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:55.663978+0000","last_change":"2024-05-08T19:48:55.664080+0000","last_active":"2024-05-08T19:48:55.663978+0000","last_peered":"2024-05-08T19:48:55.663978+0000","last_clean":"2024-05-08T19:48:55.663978+0000","last_became_active":"2024-05-08T19:22:20.005723+0000","last_became_peered":"2024-05-08T19:22:20.005723+0000","last_unstale":"2024-05-08T19:48:55.663978+0000","last_undegraded":"2024-05-08T19:48:55.663978+0000","last_fullsized":"2024-05-08T19:48:55.663978+0000","mapping_epoch":17,"log_start":"26'1600","ondisk_log_start":"26'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8079","last_scrub_stamp":"2024-05-08T19:48:55.663952+0000","last_deep_scrub":"26'8079","last_deep_scrub_stamp":"2024-05-08T19:48:55.663952+0000","last_clean_scrub_stamp":"2024-05-08T19:48:55.663952+0000","objects_scrubbed":3,"log_size":6479,"log_dups_size":0,"ondisk_log_size":6479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:23.332609+0000","scrub_duration":0.048122591999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8075,"num_write_kb":50504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'2316","reported_seq":2356,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:42.568941+0000","last_change":"2024-05-08T19:48:42.569048+0000","last_active":"2024-05-08T19:48:42.568941+0000","last_peered":"2024-05-08T19:48:42.568941+0000","last_clean":"2024-05-08T19:48:42.568941+0000","last_became_active":"2024-05-08T19:22:20.446380+0000","last_became_peered":"2024-05-08T19:22:20.446380+0000","last_unstale":"2024-05-08T19:48:42.568941+0000","last_undegraded":"2024-05-08T19:48:42.568941+0000","last_fullsized":"2024-05-08T19:48:42.568941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2316","last_scrub_stamp":"2024-05-08T19:48:42.568919+0000","last_deep_scrub":"26'2316","last_deep_scrub_stamp":"2024-05-08T19:48:42.568919+0000","last_clean_scrub_stamp":"2024-05-08T19:48:42.568919+0000","objects_scrubbed":0,"log_size":2316,"log_dups_size":0,"ondisk_log_size":2316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:21.940168+0000","scrub_duration":0.017202281999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"26'8187","reported_seq":8816,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.664137+0000","last_change":"2024-05-08T19:22:24.465354+0000","last_active":"2024-05-08T19:48:36.664137+0000","last_peered":"2024-05-08T19:48:36.664137+0000","last_clean":"2024-05-08T19:48:36.664137+0000","last_became_active":"2024-05-08T19:22:24.464669+0000","last_became_peered":"2024-05-08T19:22:24.464669+0000","last_unstale":"2024-05-08T19:48:36.664137+0000","last_undegraded":"2024-05-08T19:48:36.664137+0000","last_fullsized":"2024-05-08T19:48:36.664137+0000","mapping_epoch":22,"log_start":"26'1003","ondisk_log_start":"26'1003","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7184,"log_dups_size":0,"ondisk_log_size":7184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":604,"num_read_kb":22018,"num_write":5721,"num_write_kb":861918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'9226","reported_seq":9254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.136528+0000","last_change":"2024-05-08T19:22:20.014506+0000","last_active":"2024-05-08T19:48:33.136528+0000","last_peered":"2024-05-08T19:48:33.136528+0000","last_clean":"2024-05-08T19:48:33.136528+0000","last_became_active":"2024-05-08T19:22:20.014239+0000","last_became_peered":"2024-05-08T19:22:20.014239+0000","last_unstale":"2024-05-08T19:48:33.136528+0000","last_undegraded":"2024-05-08T19:48:33.136528+0000","last_fullsized":"2024-05-08T19:48:33.136528+0000","mapping_epoch":17,"log_start":"26'2400","ondisk_log_start":"26'2400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":6826,"log_dups_size":0,"ondisk_log_size":6826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":9240,"num_write_kb":71812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'2400","reported_seq":2421,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.243732+0000","last_change":"2024-05-08T19:23:11.054407+0000","last_active":"2024-05-08T19:48:36.243732+0000","last_peered":"2024-05-08T19:48:36.243732+0000","last_clean":"2024-05-08T19:48:36.243732+0000","last_became_active":"2024-05-08T19:23:11.054036+0000","last_became_peered":"2024-05-08T19:23:11.054036+0000","last_unstale":"2024-05-08T19:48:36.243732+0000","last_undegraded":"2024-05-08T19:48:36.243732+0000","last_fullsized":"2024-05-08T19:48:36.243732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2400,"log_dups_size":0,"ondisk_log_size":2400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"26'8213","reported_seq":8480,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.667486+0000","last_change":"2024-05-08T19:22:24.479649+0000","last_active":"2024-05-08T19:48:36.667486+0000","last_peered":"2024-05-08T19:48:36.667486+0000","last_clean":"2024-05-08T19:48:36.667486+0000","last_became_active":"2024-05-08T19:22:24.479255+0000","last_became_peered":"2024-05-08T19:22:24.479255+0000","last_unstale":"2024-05-08T19:48:36.667486+0000","last_undegraded":"2024-05-08T19:48:36.667486+0000","last_fullsized":"2024-05-08T19:48:36.667486+0000","mapping_epoch":22,"log_start":"26'1000","ondisk_log_start":"26'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7213,"log_dups_size":0,"ondisk_log_size":7213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":15390,"num_write":5835,"num_write_kb":1051850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6116","reported_seq":6155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.885993+0000","last_change":"2024-05-08T19:48:51.886082+0000","last_active":"2024-05-08T19:48:51.885993+0000","last_peered":"2024-05-08T19:48:51.885993+0000","last_clean":"2024-05-08T19:48:51.885993+0000","last_became_active":"2024-05-08T19:22:20.013793+0000","last_became_peered":"2024-05-08T19:22:20.013793+0000","last_unstale":"2024-05-08T19:48:51.885993+0000","last_undegraded":"2024-05-08T19:48:51.885993+0000","last_fullsized":"2024-05-08T19:48:51.885993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6116","last_scrub_stamp":"2024-05-08T19:48:51.885971+0000","last_deep_scrub":"26'6116","last_deep_scrub_stamp":"2024-05-08T19:48:51.885971+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.885971+0000","objects_scrubbed":2,"log_size":6116,"log_dups_size":0,"ondisk_log_size":6116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:56.172133+0000","scrub_duration":0.024158046999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6127,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":53996,"num_omap_keys":82,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'2307","reported_seq":2334,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.669431+0000","last_change":"2024-05-08T19:22:20.455505+0000","last_active":"2024-05-08T19:48:36.669431+0000","last_peered":"2024-05-08T19:48:36.669431+0000","last_clean":"2024-05-08T19:48:36.669431+0000","last_became_active":"2024-05-08T19:22:20.455148+0000","last_became_peered":"2024-05-08T19:22:20.455148+0000","last_unstale":"2024-05-08T19:48:36.669431+0000","last_undegraded":"2024-05-08T19:48:36.669431+0000","last_fullsized":"2024-05-08T19:48:36.669431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2307,"log_dups_size":0,"ondisk_log_size":2307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"26'8426","reported_seq":9287,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.672405+0000","last_change":"2024-05-08T19:22:24.465009+0000","last_active":"2024-05-08T19:48:36.672405+0000","last_peered":"2024-05-08T19:48:36.672405+0000","last_clean":"2024-05-08T19:48:36.672405+0000","last_became_active":"2024-05-08T19:22:24.464422+0000","last_became_peered":"2024-05-08T19:22:24.464422+0000","last_unstale":"2024-05-08T19:48:36.672405+0000","last_undegraded":"2024-05-08T19:48:36.672405+0000","last_fullsized":"2024-05-08T19:48:36.672405+0000","mapping_epoch":22,"log_start":"26'2000","ondisk_log_start":"26'2000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6426,"log_dups_size":0,"ondisk_log_size":6426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":836,"num_read_kb":58598,"num_write":5984,"num_write_kb":988108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"26'8502","reported_seq":8541,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:00.593259+0000","last_change":"2024-05-08T19:49:00.593376+0000","last_active":"2024-05-08T19:49:00.593259+0000","last_peered":"2024-05-08T19:49:00.593259+0000","last_clean":"2024-05-08T19:49:00.593259+0000","last_became_active":"2024-05-08T19:22:20.011183+0000","last_became_peered":"2024-05-08T19:22:20.011183+0000","last_unstale":"2024-05-08T19:49:00.593259+0000","last_undegraded":"2024-05-08T19:49:00.593259+0000","last_fullsized":"2024-05-08T19:49:00.593259+0000","mapping_epoch":17,"log_start":"26'2100","ondisk_log_start":"26'2100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8502","last_scrub_stamp":"2024-05-08T19:49:00.593234+0000","last_deep_scrub":"26'8502","last_deep_scrub_stamp":"2024-05-08T19:49:00.593234+0000","last_clean_scrub_stamp":"2024-05-08T19:49:00.593234+0000","objects_scrubbed":1,"log_size":6402,"log_dups_size":0,"ondisk_log_size":6402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:58.280772+0000","scrub_duration":0.022856498999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8495,"num_write_kb":66920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'2343","reported_seq":2381,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:44.327490+0000","last_change":"2024-05-08T19:48:44.327587+0000","last_active":"2024-05-08T19:48:44.327490+0000","last_peered":"2024-05-08T19:48:44.327490+0000","last_clean":"2024-05-08T19:48:44.327490+0000","last_became_active":"2024-05-08T19:22:20.439096+0000","last_became_peered":"2024-05-08T19:22:20.439096+0000","last_unstale":"2024-05-08T19:48:44.327490+0000","last_undegraded":"2024-05-08T19:48:44.327490+0000","last_fullsized":"2024-05-08T19:48:44.327490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2343","last_scrub_stamp":"2024-05-08T19:48:44.327466+0000","last_deep_scrub":"26'2343","last_deep_scrub_stamp":"2024-05-08T19:48:44.327466+0000","last_clean_scrub_stamp":"2024-05-08T19:48:44.327466+0000","objects_scrubbed":0,"log_size":2343,"log_dups_size":0,"ondisk_log_size":2343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:23.698715+0000","scrub_duration":0.006452167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'8654","reported_seq":9396,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:55.867163+0000","last_change":"2024-05-08T19:48:55.867311+0000","last_active":"2024-05-08T19:48:55.867163+0000","last_peered":"2024-05-08T19:48:55.867163+0000","last_clean":"2024-05-08T19:48:55.867163+0000","last_became_active":"2024-05-08T19:23:11.529451+0000","last_became_peered":"2024-05-08T19:23:11.529451+0000","last_unstale":"2024-05-08T19:48:55.867163+0000","last_undegraded":"2024-05-08T19:48:55.867163+0000","last_fullsized":"2024-05-08T19:48:55.867163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8654","last_scrub_stamp":"2024-05-08T19:48:55.867135+0000","last_deep_scrub":"26'8654","last_deep_scrub_stamp":"2024-05-08T19:48:55.867135+0000","last_clean_scrub_stamp":"2024-05-08T19:48:55.867135+0000","objects_scrubbed":0,"log_size":8654,"log_dups_size":0,"ondisk_log_size":8654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:14.157078+0000","scrub_duration":0.021771672999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":696,"num_read_kb":42234,"num_write":6185,"num_write_kb":1013081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"26'10410","reported_seq":10449,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:46.696336+0000","last_change":"2024-05-08T19:48:46.696452+0000","last_active":"2024-05-08T19:48:46.696336+0000","last_peered":"2024-05-08T19:48:46.696336+0000","last_clean":"2024-05-08T19:48:46.696336+0000","last_became_active":"2024-05-08T19:22:20.003513+0000","last_became_peered":"2024-05-08T19:22:20.003513+0000","last_unstale":"2024-05-08T19:48:46.696336+0000","last_undegraded":"2024-05-08T19:48:46.696336+0000","last_fullsized":"2024-05-08T19:48:46.696336+0000","mapping_epoch":17,"log_start":"26'2500","ondisk_log_start":"26'2500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10410","last_scrub_stamp":"2024-05-08T19:48:46.696293+0000","last_deep_scrub":"26'10410","last_deep_scrub_stamp":"2024-05-08T19:48:46.696293+0000","last_clean_scrub_stamp":"2024-05-08T19:48:46.696293+0000","objects_scrubbed":2,"log_size":7910,"log_dups_size":0,"ondisk_log_size":7910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:59.423720+0000","scrub_duration":0.035260540999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10404,"num_write_kb":72564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'2281","reported_seq":2319,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.643324+0000","last_change":"2024-05-08T19:48:51.643437+0000","last_active":"2024-05-08T19:48:51.643324+0000","last_peered":"2024-05-08T19:48:51.643324+0000","last_clean":"2024-05-08T19:48:51.643324+0000","last_became_active":"2024-05-08T19:22:20.445238+0000","last_became_peered":"2024-05-08T19:22:20.445238+0000","last_unstale":"2024-05-08T19:48:51.643324+0000","last_undegraded":"2024-05-08T19:48:51.643324+0000","last_fullsized":"2024-05-08T19:48:51.643324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2281","last_scrub_stamp":"2024-05-08T19:48:51.643299+0000","last_deep_scrub":"26'2281","last_deep_scrub_stamp":"2024-05-08T19:48:51.643299+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.643299+0000","objects_scrubbed":0,"log_size":2281,"log_dups_size":0,"ondisk_log_size":2281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:09.933242+0000","scrub_duration":0.0060195379999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'8267","reported_seq":10735,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.657643+0000","last_change":"2024-05-08T19:22:24.479665+0000","last_active":"2024-05-08T19:48:36.657643+0000","last_peered":"2024-05-08T19:48:36.657643+0000","last_clean":"2024-05-08T19:48:36.657643+0000","last_became_active":"2024-05-08T19:22:24.478998+0000","last_became_peered":"2024-05-08T19:22:24.478998+0000","last_unstale":"2024-05-08T19:48:36.657643+0000","last_undegraded":"2024-05-08T19:48:36.657643+0000","last_fullsized":"2024-05-08T19:48:36.657643+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7967,"log_dups_size":0,"ondisk_log_size":7967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2441,"num_read_kb":165440,"num_write":5908,"num_write_kb":873319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"26'5851","reported_seq":5879,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:30.065618+0000","last_change":"2024-05-08T19:22:20.002850+0000","last_active":"2024-05-08T19:48:30.065618+0000","last_peered":"2024-05-08T19:48:30.065618+0000","last_clean":"2024-05-08T19:48:30.065618+0000","last_became_active":"2024-05-08T19:22:20.002534+0000","last_became_peered":"2024-05-08T19:22:20.002534+0000","last_unstale":"2024-05-08T19:48:30.065618+0000","last_undegraded":"2024-05-08T19:48:30.065618+0000","last_fullsized":"2024-05-08T19:48:30.065618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":5851,"log_dups_size":0,"ondisk_log_size":5851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5849,"num_write_kb":40670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"26'2373","reported_seq":2411,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:53.652073+0000","last_change":"2024-05-08T19:48:53.652188+0000","last_active":"2024-05-08T19:48:53.652073+0000","last_peered":"2024-05-08T19:48:53.652073+0000","last_clean":"2024-05-08T19:48:53.652073+0000","last_became_active":"2024-05-08T19:22:20.436431+0000","last_became_peered":"2024-05-08T19:22:20.436431+0000","last_unstale":"2024-05-08T19:48:53.652073+0000","last_undegraded":"2024-05-08T19:48:53.652073+0000","last_fullsized":"2024-05-08T19:48:53.652073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2373","last_scrub_stamp":"2024-05-08T19:48:53.652045+0000","last_deep_scrub":"26'2373","last_deep_scrub_stamp":"2024-05-08T19:48:53.652045+0000","last_clean_scrub_stamp":"2024-05-08T19:48:53.652045+0000","objects_scrubbed":0,"log_size":2373,"log_dups_size":0,"ondisk_log_size":2373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:53.161766+0000","scrub_duration":0.0018538879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'8472","reported_seq":9203,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.663642+0000","last_change":"2024-05-08T19:22:24.617420+0000","last_active":"2024-05-08T19:48:36.663642+0000","last_peered":"2024-05-08T19:48:36.663642+0000","last_clean":"2024-05-08T19:48:36.663642+0000","last_became_active":"2024-05-08T19:22:24.617030+0000","last_became_peered":"2024-05-08T19:22:24.617030+0000","last_unstale":"2024-05-08T19:48:36.663642+0000","last_undegraded":"2024-05-08T19:48:36.663642+0000","last_fullsized":"2024-05-08T19:48:36.663642+0000","mapping_epoch":22,"log_start":"26'1302","ondisk_log_start":"26'1302","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7170,"log_dups_size":0,"ondisk_log_size":7170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":49016,"num_write":6130,"num_write_kb":1037918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"26'9202","reported_seq":9241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:46.507307+0000","last_change":"2024-05-08T19:48:46.507455+0000","last_active":"2024-05-08T19:48:46.507307+0000","last_peered":"2024-05-08T19:48:46.507307+0000","last_clean":"2024-05-08T19:48:46.507307+0000","last_became_active":"2024-05-08T19:22:20.003365+0000","last_became_peered":"2024-05-08T19:22:20.003365+0000","last_unstale":"2024-05-08T19:48:46.507307+0000","last_undegraded":"2024-05-08T19:48:46.507307+0000","last_fullsized":"2024-05-08T19:48:46.507307+0000","mapping_epoch":17,"log_start":"26'1700","ondisk_log_start":"26'1700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9202","last_scrub_stamp":"2024-05-08T19:48:46.507282+0000","last_deep_scrub":"26'9202","last_deep_scrub_stamp":"2024-05-08T19:48:46.507282+0000","last_clean_scrub_stamp":"2024-05-08T19:48:46.507282+0000","objects_scrubbed":0,"log_size":7502,"log_dups_size":0,"ondisk_log_size":7502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:29.867916+0000","scrub_duration":0.0077823199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9189,"num_write_kb":63509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"26'2305","reported_seq":2332,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.590924+0000","last_change":"2024-05-08T19:22:20.437480+0000","last_active":"2024-05-08T19:48:36.590924+0000","last_peered":"2024-05-08T19:48:36.590924+0000","last_clean":"2024-05-08T19:48:36.590924+0000","last_became_active":"2024-05-08T19:22:20.437214+0000","last_became_peered":"2024-05-08T19:22:20.437214+0000","last_unstale":"2024-05-08T19:48:36.590924+0000","last_undegraded":"2024-05-08T19:48:36.590924+0000","last_fullsized":"2024-05-08T19:48:36.590924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2305,"log_dups_size":0,"ondisk_log_size":2305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"26'8428","reported_seq":8897,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.658615+0000","last_change":"2024-05-08T19:22:24.615730+0000","last_active":"2024-05-08T19:48:36.658615+0000","last_peered":"2024-05-08T19:48:36.658615+0000","last_clean":"2024-05-08T19:48:36.658615+0000","last_became_active":"2024-05-08T19:22:24.615351+0000","last_became_peered":"2024-05-08T19:22:24.615351+0000","last_unstale":"2024-05-08T19:48:36.658615+0000","last_undegraded":"2024-05-08T19:48:36.658615+0000","last_fullsized":"2024-05-08T19:48:36.658615+0000","mapping_epoch":22,"log_start":"26'2014","ondisk_log_start":"26'2014","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6414,"log_dups_size":0,"ondisk_log_size":6414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":19968,"num_write":5955,"num_write_kb":994501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"26'7043","reported_seq":7921,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.648311+0000","last_change":"2024-05-08T19:48:54.648311+0000","last_active":"2024-05-08T19:48:54.648311+0000","last_peered":"2024-05-08T19:48:54.648311+0000","last_clean":"2024-05-08T19:48:54.648311+0000","last_became_active":"2024-05-08T19:22:20.001990+0000","last_became_peered":"2024-05-08T19:22:20.001990+0000","last_unstale":"2024-05-08T19:48:54.648311+0000","last_undegraded":"2024-05-08T19:48:54.648311+0000","last_fullsized":"2024-05-08T19:48:54.648311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7043","last_scrub_stamp":"2024-05-08T19:48:54.648187+0000","last_deep_scrub":"26'7043","last_deep_scrub_stamp":"2024-05-08T19:48:54.648187+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.648187+0000","objects_scrubbed":2,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:58.934349+0000","scrub_duration":0.038308684000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":838,"num_read_kb":4635,"num_write":7034,"num_write_kb":49678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"26'2319","reported_seq":2347,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.829231+0000","last_change":"2024-05-08T19:22:20.447742+0000","last_active":"2024-05-08T19:48:40.829231+0000","last_peered":"2024-05-08T19:48:40.829231+0000","last_clean":"2024-05-08T19:48:40.829231+0000","last_became_active":"2024-05-08T19:22:20.447475+0000","last_became_peered":"2024-05-08T19:22:20.447475+0000","last_unstale":"2024-05-08T19:48:40.829231+0000","last_undegraded":"2024-05-08T19:48:40.829231+0000","last_fullsized":"2024-05-08T19:48:40.829231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2319,"log_dups_size":0,"ondisk_log_size":2319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'7961","reported_seq":8450,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.577762+0000","last_change":"2024-05-08T19:23:11.054182+0000","last_active":"2024-05-08T19:48:36.577762+0000","last_peered":"2024-05-08T19:48:36.577762+0000","last_clean":"2024-05-08T19:48:36.577762+0000","last_became_active":"2024-05-08T19:23:11.053733+0000","last_became_peered":"2024-05-08T19:23:11.053733+0000","last_unstale":"2024-05-08T19:48:36.577762+0000","last_undegraded":"2024-05-08T19:48:36.577762+0000","last_fullsized":"2024-05-08T19:48:36.577762+0000","mapping_epoch":25,"log_start":"26'1500","ondisk_log_start":"26'1500","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6461,"log_dups_size":0,"ondisk_log_size":6461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":453,"num_read_kb":17282,"num_write":5569,"num_write_kb":1020101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"26'6225","reported_seq":6265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:48.436975+0000","last_change":"2024-05-08T19:48:48.436975+0000","last_active":"2024-05-08T19:48:48.436975+0000","last_peered":"2024-05-08T19:48:48.436975+0000","last_clean":"2024-05-08T19:48:48.436975+0000","last_became_active":"2024-05-08T19:22:20.000981+0000","last_became_peered":"2024-05-08T19:22:20.000981+0000","last_unstale":"2024-05-08T19:48:48.436975+0000","last_undegraded":"2024-05-08T19:48:48.436975+0000","last_fullsized":"2024-05-08T19:48:48.436975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6225","last_scrub_stamp":"2024-05-08T19:48:48.436851+0000","last_deep_scrub":"26'6225","last_deep_scrub_stamp":"2024-05-08T19:48:48.436851+0000","last_clean_scrub_stamp":"2024-05-08T19:48:48.436851+0000","objects_scrubbed":1,"log_size":6225,"log_dups_size":0,"ondisk_log_size":6225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:52.723014+0000","scrub_duration":0.024176517000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6227,"num_write_kb":45123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"26'2337","reported_seq":2364,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.606120+0000","last_change":"2024-05-08T19:22:20.446938+0000","last_active":"2024-05-08T19:48:36.606120+0000","last_peered":"2024-05-08T19:48:36.606120+0000","last_clean":"2024-05-08T19:48:36.606120+0000","last_became_active":"2024-05-08T19:22:20.446644+0000","last_became_peered":"2024-05-08T19:22:20.446644+0000","last_unstale":"2024-05-08T19:48:36.606120+0000","last_undegraded":"2024-05-08T19:48:36.606120+0000","last_fullsized":"2024-05-08T19:48:36.606120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"26'8308","reported_seq":8829,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.571477+0000","last_change":"2024-05-08T19:22:24.465089+0000","last_active":"2024-05-08T19:48:36.571477+0000","last_peered":"2024-05-08T19:48:36.571477+0000","last_clean":"2024-05-08T19:48:36.571477+0000","last_became_active":"2024-05-08T19:22:24.464178+0000","last_became_peered":"2024-05-08T19:22:24.464178+0000","last_unstale":"2024-05-08T19:48:36.571477+0000","last_undegraded":"2024-05-08T19:48:36.571477+0000","last_fullsized":"2024-05-08T19:48:36.571477+0000","mapping_epoch":22,"log_start":"26'1100","ondisk_log_start":"26'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7208,"log_dups_size":0,"ondisk_log_size":7208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":27360,"num_write":5875,"num_write_kb":879779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'6730","reported_seq":6770,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:57.645430+0000","last_change":"2024-05-08T19:48:57.645543+0000","last_active":"2024-05-08T19:48:57.645430+0000","last_peered":"2024-05-08T19:48:57.645430+0000","last_clean":"2024-05-08T19:48:57.645430+0000","last_became_active":"2024-05-08T19:22:20.000985+0000","last_became_peered":"2024-05-08T19:22:20.000985+0000","last_unstale":"2024-05-08T19:48:57.645430+0000","last_undegraded":"2024-05-08T19:48:57.645430+0000","last_fullsized":"2024-05-08T19:48:57.645430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6730","last_scrub_stamp":"2024-05-08T19:48:57.645404+0000","last_deep_scrub":"26'6730","last_deep_scrub_stamp":"2024-05-08T19:48:57.645404+0000","last_clean_scrub_stamp":"2024-05-08T19:48:57.645404+0000","objects_scrubbed":4,"log_size":6730,"log_dups_size":0,"ondisk_log_size":6730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:15.935347+0000","scrub_duration":0.038479950999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":6744,"num_write_kb":41825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":41485,"num_omap_keys":63,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'2335","reported_seq":2374,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:47.378684+0000","last_change":"2024-05-08T19:48:47.378803+0000","last_active":"2024-05-08T19:48:47.378684+0000","last_peered":"2024-05-08T19:48:47.378684+0000","last_clean":"2024-05-08T19:48:47.378684+0000","last_became_active":"2024-05-08T19:22:20.447538+0000","last_became_peered":"2024-05-08T19:22:20.447538+0000","last_unstale":"2024-05-08T19:48:47.378684+0000","last_undegraded":"2024-05-08T19:48:47.378684+0000","last_fullsized":"2024-05-08T19:48:47.378684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2335","last_scrub_stamp":"2024-05-08T19:48:47.378653+0000","last_deep_scrub":"26'2335","last_deep_scrub_stamp":"2024-05-08T19:48:47.378653+0000","last_clean_scrub_stamp":"2024-05-08T19:48:47.378653+0000","objects_scrubbed":0,"log_size":2335,"log_dups_size":0,"ondisk_log_size":2335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:51.664816+0000","scrub_duration":0.0017606900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"26'8591","reported_seq":9134,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.639212+0000","last_change":"2024-05-08T19:22:24.479544+0000","last_active":"2024-05-08T19:48:36.639212+0000","last_peered":"2024-05-08T19:48:36.639212+0000","last_clean":"2024-05-08T19:48:36.639212+0000","last_became_active":"2024-05-08T19:22:24.479071+0000","last_became_peered":"2024-05-08T19:22:24.479071+0000","last_unstale":"2024-05-08T19:48:36.639212+0000","last_undegraded":"2024-05-08T19:48:36.639212+0000","last_fullsized":"2024-05-08T19:48:36.639212+0000","mapping_epoch":22,"log_start":"26'1203","ondisk_log_start":"26'1203","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7388,"log_dups_size":0,"ondisk_log_size":7388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":517,"num_read_kb":30942,"num_write":6185,"num_write_kb":930944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'10879","reported_seq":11547,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.708511+0000","last_change":"2024-05-08T19:48:51.708629+0000","last_active":"2024-05-08T19:48:51.708511+0000","last_peered":"2024-05-08T19:48:51.708511+0000","last_clean":"2024-05-08T19:48:51.708511+0000","last_became_active":"2024-05-08T19:22:20.011331+0000","last_became_peered":"2024-05-08T19:22:20.011331+0000","last_unstale":"2024-05-08T19:48:51.708511+0000","last_undegraded":"2024-05-08T19:48:51.708511+0000","last_fullsized":"2024-05-08T19:48:51.708511+0000","mapping_epoch":17,"log_start":"26'2900","ondisk_log_start":"26'2900","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10879","last_scrub_stamp":"2024-05-08T19:48:51.708487+0000","last_deep_scrub":"26'10879","last_deep_scrub_stamp":"2024-05-08T19:48:51.708487+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.708487+0000","objects_scrubbed":6,"log_size":7979,"log_dups_size":0,"ondisk_log_size":7979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:31.079736+0000","scrub_duration":0.057288780999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":630,"num_read_kb":4505,"num_write":10869,"num_write_kb":72957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":113207,"num_omap_keys":172,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"26'2256","reported_seq":2284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.892919+0000","last_change":"2024-05-08T19:22:20.447583+0000","last_active":"2024-05-08T19:48:41.892919+0000","last_peered":"2024-05-08T19:48:41.892919+0000","last_clean":"2024-05-08T19:48:41.892919+0000","last_became_active":"2024-05-08T19:22:20.447243+0000","last_became_peered":"2024-05-08T19:22:20.447243+0000","last_unstale":"2024-05-08T19:48:41.892919+0000","last_undegraded":"2024-05-08T19:48:41.892919+0000","last_fullsized":"2024-05-08T19:48:41.892919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2256,"log_dups_size":0,"ondisk_log_size":2256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'8691","reported_seq":9094,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.829360+0000","last_change":"2024-05-08T19:22:24.615622+0000","last_active":"2024-05-08T19:48:40.829360+0000","last_peered":"2024-05-08T19:48:40.829360+0000","last_clean":"2024-05-08T19:48:40.829360+0000","last_became_active":"2024-05-08T19:22:24.614790+0000","last_became_peered":"2024-05-08T19:22:24.614790+0000","last_unstale":"2024-05-08T19:48:40.829360+0000","last_undegraded":"2024-05-08T19:48:40.829360+0000","last_fullsized":"2024-05-08T19:48:40.829360+0000","mapping_epoch":22,"log_start":"26'1126","ondisk_log_start":"26'1126","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7565,"log_dups_size":0,"ondisk_log_size":7565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":377,"num_read_kb":22514,"num_write":6361,"num_write_kb":865965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"26'5001","reported_seq":5041,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:45.598699+0000","last_change":"2024-05-08T19:48:45.598794+0000","last_active":"2024-05-08T19:48:45.598699+0000","last_peered":"2024-05-08T19:48:45.598699+0000","last_clean":"2024-05-08T19:48:45.598699+0000","last_became_active":"2024-05-08T19:22:20.005738+0000","last_became_peered":"2024-05-08T19:22:20.005738+0000","last_unstale":"2024-05-08T19:48:45.598699+0000","last_undegraded":"2024-05-08T19:48:45.598699+0000","last_fullsized":"2024-05-08T19:48:45.598699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5001","last_scrub_stamp":"2024-05-08T19:48:45.598671+0000","last_deep_scrub":"26'5001","last_deep_scrub_stamp":"2024-05-08T19:48:45.598671+0000","last_clean_scrub_stamp":"2024-05-08T19:48:45.598671+0000","objects_scrubbed":3,"log_size":5001,"log_dups_size":0,"ondisk_log_size":5001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:49.884833+0000","scrub_duration":0.024799128,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5000,"num_write_kb":36069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"26'2337","reported_seq":2365,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.587605+0000","last_change":"2024-05-08T19:22:20.448713+0000","last_active":"2024-05-08T19:48:36.587605+0000","last_peered":"2024-05-08T19:48:36.587605+0000","last_clean":"2024-05-08T19:48:36.587605+0000","last_became_active":"2024-05-08T19:22:20.448268+0000","last_became_peered":"2024-05-08T19:22:20.448268+0000","last_unstale":"2024-05-08T19:48:36.587605+0000","last_undegraded":"2024-05-08T19:48:36.587605+0000","last_fullsized":"2024-05-08T19:48:36.587605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"26'8215","reported_seq":8340,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.604342+0000","last_change":"2024-05-08T19:22:24.614076+0000","last_active":"2024-05-08T19:48:36.604342+0000","last_peered":"2024-05-08T19:48:36.604342+0000","last_clean":"2024-05-08T19:48:36.604342+0000","last_became_active":"2024-05-08T19:22:24.613698+0000","last_became_peered":"2024-05-08T19:22:24.613698+0000","last_unstale":"2024-05-08T19:48:36.604342+0000","last_undegraded":"2024-05-08T19:48:36.604342+0000","last_fullsized":"2024-05-08T19:48:36.604342+0000","mapping_epoch":22,"log_start":"26'1759","ondisk_log_start":"26'1759","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6456,"log_dups_size":0,"ondisk_log_size":6456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":5304,"num_write":5835,"num_write_kb":1072126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'2641","reported_seq":2681,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:57.371355+0000","last_change":"2024-05-08T19:48:57.371495+0000","last_active":"2024-05-08T19:48:57.371355+0000","last_peered":"2024-05-08T19:48:57.371355+0000","last_clean":"2024-05-08T19:48:57.371355+0000","last_became_active":"2024-05-08T19:22:20.011188+0000","last_became_peered":"2024-05-08T19:22:20.011188+0000","last_unstale":"2024-05-08T19:48:57.371355+0000","last_undegraded":"2024-05-08T19:48:57.371355+0000","last_fullsized":"2024-05-08T19:48:57.371355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2641","last_scrub_stamp":"2024-05-08T19:48:57.371296+0000","last_deep_scrub":"26'2641","last_deep_scrub_stamp":"2024-05-08T19:48:57.371296+0000","last_clean_scrub_stamp":"2024-05-08T19:48:57.371296+0000","objects_scrubbed":1,"log_size":2641,"log_dups_size":0,"ondisk_log_size":2641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:58.470658+0000","scrub_duration":0.02237304,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2647,"num_write_kb":22132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'2373","reported_seq":2412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:42.845985+0000","last_change":"2024-05-08T19:48:42.846073+0000","last_active":"2024-05-08T19:48:42.845985+0000","last_peered":"2024-05-08T19:48:42.845985+0000","last_clean":"2024-05-08T19:48:42.845985+0000","last_became_active":"2024-05-08T19:22:20.455562+0000","last_became_peered":"2024-05-08T19:22:20.455562+0000","last_unstale":"2024-05-08T19:48:42.845985+0000","last_undegraded":"2024-05-08T19:48:42.845985+0000","last_fullsized":"2024-05-08T19:48:42.845985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2373","last_scrub_stamp":"2024-05-08T19:48:42.845961+0000","last_deep_scrub":"26'2373","last_deep_scrub_stamp":"2024-05-08T19:48:42.845961+0000","last_clean_scrub_stamp":"2024-05-08T19:48:42.845961+0000","objects_scrubbed":0,"log_size":2373,"log_dups_size":0,"ondisk_log_size":2373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:59.674185+0000","scrub_duration":0.0025479779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"26'8227","reported_seq":8405,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:39.756325+0000","last_change":"2024-05-08T19:22:24.616812+0000","last_active":"2024-05-08T19:48:39.756325+0000","last_peered":"2024-05-08T19:48:39.756325+0000","last_clean":"2024-05-08T19:48:39.756325+0000","last_became_active":"2024-05-08T19:22:24.615618+0000","last_became_peered":"2024-05-08T19:22:24.615618+0000","last_unstale":"2024-05-08T19:48:39.756325+0000","last_undegraded":"2024-05-08T19:48:39.756325+0000","last_fullsized":"2024-05-08T19:48:39.756325+0000","mapping_epoch":22,"log_start":"26'1815","ondisk_log_start":"26'1815","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6412,"log_dups_size":0,"ondisk_log_size":6412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":3194,"num_write":5725,"num_write_kb":833306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"26'3932","reported_seq":3972,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:44.648094+0000","last_change":"2024-05-08T19:48:44.648189+0000","last_active":"2024-05-08T19:48:44.648094+0000","last_peered":"2024-05-08T19:48:44.648094+0000","last_clean":"2024-05-08T19:48:44.648094+0000","last_became_active":"2024-05-08T19:22:20.003725+0000","last_became_peered":"2024-05-08T19:22:20.003725+0000","last_unstale":"2024-05-08T19:48:44.648094+0000","last_undegraded":"2024-05-08T19:48:44.648094+0000","last_fullsized":"2024-05-08T19:48:44.648094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3932","last_scrub_stamp":"2024-05-08T19:48:44.648068+0000","last_deep_scrub":"26'3932","last_deep_scrub_stamp":"2024-05-08T19:48:44.648068+0000","last_clean_scrub_stamp":"2024-05-08T19:48:44.648068+0000","objects_scrubbed":2,"log_size":3932,"log_dups_size":0,"ondisk_log_size":3932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:01.476291+0000","scrub_duration":0.034361632000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3928,"num_write_kb":31166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"26'2246","reported_seq":2274,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.559559+0000","last_change":"2024-05-08T19:22:20.459536+0000","last_active":"2024-05-08T19:48:36.559559+0000","last_peered":"2024-05-08T19:48:36.559559+0000","last_clean":"2024-05-08T19:48:36.559559+0000","last_became_active":"2024-05-08T19:22:20.452496+0000","last_became_peered":"2024-05-08T19:22:20.452496+0000","last_unstale":"2024-05-08T19:48:36.559559+0000","last_undegraded":"2024-05-08T19:48:36.559559+0000","last_fullsized":"2024-05-08T19:48:36.559559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2246,"log_dups_size":0,"ondisk_log_size":2246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"26'8446","reported_seq":9052,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:38.170793+0000","last_change":"2024-05-08T19:22:24.478351+0000","last_active":"2024-05-08T19:48:38.170793+0000","last_peered":"2024-05-08T19:48:38.170793+0000","last_clean":"2024-05-08T19:48:38.170793+0000","last_became_active":"2024-05-08T19:22:24.477728+0000","last_became_peered":"2024-05-08T19:22:24.477728+0000","last_unstale":"2024-05-08T19:48:38.170793+0000","last_undegraded":"2024-05-08T19:48:38.170793+0000","last_fullsized":"2024-05-08T19:48:38.170793+0000","mapping_epoch":22,"log_start":"26'1217","ondisk_log_start":"26'1217","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7229,"log_dups_size":0,"ondisk_log_size":7229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":39960,"num_write":6024,"num_write_kb":827712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"26'5273","reported_seq":5313,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:47.999042+0000","last_change":"2024-05-08T19:48:47.999179+0000","last_active":"2024-05-08T19:48:47.999042+0000","last_peered":"2024-05-08T19:48:47.999042+0000","last_clean":"2024-05-08T19:48:47.999042+0000","last_became_active":"2024-05-08T19:22:20.007985+0000","last_became_peered":"2024-05-08T19:22:20.007985+0000","last_unstale":"2024-05-08T19:48:47.999042+0000","last_undegraded":"2024-05-08T19:48:47.999042+0000","last_fullsized":"2024-05-08T19:48:47.999042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5273","last_scrub_stamp":"2024-05-08T19:48:47.999018+0000","last_deep_scrub":"26'5273","last_deep_scrub_stamp":"2024-05-08T19:48:47.999018+0000","last_clean_scrub_stamp":"2024-05-08T19:48:47.999018+0000","objects_scrubbed":9,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:31.359653+0000","scrub_duration":0.067476978000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":5295,"num_write_kb":36936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":463383,"num_omap_keys":704,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"26'2365","reported_seq":2404,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:43.835331+0000","last_change":"2024-05-08T19:48:43.835445+0000","last_active":"2024-05-08T19:48:43.835331+0000","last_peered":"2024-05-08T19:48:43.835331+0000","last_clean":"2024-05-08T19:48:43.835331+0000","last_became_active":"2024-05-08T19:22:20.458588+0000","last_became_peered":"2024-05-08T19:22:20.458588+0000","last_unstale":"2024-05-08T19:48:43.835331+0000","last_undegraded":"2024-05-08T19:48:43.835331+0000","last_fullsized":"2024-05-08T19:48:43.835331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2365","last_scrub_stamp":"2024-05-08T19:48:43.835306+0000","last_deep_scrub":"26'2365","last_deep_scrub_stamp":"2024-05-08T19:48:43.835306+0000","last_clean_scrub_stamp":"2024-05-08T19:48:43.835306+0000","objects_scrubbed":0,"log_size":2365,"log_dups_size":0,"ondisk_log_size":2365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:28.364339+0000","scrub_duration":0.001815826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"26'8533","reported_seq":10204,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.294166+0000","last_change":"2024-05-08T19:22:24.464132+0000","last_active":"2024-05-08T19:48:40.294166+0000","last_peered":"2024-05-08T19:48:40.294166+0000","last_clean":"2024-05-08T19:48:40.294166+0000","last_became_active":"2024-05-08T19:22:24.463741+0000","last_became_peered":"2024-05-08T19:22:24.463741+0000","last_unstale":"2024-05-08T19:48:40.294166+0000","last_undegraded":"2024-05-08T19:48:40.294166+0000","last_fullsized":"2024-05-08T19:48:40.294166+0000","mapping_epoch":22,"log_start":"26'1304","ondisk_log_start":"26'1304","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7229,"log_dups_size":0,"ondisk_log_size":7229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1644,"num_read_kb":83588,"num_write":6135,"num_write_kb":944540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"26'5914","reported_seq":5954,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.373207+0000","last_change":"2024-05-08T19:48:40.373290+0000","last_active":"2024-05-08T19:48:40.373207+0000","last_peered":"2024-05-08T19:48:40.373207+0000","last_clean":"2024-05-08T19:48:40.373207+0000","last_became_active":"2024-05-08T19:22:20.005680+0000","last_became_peered":"2024-05-08T19:22:20.005680+0000","last_unstale":"2024-05-08T19:48:40.373207+0000","last_undegraded":"2024-05-08T19:48:40.373207+0000","last_fullsized":"2024-05-08T19:48:40.373207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5914","last_scrub_stamp":"2024-05-08T19:48:40.373183+0000","last_deep_scrub":"26'5914","last_deep_scrub_stamp":"2024-05-08T19:48:40.373183+0000","last_clean_scrub_stamp":"2024-05-08T19:48:40.373183+0000","objects_scrubbed":3,"log_size":5914,"log_dups_size":0,"ondisk_log_size":5914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:53.100609+0000","scrub_duration":0.036371251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5920,"num_write_kb":40735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"26'2309","reported_seq":2337,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.673542+0000","last_change":"2024-05-08T19:22:20.449812+0000","last_active":"2024-05-08T19:48:36.673542+0000","last_peered":"2024-05-08T19:48:36.673542+0000","last_clean":"2024-05-08T19:48:36.673542+0000","last_became_active":"2024-05-08T19:22:20.449512+0000","last_became_peered":"2024-05-08T19:22:20.449512+0000","last_unstale":"2024-05-08T19:48:36.673542+0000","last_undegraded":"2024-05-08T19:48:36.673542+0000","last_fullsized":"2024-05-08T19:48:36.673542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2309,"log_dups_size":0,"ondisk_log_size":2309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"26'8843","reported_seq":9128,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.638536+0000","last_change":"2024-05-08T19:22:24.478647+0000","last_active":"2024-05-08T19:48:36.638536+0000","last_peered":"2024-05-08T19:48:36.638536+0000","last_clean":"2024-05-08T19:48:36.638536+0000","last_became_active":"2024-05-08T19:22:24.478248+0000","last_became_peered":"2024-05-08T19:22:24.478248+0000","last_unstale":"2024-05-08T19:48:36.638536+0000","last_undegraded":"2024-05-08T19:48:36.638536+0000","last_fullsized":"2024-05-08T19:48:36.638536+0000","mapping_epoch":22,"log_start":"26'1512","ondisk_log_start":"26'1512","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7331,"log_dups_size":0,"ondisk_log_size":7331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":14826,"num_write":6450,"num_write_kb":856300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"26'7016","reported_seq":7057,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:48.585360+0000","last_change":"2024-05-08T19:48:48.585465+0000","last_active":"2024-05-08T19:48:48.585360+0000","last_peered":"2024-05-08T19:48:48.585360+0000","last_clean":"2024-05-08T19:48:48.585360+0000","last_became_active":"2024-05-08T19:22:20.003055+0000","last_became_peered":"2024-05-08T19:22:20.003055+0000","last_unstale":"2024-05-08T19:48:48.585360+0000","last_undegraded":"2024-05-08T19:48:48.585360+0000","last_fullsized":"2024-05-08T19:48:48.585360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7016","last_scrub_stamp":"2024-05-08T19:48:48.585336+0000","last_deep_scrub":"26'7016","last_deep_scrub_stamp":"2024-05-08T19:48:48.585336+0000","last_clean_scrub_stamp":"2024-05-08T19:48:48.585336+0000","objects_scrubbed":2,"log_size":7016,"log_dups_size":0,"ondisk_log_size":7016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.956585+0000","scrub_duration":0.041923031999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7021,"num_write_kb":53638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"26'2305","reported_seq":2345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:45.486801+0000","last_change":"2024-05-08T19:48:45.486911+0000","last_active":"2024-05-08T19:48:45.486801+0000","last_peered":"2024-05-08T19:48:45.486801+0000","last_clean":"2024-05-08T19:48:45.486801+0000","last_became_active":"2024-05-08T19:22:20.449693+0000","last_became_peered":"2024-05-08T19:22:20.449693+0000","last_unstale":"2024-05-08T19:48:45.486801+0000","last_undegraded":"2024-05-08T19:48:45.486801+0000","last_fullsized":"2024-05-08T19:48:45.486801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2305","last_scrub_stamp":"2024-05-08T19:48:45.486775+0000","last_deep_scrub":"26'2305","last_deep_scrub_stamp":"2024-05-08T19:48:45.486775+0000","last_clean_scrub_stamp":"2024-05-08T19:48:45.486775+0000","objects_scrubbed":0,"log_size":2305,"log_dups_size":0,"ondisk_log_size":2305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:24.858024+0000","scrub_duration":0.0061246510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'8998","reported_seq":9170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.608015+0000","last_change":"2024-05-08T19:22:24.472926+0000","last_active":"2024-05-08T19:48:36.608015+0000","last_peered":"2024-05-08T19:48:36.608015+0000","last_clean":"2024-05-08T19:48:36.608015+0000","last_became_active":"2024-05-08T19:22:24.472518+0000","last_became_peered":"2024-05-08T19:22:24.472518+0000","last_unstale":"2024-05-08T19:48:36.608015+0000","last_undegraded":"2024-05-08T19:48:36.608015+0000","last_fullsized":"2024-05-08T19:48:36.608015+0000","mapping_epoch":22,"log_start":"26'1583","ondisk_log_start":"26'1583","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7415,"log_dups_size":0,"ondisk_log_size":7415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":5460,"num_write":6563,"num_write_kb":1024036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"26'7864","reported_seq":7905,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.423965+0000","last_change":"2024-05-08T19:48:54.424101+0000","last_active":"2024-05-08T19:48:54.423965+0000","last_peered":"2024-05-08T19:48:54.423965+0000","last_clean":"2024-05-08T19:48:54.423965+0000","last_became_active":"2024-05-08T19:22:20.007542+0000","last_became_peered":"2024-05-08T19:22:20.007542+0000","last_unstale":"2024-05-08T19:48:54.423965+0000","last_undegraded":"2024-05-08T19:48:54.423965+0000","last_fullsized":"2024-05-08T19:48:54.423965+0000","mapping_epoch":17,"log_start":"26'300","ondisk_log_start":"26'300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7864","last_scrub_stamp":"2024-05-08T19:48:54.423939+0000","last_deep_scrub":"26'7864","last_deep_scrub_stamp":"2024-05-08T19:48:54.423939+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.423939+0000","objects_scrubbed":0,"log_size":7564,"log_dups_size":0,"ondisk_log_size":7564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:12.713883+0000","scrub_duration":0.007576635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7858,"num_write_kb":54448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'2322","reported_seq":2362,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.283403+0000","last_change":"2024-05-08T19:48:51.283508+0000","last_active":"2024-05-08T19:48:51.283403+0000","last_peered":"2024-05-08T19:48:51.283403+0000","last_clean":"2024-05-08T19:48:51.283403+0000","last_became_active":"2024-05-08T19:22:20.443049+0000","last_became_peered":"2024-05-08T19:22:20.443049+0000","last_unstale":"2024-05-08T19:48:51.283403+0000","last_undegraded":"2024-05-08T19:48:51.283403+0000","last_fullsized":"2024-05-08T19:48:51.283403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2322","last_scrub_stamp":"2024-05-08T19:48:51.283371+0000","last_deep_scrub":"26'2322","last_deep_scrub_stamp":"2024-05-08T19:48:51.283371+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.283371+0000","objects_scrubbed":0,"log_size":2322,"log_dups_size":0,"ondisk_log_size":2322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:41.266333+0000","scrub_duration":0.0034339180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"26'8111","reported_seq":9094,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.658543+0000","last_change":"2024-05-08T19:23:11.532565+0000","last_active":"2024-05-08T19:48:36.658543+0000","last_peered":"2024-05-08T19:48:36.658543+0000","last_clean":"2024-05-08T19:48:36.658543+0000","last_became_active":"2024-05-08T19:23:11.532148+0000","last_became_peered":"2024-05-08T19:23:11.532148+0000","last_unstale":"2024-05-08T19:48:36.658543+0000","last_undegraded":"2024-05-08T19:48:36.658543+0000","last_fullsized":"2024-05-08T19:48:36.658543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":8111,"log_dups_size":0,"ondisk_log_size":8111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":959,"num_read_kb":67642,"num_write":5666,"num_write_kb":895823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'2313","reported_seq":2343,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:38.698745+0000","last_change":"2024-05-08T19:22:20.449968+0000","last_active":"2024-05-08T19:48:38.698745+0000","last_peered":"2024-05-08T19:48:38.698745+0000","last_clean":"2024-05-08T19:48:38.698745+0000","last_became_active":"2024-05-08T19:22:20.449709+0000","last_became_peered":"2024-05-08T19:22:20.449709+0000","last_unstale":"2024-05-08T19:48:38.698745+0000","last_undegraded":"2024-05-08T19:48:38.698745+0000","last_fullsized":"2024-05-08T19:48:38.698745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2313,"log_dups_size":0,"ondisk_log_size":2313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'7717","reported_seq":8693,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.096346+0000","last_change":"2024-05-08T19:48:40.096442+0000","last_active":"2024-05-08T19:48:40.096346+0000","last_peered":"2024-05-08T19:48:40.096346+0000","last_clean":"2024-05-08T19:48:40.096346+0000","last_became_active":"2024-05-08T19:22:20.004404+0000","last_became_peered":"2024-05-08T19:22:20.004404+0000","last_unstale":"2024-05-08T19:48:40.096346+0000","last_undegraded":"2024-05-08T19:48:40.096346+0000","last_fullsized":"2024-05-08T19:48:40.096346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7717","last_scrub_stamp":"2024-05-08T19:48:40.096323+0000","last_deep_scrub":"26'7717","last_deep_scrub_stamp":"2024-05-08T19:48:40.096323+0000","last_clean_scrub_stamp":"2024-05-08T19:48:40.096323+0000","objects_scrubbed":2,"log_size":7717,"log_dups_size":0,"ondisk_log_size":7717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:30.861928+0000","scrub_duration":0.037188867,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":935,"num_read_kb":4706,"num_write":7717,"num_write_kb":54235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"26'8484","reported_seq":9041,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.672650+0000","last_change":"2024-05-08T19:22:24.617952+0000","last_active":"2024-05-08T19:48:36.672650+0000","last_peered":"2024-05-08T19:48:36.672650+0000","last_clean":"2024-05-08T19:48:36.672650+0000","last_became_active":"2024-05-08T19:22:24.617627+0000","last_became_peered":"2024-05-08T19:22:24.617627+0000","last_unstale":"2024-05-08T19:48:36.672650+0000","last_undegraded":"2024-05-08T19:48:36.672650+0000","last_fullsized":"2024-05-08T19:48:36.672650+0000","mapping_epoch":22,"log_start":"26'574","ondisk_log_start":"26'574","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7910,"log_dups_size":0,"ondisk_log_size":7910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":27006,"num_write":6146,"num_write_kb":958865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"26'2364","reported_seq":2393,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.615215+0000","last_change":"2024-05-08T19:22:20.447152+0000","last_active":"2024-05-08T19:48:36.615215+0000","last_peered":"2024-05-08T19:48:36.615215+0000","last_clean":"2024-05-08T19:48:36.615215+0000","last_became_active":"2024-05-08T19:22:20.446864+0000","last_became_peered":"2024-05-08T19:22:20.446864+0000","last_unstale":"2024-05-08T19:48:36.615215+0000","last_undegraded":"2024-05-08T19:48:36.615215+0000","last_fullsized":"2024-05-08T19:48:36.615215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2364,"log_dups_size":0,"ondisk_log_size":2364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'5126","reported_seq":5167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:52.379611+0000","last_change":"2024-05-08T19:48:52.379727+0000","last_active":"2024-05-08T19:48:52.379611+0000","last_peered":"2024-05-08T19:48:52.379611+0000","last_clean":"2024-05-08T19:48:52.379611+0000","last_became_active":"2024-05-08T19:22:20.003441+0000","last_became_peered":"2024-05-08T19:22:20.003441+0000","last_unstale":"2024-05-08T19:48:52.379611+0000","last_undegraded":"2024-05-08T19:48:52.379611+0000","last_fullsized":"2024-05-08T19:48:52.379611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5126","last_scrub_stamp":"2024-05-08T19:48:52.379584+0000","last_deep_scrub":"26'5126","last_deep_scrub_stamp":"2024-05-08T19:48:52.379584+0000","last_clean_scrub_stamp":"2024-05-08T19:48:52.379584+0000","objects_scrubbed":0,"log_size":5126,"log_dups_size":0,"ondisk_log_size":5126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:42.362547+0000","scrub_duration":0.0049865459999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5120,"num_write_kb":36122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.898947+0000","last_change":"2024-05-08T19:48:49.899073+0000","last_active":"2024-05-08T19:48:49.898947+0000","last_peered":"2024-05-08T19:48:49.898947+0000","last_clean":"2024-05-08T19:48:49.898947+0000","last_became_active":"2024-05-08T19:22:17.116272+0000","last_became_peered":"2024-05-08T19:22:17.116272+0000","last_unstale":"2024-05-08T19:48:49.898947+0000","last_undegraded":"2024-05-08T19:48:49.898947+0000","last_fullsized":"2024-05-08T19:48:49.898947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-05-08T19:48:49.898920+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-05-08T19:48:49.898920+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.898920+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:35.156807+0000","scrub_duration":0.007153057,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'8661","reported_seq":8768,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.661662+0000","last_change":"2024-05-08T19:22:24.617594+0000","last_active":"2024-05-08T19:48:36.661662+0000","last_peered":"2024-05-08T19:48:36.661662+0000","last_clean":"2024-05-08T19:48:36.661662+0000","last_became_active":"2024-05-08T19:22:24.616486+0000","last_became_peered":"2024-05-08T19:22:24.616486+0000","last_unstale":"2024-05-08T19:48:36.661662+0000","last_undegraded":"2024-05-08T19:48:36.661662+0000","last_fullsized":"2024-05-08T19:48:36.661662+0000","mapping_epoch":22,"log_start":"26'1423","ondisk_log_start":"26'1423","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7238,"log_dups_size":0,"ondisk_log_size":7238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":5028,"num_write":6258,"num_write_kb":895883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"26'2257","reported_seq":2297,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:48.540427+0000","last_change":"2024-05-08T19:48:48.540554+0000","last_active":"2024-05-08T19:48:48.540427+0000","last_peered":"2024-05-08T19:48:48.540427+0000","last_clean":"2024-05-08T19:48:48.540427+0000","last_became_active":"2024-05-08T19:22:20.445191+0000","last_became_peered":"2024-05-08T19:22:20.445191+0000","last_unstale":"2024-05-08T19:48:48.540427+0000","last_undegraded":"2024-05-08T19:48:48.540427+0000","last_fullsized":"2024-05-08T19:48:48.540427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2257","last_scrub_stamp":"2024-05-08T19:48:48.540400+0000","last_deep_scrub":"26'2257","last_deep_scrub_stamp":"2024-05-08T19:48:48.540400+0000","last_clean_scrub_stamp":"2024-05-08T19:48:48.540400+0000","objects_scrubbed":0,"log_size":2257,"log_dups_size":0,"ondisk_log_size":2257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:38.523363+0000","scrub_duration":0.0020860969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'8076","reported_seq":8118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:50.921979+0000","last_change":"2024-05-08T19:48:50.922101+0000","last_active":"2024-05-08T19:48:50.921979+0000","last_peered":"2024-05-08T19:48:50.921979+0000","last_clean":"2024-05-08T19:48:50.921979+0000","last_became_active":"2024-05-08T19:22:20.015062+0000","last_became_peered":"2024-05-08T19:22:20.015062+0000","last_unstale":"2024-05-08T19:48:50.921979+0000","last_undegraded":"2024-05-08T19:48:50.921979+0000","last_fullsized":"2024-05-08T19:48:50.921979+0000","mapping_epoch":17,"log_start":"26'1200","ondisk_log_start":"26'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8076","last_scrub_stamp":"2024-05-08T19:48:50.921951+0000","last_deep_scrub":"26'8076","last_deep_scrub_stamp":"2024-05-08T19:48:50.921951+0000","last_clean_scrub_stamp":"2024-05-08T19:48:50.921951+0000","objects_scrubbed":1,"log_size":6876,"log_dups_size":0,"ondisk_log_size":6876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:09.690484+0000","scrub_duration":0.020418589000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8080,"num_write_kb":54571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'8514","reported_seq":9514,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.275901+0000","last_change":"2024-05-08T19:22:24.614066+0000","last_active":"2024-05-08T19:48:36.275901+0000","last_peered":"2024-05-08T19:48:36.275901+0000","last_clean":"2024-05-08T19:48:36.275901+0000","last_became_active":"2024-05-08T19:22:24.613661+0000","last_became_peered":"2024-05-08T19:22:24.613661+0000","last_unstale":"2024-05-08T19:48:36.275901+0000","last_undegraded":"2024-05-08T19:48:36.275901+0000","last_fullsized":"2024-05-08T19:48:36.275901+0000","mapping_epoch":22,"log_start":"26'1305","ondisk_log_start":"26'1305","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7209,"log_dups_size":0,"ondisk_log_size":7209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":973,"num_read_kb":68996,"num_write":6084,"num_write_kb":873899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"26'6281","reported_seq":6322,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.912235+0000","last_change":"2024-05-08T19:48:54.912365+0000","last_active":"2024-05-08T19:48:54.912235+0000","last_peered":"2024-05-08T19:48:54.912235+0000","last_clean":"2024-05-08T19:48:54.912235+0000","last_became_active":"2024-05-08T19:22:20.014926+0000","last_became_peered":"2024-05-08T19:22:20.014926+0000","last_unstale":"2024-05-08T19:48:54.912235+0000","last_undegraded":"2024-05-08T19:48:54.912235+0000","last_fullsized":"2024-05-08T19:48:54.912235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6281","last_scrub_stamp":"2024-05-08T19:48:54.912210+0000","last_deep_scrub":"26'6281","last_deep_scrub_stamp":"2024-05-08T19:48:54.912210+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.912210+0000","objects_scrubbed":2,"log_size":6281,"log_dups_size":0,"ondisk_log_size":6281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:44.895173+0000","scrub_duration":0.025468606000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7231304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6276,"num_write_kb":44046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"26'2390","reported_seq":2419,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.591384+0000","last_change":"2024-05-08T19:22:20.446453+0000","last_active":"2024-05-08T19:48:36.591384+0000","last_peered":"2024-05-08T19:48:36.591384+0000","last_clean":"2024-05-08T19:48:36.591384+0000","last_became_active":"2024-05-08T19:22:20.446194+0000","last_became_peered":"2024-05-08T19:22:20.446194+0000","last_unstale":"2024-05-08T19:48:36.591384+0000","last_undegraded":"2024-05-08T19:48:36.591384+0000","last_fullsized":"2024-05-08T19:48:36.591384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2390,"log_dups_size":0,"ondisk_log_size":2390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'8362","reported_seq":8758,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:39.756356+0000","last_change":"2024-05-08T19:22:24.615481+0000","last_active":"2024-05-08T19:48:39.756356+0000","last_peered":"2024-05-08T19:48:39.756356+0000","last_clean":"2024-05-08T19:48:39.756356+0000","last_became_active":"2024-05-08T19:22:24.615069+0000","last_became_peered":"2024-05-08T19:22:24.615069+0000","last_unstale":"2024-05-08T19:48:39.756356+0000","last_undegraded":"2024-05-08T19:48:39.756356+0000","last_fullsized":"2024-05-08T19:48:39.756356+0000","mapping_epoch":22,"log_start":"26'1929","ondisk_log_start":"26'1929","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6433,"log_dups_size":0,"ondisk_log_size":6433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":368,"num_read_kb":23786,"num_write":5985,"num_write_kb":964471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'5786","reported_seq":6318,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.662419+0000","last_change":"2024-05-08T19:48:51.662511+0000","last_active":"2024-05-08T19:48:51.662419+0000","last_peered":"2024-05-08T19:48:51.662419+0000","last_clean":"2024-05-08T19:48:51.662419+0000","last_became_active":"2024-05-08T19:22:20.001339+0000","last_became_peered":"2024-05-08T19:22:20.001339+0000","last_unstale":"2024-05-08T19:48:51.662419+0000","last_undegraded":"2024-05-08T19:48:51.662419+0000","last_fullsized":"2024-05-08T19:48:51.662419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5786","last_scrub_stamp":"2024-05-08T19:48:51.662392+0000","last_deep_scrub":"26'5786","last_deep_scrub_stamp":"2024-05-08T19:48:51.662392+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.662392+0000","objects_scrubbed":4,"log_size":5786,"log_dups_size":0,"ondisk_log_size":5786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:55.948554+0000","scrub_duration":0.063602542999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11721836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":3579,"num_write":6369,"num_write_kb":46119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"26'2254","reported_seq":2276,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.636744+0000","last_change":"2024-05-08T19:23:11.387164+0000","last_active":"2024-05-08T19:48:36.636744+0000","last_peered":"2024-05-08T19:48:36.636744+0000","last_clean":"2024-05-08T19:48:36.636744+0000","last_became_active":"2024-05-08T19:23:11.386882+0000","last_became_peered":"2024-05-08T19:23:11.386882+0000","last_unstale":"2024-05-08T19:48:36.636744+0000","last_undegraded":"2024-05-08T19:48:36.636744+0000","last_fullsized":"2024-05-08T19:48:36.636744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2254,"log_dups_size":0,"ondisk_log_size":2254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"26'8456","reported_seq":8886,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.676568+0000","last_change":"2024-05-08T19:22:24.614812+0000","last_active":"2024-05-08T19:48:36.676568+0000","last_peered":"2024-05-08T19:48:36.676568+0000","last_clean":"2024-05-08T19:48:36.676568+0000","last_became_active":"2024-05-08T19:22:24.614433+0000","last_became_peered":"2024-05-08T19:22:24.614433+0000","last_unstale":"2024-05-08T19:48:36.676568+0000","last_undegraded":"2024-05-08T19:48:36.676568+0000","last_fullsized":"2024-05-08T19:48:36.676568+0000","mapping_epoch":22,"log_start":"26'1215","ondisk_log_start":"26'1215","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7241,"log_dups_size":0,"ondisk_log_size":7241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":403,"num_read_kb":32316,"num_write":6068,"num_write_kb":878068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'4080","reported_seq":4121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:52.662263+0000","last_change":"2024-05-08T19:48:52.662361+0000","last_active":"2024-05-08T19:48:52.662263+0000","last_peered":"2024-05-08T19:48:52.662263+0000","last_clean":"2024-05-08T19:48:52.662263+0000","last_became_active":"2024-05-08T19:22:20.012383+0000","last_became_peered":"2024-05-08T19:22:20.012383+0000","last_unstale":"2024-05-08T19:48:52.662263+0000","last_undegraded":"2024-05-08T19:48:52.662263+0000","last_fullsized":"2024-05-08T19:48:52.662263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4080","last_scrub_stamp":"2024-05-08T19:48:52.662236+0000","last_deep_scrub":"26'4080","last_deep_scrub_stamp":"2024-05-08T19:48:52.662236+0000","last_clean_scrub_stamp":"2024-05-08T19:48:52.662236+0000","objects_scrubbed":2,"log_size":4080,"log_dups_size":0,"ondisk_log_size":4080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:36.022871+0000","scrub_duration":0.026319581000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":4095,"num_write_kb":27507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":128316,"num_omap_keys":195,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'2300","reported_seq":2329,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.167357+0000","last_change":"2024-05-08T19:22:20.436459+0000","last_active":"2024-05-08T19:48:36.167357+0000","last_peered":"2024-05-08T19:48:36.167357+0000","last_clean":"2024-05-08T19:48:36.167357+0000","last_became_active":"2024-05-08T19:22:20.435680+0000","last_became_peered":"2024-05-08T19:22:20.435680+0000","last_unstale":"2024-05-08T19:48:36.167357+0000","last_undegraded":"2024-05-08T19:48:36.167357+0000","last_fullsized":"2024-05-08T19:48:36.167357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2300,"log_dups_size":0,"ondisk_log_size":2300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"26'8822","reported_seq":9061,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.658972+0000","last_change":"2024-05-08T19:22:24.473208+0000","last_active":"2024-05-08T19:48:36.658972+0000","last_peered":"2024-05-08T19:48:36.658972+0000","last_clean":"2024-05-08T19:48:36.658972+0000","last_became_active":"2024-05-08T19:22:24.472782+0000","last_became_peered":"2024-05-08T19:22:24.472782+0000","last_unstale":"2024-05-08T19:48:36.658972+0000","last_undegraded":"2024-05-08T19:48:36.658972+0000","last_fullsized":"2024-05-08T19:48:36.658972+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7184,"log_dups_size":0,"ondisk_log_size":7184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":12280,"num_write":6457,"num_write_kb":1036607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2845","reported_seq":2875,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:33.125352+0000","last_change":"2024-05-08T19:22:20.014848+0000","last_active":"2024-05-08T19:48:33.125352+0000","last_peered":"2024-05-08T19:48:33.125352+0000","last_clean":"2024-05-08T19:48:33.125352+0000","last_became_active":"2024-05-08T19:22:20.013739+0000","last_became_peered":"2024-05-08T19:22:20.013739+0000","last_unstale":"2024-05-08T19:48:33.125352+0000","last_undegraded":"2024-05-08T19:48:33.125352+0000","last_fullsized":"2024-05-08T19:48:33.125352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:18.976800+0000","last_clean_scrub_stamp":"2024-05-08T19:22:18.976800+0000","objects_scrubbed":0,"log_size":2845,"log_dups_size":0,"ondisk_log_size":2845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2848,"num_write_kb":22358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"26'2333","reported_seq":2373,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:45.305790+0000","last_change":"2024-05-08T19:48:45.305902+0000","last_active":"2024-05-08T19:48:45.305790+0000","last_peered":"2024-05-08T19:48:45.305790+0000","last_clean":"2024-05-08T19:48:45.305790+0000","last_became_active":"2024-05-08T19:22:20.447180+0000","last_became_peered":"2024-05-08T19:22:20.447180+0000","last_unstale":"2024-05-08T19:48:45.305790+0000","last_undegraded":"2024-05-08T19:48:45.305790+0000","last_fullsized":"2024-05-08T19:48:45.305790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2333","last_scrub_stamp":"2024-05-08T19:48:45.305763+0000","last_deep_scrub":"26'2333","last_deep_scrub_stamp":"2024-05-08T19:48:45.305763+0000","last_clean_scrub_stamp":"2024-05-08T19:48:45.305763+0000","objects_scrubbed":0,"log_size":2333,"log_dups_size":0,"ondisk_log_size":2333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:28.666398+0000","scrub_duration":0.002168775,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"26'8924","reported_seq":9895,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.112356+0000","last_change":"2024-05-08T19:22:24.614091+0000","last_active":"2024-05-08T19:48:36.112356+0000","last_peered":"2024-05-08T19:48:36.112356+0000","last_clean":"2024-05-08T19:48:36.112356+0000","last_became_active":"2024-05-08T19:22:24.613677+0000","last_became_peered":"2024-05-08T19:22:24.613677+0000","last_unstale":"2024-05-08T19:48:36.112356+0000","last_undegraded":"2024-05-08T19:48:36.112356+0000","last_fullsized":"2024-05-08T19:48:36.112356+0000","mapping_epoch":22,"log_start":"26'1529","ondisk_log_start":"26'1529","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7395,"log_dups_size":0,"ondisk_log_size":7395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":945,"num_read_kb":70780,"num_write":6622,"num_write_kb":1028558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"26'4275","reported_seq":4316,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.616175+0000","last_change":"2024-05-08T19:48:41.616298+0000","last_active":"2024-05-08T19:48:41.616175+0000","last_peered":"2024-05-08T19:48:41.616175+0000","last_clean":"2024-05-08T19:48:41.616175+0000","last_became_active":"2024-05-08T19:22:20.011262+0000","last_became_peered":"2024-05-08T19:22:20.011262+0000","last_unstale":"2024-05-08T19:48:41.616175+0000","last_undegraded":"2024-05-08T19:48:41.616175+0000","last_fullsized":"2024-05-08T19:48:41.616175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4275","last_scrub_stamp":"2024-05-08T19:48:41.616128+0000","last_deep_scrub":"26'4275","last_deep_scrub_stamp":"2024-05-08T19:48:41.616128+0000","last_clean_scrub_stamp":"2024-05-08T19:48:41.616128+0000","objects_scrubbed":2,"log_size":4275,"log_dups_size":0,"ondisk_log_size":4275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:26.145161+0000","scrub_duration":0.036942485999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4270,"num_write_kb":27446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"26'2429","reported_seq":2458,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.672769+0000","last_change":"2024-05-08T19:22:20.438689+0000","last_active":"2024-05-08T19:48:36.672769+0000","last_peered":"2024-05-08T19:48:36.672769+0000","last_clean":"2024-05-08T19:48:36.672769+0000","last_became_active":"2024-05-08T19:22:20.438434+0000","last_became_peered":"2024-05-08T19:22:20.438434+0000","last_unstale":"2024-05-08T19:48:36.672769+0000","last_undegraded":"2024-05-08T19:48:36.672769+0000","last_fullsized":"2024-05-08T19:48:36.672769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2429,"log_dups_size":0,"ondisk_log_size":2429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"26'8249","reported_seq":8514,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.440362+0000","last_change":"2024-05-08T19:22:24.473569+0000","last_active":"2024-05-08T19:48:36.440362+0000","last_peered":"2024-05-08T19:48:36.440362+0000","last_clean":"2024-05-08T19:48:36.440362+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:48:36.440362+0000","last_undegraded":"2024-05-08T19:48:36.440362+0000","last_fullsized":"2024-05-08T19:48:36.440362+0000","mapping_epoch":22,"log_start":"26'1106","ondisk_log_start":"26'1106","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7143,"log_dups_size":0,"ondisk_log_size":7143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":13756,"num_write":5781,"num_write_kb":975965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"26'7372","reported_seq":7413,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.622314+0000","last_change":"2024-05-08T19:48:49.622415+0000","last_active":"2024-05-08T19:48:49.622314+0000","last_peered":"2024-05-08T19:48:49.622314+0000","last_clean":"2024-05-08T19:48:49.622314+0000","last_became_active":"2024-05-08T19:22:20.006772+0000","last_became_peered":"2024-05-08T19:22:20.006772+0000","last_unstale":"2024-05-08T19:48:49.622314+0000","last_undegraded":"2024-05-08T19:48:49.622314+0000","last_fullsized":"2024-05-08T19:48:49.622314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7372","last_scrub_stamp":"2024-05-08T19:48:49.622290+0000","last_deep_scrub":"26'7372","last_deep_scrub_stamp":"2024-05-08T19:48:49.622290+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.622290+0000","objects_scrubbed":3,"log_size":7372,"log_dups_size":0,"ondisk_log_size":7372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:32.982924+0000","scrub_duration":0.047389768999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7364,"num_write_kb":54049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"26'2338","reported_seq":2366,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.407041+0000","last_change":"2024-05-08T19:22:20.436696+0000","last_active":"2024-05-08T19:48:36.407041+0000","last_peered":"2024-05-08T19:48:36.407041+0000","last_clean":"2024-05-08T19:48:36.407041+0000","last_became_active":"2024-05-08T19:22:20.436373+0000","last_became_peered":"2024-05-08T19:22:20.436373+0000","last_unstale":"2024-05-08T19:48:36.407041+0000","last_undegraded":"2024-05-08T19:48:36.407041+0000","last_fullsized":"2024-05-08T19:48:36.407041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2338,"log_dups_size":0,"ondisk_log_size":2338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"26'8815","reported_seq":9444,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.647414+0000","last_change":"2024-05-08T19:22:24.478232+0000","last_active":"2024-05-08T19:48:36.647414+0000","last_peered":"2024-05-08T19:48:36.647414+0000","last_clean":"2024-05-08T19:48:36.647414+0000","last_became_active":"2024-05-08T19:22:24.477941+0000","last_became_peered":"2024-05-08T19:22:24.477941+0000","last_unstale":"2024-05-08T19:48:36.647414+0000","last_undegraded":"2024-05-08T19:48:36.647414+0000","last_fullsized":"2024-05-08T19:48:36.647414+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7177,"log_dups_size":0,"ondisk_log_size":7177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":603,"num_read_kb":28586,"num_write":6338,"num_write_kb":901267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"26'6180","reported_seq":6220,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:56.885655+0000","last_change":"2024-05-08T19:48:56.885764+0000","last_active":"2024-05-08T19:48:56.885655+0000","last_peered":"2024-05-08T19:48:56.885655+0000","last_clean":"2024-05-08T19:48:56.885655+0000","last_became_active":"2024-05-08T19:22:20.013748+0000","last_became_peered":"2024-05-08T19:22:20.013748+0000","last_unstale":"2024-05-08T19:48:56.885655+0000","last_undegraded":"2024-05-08T19:48:56.885655+0000","last_fullsized":"2024-05-08T19:48:56.885655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6180","last_scrub_stamp":"2024-05-08T19:48:56.885629+0000","last_deep_scrub":"26'6180","last_deep_scrub_stamp":"2024-05-08T19:48:56.885629+0000","last_clean_scrub_stamp":"2024-05-08T19:48:56.885629+0000","objects_scrubbed":1,"log_size":6180,"log_dups_size":0,"ondisk_log_size":6180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:15.175572+0000","scrub_duration":0.012091622,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6199,"num_write_kb":41171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":340,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"26'2344","reported_seq":2373,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.314963+0000","last_change":"2024-05-08T19:22:20.457103+0000","last_active":"2024-05-08T19:48:41.314963+0000","last_peered":"2024-05-08T19:48:41.314963+0000","last_clean":"2024-05-08T19:48:41.314963+0000","last_became_active":"2024-05-08T19:22:20.456850+0000","last_became_peered":"2024-05-08T19:22:20.456850+0000","last_unstale":"2024-05-08T19:48:41.314963+0000","last_undegraded":"2024-05-08T19:48:41.314963+0000","last_fullsized":"2024-05-08T19:48:41.314963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2344,"log_dups_size":0,"ondisk_log_size":2344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"26'8417","reported_seq":8861,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.314939+0000","last_change":"2024-05-08T19:22:24.614410+0000","last_active":"2024-05-08T19:48:41.314939+0000","last_peered":"2024-05-08T19:48:41.314939+0000","last_clean":"2024-05-08T19:48:41.314939+0000","last_became_active":"2024-05-08T19:22:24.613904+0000","last_became_peered":"2024-05-08T19:22:24.613904+0000","last_unstale":"2024-05-08T19:48:41.314939+0000","last_undegraded":"2024-05-08T19:48:41.314939+0000","last_fullsized":"2024-05-08T19:48:41.314939+0000","mapping_epoch":22,"log_start":"26'512","ondisk_log_start":"26'512","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7905,"log_dups_size":0,"ondisk_log_size":7905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":29592,"num_write":6013,"num_write_kb":842872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"26'8395","reported_seq":8435,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:47.025688+0000","last_change":"2024-05-08T19:48:47.025794+0000","last_active":"2024-05-08T19:48:47.025688+0000","last_peered":"2024-05-08T19:48:47.025688+0000","last_clean":"2024-05-08T19:48:47.025688+0000","last_became_active":"2024-05-08T19:22:20.000454+0000","last_became_peered":"2024-05-08T19:22:20.000454+0000","last_unstale":"2024-05-08T19:48:47.025688+0000","last_undegraded":"2024-05-08T19:48:47.025688+0000","last_fullsized":"2024-05-08T19:48:47.025688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8395","last_scrub_stamp":"2024-05-08T19:48:47.025662+0000","last_deep_scrub":"26'8395","last_deep_scrub_stamp":"2024-05-08T19:48:47.025662+0000","last_clean_scrub_stamp":"2024-05-08T19:48:47.025662+0000","objects_scrubbed":3,"log_size":8395,"log_dups_size":0,"ondisk_log_size":8395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:26.396911+0000","scrub_duration":0.054102984999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8388,"num_write_kb":54739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'2302","reported_seq":2330,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.577848+0000","last_change":"2024-05-08T19:22:20.456485+0000","last_active":"2024-05-08T19:48:36.577848+0000","last_peered":"2024-05-08T19:48:36.577848+0000","last_clean":"2024-05-08T19:48:36.577848+0000","last_became_active":"2024-05-08T19:22:20.456225+0000","last_became_peered":"2024-05-08T19:22:20.456225+0000","last_unstale":"2024-05-08T19:48:36.577848+0000","last_undegraded":"2024-05-08T19:48:36.577848+0000","last_fullsized":"2024-05-08T19:48:36.577848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2302,"log_dups_size":0,"ondisk_log_size":2302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"26'8603","reported_seq":9423,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.436904+0000","last_change":"2024-05-08T19:22:24.473117+0000","last_active":"2024-05-08T19:48:36.436904+0000","last_peered":"2024-05-08T19:48:36.436904+0000","last_clean":"2024-05-08T19:48:36.436904+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:48:36.436904+0000","last_undegraded":"2024-05-08T19:48:36.436904+0000","last_fullsized":"2024-05-08T19:48:36.436904+0000","mapping_epoch":22,"log_start":"26'1458","ondisk_log_start":"26'1458","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":794,"num_read_kb":57832,"num_write":6099,"num_write_kb":1028205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'7807","reported_seq":7847,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:55.618149+0000","last_change":"2024-05-08T19:48:55.618256+0000","last_active":"2024-05-08T19:48:55.618149+0000","last_peered":"2024-05-08T19:48:55.618149+0000","last_clean":"2024-05-08T19:48:55.618149+0000","last_became_active":"2024-05-08T19:22:20.005996+0000","last_became_peered":"2024-05-08T19:22:20.005996+0000","last_unstale":"2024-05-08T19:48:55.618149+0000","last_undegraded":"2024-05-08T19:48:55.618149+0000","last_fullsized":"2024-05-08T19:48:55.618149+0000","mapping_epoch":17,"log_start":"26'400","ondisk_log_start":"26'400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7807","last_scrub_stamp":"2024-05-08T19:48:55.618119+0000","last_deep_scrub":"26'7807","last_deep_scrub_stamp":"2024-05-08T19:48:55.618119+0000","last_clean_scrub_stamp":"2024-05-08T19:48:55.618119+0000","objects_scrubbed":3,"log_size":7407,"log_dups_size":0,"ondisk_log_size":7407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:45.601081+0000","scrub_duration":0.038095381999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7797,"num_write_kb":54350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"26'2304","reported_seq":2332,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.440462+0000","last_change":"2024-05-08T19:22:20.452861+0000","last_active":"2024-05-08T19:48:36.440462+0000","last_peered":"2024-05-08T19:48:36.440462+0000","last_clean":"2024-05-08T19:48:36.440462+0000","last_became_active":"2024-05-08T19:22:20.452600+0000","last_became_peered":"2024-05-08T19:22:20.452600+0000","last_unstale":"2024-05-08T19:48:36.440462+0000","last_undegraded":"2024-05-08T19:48:36.440462+0000","last_fullsized":"2024-05-08T19:48:36.440462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2304,"log_dups_size":0,"ondisk_log_size":2304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"26'8464","reported_seq":9181,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.672659+0000","last_change":"2024-05-08T19:22:24.614345+0000","last_active":"2024-05-08T19:48:36.672659+0000","last_peered":"2024-05-08T19:48:36.672659+0000","last_clean":"2024-05-08T19:48:36.672659+0000","last_became_active":"2024-05-08T19:22:24.613948+0000","last_became_peered":"2024-05-08T19:22:24.613948+0000","last_unstale":"2024-05-08T19:48:36.672659+0000","last_undegraded":"2024-05-08T19:48:36.672659+0000","last_fullsized":"2024-05-08T19:48:36.672659+0000","mapping_epoch":22,"log_start":"26'935","ondisk_log_start":"26'935","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7529,"log_dups_size":0,"ondisk_log_size":7529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":690,"num_read_kb":34094,"num_write":6014,"num_write_kb":938918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"26'9153","reported_seq":9193,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:42.086811+0000","last_change":"2024-05-08T19:48:42.086898+0000","last_active":"2024-05-08T19:48:42.086811+0000","last_peered":"2024-05-08T19:48:42.086811+0000","last_clean":"2024-05-08T19:48:42.086811+0000","last_became_active":"2024-05-08T19:22:20.004254+0000","last_became_peered":"2024-05-08T19:22:20.004254+0000","last_unstale":"2024-05-08T19:48:42.086811+0000","last_undegraded":"2024-05-08T19:48:42.086811+0000","last_fullsized":"2024-05-08T19:48:42.086811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9153","last_scrub_stamp":"2024-05-08T19:48:42.086788+0000","last_deep_scrub":"26'9153","last_deep_scrub_stamp":"2024-05-08T19:48:42.086788+0000","last_clean_scrub_stamp":"2024-05-08T19:48:42.086788+0000","objects_scrubbed":6,"log_size":9153,"log_dups_size":0,"ondisk_log_size":9153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:54.814215+0000","scrub_duration":0.069169347000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":9139,"num_write_kb":67371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73643,"num_omap_keys":112,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'2210","reported_seq":2238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.970400+0000","last_change":"2024-05-08T19:22:20.455712+0000","last_active":"2024-05-08T19:48:35.970400+0000","last_peered":"2024-05-08T19:48:35.970400+0000","last_clean":"2024-05-08T19:48:35.970400+0000","last_became_active":"2024-05-08T19:22:20.455493+0000","last_became_peered":"2024-05-08T19:22:20.455493+0000","last_unstale":"2024-05-08T19:48:35.970400+0000","last_undegraded":"2024-05-08T19:48:35.970400+0000","last_fullsized":"2024-05-08T19:48:35.970400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2210,"log_dups_size":0,"ondisk_log_size":2210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"26'2266","reported_seq":2295,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.584222+0000","last_change":"2024-05-08T19:22:20.459104+0000","last_active":"2024-05-08T19:48:36.584222+0000","last_peered":"2024-05-08T19:48:36.584222+0000","last_clean":"2024-05-08T19:48:36.584222+0000","last_became_active":"2024-05-08T19:22:20.452169+0000","last_became_peered":"2024-05-08T19:22:20.452169+0000","last_unstale":"2024-05-08T19:48:36.584222+0000","last_undegraded":"2024-05-08T19:48:36.584222+0000","last_fullsized":"2024-05-08T19:48:36.584222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2266,"log_dups_size":0,"ondisk_log_size":2266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'2366","reported_seq":2406,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.894394+0000","last_change":"2024-05-08T19:48:49.894493+0000","last_active":"2024-05-08T19:48:49.894394+0000","last_peered":"2024-05-08T19:48:49.894394+0000","last_clean":"2024-05-08T19:48:49.894394+0000","last_became_active":"2024-05-08T19:22:20.449047+0000","last_became_peered":"2024-05-08T19:22:20.449047+0000","last_unstale":"2024-05-08T19:48:49.894394+0000","last_undegraded":"2024-05-08T19:48:49.894394+0000","last_fullsized":"2024-05-08T19:48:49.894394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2366","last_scrub_stamp":"2024-05-08T19:48:49.894367+0000","last_deep_scrub":"26'2366","last_deep_scrub_stamp":"2024-05-08T19:48:49.894367+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.894367+0000","objects_scrubbed":0,"log_size":2366,"log_dups_size":0,"ondisk_log_size":2366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:54.180529+0000","scrub_duration":0.004363408,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'2258","reported_seq":2287,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.370865+0000","last_change":"2024-05-08T19:22:20.452192+0000","last_active":"2024-05-08T19:48:36.370865+0000","last_peered":"2024-05-08T19:48:36.370865+0000","last_clean":"2024-05-08T19:48:36.370865+0000","last_became_active":"2024-05-08T19:22:20.451625+0000","last_became_peered":"2024-05-08T19:22:20.451625+0000","last_unstale":"2024-05-08T19:48:36.370865+0000","last_undegraded":"2024-05-08T19:48:36.370865+0000","last_fullsized":"2024-05-08T19:48:36.370865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2258,"log_dups_size":0,"ondisk_log_size":2258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'2371","reported_seq":2408,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.942438+0000","last_change":"2024-05-08T19:23:11.054094+0000","last_active":"2024-05-08T19:48:35.942438+0000","last_peered":"2024-05-08T19:48:35.942438+0000","last_clean":"2024-05-08T19:48:35.942438+0000","last_became_active":"2024-05-08T19:23:11.053750+0000","last_became_peered":"2024-05-08T19:23:11.053750+0000","last_unstale":"2024-05-08T19:48:35.942438+0000","last_undegraded":"2024-05-08T19:48:35.942438+0000","last_fullsized":"2024-05-08T19:48:35.942438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2371,"log_dups_size":0,"ondisk_log_size":2371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'2321","reported_seq":2350,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.422394+0000","last_change":"2024-05-08T19:22:20.444479+0000","last_active":"2024-05-08T19:48:36.422394+0000","last_peered":"2024-05-08T19:48:36.422394+0000","last_clean":"2024-05-08T19:48:36.422394+0000","last_became_active":"2024-05-08T19:22:20.444219+0000","last_became_peered":"2024-05-08T19:22:20.444219+0000","last_unstale":"2024-05-08T19:48:36.422394+0000","last_undegraded":"2024-05-08T19:48:36.422394+0000","last_fullsized":"2024-05-08T19:48:36.422394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2321,"log_dups_size":0,"ondisk_log_size":2321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'2227","reported_seq":2256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.672228+0000","last_change":"2024-05-08T19:22:20.436874+0000","last_active":"2024-05-08T19:48:36.672228+0000","last_peered":"2024-05-08T19:48:36.672228+0000","last_clean":"2024-05-08T19:48:36.672228+0000","last_became_active":"2024-05-08T19:22:20.436626+0000","last_became_peered":"2024-05-08T19:22:20.436626+0000","last_unstale":"2024-05-08T19:48:36.672228+0000","last_undegraded":"2024-05-08T19:48:36.672228+0000","last_fullsized":"2024-05-08T19:48:36.672228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2227,"log_dups_size":0,"ondisk_log_size":2227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'2353","reported_seq":2382,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.616322+0000","last_change":"2024-05-08T19:22:20.462445+0000","last_active":"2024-05-08T19:48:36.616322+0000","last_peered":"2024-05-08T19:48:36.616322+0000","last_clean":"2024-05-08T19:48:36.616322+0000","last_became_active":"2024-05-08T19:22:20.461547+0000","last_became_peered":"2024-05-08T19:22:20.461547+0000","last_unstale":"2024-05-08T19:48:36.616322+0000","last_undegraded":"2024-05-08T19:48:36.616322+0000","last_fullsized":"2024-05-08T19:48:36.616322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2353,"log_dups_size":0,"ondisk_log_size":2353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'2321","reported_seq":2361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:39.900372+0000","last_change":"2024-05-08T19:48:39.900526+0000","last_active":"2024-05-08T19:48:39.900372+0000","last_peered":"2024-05-08T19:48:39.900372+0000","last_clean":"2024-05-08T19:48:39.900372+0000","last_became_active":"2024-05-08T19:22:20.442667+0000","last_became_peered":"2024-05-08T19:22:20.442667+0000","last_unstale":"2024-05-08T19:48:39.900372+0000","last_undegraded":"2024-05-08T19:48:39.900372+0000","last_fullsized":"2024-05-08T19:48:39.900372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2321","last_scrub_stamp":"2024-05-08T19:48:39.900327+0000","last_deep_scrub":"26'2321","last_deep_scrub_stamp":"2024-05-08T19:48:39.900327+0000","last_clean_scrub_stamp":"2024-05-08T19:48:39.900327+0000","objects_scrubbed":0,"log_size":2321,"log_dups_size":0,"ondisk_log_size":2321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:58.190270+0000","scrub_duration":0.094527218999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'2280","reported_seq":2309,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.799834+0000","last_change":"2024-05-08T19:22:20.448722+0000","last_active":"2024-05-08T19:48:40.799834+0000","last_peered":"2024-05-08T19:48:40.799834+0000","last_clean":"2024-05-08T19:48:40.799834+0000","last_became_active":"2024-05-08T19:22:20.448449+0000","last_became_peered":"2024-05-08T19:22:20.448449+0000","last_unstale":"2024-05-08T19:48:40.799834+0000","last_undegraded":"2024-05-08T19:48:40.799834+0000","last_fullsized":"2024-05-08T19:48:40.799834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2280,"log_dups_size":0,"ondisk_log_size":2280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'2285","reported_seq":2324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:44.719331+0000","last_change":"2024-05-08T19:48:44.719448+0000","last_active":"2024-05-08T19:48:44.719331+0000","last_peered":"2024-05-08T19:48:44.719331+0000","last_clean":"2024-05-08T19:48:44.719331+0000","last_became_active":"2024-05-08T19:22:20.450217+0000","last_became_peered":"2024-05-08T19:22:20.450217+0000","last_unstale":"2024-05-08T19:48:44.719331+0000","last_undegraded":"2024-05-08T19:48:44.719331+0000","last_fullsized":"2024-05-08T19:48:44.719331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2285","last_scrub_stamp":"2024-05-08T19:48:44.719301+0000","last_deep_scrub":"26'2285","last_deep_scrub_stamp":"2024-05-08T19:48:44.719301+0000","last_clean_scrub_stamp":"2024-05-08T19:48:44.719301+0000","objects_scrubbed":0,"log_size":2285,"log_dups_size":0,"ondisk_log_size":2285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:52.389992+0000","scrub_duration":0.0035809150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'2324","reported_seq":2352,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.496601+0000","last_change":"2024-05-08T19:22:20.453450+0000","last_active":"2024-05-08T19:48:36.496601+0000","last_peered":"2024-05-08T19:48:36.496601+0000","last_clean":"2024-05-08T19:48:36.496601+0000","last_became_active":"2024-05-08T19:22:20.453191+0000","last_became_peered":"2024-05-08T19:22:20.453191+0000","last_unstale":"2024-05-08T19:48:36.496601+0000","last_undegraded":"2024-05-08T19:48:36.496601+0000","last_fullsized":"2024-05-08T19:48:36.496601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'2354","reported_seq":2382,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.250642+0000","last_change":"2024-05-08T19:22:20.452591+0000","last_active":"2024-05-08T19:48:36.250642+0000","last_peered":"2024-05-08T19:48:36.250642+0000","last_clean":"2024-05-08T19:48:36.250642+0000","last_became_active":"2024-05-08T19:22:20.451209+0000","last_became_peered":"2024-05-08T19:22:20.451209+0000","last_unstale":"2024-05-08T19:48:36.250642+0000","last_undegraded":"2024-05-08T19:48:36.250642+0000","last_fullsized":"2024-05-08T19:48:36.250642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2354,"log_dups_size":0,"ondisk_log_size":2354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'2352","reported_seq":2380,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.913038+0000","last_change":"2024-05-08T19:22:20.461584+0000","last_active":"2024-05-08T19:48:35.913038+0000","last_peered":"2024-05-08T19:48:35.913038+0000","last_clean":"2024-05-08T19:48:35.913038+0000","last_became_active":"2024-05-08T19:22:20.461097+0000","last_became_peered":"2024-05-08T19:22:20.461097+0000","last_unstale":"2024-05-08T19:48:35.913038+0000","last_undegraded":"2024-05-08T19:48:35.913038+0000","last_fullsized":"2024-05-08T19:48:35.913038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18592,"num_read_kb":1141288,"num_write":194903,"num_write_kb":30181748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230906,"ondisk_log_size":230906,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2442,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148135,"ondisk_log_size":148135,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":241252722,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":2935,"num_read_kb":17425,"num_write":211935,"num_write_kb":1497715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":879928,"num_omap_keys":1340,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":323821568,"data_stored":482505444,"data_compressed":47939648,"data_compressed_allocated":70770688,"data_compressed_original":229515264,"omap_allocated":0,"internal_metadata":0},"log_size":196249,"ondisk_log_size":196249,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575171,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":901808,"kb_used_data":36392,"kb_used_omap":1,"kb_used_meta":865406,"kb_avail":93470032,"statfs":{"total":96636764160,"available":95713312768,"internally_reserved":0,"allocated":37265408,"data_stored":58267643,"data_compressed":5895427,"data_compressed_allocated":8474624,"data_compressed_original":29650944,"omap_allocated":1588,"internal_metadata":886176204},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.7290000000000001,"5min":2.153,"15min":1.4990000000000001},"min":{"1min":0.247,"5min":0.216,"15min":0.20699999999999999},"max":{"1min":13.09,"5min":26.544,"15min":26.544},"last":0.65600000000000003},{"interface":"front","average":{"1min":1.7270000000000001,"5min":2.0529999999999999,"15min":1.7729999999999999},"min":{"1min":0.31900000000000001,"5min":0.27800000000000002,"15min":0.223},"max":{"1min":12.454000000000001,"5min":26.713999999999999,"15min":26.713999999999999},"last":0.71699999999999997}]},{"osd":1,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":2.0600000000000001,"15min":1.982},"min":{"1min":0.27800000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":8.9480000000000004,"5min":14.557,"15min":32.259999999999998},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.599,"5min":2.0699999999999998,"15min":1.6259999999999999},"min":{"1min":0.28499999999999998,"5min":0.251,"15min":0.25},"max":{"1min":6.7190000000000003,"5min":21.867000000000001,"15min":36.018000000000001},"last":0.66900000000000004}]},{"osd":2,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":2.1629999999999998,"15min":1.5169999999999999},"min":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":10.959,"5min":13.635,"15min":13.635},"last":0.58099999999999996},{"interface":"front","average":{"1min":2.2810000000000001,"5min":2.3239999999999998,"15min":1.827},"min":{"1min":0.34300000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":19.231000000000002,"5min":19.469999999999999,"15min":19.469999999999999},"last":0.81399999999999995}]},{"osd":3,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":3.9630000000000001,"5min":2.6520000000000001,"15min":1.8720000000000001},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.29299999999999998},"max":{"1min":38.195,"5min":38.195,"15min":38.195},"last":0.746},{"interface":"front","average":{"1min":2.1269999999999998,"5min":1.996,"15min":1.806},"min":{"1min":0.373,"5min":0.33800000000000002,"15min":0.30599999999999999},"max":{"1min":14.134,"5min":14.134,"15min":26.501999999999999},"last":0.60099999999999998}]},{"osd":4,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":2.2000000000000002,"15min":1.677},"min":{"1min":0.30599999999999999,"5min":0.26600000000000001,"15min":0.26100000000000001},"max":{"1min":9.2289999999999992,"5min":37.356000000000002,"15min":37.356000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.319,"5min":2.5449999999999999,"15min":1.7450000000000001},"min":{"1min":0.35799999999999998,"5min":0.253,"15min":0.253},"max":{"1min":5.9950000000000001,"5min":31.786000000000001,"15min":31.786000000000001},"last":0.42099999999999999}]},{"osd":5,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":2.2440000000000002,"15min":1.8120000000000001},"min":{"1min":0.33000000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":4.6079999999999997,"5min":29.346,"15min":35.156999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.73,"15min":1.349},"min":{"1min":0.36699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":10.848000000000001,"5min":10.848000000000001,"15min":32.988999999999997},"last":0.53500000000000003}]},{"osd":6,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.681,"5min":1.7969999999999999,"15min":1.5089999999999999},"min":{"1min":0.42799999999999999,"5min":0.315,"15min":0.308},"max":{"1min":7.9089999999999998,"5min":13.763,"15min":16.077999999999999},"last":0.498},{"interface":"front","average":{"1min":2.2799999999999998,"5min":1.962,"15min":1.605},"min":{"1min":0.45700000000000002,"5min":0.308,"15min":0.27500000000000002},"max":{"1min":28.535,"5min":28.535,"15min":28.535},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575170,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1085188,"kb_used_data":49212,"kb_used_omap":1,"kb_used_meta":1035966,"kb_avail":93286652,"statfs":{"total":96636764160,"available":95525531648,"internally_reserved":0,"allocated":50393088,"data_stored":74750809,"data_compressed":7372511,"data_compressed_allocated":10829824,"data_compressed_original":35360768,"omap_allocated":1593,"internal_metadata":1060829639},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":2.6739999999999999,"5min":2.0550000000000002,"15min":1.466},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":17.488,"5min":17.488,"15min":17.488},"last":0.495},{"interface":"front","average":{"1min":3.4830000000000001,"5min":2.9060000000000001,"15min":1.899},"min":{"1min":0.34200000000000003,"5min":0.246,"15min":0.245},"max":{"1min":17.445,"5min":37.295999999999999,"15min":37.295999999999999},"last":0.57499999999999996}]},{"osd":1,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.101,"5min":2.581,"15min":1.8320000000000001},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.22800000000000001},"max":{"1min":20.460000000000001,"5min":22.753,"15min":22.753},"last":0.52600000000000002},{"interface":"front","average":{"1min":3.2210000000000001,"5min":2.7170000000000001,"15min":1.8859999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":18.388000000000002,"5min":37.521000000000001,"15min":37.521000000000001},"last":0.64400000000000002}]},{"osd":2,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.879,"5min":2.7669999999999999,"15min":1.903},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.247},"max":{"1min":23.228999999999999,"5min":23.952999999999999,"15min":23.952999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.367,"15min":1.6890000000000001},"min":{"1min":0.35799999999999998,"5min":0.29499999999999998,"15min":0.255},"max":{"1min":14.472,"5min":23.196999999999999,"15min":23.196999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.2400000000000002,"5min":2.5579999999999998,"15min":1.994},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.25800000000000001},"max":{"1min":17.577999999999999,"5min":21.975000000000001,"15min":43.082999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":3.6709999999999998,"5min":2.911,"15min":2.1219999999999999},"min":{"1min":0.434,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":17.719000000000001,"5min":23.859000000000002,"15min":43.872999999999998},"last":0.61599999999999999}]},{"osd":4,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.0910000000000002,"5min":2.7829999999999999,"15min":2.4390000000000001},"min":{"1min":0.29999999999999999,"5min":0.26500000000000001,"15min":0.26100000000000001},"max":{"1min":18.416,"5min":23.055,"15min":111.04900000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":4.2690000000000001,"5min":2.8079999999999998,"15min":1.7549999999999999},"min":{"1min":0.34499999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":28.757999999999999,"5min":28.757999999999999,"15min":28.757999999999999},"last":0.42499999999999999}]},{"osd":5,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.2090000000000001,"5min":2.5169999999999999,"15min":1.617},"min":{"1min":0.33900000000000002,"5min":0.309,"15min":0.251},"max":{"1min":14.680999999999999,"5min":39.134,"15min":39.134},"last":0.45600000000000002},{"interface":"front","average":{"1min":3.2709999999999999,"5min":3.2789999999999999,"15min":2.0249999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":19.527000000000001,"5min":67.576999999999998,"15min":67.576999999999998},"last":0.53700000000000003}]},{"osd":7,"last update":"Wed May 8 19:48:03 2024","interfaces":[{"interface":"back","average":{"1min":3.7450000000000001,"5min":2.52,"15min":1.6259999999999999},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":17.402000000000001,"5min":17.402000000000001,"15min":17.402000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":2.5459999999999998,"5min":1.9119999999999999,"15min":1.4590000000000001},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.29899999999999999},"max":{"1min":14.436999999999999,"5min":14.436999999999999,"15min":17.251000000000001},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834575170,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1188576,"kb_used_data":52632,"kb_used_omap":1,"kb_used_meta":1135934,"kb_avail":93183264,"statfs":{"total":96636764160,"available":95419662336,"internally_reserved":0,"allocated":53895168,"data_stored":78944601,"data_compressed":7659770,"data_compressed_allocated":11517952,"data_compressed_original":36741120,"omap_allocated":1594,"internal_metadata":1163196870},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.379,"15min":1.147},"min":{"1min":0.214,"5min":0.20300000000000001,"15min":0.186},"max":{"1min":8.6210000000000004,"5min":11.619999999999999,"15min":27.282},"last":0.39600000000000002},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.8440000000000001,"15min":1.1040000000000001},"min":{"1min":0.23699999999999999,"5min":0.217,"15min":0.186},"max":{"1min":10.148,"5min":17.922000000000001,"15min":17.922000000000001},"last":0.497}]},{"osd":2,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.891,"15min":1.0760000000000001},"min":{"1min":0.21199999999999999,"5min":0.20999999999999999,"15min":0.183},"max":{"1min":16.600000000000001,"5min":17.658000000000001,"15min":17.658000000000001},"last":0.443},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.3520000000000001,"15min":0.97299999999999998},"min":{"1min":0.29599999999999999,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":7.2709999999999999,"5min":18.058,"15min":18.058},"last":0.53700000000000003}]},{"osd":3,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":2.1960000000000002,"5min":1.712,"15min":1.2150000000000001},"min":{"1min":0.32400000000000001,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":15.871,"5min":18.024999999999999,"15min":18.024999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.577,"15min":1.323},"min":{"1min":0.32100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":7.4379999999999997,"5min":10.773,"15min":44.454999999999998},"last":0.51600000000000001}]},{"osd":4,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":2.7210000000000001,"15min":1.7749999999999999},"min":{"1min":0.311,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":9.4320000000000004,"5min":17.629000000000001,"15min":33.939999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.839,"5min":2.0680000000000001,"15min":1.744},"min":{"1min":0.378,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":9.5009999999999994,"5min":20.326000000000001,"15min":41.939},"last":0.624}]},{"osd":5,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":3.0430000000000001,"5min":2.1030000000000002,"15min":1.5229999999999999},"min":{"1min":0.38100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":27.143000000000001,"5min":27.727,"15min":27.727},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.343,"5min":2.5270000000000001,"15min":1.6479999999999999},"min":{"1min":0.35999999999999999,"5min":0.32300000000000001,"15min":0.318},"max":{"1min":9.3970000000000002,"5min":20.289999999999999,"15min":20.289999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.8100000000000001,"5min":2.5030000000000001,"15min":1.7150000000000001},"min":{"1min":0.48899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":8.5879999999999992,"5min":33.189999999999998,"15min":33.189999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":3.5880000000000001,"5min":3.2570000000000001,"15min":2.0129999999999999},"min":{"1min":0.39500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":23.395,"5min":35.344000000000001,"15min":35.344000000000001},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed May 8 19:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":1.762,"15min":1.3620000000000001},"min":{"1min":0.41599999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":9.5440000000000005,"5min":17.890000000000001,"15min":17.890000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.492,"15min":1.726},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":15.553000000000001,"5min":21.039999999999999,"15min":21.039999999999999},"last":0.79400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575170,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":805416,"kb_used_data":34464,"kb_used_omap":1,"kb_used_meta":770942,"kb_avail":93566424,"statfs":{"total":96636764160,"available":95812018176,"internally_reserved":0,"allocated":35291136,"data_stored":54073395,"data_compressed":5457884,"data_compressed_allocated":7987200,"data_compressed_original":26951680,"omap_allocated":1593,"internal_metadata":789445063},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.6200000000000001,"15min":1.7170000000000001},"min":{"1min":0.20799999999999999,"5min":0.189,"15min":0.185},"max":{"1min":12.77,"5min":22.343,"15min":37.991999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.571,"15min":1.2490000000000001},"min":{"1min":0.23899999999999999,"5min":0.191,"15min":0.191},"max":{"1min":7.8449999999999998,"5min":20.382000000000001,"15min":21.954000000000001},"last":0.54100000000000004}]},{"osd":2,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":1.1759999999999999,"15min":1.101},"min":{"1min":0.27400000000000002,"5min":0.22600000000000001,"15min":0.20899999999999999},"max":{"1min":3.7400000000000002,"5min":17.687999999999999,"15min":19.789999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":1.4510000000000001,"15min":1.1539999999999999},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.20899999999999999},"max":{"1min":3.2109999999999999,"5min":20.419,"15min":22.026},"last":0.42699999999999999}]},{"osd":3,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":2.0950000000000002,"15min":1.7},"min":{"1min":0.24099999999999999,"5min":0.192,"15min":0.192},"max":{"1min":18.613,"5min":34.515000000000001,"15min":34.515000000000001},"last":0.502},{"interface":"front","average":{"1min":0.98699999999999999,"5min":2.286,"15min":1.619},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.22600000000000001},"max":{"1min":7.6399999999999997,"5min":85.606999999999999,"15min":85.606999999999999},"last":0.51300000000000001}]},{"osd":4,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":2.5800000000000001,"15min":2.1059999999999999},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":14.317,"5min":42.345999999999997,"15min":66.331999999999994},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.6719999999999999,"5min":2.7599999999999998,"15min":2.3010000000000002},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":12.81,"5min":59.832999999999998,"15min":59.832999999999998},"last":0.80600000000000005}]},{"osd":5,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.881,"15min":1.53},"min":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":12.012,"5min":14.026999999999999,"15min":21.981000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.74,"15min":1.538},"min":{"1min":0.33200000000000002,"5min":0.32400000000000001,"15min":0.30599999999999999},"max":{"1min":14.019,"5min":14.019,"15min":25.446999999999999},"last":0.76200000000000001}]},{"osd":6,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":3.1000000000000001,"15min":2.0990000000000002},"min":{"1min":0.38300000000000001,"5min":0.33900000000000002,"15min":0.318},"max":{"1min":9.2370000000000001,"5min":82.542000000000002,"15min":82.542000000000002},"last":0.75},{"interface":"front","average":{"1min":1.131,"5min":2.0569999999999999,"15min":1.8859999999999999},"min":{"1min":0.373,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":6.4420000000000002,"5min":25.914999999999999,"15min":25.914999999999999},"last":0.82399999999999995}]},{"osd":7,"last update":"Wed May 8 19:48:15 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":2.242,"15min":1.974},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.34599999999999997},"max":{"1min":6.3460000000000001,"5min":26.669,"15min":26.669},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.569,"5min":1.732,"15min":1.7210000000000001},"min":{"1min":0.41599999999999998,"5min":0.38400000000000001,"15min":0.33100000000000002},"max":{"1min":13.964,"5min":13.964,"15min":20.146000000000001},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":729616,"kb_used_data":40712,"kb_used_omap":1,"kb_used_meta":688894,"kb_avail":93642224,"statfs":{"total":96636764160,"available":95889637376,"internally_reserved":0,"allocated":41689088,"data_stored":58833997,"data_compressed":5586562,"data_compressed_allocated":8433664,"data_compressed_original":25743360,"omap_allocated":1594,"internal_metadata":705427910},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.849,"5min":1.4379999999999999,"15min":1.135},"min":{"1min":0.19800000000000001,"5min":0.186,"15min":0.16900000000000001},"max":{"1min":15.834,"5min":15.834,"15min":21.475999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1779999999999999,"15min":1.141},"min":{"1min":0.23100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":7.4950000000000001,"5min":14.374000000000001,"15min":30.434999999999999},"last":0.44600000000000001}]},{"osd":1,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":1.831,"15min":1.5369999999999999},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":15.907,"5min":24.190000000000001,"15min":25.550000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.93799999999999994,"15min":1.032},"min":{"1min":0.215,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":2.8929999999999998,"5min":8.532,"15min":20.591000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":2.5569999999999999,"5min":2.0609999999999999,"15min":1.6839999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.21099999999999999},"max":{"1min":34.598999999999997,"5min":34.598999999999997,"15min":34.598999999999997},"last":0.497},{"interface":"front","average":{"1min":2.1989999999999998,"5min":2.2829999999999999,"15min":1.633},"min":{"1min":0.29899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":15.789999999999999,"5min":20.491,"15min":25.827000000000002},"last":0.57199999999999995}]},{"osd":4,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":2.4049999999999998,"15min":2.4500000000000002},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.312},"max":{"1min":15.936,"5min":27.963000000000001,"15min":67.506},"last":0.622},{"interface":"front","average":{"1min":2.121,"5min":2.4369999999999998,"15min":2.573},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":7.5759999999999996,"5min":37.548999999999999,"15min":111.973},"last":0.68700000000000006}]},{"osd":5,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":2.1309999999999998,"5min":2.0510000000000002,"15min":1.573},"min":{"1min":0.33500000000000002,"5min":0.314,"15min":0.308},"max":{"1min":13.215999999999999,"5min":37.496000000000002,"15min":37.496000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":2.5379999999999998,"5min":2.2799999999999998,"15min":1.645},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32600000000000001},"max":{"1min":34.545000000000002,"5min":45.997999999999998,"15min":45.997999999999998},"last":0.64700000000000002}]},{"osd":6,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":3.2850000000000001,"5min":2.9300000000000002,"15min":1.984},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":29.954999999999998,"5min":68.453000000000003,"15min":68.453000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":2.4860000000000002,"5min":2.859,"15min":1.927},"min":{"1min":0.40699999999999997,"5min":0.34899999999999998,"15min":0.33600000000000002},"max":{"1min":11.115,"5min":63.966000000000001,"15min":63.966000000000001},"last":0.70499999999999996}]},{"osd":7,"last update":"Wed May 8 19:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":2.0409999999999999,"15min":1.8720000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.0629999999999997,"5min":27.504000000000001,"15min":32.700000000000003},"last":0.77900000000000003},{"interface":"front","average":{"1min":2.6520000000000001,"5min":2.2450000000000001,"15min":2.0259999999999998},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":29.881,"5min":29.881,"15min":32.840000000000003},"last":0.79400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575170,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1195628,"kb_used_data":51492,"kb_used_omap":1,"kb_used_meta":1144126,"kb_avail":93176212,"statfs":{"total":96636764160,"available":95412441088,"internally_reserved":0,"allocated":52727808,"data_stored":79806189,"data_compressed":8205315,"data_compressed_allocated":12034048,"data_compressed_original":39284736,"omap_allocated":1591,"internal_metadata":1171585481},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.5740000000000001,"15min":1.103},"min":{"1min":0.20899999999999999,"5min":0.192,"15min":0.184},"max":{"1min":7.7149999999999999,"5min":24.539999999999999,"15min":24.539999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":1.48,"5min":1.468,"15min":1.476},"min":{"1min":0.21099999999999999,"5min":0.20100000000000001,"15min":0.19900000000000001},"max":{"1min":8.7539999999999996,"5min":12.204000000000001,"15min":95.932000000000002},"last":0.50900000000000001}]},{"osd":1,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":2.048,"5min":3.0209999999999999,"15min":2.036},"min":{"1min":0.22600000000000001,"5min":0.193,"15min":0.193},"max":{"1min":18.105,"5min":44.308,"15min":44.308},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.99,"15min":1.2889999999999999},"min":{"1min":0.28999999999999998,"5min":0.23100000000000001,"15min":0.22},"max":{"1min":14.875,"5min":38.054000000000002,"15min":38.054000000000002},"last":0.58299999999999996}]},{"osd":2,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":2.2029999999999998,"5min":1.8839999999999999,"15min":1.522},"min":{"1min":0.26100000000000001,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":15.788,"5min":18.132000000000001,"15min":18.132000000000001},"last":0.626},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.2769999999999999,"15min":1.1040000000000001},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.26700000000000002},"max":{"1min":4.0629999999999997,"5min":17.364000000000001,"15min":17.364000000000001},"last":0.66100000000000003}]},{"osd":4,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":2.0459999999999998,"15min":1.6439999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27100000000000002},"max":{"1min":8.6159999999999997,"5min":18.960000000000001,"15min":19.16},"last":0.64900000000000002},{"interface":"front","average":{"1min":2.379,"5min":2.351,"15min":2.0609999999999999},"min":{"1min":0.31900000000000001,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":15.739000000000001,"5min":20.808,"15min":27.515999999999998},"last":0.71099999999999997}]},{"osd":5,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.7250000000000001,"5min":2.3050000000000002,"15min":1.8979999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32100000000000001},"max":{"1min":8.7739999999999991,"5min":33.436999999999998,"15min":33.436999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":2.1139999999999999,"5min":2.048,"15min":1.5860000000000001},"min":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":13.818,"5min":17.329000000000001,"15min":17.329000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":2.3500000000000001,"5min":2.3220000000000001,"15min":1.9850000000000001},"min":{"1min":0.38800000000000001,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":25.329000000000001,"5min":25.329000000000001,"15min":30.588000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.5189999999999999,"5min":2.0659999999999998,"15min":1.804},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.33900000000000002},"max":{"1min":8.5809999999999995,"5min":18.803000000000001,"15min":23.318999999999999},"last":0.82099999999999995}]},{"osd":7,"last update":"Wed May 8 19:48:12 2024","interfaces":[{"interface":"back","average":{"1min":1.9630000000000001,"5min":1.8280000000000001,"15min":1.7929999999999999},"min":{"1min":0.40999999999999998,"5min":0.35699999999999998,"15min":0.34699999999999998},"max":{"1min":10.007999999999999,"5min":18.841999999999999,"15min":19.116},"last":0.85199999999999998},{"interface":"front","average":{"1min":3.129,"5min":2.5910000000000002,"15min":1.9770000000000001},"min":{"1min":0.42699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":19.504999999999999,"5min":33.505000000000003,"15min":33.505000000000003},"last":0.76400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575170,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":925352,"kb_used_data":24096,"kb_used_omap":1,"kb_used_meta":901246,"kb_avail":93446488,"statfs":{"total":96636764160,"available":95689203712,"internally_reserved":0,"allocated":24674304,"data_stored":37862603,"data_compressed":4009381,"data_compressed_allocated":5820416,"data_compressed_original":19185664,"omap_allocated":1594,"internal_metadata":922876358},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.355,"5min":2.613,"15min":1.677},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.20599999999999999},"max":{"1min":19.058,"5min":21.062999999999999,"15min":45.375},"last":0.59299999999999997},{"interface":"front","average":{"1min":2.375,"5min":2.206,"15min":1.704},"min":{"1min":0.27500000000000002,"5min":0.23100000000000001,"15min":0.188},"max":{"1min":8.9550000000000001,"5min":19.850999999999999,"15min":35.765000000000001},"last":0.56799999999999995}]},{"osd":1,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.617,"5min":2.9140000000000001,"15min":2.0609999999999999},"min":{"1min":0.26300000000000001,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":22.718,"5min":22.718,"15min":29.928000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":3.3170000000000002,"5min":2.8740000000000001,"15min":1.714},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":19.032,"5min":21.103000000000002,"15min":23.634},"last":0.63100000000000001}]},{"osd":2,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.2349999999999999,"5min":2.8679999999999999,"15min":1.786},"min":{"1min":0.32400000000000001,"5min":0.28599999999999998,"15min":0.27600000000000002},"max":{"1min":22.774000000000001,"5min":30.512,"15min":30.512},"last":0.57899999999999996},{"interface":"front","average":{"1min":5.0419999999999998,"5min":4.0350000000000001,"15min":2.109},"min":{"1min":0.29499999999999998,"5min":0.27400000000000002,"15min":0.26300000000000001},"max":{"1min":26.567,"5min":82.847999999999999,"15min":82.847999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":2.1880000000000002,"5min":2.2400000000000002,"15min":1.5960000000000001},"min":{"1min":0.32600000000000001,"5min":0.26600000000000001,"15min":0.23899999999999999},"max":{"1min":8.452,"5min":15.500999999999999,"15min":22.555},"last":0.51100000000000001},{"interface":"front","average":{"1min":3.1230000000000002,"5min":3.1400000000000001,"15min":1.9710000000000001},"min":{"1min":0.37,"5min":0.313,"15min":0.308},"max":{"1min":22.66,"5min":26.259,"15min":26.259},"last":0.61799999999999999}]},{"osd":5,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":4.4569999999999999,"5min":4.1269999999999998,"15min":2.073},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.24399999999999999},"max":{"1min":26.484999999999999,"5min":82.918999999999997,"15min":82.918999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":2.4569999999999999,"5min":2.7490000000000001,"15min":1.8320000000000001},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.249},"max":{"1min":18.288,"5min":25.120000000000001,"15min":25.120000000000001},"last":0.44700000000000001}]},{"osd":6,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":2.573,"5min":2.552,"15min":1.671},"min":{"1min":0.313,"5min":0.313,"15min":0.252},"max":{"1min":18.141999999999999,"5min":18.141999999999999,"15min":20.562999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":3.8940000000000001,"5min":3.8290000000000002,"15min":2.2440000000000002},"min":{"1min":0.36199999999999999,"5min":0.30499999999999999,"15min":0.29499999999999998},"max":{"1min":21.478000000000002,"5min":83.643000000000001,"15min":83.643000000000001},"last":0.54800000000000004}]},{"osd":7,"last update":"Wed May 8 19:48:00 2024","interfaces":[{"interface":"back","average":{"1min":3.1389999999999998,"5min":2.3490000000000002,"15min":1.748},"min":{"1min":0.373,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":19.021999999999998,"5min":19.021999999999998,"15min":25.878},"last":0.60599999999999998},{"interface":"front","average":{"1min":2.9780000000000002,"5min":2.4380000000000002,"15min":1.7609999999999999},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.27800000000000002},"max":{"1min":22.75,"5min":22.75,"15min":22.75},"last":0.64500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575170,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":957096,"kb_used_data":29536,"kb_used_omap":1,"kb_used_meta":927550,"kb_avail":93414744,"statfs":{"total":96636764160,"available":95656697856,"internally_reserved":0,"allocated":30244864,"data_stored":42056871,"data_compressed":3817580,"data_compressed_allocated":5763072,"data_compressed_original":17743872,"omap_allocated":1594,"internal_metadata":949811654},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.911,"15min":1.306},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":6.2060000000000004,"5min":19.097999999999999,"15min":19.097999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.609,"5min":2.157,"15min":1.508},"min":{"1min":0.28599999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":14.662000000000001,"5min":21.416,"15min":21.416},"last":0.55200000000000005}]},{"osd":1,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":2.0070000000000001,"15min":1.6040000000000001},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":3.4750000000000001,"5min":16.515000000000001,"15min":19.581},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.611,"15min":1.28},"min":{"1min":0.27100000000000002,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":8.4629999999999992,"5min":16.492999999999999,"15min":16.492999999999999},"last":0.56799999999999995}]},{"osd":2,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.679,"15min":1.409},"min":{"1min":0.30599999999999999,"5min":0.27300000000000002,"15min":0.25700000000000001},"max":{"1min":5.7770000000000001,"5min":21.186,"15min":21.186},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.6859999999999999,"15min":1.2609999999999999},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.25700000000000001},"max":{"1min":6.1289999999999996,"5min":22.353999999999999,"15min":22.353999999999999},"last":0.52600000000000002}]},{"osd":3,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":2.0169999999999999,"15min":1.595},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.28199999999999997},"max":{"1min":14.736000000000001,"5min":16.324999999999999,"15min":17.103999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":1.5940000000000001,"5min":2.1800000000000002,"15min":1.6819999999999999},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.29899999999999999},"max":{"1min":15.821999999999999,"5min":18.798999999999999,"15min":23.224},"last":0.45700000000000002}]},{"osd":4,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":2.2869999999999999,"5min":2.206,"15min":1.5},"min":{"1min":0.27600000000000002,"5min":0.25,"15min":0.20799999999999999},"max":{"1min":17.914000000000001,"5min":22.300000000000001,"15min":28.724},"last":0.374},{"interface":"front","average":{"1min":2.0960000000000001,"5min":2.4940000000000002,"15min":1.5980000000000001},"min":{"1min":0.371,"5min":0.28100000000000003,"15min":0.22800000000000001},"max":{"1min":22.385999999999999,"5min":25.466999999999999,"15min":25.466999999999999},"last":0.41799999999999998}]},{"osd":6,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":2.1000000000000001,"15min":1.5129999999999999},"min":{"1min":0.29699999999999999,"5min":0.28699999999999998,"15min":0.23899999999999999},"max":{"1min":9.3539999999999992,"5min":21.294,"15min":21.294},"last":0.495},{"interface":"front","average":{"1min":1.1579999999999999,"5min":2.3690000000000002,"15min":1.4590000000000001},"min":{"1min":0.39700000000000002,"5min":0.34300000000000003,"15min":0.24199999999999999},"max":{"1min":6.1820000000000004,"5min":23.731000000000002,"15min":23.731000000000002},"last":0.442}]},{"osd":7,"last update":"Wed May 8 19:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.724,"5min":2.0630000000000002,"15min":1.4370000000000001},"min":{"1min":0.436,"5min":0.29799999999999999,"15min":0.28100000000000003},"max":{"1min":14.711,"5min":21.462,"15min":30.076000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.796,"15min":1.29},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.26100000000000001},"max":{"1min":5.7460000000000004,"5min":21.257000000000001,"15min":21.257000000000001},"last":0.39600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34947072,"data_stored":53369286,"data_compressed":5425493,"data_compressed_allocated":7942144,"data_compressed_original":26378240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53616640,"data_stored":78830860,"data_compressed":7659770,"data_compressed_allocated":11517952,"data_compressed_original":36741120,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41410560,"data_stored":58720256,"data_compressed":5586562,"data_compressed_allocated":8433664,"data_compressed_original":25743360,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":52449280,"data_stored":79692448,"data_compressed":8205315,"data_compressed_allocated":12034048,"data_compressed_original":39284736,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24395776,"data_stored":37748862,"data_compressed":4009381,"data_compressed_allocated":5820416,"data_compressed_original":19185664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29966336,"data_stored":41943130,"data_compressed":3817580,"data_compressed_allocated":5763072,"data_compressed_original":17743872,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50114560,"data_stored":74637068,"data_compressed":7372511,"data_compressed_allocated":10829824,"data_compressed_original":35360768,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36921344,"data_stored":57563534,"data_compressed":5863036,"data_compressed_allocated":8429568,"data_compressed_original":29077504,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T19:49:02.689 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.690 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.690 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.690 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.690 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.690 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.690 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.690 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.690 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.690 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.691 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.691 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.691 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.691 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.691 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.691 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.691 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.691 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.692 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.692 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.692 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.692 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.692 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.692 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.692 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.692 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.693 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.693 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.693 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.693 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.693 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.693 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.693 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.693 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.694 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.694 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.694 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.694 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.694 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.694 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.694 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.694 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.695 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.695 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.695 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.695 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.695 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.695 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.695 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.695 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.695 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.696 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.696 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.696 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.696 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-08T19:22:18.976800+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.696 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.696 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.696 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.696 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.697 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.697 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.697 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.697 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.697 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.697 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.697 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.697 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.697 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.698 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.698 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.698 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.698 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.698 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.698 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.698 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.698 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.698 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:02.699 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T19:49:12.432 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:49:12.435 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:49:22.699 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T19:49:22.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.851+0000 7f39e7f29700 1 Processor -- start 2024-05-08T19:49:22.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.851+0000 7f39e7f29700 1 -- start start 2024-05-08T19:49:22.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.852+0000 7f39e7f29700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f39e0152130 0x7f39e0158920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:22.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.852+0000 7f39e7f29700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f39e006e890 0x7f39e006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:22.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.852+0000 7f39e7f29700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e00c4570 con 0x7f39e00702a0 2024-05-08T19:49:22.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.852+0000 7f39e7f29700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e00c2830 con 0x7f39e0152130 2024-05-08T19:49:22.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.852+0000 7f39e7f29700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e00c4850 con 0x7f39e006e890 2024-05-08T19:49:22.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.852+0000 7f39e5cc5700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f39e0152130 0x7f39e0158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:22.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.852+0000 7f39e54c4700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f39e00702a0 0x7f39e00c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:46604/0 (socket says 172.21.15.47:46604) 2024-05-08T19:49:22.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.852+0000 7f39e54c4700 1 -- 172.21.15.47:0/698538096 learned_addr learned my addr 172.21.15.47:0/698538096 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:49:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.852+0000 7f39e5cc5700 1 -- 172.21.15.47:0/698538096 >> v2:172.21.15.177:3300/0 conn(0x7f39e006e890 msgr2=0x7f39e006ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:49:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.852+0000 7f39e64c6700 1 --2- 172.21.15.47:0/698538096 >> v2:172.21.15.177:3300/0 conn(0x7f39e006e890 0x7f39e006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.852+0000 7f39e5cc5700 1 --2- 172.21.15.47:0/698538096 >> v2:172.21.15.177:3300/0 conn(0x7f39e006e890 0x7f39e006ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.852+0000 7f39e4cc3700 1 -- 172.21.15.47:0/698538096 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563421546 0 0) 0x7f39e00c4570 con 0x7f39e00702a0 2024-05-08T19:49:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.852+0000 7f39e5cc5700 1 -- 172.21.15.47:0/698538096 >> v1:172.21.15.47:6789/0 conn(0x7f39e00702a0 legacy=0x7f39e00c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.852+0000 7f39e5cc5700 1 -- 172.21.15.47:0/698538096 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e00c2030 con 0x7f39e0152130 2024-05-08T19:49:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.852+0000 7f39e64c6700 1 --2- 172.21.15.47:0/698538096 >> v2:172.21.15.177:3300/0 conn(0x7f39e006e890 0x7f39e006ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:49:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.853+0000 7f39e5cc5700 1 --2- 172.21.15.47:0/698538096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e0152130 0x7f39e0158920 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f39e00c5c20 tx=0x7f39d4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d13be70e22a3553 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:49:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.853+0000 7f39e4cc3700 1 -- 172.21.15.47:0/698538096 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d4011830 con 0x7f39e0152130 2024-05-08T19:49:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.853+0000 7f39e4cc3700 1 -- 172.21.15.47:0/698538096 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d4011990 con 0x7f39e0152130 2024-05-08T19:49:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.853+0000 7f39e4cc3700 1 -- 172.21.15.47:0/698538096 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d4011d20 con 0x7f39e0152130 2024-05-08T19:49:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.853+0000 7f39e7f29700 1 -- 172.21.15.47:0/698538096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e0152130 msgr2=0x7f39e0158920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.853+0000 7f39e7f29700 1 --2- 172.21.15.47:0/698538096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e0152130 0x7f39e0158920 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f39e00c5c20 tx=0x7f39d4009b20 comp rx=0 tx=0).stop 2024-05-08T19:49:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.853+0000 7f39e7f29700 1 -- 172.21.15.47:0/698538096 shutdown_connections 2024-05-08T19:49:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.853+0000 7f39e7f29700 1 --2- 172.21.15.47:0/698538096 >> v2:172.21.15.177:3300/0 conn(0x7f39e006e890 0x7f39e006ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:22.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.853+0000 7f39e7f29700 1 --2- 172.21.15.47:0/698538096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e0152130 0x7f39e0158920 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:22.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.853+0000 7f39e7f29700 1 -- 172.21.15.47:0/698538096 >> 172.21.15.47:0/698538096 conn(0x7f39e0072dd0 msgr2=0x7f39e006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:49:22.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.853+0000 7f39e7f29700 1 -- 172.21.15.47:0/698538096 shutdown_connections 2024-05-08T19:49:22.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.854+0000 7f39e7f29700 1 -- 172.21.15.47:0/698538096 wait complete. 2024-05-08T19:49:22.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.855+0000 7f39e7f29700 1 Processor -- start 2024-05-08T19:49:22.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.855+0000 7f39e7f29700 1 -- start start 2024-05-08T19:49:22.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.855+0000 7f39e7f29700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006e890 0x7f39e014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:22.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.855+0000 7f39e7f29700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e00702a0 0x7f39e01e1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:22.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.855+0000 7f39e7f29700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e0152130 0x7f39e01ee160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:22.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.855+0000 7f39e7f29700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e01edcd0 con 0x7f39e0152130 2024-05-08T19:49:22.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.855+0000 7f39e7f29700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e00c7450 con 0x7f39e00702a0 2024-05-08T19:49:22.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.855+0000 7f39e7f29700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e01ee6a0 con 0x7f39e006e890 2024-05-08T19:49:22.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.855+0000 7f39e64c6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e0152130 0x7f39e01ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:22.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.856+0000 7f39e64c6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e0152130 0x7f39e01ee160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43804/0 (socket says 172.21.15.47:43804) 2024-05-08T19:49:22.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.856+0000 7f39e64c6700 1 -- 172.21.15.47:0/1775473100 learned_addr learned my addr 172.21.15.47:0/1775473100 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:49:22.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.856+0000 7f39e54c4700 1 --2- 172.21.15.47:0/1775473100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e00702a0 0x7f39e01e1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:22.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.856+0000 7f39e5cc5700 1 --2- 172.21.15.47:0/1775473100 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006e890 0x7f39e014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:22.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.856+0000 7f39e64c6700 1 -- 172.21.15.47:0/1775473100 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006e890 msgr2=0x7f39e014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:22.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.856+0000 7f39e64c6700 1 --2- 172.21.15.47:0/1775473100 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006e890 0x7f39e014f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:22.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.856+0000 7f39e64c6700 1 -- 172.21.15.47:0/1775473100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e00702a0 msgr2=0x7f39e01e1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:22.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.856+0000 7f39e64c6700 1 --2- 172.21.15.47:0/1775473100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e00702a0 0x7f39e01e1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:22.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.856+0000 7f39e64c6700 1 -- 172.21.15.47:0/1775473100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d40094a0 con 0x7f39e0152130 2024-05-08T19:49:22.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.856+0000 7f39e64c6700 1 --2- 172.21.15.47:0/1775473100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e0152130 0x7f39e01ee160 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f39d800cef0 tx=0x7f39d800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:49:22.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.856+0000 7f39d27fc700 1 -- 172.21.15.47:0/1775473100 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d800ad00 con 0x7f39e0152130 2024-05-08T19:49:22.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.856+0000 7f39d27fc700 1 -- 172.21.15.47:0/1775473100 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d800ae60 con 0x7f39e0152130 2024-05-08T19:49:22.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.856+0000 7f39e7f29700 1 -- 172.21.15.47:0/1775473100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e00c76f0 con 0x7f39e0152130 2024-05-08T19:49:22.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.856+0000 7f39d27fc700 1 -- 172.21.15.47:0/1775473100 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8015680 con 0x7f39e0152130 2024-05-08T19:49:22.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.856+0000 7f39e7f29700 1 -- 172.21.15.47:0/1775473100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e0152760 con 0x7f39e0152130 2024-05-08T19:49:22.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.857+0000 7f39e7f29700 1 -- 172.21.15.47:0/1775473100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e01ed7c0 con 0x7f39e0152130 2024-05-08T19:49:22.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.858+0000 7f39d27fc700 1 -- 172.21.15.47:0/1775473100 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f39d800d430 con 0x7f39e0152130 2024-05-08T19:49:22.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.858+0000 7f39d27fc700 1 --2- 172.21.15.47:0/1775473100 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f39c406ac90 0x7f39c406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:22.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.858+0000 7f39d27fc700 1 -- 172.21.15.47:0/1775473100 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f39d8089b40 con 0x7f39e0152130 2024-05-08T19:49:22.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.858+0000 7f39e5cc5700 1 --2- 172.21.15.47:0/1775473100 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f39c406ac90 0x7f39c406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:22.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.859+0000 7f39e5cc5700 1 --2- 172.21.15.47:0/1775473100 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f39c406ac90 0x7f39c406d150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f39d40090b0 tx=0x7f39d401c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:49:22.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:22.863+0000 7f39d27fc700 1 -- 172.21.15.47:0/1775473100 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f39e01ed7c0 con 0x7f39e0152130 2024-05-08T19:49:23.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:23.065+0000 7f39e7f29700 1 -- 172.21.15.47:0/1775473100 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39e00c2980 con 0x7f39c406ac90 2024-05-08T19:49:23.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:23.076+0000 7f39d27fc700 1 -- 172.21.15.47:0/1775473100 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371675 (secure 0 0 0) 0x7f39e00c2980 con 0x7f39c406ac90 2024-05-08T19:49:23.071 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:49:23.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:23.079+0000 7f39e7f29700 1 -- 172.21.15.47:0/1775473100 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f39c406ac90 msgr2=0x7f39c406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:23.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:23.079+0000 7f39e7f29700 1 --2- 172.21.15.47:0/1775473100 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f39c406ac90 0x7f39c406d150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f39d40090b0 tx=0x7f39d401c040 comp rx=0 tx=0).stop 2024-05-08T19:49:23.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:23.079+0000 7f39e7f29700 1 -- 172.21.15.47:0/1775473100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e0152130 msgr2=0x7f39e01ee160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:23.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:23.079+0000 7f39e7f29700 1 --2- 172.21.15.47:0/1775473100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e0152130 0x7f39e01ee160 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f39d800cef0 tx=0x7f39d800cf20 comp rx=0 tx=0).stop 2024-05-08T19:49:23.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:23.080+0000 7f39e7f29700 1 -- 172.21.15.47:0/1775473100 shutdown_connections 2024-05-08T19:49:23.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:23.080+0000 7f39e7f29700 1 --2- 172.21.15.47:0/1775473100 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f39c406ac90 0x7f39c406d150 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:23.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:23.080+0000 7f39e7f29700 1 --2- 172.21.15.47:0/1775473100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e0152130 0x7f39e01ee160 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:23.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:23.080+0000 7f39e7f29700 1 --2- 172.21.15.47:0/1775473100 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006e890 0x7f39e014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:23.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:23.080+0000 7f39e7f29700 1 --2- 172.21.15.47:0/1775473100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e00702a0 0x7f39e01e1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:23.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:23.080+0000 7f39e7f29700 1 -- 172.21.15.47:0/1775473100 >> 172.21.15.47:0/1775473100 conn(0x7f39e0072dd0 msgr2=0x7f39e006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:49:23.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:23.080+0000 7f39e7f29700 1 -- 172.21.15.47:0/1775473100 shutdown_connections 2024-05-08T19:49:23.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:23.080+0000 7f39e7f29700 1 -- 172.21.15.47:0/1775473100 wait complete. 2024-05-08T19:49:23.075 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-08T19:49:23.082 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":833,"stamp":"2024-05-08T19:49:22.614443+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":241843090,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":21643,"num_read_kb":1158813,"num_write":409439,"num_write_kb":31681879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":983922,"num_omap_keys":1498,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575416,"ondisk_log_size":575416,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7788680,"kb_used_data":318536,"kb_used_omap":12,"kb_used_meta":7470067,"kb_avail":747186040,"statfs":{"total":773094113280,"available":765118504960,"internally_reserved":0,"allocated":326180864,"data_stored":484596108,"data_compressed":48004430,"data_compressed_allocated":70860800,"data_compressed_original":230662144,"omap_allocated":12741,"internal_metadata":7649349179},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003287"},"pg_stats":[{"pgid":"3.3f","version":"26'2251","reported_seq":2291,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:16.946459+0000","last_change":"2024-05-08T19:49:16.946583+0000","last_active":"2024-05-08T19:49:16.946459+0000","last_peered":"2024-05-08T19:49:16.946459+0000","last_clean":"2024-05-08T19:49:16.946459+0000","last_became_active":"2024-05-08T19:22:20.461515+0000","last_became_peered":"2024-05-08T19:22:20.461515+0000","last_unstale":"2024-05-08T19:49:16.946459+0000","last_undegraded":"2024-05-08T19:49:16.946459+0000","last_fullsized":"2024-05-08T19:49:16.946459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2251","last_scrub_stamp":"2024-05-08T19:49:16.946432+0000","last_deep_scrub":"26'2251","last_deep_scrub_stamp":"2024-05-08T19:49:16.946432+0000","last_clean_scrub_stamp":"2024-05-08T19:49:16.946432+0000","objects_scrubbed":0,"log_size":2251,"log_dups_size":0,"ondisk_log_size":2251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:14.633970+0000","scrub_duration":0.019606787000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'2273","reported_seq":2313,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:10.656493+0000","last_change":"2024-05-08T19:49:10.656598+0000","last_active":"2024-05-08T19:49:10.656493+0000","last_peered":"2024-05-08T19:49:10.656493+0000","last_clean":"2024-05-08T19:49:10.656493+0000","last_became_active":"2024-05-08T19:22:20.434629+0000","last_became_peered":"2024-05-08T19:22:20.434629+0000","last_unstale":"2024-05-08T19:49:10.656493+0000","last_undegraded":"2024-05-08T19:49:10.656493+0000","last_fullsized":"2024-05-08T19:49:10.656493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2273","last_scrub_stamp":"2024-05-08T19:49:10.656467+0000","last_deep_scrub":"26'2273","last_deep_scrub_stamp":"2024-05-08T19:49:10.656467+0000","last_clean_scrub_stamp":"2024-05-08T19:49:10.656467+0000","objects_scrubbed":0,"log_size":2273,"log_dups_size":0,"ondisk_log_size":2273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:10.166188+0000","scrub_duration":0.007619575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"26'2375","reported_seq":2416,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:01.779542+0000","last_change":"2024-05-08T19:49:01.779542+0000","last_active":"2024-05-08T19:49:01.779542+0000","last_peered":"2024-05-08T19:49:01.779542+0000","last_clean":"2024-05-08T19:49:01.779542+0000","last_became_active":"2024-05-08T19:22:20.449184+0000","last_became_peered":"2024-05-08T19:22:20.449184+0000","last_unstale":"2024-05-08T19:49:01.779542+0000","last_undegraded":"2024-05-08T19:49:01.779542+0000","last_fullsized":"2024-05-08T19:49:01.779542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2375","last_scrub_stamp":"2024-05-08T19:49:01.779390+0000","last_deep_scrub":"26'2375","last_deep_scrub_stamp":"2024-05-08T19:49:01.779390+0000","last_clean_scrub_stamp":"2024-05-08T19:49:01.779390+0000","objects_scrubbed":0,"log_size":2375,"log_dups_size":0,"ondisk_log_size":2375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:47.169212+0000","scrub_duration":0.002872987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"26'2359","reported_seq":2400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:03.254773+0000","last_change":"2024-05-08T19:49:03.255052+0000","last_active":"2024-05-08T19:49:03.254773+0000","last_peered":"2024-05-08T19:49:03.254773+0000","last_clean":"2024-05-08T19:49:03.254773+0000","last_became_active":"2024-05-08T19:22:20.449637+0000","last_became_peered":"2024-05-08T19:22:20.449637+0000","last_unstale":"2024-05-08T19:49:03.254773+0000","last_undegraded":"2024-05-08T19:49:03.254773+0000","last_fullsized":"2024-05-08T19:49:03.254773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2359","last_scrub_stamp":"2024-05-08T19:49:03.254747+0000","last_deep_scrub":"26'2359","last_deep_scrub_stamp":"2024-05-08T19:49:03.254747+0000","last_clean_scrub_stamp":"2024-05-08T19:49:03.254747+0000","objects_scrubbed":0,"log_size":2359,"log_dups_size":0,"ondisk_log_size":2359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:43.728458+0000","scrub_duration":0.002337698,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'2307","reported_seq":2334,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.644813+0000","last_change":"2024-05-08T19:22:20.449676+0000","last_active":"2024-05-08T19:48:36.644813+0000","last_peered":"2024-05-08T19:48:36.644813+0000","last_clean":"2024-05-08T19:48:36.644813+0000","last_became_active":"2024-05-08T19:22:20.449347+0000","last_became_peered":"2024-05-08T19:22:20.449347+0000","last_unstale":"2024-05-08T19:48:36.644813+0000","last_undegraded":"2024-05-08T19:48:36.644813+0000","last_fullsized":"2024-05-08T19:48:36.644813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2307,"log_dups_size":0,"ondisk_log_size":2307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'2223","reported_seq":2255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:58.858078+0000","last_change":"2024-05-08T19:48:58.858191+0000","last_active":"2024-05-08T19:48:58.858078+0000","last_peered":"2024-05-08T19:48:58.858078+0000","last_clean":"2024-05-08T19:48:58.858078+0000","last_became_active":"2024-05-08T19:23:11.052928+0000","last_became_peered":"2024-05-08T19:23:11.052928+0000","last_unstale":"2024-05-08T19:48:58.858078+0000","last_undegraded":"2024-05-08T19:48:58.858078+0000","last_fullsized":"2024-05-08T19:48:58.858078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2223","last_scrub_stamp":"2024-05-08T19:48:58.858050+0000","last_deep_scrub":"26'2223","last_deep_scrub_stamp":"2024-05-08T19:48:58.858050+0000","last_clean_scrub_stamp":"2024-05-08T19:48:58.858050+0000","objects_scrubbed":0,"log_size":2223,"log_dups_size":0,"ondisk_log_size":2223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:59.957413+0000","scrub_duration":0.001763433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"26'2288","reported_seq":2315,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.320165+0000","last_change":"2024-05-08T19:22:20.446830+0000","last_active":"2024-05-08T19:48:36.320165+0000","last_peered":"2024-05-08T19:48:36.320165+0000","last_clean":"2024-05-08T19:48:36.320165+0000","last_became_active":"2024-05-08T19:22:20.446520+0000","last_became_peered":"2024-05-08T19:22:20.446520+0000","last_unstale":"2024-05-08T19:48:36.320165+0000","last_undegraded":"2024-05-08T19:48:36.320165+0000","last_fullsized":"2024-05-08T19:48:36.320165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2288,"log_dups_size":0,"ondisk_log_size":2288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'2289","reported_seq":2316,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.615952+0000","last_change":"2024-05-08T19:22:20.447313+0000","last_active":"2024-05-08T19:48:36.615952+0000","last_peered":"2024-05-08T19:48:36.615952+0000","last_clean":"2024-05-08T19:48:36.615952+0000","last_became_active":"2024-05-08T19:22:20.447031+0000","last_became_peered":"2024-05-08T19:22:20.447031+0000","last_unstale":"2024-05-08T19:48:36.615952+0000","last_undegraded":"2024-05-08T19:48:36.615952+0000","last_fullsized":"2024-05-08T19:48:36.615952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2289,"log_dups_size":0,"ondisk_log_size":2289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"26'2353","reported_seq":2381,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.892877+0000","last_change":"2024-05-08T19:22:20.447186+0000","last_active":"2024-05-08T19:48:41.892877+0000","last_peered":"2024-05-08T19:48:41.892877+0000","last_clean":"2024-05-08T19:48:41.892877+0000","last_became_active":"2024-05-08T19:22:20.446803+0000","last_became_peered":"2024-05-08T19:22:20.446803+0000","last_unstale":"2024-05-08T19:48:41.892877+0000","last_undegraded":"2024-05-08T19:48:41.892877+0000","last_fullsized":"2024-05-08T19:48:41.892877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2353,"log_dups_size":0,"ondisk_log_size":2353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'2369","reported_seq":2408,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:19.718394+0000","last_change":"2024-05-08T19:49:19.718539+0000","last_active":"2024-05-08T19:49:19.718394+0000","last_peered":"2024-05-08T19:49:19.718394+0000","last_clean":"2024-05-08T19:49:19.718394+0000","last_became_active":"2024-05-08T19:22:20.461395+0000","last_became_peered":"2024-05-08T19:22:20.461395+0000","last_unstale":"2024-05-08T19:49:19.718394+0000","last_undegraded":"2024-05-08T19:49:19.718394+0000","last_fullsized":"2024-05-08T19:49:19.718394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2369","last_scrub_stamp":"2024-05-08T19:49:19.718358+0000","last_deep_scrub":"26'2369","last_deep_scrub_stamp":"2024-05-08T19:49:19.718358+0000","last_clean_scrub_stamp":"2024-05-08T19:49:19.718358+0000","objects_scrubbed":0,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:05.676957+0000","scrub_duration":0.0039461089999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"26'2237","reported_seq":2276,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:15.650434+0000","last_change":"2024-05-08T19:49:15.650556+0000","last_active":"2024-05-08T19:49:15.650434+0000","last_peered":"2024-05-08T19:49:15.650434+0000","last_clean":"2024-05-08T19:49:15.650434+0000","last_became_active":"2024-05-08T19:22:20.459253+0000","last_became_peered":"2024-05-08T19:22:20.459253+0000","last_unstale":"2024-05-08T19:49:15.650434+0000","last_undegraded":"2024-05-08T19:49:15.650434+0000","last_fullsized":"2024-05-08T19:49:15.650434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2237","last_scrub_stamp":"2024-05-08T19:49:15.650406+0000","last_deep_scrub":"26'2237","last_deep_scrub_stamp":"2024-05-08T19:49:15.650406+0000","last_clean_scrub_stamp":"2024-05-08T19:49:15.650406+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:15.160128+0000","scrub_duration":0.010753660999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"26'2223","reported_seq":2262,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:53.275993+0000","last_change":"2024-05-08T19:48:53.275993+0000","last_active":"2024-05-08T19:48:53.275993+0000","last_peered":"2024-05-08T19:48:53.275993+0000","last_clean":"2024-05-08T19:48:53.275993+0000","last_became_active":"2024-05-08T19:22:20.461852+0000","last_became_peered":"2024-05-08T19:22:20.461852+0000","last_unstale":"2024-05-08T19:48:53.275993+0000","last_undegraded":"2024-05-08T19:48:53.275993+0000","last_fullsized":"2024-05-08T19:48:53.275993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2223","last_scrub_stamp":"2024-05-08T19:48:53.275860+0000","last_deep_scrub":"26'2223","last_deep_scrub_stamp":"2024-05-08T19:48:53.275860+0000","last_clean_scrub_stamp":"2024-05-08T19:48:53.275860+0000","objects_scrubbed":0,"log_size":2223,"log_dups_size":0,"ondisk_log_size":2223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:11.565803+0000","scrub_duration":0.0016971060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"26'2273","reported_seq":2312,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.733749+0000","last_change":"2024-05-08T19:48:49.733749+0000","last_active":"2024-05-08T19:48:49.733749+0000","last_peered":"2024-05-08T19:48:49.733749+0000","last_clean":"2024-05-08T19:48:49.733749+0000","last_became_active":"2024-05-08T19:22:20.452884+0000","last_became_peered":"2024-05-08T19:22:20.452884+0000","last_unstale":"2024-05-08T19:48:49.733749+0000","last_undegraded":"2024-05-08T19:48:49.733749+0000","last_fullsized":"2024-05-08T19:48:49.733749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2273","last_scrub_stamp":"2024-05-08T19:48:49.733627+0000","last_deep_scrub":"26'2273","last_deep_scrub_stamp":"2024-05-08T19:48:49.733627+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.733627+0000","objects_scrubbed":0,"log_size":2273,"log_dups_size":0,"ondisk_log_size":2273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:35.123448+0000","scrub_duration":0.011898308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"26'2298","reported_seq":2337,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.685749+0000","last_change":"2024-05-08T19:48:54.685845+0000","last_active":"2024-05-08T19:48:54.685749+0000","last_peered":"2024-05-08T19:48:54.685749+0000","last_clean":"2024-05-08T19:48:54.685749+0000","last_became_active":"2024-05-08T19:22:20.435456+0000","last_became_peered":"2024-05-08T19:22:20.435456+0000","last_unstale":"2024-05-08T19:48:54.685749+0000","last_undegraded":"2024-05-08T19:48:54.685749+0000","last_fullsized":"2024-05-08T19:48:54.685749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2298","last_scrub_stamp":"2024-05-08T19:48:54.685720+0000","last_deep_scrub":"26'2298","last_deep_scrub_stamp":"2024-05-08T19:48:54.685720+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.685720+0000","objects_scrubbed":0,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:55.785082+0000","scrub_duration":0.0058416680000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"26'2373","reported_seq":2412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.575902+0000","last_change":"2024-05-08T19:48:40.575994+0000","last_active":"2024-05-08T19:48:40.575902+0000","last_peered":"2024-05-08T19:48:40.575902+0000","last_clean":"2024-05-08T19:48:40.575902+0000","last_became_active":"2024-05-08T19:22:20.444369+0000","last_became_peered":"2024-05-08T19:22:20.444369+0000","last_unstale":"2024-05-08T19:48:40.575902+0000","last_undegraded":"2024-05-08T19:48:40.575902+0000","last_fullsized":"2024-05-08T19:48:40.575902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2373","last_scrub_stamp":"2024-05-08T19:48:40.575879+0000","last_deep_scrub":"26'2373","last_deep_scrub_stamp":"2024-05-08T19:48:40.575879+0000","last_clean_scrub_stamp":"2024-05-08T19:48:40.575879+0000","objects_scrubbed":0,"log_size":2373,"log_dups_size":0,"ondisk_log_size":2373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:57.404103+0000","scrub_duration":0.0065170310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'2274","reported_seq":2302,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.976700+0000","last_change":"2024-05-08T19:22:20.445391+0000","last_active":"2024-05-08T19:48:35.976700+0000","last_peered":"2024-05-08T19:48:35.976700+0000","last_clean":"2024-05-08T19:48:35.976700+0000","last_became_active":"2024-05-08T19:22:20.444996+0000","last_became_peered":"2024-05-08T19:22:20.444996+0000","last_unstale":"2024-05-08T19:48:35.976700+0000","last_undegraded":"2024-05-08T19:48:35.976700+0000","last_fullsized":"2024-05-08T19:48:35.976700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2274,"log_dups_size":0,"ondisk_log_size":2274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"26'2337","reported_seq":2376,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:04.327857+0000","last_change":"2024-05-08T19:49:04.327997+0000","last_active":"2024-05-08T19:49:04.327857+0000","last_peered":"2024-05-08T19:49:04.327857+0000","last_clean":"2024-05-08T19:49:04.327857+0000","last_became_active":"2024-05-08T19:22:20.450843+0000","last_became_peered":"2024-05-08T19:22:20.450843+0000","last_unstale":"2024-05-08T19:49:04.327857+0000","last_undegraded":"2024-05-08T19:49:04.327857+0000","last_fullsized":"2024-05-08T19:49:04.327857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2337","last_scrub_stamp":"2024-05-08T19:49:04.327828+0000","last_deep_scrub":"26'2337","last_deep_scrub_stamp":"2024-05-08T19:49:04.327828+0000","last_clean_scrub_stamp":"2024-05-08T19:49:04.327828+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:54.003812+0000","scrub_duration":0.025184673000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'2298","reported_seq":2337,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:52.831688+0000","last_change":"2024-05-08T19:48:52.831797+0000","last_active":"2024-05-08T19:48:52.831688+0000","last_peered":"2024-05-08T19:48:52.831688+0000","last_clean":"2024-05-08T19:48:52.831688+0000","last_became_active":"2024-05-08T19:22:20.462266+0000","last_became_peered":"2024-05-08T19:22:20.462266+0000","last_unstale":"2024-05-08T19:48:52.831688+0000","last_undegraded":"2024-05-08T19:48:52.831688+0000","last_fullsized":"2024-05-08T19:48:52.831688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2298","last_scrub_stamp":"2024-05-08T19:48:52.831661+0000","last_deep_scrub":"26'2298","last_deep_scrub_stamp":"2024-05-08T19:48:52.831661+0000","last_clean_scrub_stamp":"2024-05-08T19:48:52.831661+0000","objects_scrubbed":0,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:42.814623+0000","scrub_duration":0.0019874760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"26'2369","reported_seq":2397,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.631677+0000","last_change":"2024-05-08T19:22:20.454128+0000","last_active":"2024-05-08T19:48:36.631677+0000","last_peered":"2024-05-08T19:48:36.631677+0000","last_clean":"2024-05-08T19:48:36.631677+0000","last_became_active":"2024-05-08T19:22:20.453834+0000","last_became_peered":"2024-05-08T19:22:20.453834+0000","last_unstale":"2024-05-08T19:48:36.631677+0000","last_undegraded":"2024-05-08T19:48:36.631677+0000","last_fullsized":"2024-05-08T19:48:36.631677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"26'8922","reported_seq":8999,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:39.756405+0000","last_change":"2024-05-08T19:22:24.616532+0000","last_active":"2024-05-08T19:48:39.756405+0000","last_peered":"2024-05-08T19:48:39.756405+0000","last_clean":"2024-05-08T19:48:39.756405+0000","last_became_active":"2024-05-08T19:22:24.616128+0000","last_became_peered":"2024-05-08T19:22:24.616128+0000","last_unstale":"2024-05-08T19:48:39.756405+0000","last_undegraded":"2024-05-08T19:48:39.756405+0000","last_fullsized":"2024-05-08T19:48:39.756405+0000","mapping_epoch":22,"log_start":"26'2512","ondisk_log_start":"26'2512","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6410,"log_dups_size":0,"ondisk_log_size":6410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":3400,"num_write":6578,"num_write_kb":966197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"26'2352","reported_seq":2394,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:43.584133+0000","last_change":"2024-05-08T19:48:43.584133+0000","last_active":"2024-05-08T19:48:43.584133+0000","last_peered":"2024-05-08T19:48:43.584133+0000","last_clean":"2024-05-08T19:48:43.584133+0000","last_became_active":"2024-05-08T19:22:20.012453+0000","last_became_peered":"2024-05-08T19:22:20.012453+0000","last_unstale":"2024-05-08T19:48:43.584133+0000","last_undegraded":"2024-05-08T19:48:43.584133+0000","last_fullsized":"2024-05-08T19:48:43.584133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2352","last_scrub_stamp":"2024-05-08T19:48:43.583999+0000","last_deep_scrub":"26'2352","last_deep_scrub_stamp":"2024-05-08T19:48:43.583999+0000","last_clean_scrub_stamp":"2024-05-08T19:48:43.583999+0000","objects_scrubbed":3,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:26.944633+0000","scrub_duration":0.023303528,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2351,"num_write_kb":17974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":558,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'2321","reported_seq":2351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:39.756224+0000","last_change":"2024-05-08T19:22:20.464578+0000","last_active":"2024-05-08T19:48:39.756224+0000","last_peered":"2024-05-08T19:48:39.756224+0000","last_clean":"2024-05-08T19:48:39.756224+0000","last_became_active":"2024-05-08T19:22:20.464396+0000","last_became_peered":"2024-05-08T19:22:20.464396+0000","last_unstale":"2024-05-08T19:48:39.756224+0000","last_undegraded":"2024-05-08T19:48:39.756224+0000","last_fullsized":"2024-05-08T19:48:39.756224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2321,"log_dups_size":0,"ondisk_log_size":2321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"26'8798","reported_seq":9477,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:56.284630+0000","last_change":"2024-05-08T19:48:56.284630+0000","last_active":"2024-05-08T19:48:56.284630+0000","last_peered":"2024-05-08T19:48:56.284630+0000","last_clean":"2024-05-08T19:48:56.284630+0000","last_became_active":"2024-05-08T19:22:24.469161+0000","last_became_peered":"2024-05-08T19:22:24.469161+0000","last_unstale":"2024-05-08T19:48:56.284630+0000","last_undegraded":"2024-05-08T19:48:56.284630+0000","last_fullsized":"2024-05-08T19:48:56.284630+0000","mapping_epoch":22,"log_start":"26'1644","ondisk_log_start":"26'1644","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8798","last_scrub_stamp":"2024-05-08T19:48:56.284453+0000","last_deep_scrub":"26'8798","last_deep_scrub_stamp":"2024-05-08T19:48:56.284453+0000","last_clean_scrub_stamp":"2024-05-08T19:48:56.284453+0000","objects_scrubbed":0,"log_size":7154,"log_dups_size":0,"ondisk_log_size":7154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:57.383815+0000","scrub_duration":0.029791432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":642,"num_read_kb":43100,"num_write":6354,"num_write_kb":920646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"26'8079","reported_seq":8121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:55.663978+0000","last_change":"2024-05-08T19:48:55.664080+0000","last_active":"2024-05-08T19:48:55.663978+0000","last_peered":"2024-05-08T19:48:55.663978+0000","last_clean":"2024-05-08T19:48:55.663978+0000","last_became_active":"2024-05-08T19:22:20.005723+0000","last_became_peered":"2024-05-08T19:22:20.005723+0000","last_unstale":"2024-05-08T19:48:55.663978+0000","last_undegraded":"2024-05-08T19:48:55.663978+0000","last_fullsized":"2024-05-08T19:48:55.663978+0000","mapping_epoch":17,"log_start":"26'1600","ondisk_log_start":"26'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8079","last_scrub_stamp":"2024-05-08T19:48:55.663952+0000","last_deep_scrub":"26'8079","last_deep_scrub_stamp":"2024-05-08T19:48:55.663952+0000","last_clean_scrub_stamp":"2024-05-08T19:48:55.663952+0000","objects_scrubbed":3,"log_size":6479,"log_dups_size":0,"ondisk_log_size":6479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:23.332609+0000","scrub_duration":0.048122591999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8075,"num_write_kb":50504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'2316","reported_seq":2357,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:42.569048+0000","last_change":"2024-05-08T19:48:42.569048+0000","last_active":"2024-05-08T19:48:42.569048+0000","last_peered":"2024-05-08T19:48:42.569048+0000","last_clean":"2024-05-08T19:48:42.569048+0000","last_became_active":"2024-05-08T19:22:20.446380+0000","last_became_peered":"2024-05-08T19:22:20.446380+0000","last_unstale":"2024-05-08T19:48:42.569048+0000","last_undegraded":"2024-05-08T19:48:42.569048+0000","last_fullsized":"2024-05-08T19:48:42.569048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2316","last_scrub_stamp":"2024-05-08T19:48:42.568919+0000","last_deep_scrub":"26'2316","last_deep_scrub_stamp":"2024-05-08T19:48:42.568919+0000","last_clean_scrub_stamp":"2024-05-08T19:48:42.568919+0000","objects_scrubbed":0,"log_size":2316,"log_dups_size":0,"ondisk_log_size":2316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:21.940168+0000","scrub_duration":0.017202281999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"26'8187","reported_seq":8816,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.664137+0000","last_change":"2024-05-08T19:22:24.465354+0000","last_active":"2024-05-08T19:48:36.664137+0000","last_peered":"2024-05-08T19:48:36.664137+0000","last_clean":"2024-05-08T19:48:36.664137+0000","last_became_active":"2024-05-08T19:22:24.464669+0000","last_became_peered":"2024-05-08T19:22:24.464669+0000","last_unstale":"2024-05-08T19:48:36.664137+0000","last_undegraded":"2024-05-08T19:48:36.664137+0000","last_fullsized":"2024-05-08T19:48:36.664137+0000","mapping_epoch":22,"log_start":"26'1003","ondisk_log_start":"26'1003","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7184,"log_dups_size":0,"ondisk_log_size":7184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":604,"num_read_kb":22018,"num_write":5721,"num_write_kb":861918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'9230","reported_seq":9269,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:06.001201+0000","last_change":"2024-05-08T19:49:06.001307+0000","last_active":"2024-05-08T19:49:06.001201+0000","last_peered":"2024-05-08T19:49:06.001201+0000","last_clean":"2024-05-08T19:49:06.001201+0000","last_became_active":"2024-05-08T19:22:20.014239+0000","last_became_peered":"2024-05-08T19:22:20.014239+0000","last_unstale":"2024-05-08T19:49:06.001201+0000","last_undegraded":"2024-05-08T19:49:06.001201+0000","last_fullsized":"2024-05-08T19:49:06.001201+0000","mapping_epoch":17,"log_start":"26'2400","ondisk_log_start":"26'2400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9230","last_scrub_stamp":"2024-05-08T19:49:06.001176+0000","last_deep_scrub":"26'9230","last_deep_scrub_stamp":"2024-05-08T19:49:06.001176+0000","last_clean_scrub_stamp":"2024-05-08T19:49:06.001176+0000","objects_scrubbed":4,"log_size":6830,"log_dups_size":0,"ondisk_log_size":6830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:51.390997+0000","scrub_duration":0.063126971000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":9240,"num_write_kb":71812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":103994,"num_omap_keys":158,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'2400","reported_seq":2432,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:09.940152+0000","last_change":"2024-05-08T19:49:09.940263+0000","last_active":"2024-05-08T19:49:09.940152+0000","last_peered":"2024-05-08T19:49:09.940152+0000","last_clean":"2024-05-08T19:49:09.940152+0000","last_became_active":"2024-05-08T19:23:11.054036+0000","last_became_peered":"2024-05-08T19:23:11.054036+0000","last_unstale":"2024-05-08T19:49:09.940152+0000","last_undegraded":"2024-05-08T19:49:09.940152+0000","last_fullsized":"2024-05-08T19:49:09.940152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2400","last_scrub_stamp":"2024-05-08T19:49:09.940123+0000","last_deep_scrub":"26'2400","last_deep_scrub_stamp":"2024-05-08T19:49:09.940123+0000","last_clean_scrub_stamp":"2024-05-08T19:49:09.940123+0000","objects_scrubbed":0,"log_size":2400,"log_dups_size":0,"ondisk_log_size":2400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:09.449845+0000","scrub_duration":0.0021755020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"26'8213","reported_seq":8491,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:03.258346+0000","last_change":"2024-05-08T19:49:03.258502+0000","last_active":"2024-05-08T19:49:03.258346+0000","last_peered":"2024-05-08T19:49:03.258346+0000","last_clean":"2024-05-08T19:49:03.258346+0000","last_became_active":"2024-05-08T19:22:24.479255+0000","last_became_peered":"2024-05-08T19:22:24.479255+0000","last_unstale":"2024-05-08T19:49:03.258346+0000","last_undegraded":"2024-05-08T19:49:03.258346+0000","last_fullsized":"2024-05-08T19:49:03.258346+0000","mapping_epoch":22,"log_start":"26'1000","ondisk_log_start":"26'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8213","last_scrub_stamp":"2024-05-08T19:49:03.258320+0000","last_deep_scrub":"26'8213","last_deep_scrub_stamp":"2024-05-08T19:49:03.258320+0000","last_clean_scrub_stamp":"2024-05-08T19:49:03.258320+0000","objects_scrubbed":0,"log_size":7213,"log_dups_size":0,"ondisk_log_size":7213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:52.934304+0000","scrub_duration":0.032424343000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":15390,"num_write":5835,"num_write_kb":1051850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6116","reported_seq":6155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.885993+0000","last_change":"2024-05-08T19:48:51.886082+0000","last_active":"2024-05-08T19:48:51.885993+0000","last_peered":"2024-05-08T19:48:51.885993+0000","last_clean":"2024-05-08T19:48:51.885993+0000","last_became_active":"2024-05-08T19:22:20.013793+0000","last_became_peered":"2024-05-08T19:22:20.013793+0000","last_unstale":"2024-05-08T19:48:51.885993+0000","last_undegraded":"2024-05-08T19:48:51.885993+0000","last_fullsized":"2024-05-08T19:48:51.885993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6116","last_scrub_stamp":"2024-05-08T19:48:51.885971+0000","last_deep_scrub":"26'6116","last_deep_scrub_stamp":"2024-05-08T19:48:51.885971+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.885971+0000","objects_scrubbed":2,"log_size":6116,"log_dups_size":0,"ondisk_log_size":6116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:56.172133+0000","scrub_duration":0.024158046999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6127,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":53996,"num_omap_keys":82,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'2307","reported_seq":2334,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.669431+0000","last_change":"2024-05-08T19:22:20.455505+0000","last_active":"2024-05-08T19:48:36.669431+0000","last_peered":"2024-05-08T19:48:36.669431+0000","last_clean":"2024-05-08T19:48:36.669431+0000","last_became_active":"2024-05-08T19:22:20.455148+0000","last_became_peered":"2024-05-08T19:22:20.455148+0000","last_unstale":"2024-05-08T19:48:36.669431+0000","last_undegraded":"2024-05-08T19:48:36.669431+0000","last_fullsized":"2024-05-08T19:48:36.669431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2307,"log_dups_size":0,"ondisk_log_size":2307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"26'8426","reported_seq":9287,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.672405+0000","last_change":"2024-05-08T19:22:24.465009+0000","last_active":"2024-05-08T19:48:36.672405+0000","last_peered":"2024-05-08T19:48:36.672405+0000","last_clean":"2024-05-08T19:48:36.672405+0000","last_became_active":"2024-05-08T19:22:24.464422+0000","last_became_peered":"2024-05-08T19:22:24.464422+0000","last_unstale":"2024-05-08T19:48:36.672405+0000","last_undegraded":"2024-05-08T19:48:36.672405+0000","last_fullsized":"2024-05-08T19:48:36.672405+0000","mapping_epoch":22,"log_start":"26'2000","ondisk_log_start":"26'2000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6426,"log_dups_size":0,"ondisk_log_size":6426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":836,"num_read_kb":58598,"num_write":5984,"num_write_kb":988108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"26'8502","reported_seq":8541,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:00.593259+0000","last_change":"2024-05-08T19:49:00.593376+0000","last_active":"2024-05-08T19:49:00.593259+0000","last_peered":"2024-05-08T19:49:00.593259+0000","last_clean":"2024-05-08T19:49:00.593259+0000","last_became_active":"2024-05-08T19:22:20.011183+0000","last_became_peered":"2024-05-08T19:22:20.011183+0000","last_unstale":"2024-05-08T19:49:00.593259+0000","last_undegraded":"2024-05-08T19:49:00.593259+0000","last_fullsized":"2024-05-08T19:49:00.593259+0000","mapping_epoch":17,"log_start":"26'2100","ondisk_log_start":"26'2100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8502","last_scrub_stamp":"2024-05-08T19:49:00.593234+0000","last_deep_scrub":"26'8502","last_deep_scrub_stamp":"2024-05-08T19:49:00.593234+0000","last_clean_scrub_stamp":"2024-05-08T19:49:00.593234+0000","objects_scrubbed":1,"log_size":6402,"log_dups_size":0,"ondisk_log_size":6402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:58.280772+0000","scrub_duration":0.022856498999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8495,"num_write_kb":66920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'2343","reported_seq":2381,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:44.327490+0000","last_change":"2024-05-08T19:48:44.327587+0000","last_active":"2024-05-08T19:48:44.327490+0000","last_peered":"2024-05-08T19:48:44.327490+0000","last_clean":"2024-05-08T19:48:44.327490+0000","last_became_active":"2024-05-08T19:22:20.439096+0000","last_became_peered":"2024-05-08T19:22:20.439096+0000","last_unstale":"2024-05-08T19:48:44.327490+0000","last_undegraded":"2024-05-08T19:48:44.327490+0000","last_fullsized":"2024-05-08T19:48:44.327490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2343","last_scrub_stamp":"2024-05-08T19:48:44.327466+0000","last_deep_scrub":"26'2343","last_deep_scrub_stamp":"2024-05-08T19:48:44.327466+0000","last_clean_scrub_stamp":"2024-05-08T19:48:44.327466+0000","objects_scrubbed":0,"log_size":2343,"log_dups_size":0,"ondisk_log_size":2343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:23.698715+0000","scrub_duration":0.006452167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'8654","reported_seq":9396,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:55.867163+0000","last_change":"2024-05-08T19:48:55.867311+0000","last_active":"2024-05-08T19:48:55.867163+0000","last_peered":"2024-05-08T19:48:55.867163+0000","last_clean":"2024-05-08T19:48:55.867163+0000","last_became_active":"2024-05-08T19:23:11.529451+0000","last_became_peered":"2024-05-08T19:23:11.529451+0000","last_unstale":"2024-05-08T19:48:55.867163+0000","last_undegraded":"2024-05-08T19:48:55.867163+0000","last_fullsized":"2024-05-08T19:48:55.867163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8654","last_scrub_stamp":"2024-05-08T19:48:55.867135+0000","last_deep_scrub":"26'8654","last_deep_scrub_stamp":"2024-05-08T19:48:55.867135+0000","last_clean_scrub_stamp":"2024-05-08T19:48:55.867135+0000","objects_scrubbed":0,"log_size":8654,"log_dups_size":0,"ondisk_log_size":8654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:14.157078+0000","scrub_duration":0.021771672999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":696,"num_read_kb":42234,"num_write":6185,"num_write_kb":1013081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"26'10410","reported_seq":10449,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:46.696336+0000","last_change":"2024-05-08T19:48:46.696452+0000","last_active":"2024-05-08T19:48:46.696336+0000","last_peered":"2024-05-08T19:48:46.696336+0000","last_clean":"2024-05-08T19:48:46.696336+0000","last_became_active":"2024-05-08T19:22:20.003513+0000","last_became_peered":"2024-05-08T19:22:20.003513+0000","last_unstale":"2024-05-08T19:48:46.696336+0000","last_undegraded":"2024-05-08T19:48:46.696336+0000","last_fullsized":"2024-05-08T19:48:46.696336+0000","mapping_epoch":17,"log_start":"26'2500","ondisk_log_start":"26'2500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10410","last_scrub_stamp":"2024-05-08T19:48:46.696293+0000","last_deep_scrub":"26'10410","last_deep_scrub_stamp":"2024-05-08T19:48:46.696293+0000","last_clean_scrub_stamp":"2024-05-08T19:48:46.696293+0000","objects_scrubbed":2,"log_size":7910,"log_dups_size":0,"ondisk_log_size":7910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:59.423720+0000","scrub_duration":0.035260540999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10404,"num_write_kb":72564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'2281","reported_seq":2319,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.643324+0000","last_change":"2024-05-08T19:48:51.643437+0000","last_active":"2024-05-08T19:48:51.643324+0000","last_peered":"2024-05-08T19:48:51.643324+0000","last_clean":"2024-05-08T19:48:51.643324+0000","last_became_active":"2024-05-08T19:22:20.445238+0000","last_became_peered":"2024-05-08T19:22:20.445238+0000","last_unstale":"2024-05-08T19:48:51.643324+0000","last_undegraded":"2024-05-08T19:48:51.643324+0000","last_fullsized":"2024-05-08T19:48:51.643324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2281","last_scrub_stamp":"2024-05-08T19:48:51.643299+0000","last_deep_scrub":"26'2281","last_deep_scrub_stamp":"2024-05-08T19:48:51.643299+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.643299+0000","objects_scrubbed":0,"log_size":2281,"log_dups_size":0,"ondisk_log_size":2281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:09.933242+0000","scrub_duration":0.0060195379999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'8267","reported_seq":10736,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.361450+0000","last_change":"2024-05-08T19:22:24.479665+0000","last_active":"2024-05-08T19:48:41.361450+0000","last_peered":"2024-05-08T19:48:41.361450+0000","last_clean":"2024-05-08T19:48:41.361450+0000","last_became_active":"2024-05-08T19:22:24.478998+0000","last_became_peered":"2024-05-08T19:22:24.478998+0000","last_unstale":"2024-05-08T19:48:41.361450+0000","last_undegraded":"2024-05-08T19:48:41.361450+0000","last_fullsized":"2024-05-08T19:48:41.361450+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7967,"log_dups_size":0,"ondisk_log_size":7967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2441,"num_read_kb":165440,"num_write":5908,"num_write_kb":873319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"26'5852","reported_seq":5892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:08.600865+0000","last_change":"2024-05-08T19:49:08.600961+0000","last_active":"2024-05-08T19:49:08.600865+0000","last_peered":"2024-05-08T19:49:08.600865+0000","last_clean":"2024-05-08T19:49:08.600865+0000","last_became_active":"2024-05-08T19:22:20.002534+0000","last_became_peered":"2024-05-08T19:22:20.002534+0000","last_unstale":"2024-05-08T19:49:08.600865+0000","last_undegraded":"2024-05-08T19:49:08.600865+0000","last_fullsized":"2024-05-08T19:49:08.600865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5852","last_scrub_stamp":"2024-05-08T19:49:08.600840+0000","last_deep_scrub":"26'5852","last_deep_scrub_stamp":"2024-05-08T19:49:08.600840+0000","last_clean_scrub_stamp":"2024-05-08T19:49:08.600840+0000","objects_scrubbed":1,"log_size":5852,"log_dups_size":0,"ondisk_log_size":5852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:04.417043+0000","scrub_duration":0.024786341999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5849,"num_write_kb":40670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"26'2373","reported_seq":2412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:53.652188+0000","last_change":"2024-05-08T19:48:53.652188+0000","last_active":"2024-05-08T19:48:53.652188+0000","last_peered":"2024-05-08T19:48:53.652188+0000","last_clean":"2024-05-08T19:48:53.652188+0000","last_became_active":"2024-05-08T19:22:20.436431+0000","last_became_peered":"2024-05-08T19:22:20.436431+0000","last_unstale":"2024-05-08T19:48:53.652188+0000","last_undegraded":"2024-05-08T19:48:53.652188+0000","last_fullsized":"2024-05-08T19:48:53.652188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2373","last_scrub_stamp":"2024-05-08T19:48:53.652045+0000","last_deep_scrub":"26'2373","last_deep_scrub_stamp":"2024-05-08T19:48:53.652045+0000","last_clean_scrub_stamp":"2024-05-08T19:48:53.652045+0000","objects_scrubbed":0,"log_size":2373,"log_dups_size":0,"ondisk_log_size":2373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:53.161766+0000","scrub_duration":0.0018538879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'8472","reported_seq":9203,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.663642+0000","last_change":"2024-05-08T19:22:24.617420+0000","last_active":"2024-05-08T19:48:36.663642+0000","last_peered":"2024-05-08T19:48:36.663642+0000","last_clean":"2024-05-08T19:48:36.663642+0000","last_became_active":"2024-05-08T19:22:24.617030+0000","last_became_peered":"2024-05-08T19:22:24.617030+0000","last_unstale":"2024-05-08T19:48:36.663642+0000","last_undegraded":"2024-05-08T19:48:36.663642+0000","last_fullsized":"2024-05-08T19:48:36.663642+0000","mapping_epoch":22,"log_start":"26'1302","ondisk_log_start":"26'1302","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7170,"log_dups_size":0,"ondisk_log_size":7170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":49016,"num_write":6130,"num_write_kb":1037918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"26'9202","reported_seq":9242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:46.507455+0000","last_change":"2024-05-08T19:48:46.507455+0000","last_active":"2024-05-08T19:48:46.507455+0000","last_peered":"2024-05-08T19:48:46.507455+0000","last_clean":"2024-05-08T19:48:46.507455+0000","last_became_active":"2024-05-08T19:22:20.003365+0000","last_became_peered":"2024-05-08T19:22:20.003365+0000","last_unstale":"2024-05-08T19:48:46.507455+0000","last_undegraded":"2024-05-08T19:48:46.507455+0000","last_fullsized":"2024-05-08T19:48:46.507455+0000","mapping_epoch":17,"log_start":"26'1700","ondisk_log_start":"26'1700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9202","last_scrub_stamp":"2024-05-08T19:48:46.507282+0000","last_deep_scrub":"26'9202","last_deep_scrub_stamp":"2024-05-08T19:48:46.507282+0000","last_clean_scrub_stamp":"2024-05-08T19:48:46.507282+0000","objects_scrubbed":0,"log_size":7502,"log_dups_size":0,"ondisk_log_size":7502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:29.867916+0000","scrub_duration":0.0077823199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9189,"num_write_kb":63509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"26'2305","reported_seq":2344,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:00.639014+0000","last_change":"2024-05-08T19:49:00.639014+0000","last_active":"2024-05-08T19:49:00.639014+0000","last_peered":"2024-05-08T19:49:00.639014+0000","last_clean":"2024-05-08T19:49:00.639014+0000","last_became_active":"2024-05-08T19:22:20.437214+0000","last_became_peered":"2024-05-08T19:22:20.437214+0000","last_unstale":"2024-05-08T19:49:00.639014+0000","last_undegraded":"2024-05-08T19:49:00.639014+0000","last_fullsized":"2024-05-08T19:49:00.639014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2305","last_scrub_stamp":"2024-05-08T19:49:00.638891+0000","last_deep_scrub":"26'2305","last_deep_scrub_stamp":"2024-05-08T19:49:00.638891+0000","last_clean_scrub_stamp":"2024-05-08T19:49:00.638891+0000","objects_scrubbed":0,"log_size":2305,"log_dups_size":0,"ondisk_log_size":2305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.738253+0000","scrub_duration":0.0074742209999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"26'8428","reported_seq":8897,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.658615+0000","last_change":"2024-05-08T19:22:24.615730+0000","last_active":"2024-05-08T19:48:36.658615+0000","last_peered":"2024-05-08T19:48:36.658615+0000","last_clean":"2024-05-08T19:48:36.658615+0000","last_became_active":"2024-05-08T19:22:24.615351+0000","last_became_peered":"2024-05-08T19:22:24.615351+0000","last_unstale":"2024-05-08T19:48:36.658615+0000","last_undegraded":"2024-05-08T19:48:36.658615+0000","last_fullsized":"2024-05-08T19:48:36.658615+0000","mapping_epoch":22,"log_start":"26'2014","ondisk_log_start":"26'2014","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6414,"log_dups_size":0,"ondisk_log_size":6414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":19968,"num_write":5955,"num_write_kb":994501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"26'7043","reported_seq":7921,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.648311+0000","last_change":"2024-05-08T19:48:54.648311+0000","last_active":"2024-05-08T19:48:54.648311+0000","last_peered":"2024-05-08T19:48:54.648311+0000","last_clean":"2024-05-08T19:48:54.648311+0000","last_became_active":"2024-05-08T19:22:20.001990+0000","last_became_peered":"2024-05-08T19:22:20.001990+0000","last_unstale":"2024-05-08T19:48:54.648311+0000","last_undegraded":"2024-05-08T19:48:54.648311+0000","last_fullsized":"2024-05-08T19:48:54.648311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7043","last_scrub_stamp":"2024-05-08T19:48:54.648187+0000","last_deep_scrub":"26'7043","last_deep_scrub_stamp":"2024-05-08T19:48:54.648187+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.648187+0000","objects_scrubbed":2,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:58.934349+0000","scrub_duration":0.038308684000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":838,"num_read_kb":4635,"num_write":7034,"num_write_kb":49678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"26'2319","reported_seq":2358,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:08.220801+0000","last_change":"2024-05-08T19:49:08.220920+0000","last_active":"2024-05-08T19:49:08.220801+0000","last_peered":"2024-05-08T19:49:08.220801+0000","last_clean":"2024-05-08T19:49:08.220801+0000","last_became_active":"2024-05-08T19:22:20.447475+0000","last_became_peered":"2024-05-08T19:22:20.447475+0000","last_unstale":"2024-05-08T19:49:08.220801+0000","last_undegraded":"2024-05-08T19:49:08.220801+0000","last_fullsized":"2024-05-08T19:49:08.220801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2319","last_scrub_stamp":"2024-05-08T19:49:08.220776+0000","last_deep_scrub":"26'2319","last_deep_scrub_stamp":"2024-05-08T19:49:08.220776+0000","last_clean_scrub_stamp":"2024-05-08T19:49:08.220776+0000","objects_scrubbed":0,"log_size":2319,"log_dups_size":0,"ondisk_log_size":2319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:35.889432+0000","scrub_duration":0.005478826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'7961","reported_seq":8450,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.577762+0000","last_change":"2024-05-08T19:23:11.054182+0000","last_active":"2024-05-08T19:48:36.577762+0000","last_peered":"2024-05-08T19:48:36.577762+0000","last_clean":"2024-05-08T19:48:36.577762+0000","last_became_active":"2024-05-08T19:23:11.053733+0000","last_became_peered":"2024-05-08T19:23:11.053733+0000","last_unstale":"2024-05-08T19:48:36.577762+0000","last_undegraded":"2024-05-08T19:48:36.577762+0000","last_fullsized":"2024-05-08T19:48:36.577762+0000","mapping_epoch":25,"log_start":"26'1500","ondisk_log_start":"26'1500","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6461,"log_dups_size":0,"ondisk_log_size":6461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":453,"num_read_kb":17282,"num_write":5569,"num_write_kb":1020101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"26'6225","reported_seq":6265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:48.436975+0000","last_change":"2024-05-08T19:48:48.436975+0000","last_active":"2024-05-08T19:48:48.436975+0000","last_peered":"2024-05-08T19:48:48.436975+0000","last_clean":"2024-05-08T19:48:48.436975+0000","last_became_active":"2024-05-08T19:22:20.000981+0000","last_became_peered":"2024-05-08T19:22:20.000981+0000","last_unstale":"2024-05-08T19:48:48.436975+0000","last_undegraded":"2024-05-08T19:48:48.436975+0000","last_fullsized":"2024-05-08T19:48:48.436975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6225","last_scrub_stamp":"2024-05-08T19:48:48.436851+0000","last_deep_scrub":"26'6225","last_deep_scrub_stamp":"2024-05-08T19:48:48.436851+0000","last_clean_scrub_stamp":"2024-05-08T19:48:48.436851+0000","objects_scrubbed":1,"log_size":6225,"log_dups_size":0,"ondisk_log_size":6225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:52.723014+0000","scrub_duration":0.024176517000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6227,"num_write_kb":45123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"26'2337","reported_seq":2376,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:07.756473+0000","last_change":"2024-05-08T19:49:07.756598+0000","last_active":"2024-05-08T19:49:07.756473+0000","last_peered":"2024-05-08T19:49:07.756473+0000","last_clean":"2024-05-08T19:49:07.756473+0000","last_became_active":"2024-05-08T19:22:20.446644+0000","last_became_peered":"2024-05-08T19:22:20.446644+0000","last_unstale":"2024-05-08T19:49:07.756473+0000","last_undegraded":"2024-05-08T19:49:07.756473+0000","last_fullsized":"2024-05-08T19:49:07.756473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2337","last_scrub_stamp":"2024-05-08T19:49:07.756442+0000","last_deep_scrub":"26'2337","last_deep_scrub_stamp":"2024-05-08T19:49:07.756442+0000","last_clean_scrub_stamp":"2024-05-08T19:49:07.756442+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:28.707928+0000","scrub_duration":0.010132966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"26'8308","reported_seq":8840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:02.281238+0000","last_change":"2024-05-08T19:49:02.281396+0000","last_active":"2024-05-08T19:49:02.281238+0000","last_peered":"2024-05-08T19:49:02.281238+0000","last_clean":"2024-05-08T19:49:02.281238+0000","last_became_active":"2024-05-08T19:22:24.464178+0000","last_became_peered":"2024-05-08T19:22:24.464178+0000","last_unstale":"2024-05-08T19:49:02.281238+0000","last_undegraded":"2024-05-08T19:49:02.281238+0000","last_fullsized":"2024-05-08T19:49:02.281238+0000","mapping_epoch":22,"log_start":"26'1100","ondisk_log_start":"26'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8308","last_scrub_stamp":"2024-05-08T19:49:02.281211+0000","last_deep_scrub":"26'8308","last_deep_scrub_stamp":"2024-05-08T19:49:02.281211+0000","last_clean_scrub_stamp":"2024-05-08T19:49:02.281211+0000","objects_scrubbed":0,"log_size":7208,"log_dups_size":0,"ondisk_log_size":7208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:42.754921+0000","scrub_duration":0.025608511,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":27360,"num_write":5875,"num_write_kb":879779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'6730","reported_seq":6770,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:57.645430+0000","last_change":"2024-05-08T19:48:57.645543+0000","last_active":"2024-05-08T19:48:57.645430+0000","last_peered":"2024-05-08T19:48:57.645430+0000","last_clean":"2024-05-08T19:48:57.645430+0000","last_became_active":"2024-05-08T19:22:20.000985+0000","last_became_peered":"2024-05-08T19:22:20.000985+0000","last_unstale":"2024-05-08T19:48:57.645430+0000","last_undegraded":"2024-05-08T19:48:57.645430+0000","last_fullsized":"2024-05-08T19:48:57.645430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6730","last_scrub_stamp":"2024-05-08T19:48:57.645404+0000","last_deep_scrub":"26'6730","last_deep_scrub_stamp":"2024-05-08T19:48:57.645404+0000","last_clean_scrub_stamp":"2024-05-08T19:48:57.645404+0000","objects_scrubbed":4,"log_size":6730,"log_dups_size":0,"ondisk_log_size":6730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:15.935347+0000","scrub_duration":0.038479950999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":6744,"num_write_kb":41825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":41485,"num_omap_keys":63,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'2335","reported_seq":2374,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:47.378684+0000","last_change":"2024-05-08T19:48:47.378803+0000","last_active":"2024-05-08T19:48:47.378684+0000","last_peered":"2024-05-08T19:48:47.378684+0000","last_clean":"2024-05-08T19:48:47.378684+0000","last_became_active":"2024-05-08T19:22:20.447538+0000","last_became_peered":"2024-05-08T19:22:20.447538+0000","last_unstale":"2024-05-08T19:48:47.378684+0000","last_undegraded":"2024-05-08T19:48:47.378684+0000","last_fullsized":"2024-05-08T19:48:47.378684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2335","last_scrub_stamp":"2024-05-08T19:48:47.378653+0000","last_deep_scrub":"26'2335","last_deep_scrub_stamp":"2024-05-08T19:48:47.378653+0000","last_clean_scrub_stamp":"2024-05-08T19:48:47.378653+0000","objects_scrubbed":0,"log_size":2335,"log_dups_size":0,"ondisk_log_size":2335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:51.664816+0000","scrub_duration":0.0017606900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"26'8591","reported_seq":9134,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.639212+0000","last_change":"2024-05-08T19:22:24.479544+0000","last_active":"2024-05-08T19:48:36.639212+0000","last_peered":"2024-05-08T19:48:36.639212+0000","last_clean":"2024-05-08T19:48:36.639212+0000","last_became_active":"2024-05-08T19:22:24.479071+0000","last_became_peered":"2024-05-08T19:22:24.479071+0000","last_unstale":"2024-05-08T19:48:36.639212+0000","last_undegraded":"2024-05-08T19:48:36.639212+0000","last_fullsized":"2024-05-08T19:48:36.639212+0000","mapping_epoch":22,"log_start":"26'1203","ondisk_log_start":"26'1203","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7388,"log_dups_size":0,"ondisk_log_size":7388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":517,"num_read_kb":30942,"num_write":6185,"num_write_kb":930944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'10879","reported_seq":11547,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.708511+0000","last_change":"2024-05-08T19:48:51.708629+0000","last_active":"2024-05-08T19:48:51.708511+0000","last_peered":"2024-05-08T19:48:51.708511+0000","last_clean":"2024-05-08T19:48:51.708511+0000","last_became_active":"2024-05-08T19:22:20.011331+0000","last_became_peered":"2024-05-08T19:22:20.011331+0000","last_unstale":"2024-05-08T19:48:51.708511+0000","last_undegraded":"2024-05-08T19:48:51.708511+0000","last_fullsized":"2024-05-08T19:48:51.708511+0000","mapping_epoch":17,"log_start":"26'2900","ondisk_log_start":"26'2900","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10879","last_scrub_stamp":"2024-05-08T19:48:51.708487+0000","last_deep_scrub":"26'10879","last_deep_scrub_stamp":"2024-05-08T19:48:51.708487+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.708487+0000","objects_scrubbed":6,"log_size":7979,"log_dups_size":0,"ondisk_log_size":7979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:31.079736+0000","scrub_duration":0.057288780999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":630,"num_read_kb":4505,"num_write":10869,"num_write_kb":72957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":113207,"num_omap_keys":172,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"26'2256","reported_seq":2284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.892919+0000","last_change":"2024-05-08T19:22:20.447583+0000","last_active":"2024-05-08T19:48:41.892919+0000","last_peered":"2024-05-08T19:48:41.892919+0000","last_clean":"2024-05-08T19:48:41.892919+0000","last_became_active":"2024-05-08T19:22:20.447243+0000","last_became_peered":"2024-05-08T19:22:20.447243+0000","last_unstale":"2024-05-08T19:48:41.892919+0000","last_undegraded":"2024-05-08T19:48:41.892919+0000","last_fullsized":"2024-05-08T19:48:41.892919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2256,"log_dups_size":0,"ondisk_log_size":2256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'8691","reported_seq":9094,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.829360+0000","last_change":"2024-05-08T19:22:24.615622+0000","last_active":"2024-05-08T19:48:40.829360+0000","last_peered":"2024-05-08T19:48:40.829360+0000","last_clean":"2024-05-08T19:48:40.829360+0000","last_became_active":"2024-05-08T19:22:24.614790+0000","last_became_peered":"2024-05-08T19:22:24.614790+0000","last_unstale":"2024-05-08T19:48:40.829360+0000","last_undegraded":"2024-05-08T19:48:40.829360+0000","last_fullsized":"2024-05-08T19:48:40.829360+0000","mapping_epoch":22,"log_start":"26'1126","ondisk_log_start":"26'1126","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7565,"log_dups_size":0,"ondisk_log_size":7565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":377,"num_read_kb":22514,"num_write":6361,"num_write_kb":865965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"26'5001","reported_seq":5041,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:45.598699+0000","last_change":"2024-05-08T19:48:45.598794+0000","last_active":"2024-05-08T19:48:45.598699+0000","last_peered":"2024-05-08T19:48:45.598699+0000","last_clean":"2024-05-08T19:48:45.598699+0000","last_became_active":"2024-05-08T19:22:20.005738+0000","last_became_peered":"2024-05-08T19:22:20.005738+0000","last_unstale":"2024-05-08T19:48:45.598699+0000","last_undegraded":"2024-05-08T19:48:45.598699+0000","last_fullsized":"2024-05-08T19:48:45.598699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5001","last_scrub_stamp":"2024-05-08T19:48:45.598671+0000","last_deep_scrub":"26'5001","last_deep_scrub_stamp":"2024-05-08T19:48:45.598671+0000","last_clean_scrub_stamp":"2024-05-08T19:48:45.598671+0000","objects_scrubbed":3,"log_size":5001,"log_dups_size":0,"ondisk_log_size":5001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:49.884833+0000","scrub_duration":0.024799128,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5000,"num_write_kb":36069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"26'2337","reported_seq":2376,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:05.739978+0000","last_change":"2024-05-08T19:49:05.740082+0000","last_active":"2024-05-08T19:49:05.739978+0000","last_peered":"2024-05-08T19:49:05.739978+0000","last_clean":"2024-05-08T19:49:05.739978+0000","last_became_active":"2024-05-08T19:22:20.448268+0000","last_became_peered":"2024-05-08T19:22:20.448268+0000","last_unstale":"2024-05-08T19:49:05.739978+0000","last_undegraded":"2024-05-08T19:49:05.739978+0000","last_fullsized":"2024-05-08T19:49:05.739978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2337","last_scrub_stamp":"2024-05-08T19:49:05.739949+0000","last_deep_scrub":"26'2337","last_deep_scrub_stamp":"2024-05-08T19:49:05.739949+0000","last_clean_scrub_stamp":"2024-05-08T19:49:05.739949+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:05.249670+0000","scrub_duration":0.0023711069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"26'8215","reported_seq":8340,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.604342+0000","last_change":"2024-05-08T19:22:24.614076+0000","last_active":"2024-05-08T19:48:36.604342+0000","last_peered":"2024-05-08T19:48:36.604342+0000","last_clean":"2024-05-08T19:48:36.604342+0000","last_became_active":"2024-05-08T19:22:24.613698+0000","last_became_peered":"2024-05-08T19:22:24.613698+0000","last_unstale":"2024-05-08T19:48:36.604342+0000","last_undegraded":"2024-05-08T19:48:36.604342+0000","last_fullsized":"2024-05-08T19:48:36.604342+0000","mapping_epoch":22,"log_start":"26'1759","ondisk_log_start":"26'1759","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6456,"log_dups_size":0,"ondisk_log_size":6456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":5304,"num_write":5835,"num_write_kb":1072126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'2641","reported_seq":2681,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:57.371355+0000","last_change":"2024-05-08T19:48:57.371495+0000","last_active":"2024-05-08T19:48:57.371355+0000","last_peered":"2024-05-08T19:48:57.371355+0000","last_clean":"2024-05-08T19:48:57.371355+0000","last_became_active":"2024-05-08T19:22:20.011188+0000","last_became_peered":"2024-05-08T19:22:20.011188+0000","last_unstale":"2024-05-08T19:48:57.371355+0000","last_undegraded":"2024-05-08T19:48:57.371355+0000","last_fullsized":"2024-05-08T19:48:57.371355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2641","last_scrub_stamp":"2024-05-08T19:48:57.371296+0000","last_deep_scrub":"26'2641","last_deep_scrub_stamp":"2024-05-08T19:48:57.371296+0000","last_clean_scrub_stamp":"2024-05-08T19:48:57.371296+0000","objects_scrubbed":1,"log_size":2641,"log_dups_size":0,"ondisk_log_size":2641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:58.470658+0000","scrub_duration":0.02237304,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2647,"num_write_kb":22132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'2373","reported_seq":2412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:42.845985+0000","last_change":"2024-05-08T19:48:42.846073+0000","last_active":"2024-05-08T19:48:42.845985+0000","last_peered":"2024-05-08T19:48:42.845985+0000","last_clean":"2024-05-08T19:48:42.845985+0000","last_became_active":"2024-05-08T19:22:20.455562+0000","last_became_peered":"2024-05-08T19:22:20.455562+0000","last_unstale":"2024-05-08T19:48:42.845985+0000","last_undegraded":"2024-05-08T19:48:42.845985+0000","last_fullsized":"2024-05-08T19:48:42.845985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2373","last_scrub_stamp":"2024-05-08T19:48:42.845961+0000","last_deep_scrub":"26'2373","last_deep_scrub_stamp":"2024-05-08T19:48:42.845961+0000","last_clean_scrub_stamp":"2024-05-08T19:48:42.845961+0000","objects_scrubbed":0,"log_size":2373,"log_dups_size":0,"ondisk_log_size":2373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:59.674185+0000","scrub_duration":0.0025479779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"26'8227","reported_seq":8405,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:39.756325+0000","last_change":"2024-05-08T19:22:24.616812+0000","last_active":"2024-05-08T19:48:39.756325+0000","last_peered":"2024-05-08T19:48:39.756325+0000","last_clean":"2024-05-08T19:48:39.756325+0000","last_became_active":"2024-05-08T19:22:24.615618+0000","last_became_peered":"2024-05-08T19:22:24.615618+0000","last_unstale":"2024-05-08T19:48:39.756325+0000","last_undegraded":"2024-05-08T19:48:39.756325+0000","last_fullsized":"2024-05-08T19:48:39.756325+0000","mapping_epoch":22,"log_start":"26'1815","ondisk_log_start":"26'1815","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6412,"log_dups_size":0,"ondisk_log_size":6412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":3194,"num_write":5725,"num_write_kb":833306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"26'3932","reported_seq":3972,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:44.648094+0000","last_change":"2024-05-08T19:48:44.648189+0000","last_active":"2024-05-08T19:48:44.648094+0000","last_peered":"2024-05-08T19:48:44.648094+0000","last_clean":"2024-05-08T19:48:44.648094+0000","last_became_active":"2024-05-08T19:22:20.003725+0000","last_became_peered":"2024-05-08T19:22:20.003725+0000","last_unstale":"2024-05-08T19:48:44.648094+0000","last_undegraded":"2024-05-08T19:48:44.648094+0000","last_fullsized":"2024-05-08T19:48:44.648094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3932","last_scrub_stamp":"2024-05-08T19:48:44.648068+0000","last_deep_scrub":"26'3932","last_deep_scrub_stamp":"2024-05-08T19:48:44.648068+0000","last_clean_scrub_stamp":"2024-05-08T19:48:44.648068+0000","objects_scrubbed":2,"log_size":3932,"log_dups_size":0,"ondisk_log_size":3932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:01.476291+0000","scrub_duration":0.034361632000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3928,"num_write_kb":31166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"26'2246","reported_seq":2285,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:04.571285+0000","last_change":"2024-05-08T19:49:04.571392+0000","last_active":"2024-05-08T19:49:04.571285+0000","last_peered":"2024-05-08T19:49:04.571285+0000","last_clean":"2024-05-08T19:49:04.571285+0000","last_became_active":"2024-05-08T19:22:20.452496+0000","last_became_peered":"2024-05-08T19:22:20.452496+0000","last_unstale":"2024-05-08T19:49:04.571285+0000","last_undegraded":"2024-05-08T19:49:04.571285+0000","last_fullsized":"2024-05-08T19:49:04.571285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2246","last_scrub_stamp":"2024-05-08T19:49:04.571260+0000","last_deep_scrub":"26'2246","last_deep_scrub_stamp":"2024-05-08T19:49:04.571260+0000","last_clean_scrub_stamp":"2024-05-08T19:49:04.571260+0000","objects_scrubbed":0,"log_size":2246,"log_dups_size":0,"ondisk_log_size":2246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:05.670622+0000","scrub_duration":0.00192366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"26'8446","reported_seq":9052,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:38.170793+0000","last_change":"2024-05-08T19:22:24.478351+0000","last_active":"2024-05-08T19:48:38.170793+0000","last_peered":"2024-05-08T19:48:38.170793+0000","last_clean":"2024-05-08T19:48:38.170793+0000","last_became_active":"2024-05-08T19:22:24.477728+0000","last_became_peered":"2024-05-08T19:22:24.477728+0000","last_unstale":"2024-05-08T19:48:38.170793+0000","last_undegraded":"2024-05-08T19:48:38.170793+0000","last_fullsized":"2024-05-08T19:48:38.170793+0000","mapping_epoch":22,"log_start":"26'1217","ondisk_log_start":"26'1217","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7229,"log_dups_size":0,"ondisk_log_size":7229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":39960,"num_write":6024,"num_write_kb":827712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"26'5273","reported_seq":5313,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:47.999042+0000","last_change":"2024-05-08T19:48:47.999179+0000","last_active":"2024-05-08T19:48:47.999042+0000","last_peered":"2024-05-08T19:48:47.999042+0000","last_clean":"2024-05-08T19:48:47.999042+0000","last_became_active":"2024-05-08T19:22:20.007985+0000","last_became_peered":"2024-05-08T19:22:20.007985+0000","last_unstale":"2024-05-08T19:48:47.999042+0000","last_undegraded":"2024-05-08T19:48:47.999042+0000","last_fullsized":"2024-05-08T19:48:47.999042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5273","last_scrub_stamp":"2024-05-08T19:48:47.999018+0000","last_deep_scrub":"26'5273","last_deep_scrub_stamp":"2024-05-08T19:48:47.999018+0000","last_clean_scrub_stamp":"2024-05-08T19:48:47.999018+0000","objects_scrubbed":9,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:31.359653+0000","scrub_duration":0.067476978000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":5295,"num_write_kb":36936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":463383,"num_omap_keys":704,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"26'2365","reported_seq":2404,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:43.835331+0000","last_change":"2024-05-08T19:48:43.835445+0000","last_active":"2024-05-08T19:48:43.835331+0000","last_peered":"2024-05-08T19:48:43.835331+0000","last_clean":"2024-05-08T19:48:43.835331+0000","last_became_active":"2024-05-08T19:22:20.458588+0000","last_became_peered":"2024-05-08T19:22:20.458588+0000","last_unstale":"2024-05-08T19:48:43.835331+0000","last_undegraded":"2024-05-08T19:48:43.835331+0000","last_fullsized":"2024-05-08T19:48:43.835331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2365","last_scrub_stamp":"2024-05-08T19:48:43.835306+0000","last_deep_scrub":"26'2365","last_deep_scrub_stamp":"2024-05-08T19:48:43.835306+0000","last_clean_scrub_stamp":"2024-05-08T19:48:43.835306+0000","objects_scrubbed":0,"log_size":2365,"log_dups_size":0,"ondisk_log_size":2365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:28.364339+0000","scrub_duration":0.001815826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"26'8533","reported_seq":10204,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.294166+0000","last_change":"2024-05-08T19:22:24.464132+0000","last_active":"2024-05-08T19:48:40.294166+0000","last_peered":"2024-05-08T19:48:40.294166+0000","last_clean":"2024-05-08T19:48:40.294166+0000","last_became_active":"2024-05-08T19:22:24.463741+0000","last_became_peered":"2024-05-08T19:22:24.463741+0000","last_unstale":"2024-05-08T19:48:40.294166+0000","last_undegraded":"2024-05-08T19:48:40.294166+0000","last_fullsized":"2024-05-08T19:48:40.294166+0000","mapping_epoch":22,"log_start":"26'1304","ondisk_log_start":"26'1304","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7229,"log_dups_size":0,"ondisk_log_size":7229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1644,"num_read_kb":83588,"num_write":6135,"num_write_kb":944540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"26'5914","reported_seq":5954,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.373207+0000","last_change":"2024-05-08T19:48:40.373290+0000","last_active":"2024-05-08T19:48:40.373207+0000","last_peered":"2024-05-08T19:48:40.373207+0000","last_clean":"2024-05-08T19:48:40.373207+0000","last_became_active":"2024-05-08T19:22:20.005680+0000","last_became_peered":"2024-05-08T19:22:20.005680+0000","last_unstale":"2024-05-08T19:48:40.373207+0000","last_undegraded":"2024-05-08T19:48:40.373207+0000","last_fullsized":"2024-05-08T19:48:40.373207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5914","last_scrub_stamp":"2024-05-08T19:48:40.373183+0000","last_deep_scrub":"26'5914","last_deep_scrub_stamp":"2024-05-08T19:48:40.373183+0000","last_clean_scrub_stamp":"2024-05-08T19:48:40.373183+0000","objects_scrubbed":3,"log_size":5914,"log_dups_size":0,"ondisk_log_size":5914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:53.100609+0000","scrub_duration":0.036371251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5920,"num_write_kb":40735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"26'2309","reported_seq":2348,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:11.899690+0000","last_change":"2024-05-08T19:49:11.899815+0000","last_active":"2024-05-08T19:49:11.899690+0000","last_peered":"2024-05-08T19:49:11.899690+0000","last_clean":"2024-05-08T19:49:11.899690+0000","last_became_active":"2024-05-08T19:22:20.449512+0000","last_became_peered":"2024-05-08T19:22:20.449512+0000","last_unstale":"2024-05-08T19:49:11.899690+0000","last_undegraded":"2024-05-08T19:49:11.899690+0000","last_fullsized":"2024-05-08T19:49:11.899690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2309","last_scrub_stamp":"2024-05-08T19:49:11.899665+0000","last_deep_scrub":"26'2309","last_deep_scrub_stamp":"2024-05-08T19:49:11.899665+0000","last_clean_scrub_stamp":"2024-05-08T19:49:11.899665+0000","objects_scrubbed":0,"log_size":2309,"log_dups_size":0,"ondisk_log_size":2309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:39.568321+0000","scrub_duration":0.0016931680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"26'8843","reported_seq":9128,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.638536+0000","last_change":"2024-05-08T19:22:24.478647+0000","last_active":"2024-05-08T19:48:36.638536+0000","last_peered":"2024-05-08T19:48:36.638536+0000","last_clean":"2024-05-08T19:48:36.638536+0000","last_became_active":"2024-05-08T19:22:24.478248+0000","last_became_peered":"2024-05-08T19:22:24.478248+0000","last_unstale":"2024-05-08T19:48:36.638536+0000","last_undegraded":"2024-05-08T19:48:36.638536+0000","last_fullsized":"2024-05-08T19:48:36.638536+0000","mapping_epoch":22,"log_start":"26'1512","ondisk_log_start":"26'1512","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7331,"log_dups_size":0,"ondisk_log_size":7331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":14826,"num_write":6450,"num_write_kb":856300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"26'7016","reported_seq":7057,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:48.585360+0000","last_change":"2024-05-08T19:48:48.585465+0000","last_active":"2024-05-08T19:48:48.585360+0000","last_peered":"2024-05-08T19:48:48.585360+0000","last_clean":"2024-05-08T19:48:48.585360+0000","last_became_active":"2024-05-08T19:22:20.003055+0000","last_became_peered":"2024-05-08T19:22:20.003055+0000","last_unstale":"2024-05-08T19:48:48.585360+0000","last_undegraded":"2024-05-08T19:48:48.585360+0000","last_fullsized":"2024-05-08T19:48:48.585360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7016","last_scrub_stamp":"2024-05-08T19:48:48.585336+0000","last_deep_scrub":"26'7016","last_deep_scrub_stamp":"2024-05-08T19:48:48.585336+0000","last_clean_scrub_stamp":"2024-05-08T19:48:48.585336+0000","objects_scrubbed":2,"log_size":7016,"log_dups_size":0,"ondisk_log_size":7016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.956585+0000","scrub_duration":0.041923031999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7021,"num_write_kb":53638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"26'2305","reported_seq":2345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:45.486801+0000","last_change":"2024-05-08T19:48:45.486911+0000","last_active":"2024-05-08T19:48:45.486801+0000","last_peered":"2024-05-08T19:48:45.486801+0000","last_clean":"2024-05-08T19:48:45.486801+0000","last_became_active":"2024-05-08T19:22:20.449693+0000","last_became_peered":"2024-05-08T19:22:20.449693+0000","last_unstale":"2024-05-08T19:48:45.486801+0000","last_undegraded":"2024-05-08T19:48:45.486801+0000","last_fullsized":"2024-05-08T19:48:45.486801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2305","last_scrub_stamp":"2024-05-08T19:48:45.486775+0000","last_deep_scrub":"26'2305","last_deep_scrub_stamp":"2024-05-08T19:48:45.486775+0000","last_clean_scrub_stamp":"2024-05-08T19:48:45.486775+0000","objects_scrubbed":0,"log_size":2305,"log_dups_size":0,"ondisk_log_size":2305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:24.858024+0000","scrub_duration":0.0061246510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'8998","reported_seq":9170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.608015+0000","last_change":"2024-05-08T19:22:24.472926+0000","last_active":"2024-05-08T19:48:36.608015+0000","last_peered":"2024-05-08T19:48:36.608015+0000","last_clean":"2024-05-08T19:48:36.608015+0000","last_became_active":"2024-05-08T19:22:24.472518+0000","last_became_peered":"2024-05-08T19:22:24.472518+0000","last_unstale":"2024-05-08T19:48:36.608015+0000","last_undegraded":"2024-05-08T19:48:36.608015+0000","last_fullsized":"2024-05-08T19:48:36.608015+0000","mapping_epoch":22,"log_start":"26'1583","ondisk_log_start":"26'1583","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7415,"log_dups_size":0,"ondisk_log_size":7415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":5460,"num_write":6563,"num_write_kb":1024036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"26'7864","reported_seq":7906,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.424101+0000","last_change":"2024-05-08T19:48:54.424101+0000","last_active":"2024-05-08T19:48:54.424101+0000","last_peered":"2024-05-08T19:48:54.424101+0000","last_clean":"2024-05-08T19:48:54.424101+0000","last_became_active":"2024-05-08T19:22:20.007542+0000","last_became_peered":"2024-05-08T19:22:20.007542+0000","last_unstale":"2024-05-08T19:48:54.424101+0000","last_undegraded":"2024-05-08T19:48:54.424101+0000","last_fullsized":"2024-05-08T19:48:54.424101+0000","mapping_epoch":17,"log_start":"26'300","ondisk_log_start":"26'300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7864","last_scrub_stamp":"2024-05-08T19:48:54.423939+0000","last_deep_scrub":"26'7864","last_deep_scrub_stamp":"2024-05-08T19:48:54.423939+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.423939+0000","objects_scrubbed":0,"log_size":7564,"log_dups_size":0,"ondisk_log_size":7564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:12.713883+0000","scrub_duration":0.007576635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7858,"num_write_kb":54448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'2322","reported_seq":2362,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.283403+0000","last_change":"2024-05-08T19:48:51.283508+0000","last_active":"2024-05-08T19:48:51.283403+0000","last_peered":"2024-05-08T19:48:51.283403+0000","last_clean":"2024-05-08T19:48:51.283403+0000","last_became_active":"2024-05-08T19:22:20.443049+0000","last_became_peered":"2024-05-08T19:22:20.443049+0000","last_unstale":"2024-05-08T19:48:51.283403+0000","last_undegraded":"2024-05-08T19:48:51.283403+0000","last_fullsized":"2024-05-08T19:48:51.283403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2322","last_scrub_stamp":"2024-05-08T19:48:51.283371+0000","last_deep_scrub":"26'2322","last_deep_scrub_stamp":"2024-05-08T19:48:51.283371+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.283371+0000","objects_scrubbed":0,"log_size":2322,"log_dups_size":0,"ondisk_log_size":2322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:41.266333+0000","scrub_duration":0.0034339180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"26'8111","reported_seq":9106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:05.878734+0000","last_change":"2024-05-08T19:49:05.878734+0000","last_active":"2024-05-08T19:49:05.878734+0000","last_peered":"2024-05-08T19:49:05.878734+0000","last_clean":"2024-05-08T19:49:05.878734+0000","last_became_active":"2024-05-08T19:23:11.532148+0000","last_became_peered":"2024-05-08T19:23:11.532148+0000","last_unstale":"2024-05-08T19:49:05.878734+0000","last_undegraded":"2024-05-08T19:49:05.878734+0000","last_fullsized":"2024-05-08T19:49:05.878734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8111","last_scrub_stamp":"2024-05-08T19:49:05.878535+0000","last_deep_scrub":"26'8111","last_deep_scrub_stamp":"2024-05-08T19:49:05.878535+0000","last_clean_scrub_stamp":"2024-05-08T19:49:05.878535+0000","objects_scrubbed":0,"log_size":8111,"log_dups_size":0,"ondisk_log_size":8111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:51.268356+0000","scrub_duration":0.036970507,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":959,"num_read_kb":67642,"num_write":5666,"num_write_kb":895823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'2313","reported_seq":2354,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:13.665463+0000","last_change":"2024-05-08T19:49:13.665588+0000","last_active":"2024-05-08T19:49:13.665463+0000","last_peered":"2024-05-08T19:49:13.665463+0000","last_clean":"2024-05-08T19:49:13.665463+0000","last_became_active":"2024-05-08T19:22:20.449709+0000","last_became_peered":"2024-05-08T19:22:20.449709+0000","last_unstale":"2024-05-08T19:49:13.665463+0000","last_undegraded":"2024-05-08T19:49:13.665463+0000","last_fullsized":"2024-05-08T19:49:13.665463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2313","last_scrub_stamp":"2024-05-08T19:49:13.665434+0000","last_deep_scrub":"26'2313","last_deep_scrub_stamp":"2024-05-08T19:49:13.665434+0000","last_clean_scrub_stamp":"2024-05-08T19:49:13.665434+0000","objects_scrubbed":0,"log_size":2313,"log_dups_size":0,"ondisk_log_size":2313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:59.624034+0000","scrub_duration":0.001892431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'7717","reported_seq":8693,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.096346+0000","last_change":"2024-05-08T19:48:40.096442+0000","last_active":"2024-05-08T19:48:40.096346+0000","last_peered":"2024-05-08T19:48:40.096346+0000","last_clean":"2024-05-08T19:48:40.096346+0000","last_became_active":"2024-05-08T19:22:20.004404+0000","last_became_peered":"2024-05-08T19:22:20.004404+0000","last_unstale":"2024-05-08T19:48:40.096346+0000","last_undegraded":"2024-05-08T19:48:40.096346+0000","last_fullsized":"2024-05-08T19:48:40.096346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7717","last_scrub_stamp":"2024-05-08T19:48:40.096323+0000","last_deep_scrub":"26'7717","last_deep_scrub_stamp":"2024-05-08T19:48:40.096323+0000","last_clean_scrub_stamp":"2024-05-08T19:48:40.096323+0000","objects_scrubbed":2,"log_size":7717,"log_dups_size":0,"ondisk_log_size":7717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:30.861928+0000","scrub_duration":0.037188867,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":935,"num_read_kb":4706,"num_write":7717,"num_write_kb":54235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"26'8484","reported_seq":9041,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.672650+0000","last_change":"2024-05-08T19:22:24.617952+0000","last_active":"2024-05-08T19:48:36.672650+0000","last_peered":"2024-05-08T19:48:36.672650+0000","last_clean":"2024-05-08T19:48:36.672650+0000","last_became_active":"2024-05-08T19:22:24.617627+0000","last_became_peered":"2024-05-08T19:22:24.617627+0000","last_unstale":"2024-05-08T19:48:36.672650+0000","last_undegraded":"2024-05-08T19:48:36.672650+0000","last_fullsized":"2024-05-08T19:48:36.672650+0000","mapping_epoch":22,"log_start":"26'574","ondisk_log_start":"26'574","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7910,"log_dups_size":0,"ondisk_log_size":7910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":27006,"num_write":6146,"num_write_kb":958865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"26'2364","reported_seq":2393,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.615215+0000","last_change":"2024-05-08T19:22:20.447152+0000","last_active":"2024-05-08T19:48:36.615215+0000","last_peered":"2024-05-08T19:48:36.615215+0000","last_clean":"2024-05-08T19:48:36.615215+0000","last_became_active":"2024-05-08T19:22:20.446864+0000","last_became_peered":"2024-05-08T19:22:20.446864+0000","last_unstale":"2024-05-08T19:48:36.615215+0000","last_undegraded":"2024-05-08T19:48:36.615215+0000","last_fullsized":"2024-05-08T19:48:36.615215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2364,"log_dups_size":0,"ondisk_log_size":2364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'5126","reported_seq":5167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:52.379611+0000","last_change":"2024-05-08T19:48:52.379727+0000","last_active":"2024-05-08T19:48:52.379611+0000","last_peered":"2024-05-08T19:48:52.379611+0000","last_clean":"2024-05-08T19:48:52.379611+0000","last_became_active":"2024-05-08T19:22:20.003441+0000","last_became_peered":"2024-05-08T19:22:20.003441+0000","last_unstale":"2024-05-08T19:48:52.379611+0000","last_undegraded":"2024-05-08T19:48:52.379611+0000","last_fullsized":"2024-05-08T19:48:52.379611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5126","last_scrub_stamp":"2024-05-08T19:48:52.379584+0000","last_deep_scrub":"26'5126","last_deep_scrub_stamp":"2024-05-08T19:48:52.379584+0000","last_clean_scrub_stamp":"2024-05-08T19:48:52.379584+0000","objects_scrubbed":0,"log_size":5126,"log_dups_size":0,"ondisk_log_size":5126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:42.362547+0000","scrub_duration":0.0049865459999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5120,"num_write_kb":36122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.898947+0000","last_change":"2024-05-08T19:48:49.899073+0000","last_active":"2024-05-08T19:48:49.898947+0000","last_peered":"2024-05-08T19:48:49.898947+0000","last_clean":"2024-05-08T19:48:49.898947+0000","last_became_active":"2024-05-08T19:22:17.116272+0000","last_became_peered":"2024-05-08T19:22:17.116272+0000","last_unstale":"2024-05-08T19:48:49.898947+0000","last_undegraded":"2024-05-08T19:48:49.898947+0000","last_fullsized":"2024-05-08T19:48:49.898947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-05-08T19:48:49.898920+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-05-08T19:48:49.898920+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.898920+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:35.156807+0000","scrub_duration":0.007153057,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'8661","reported_seq":8768,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.661662+0000","last_change":"2024-05-08T19:22:24.617594+0000","last_active":"2024-05-08T19:48:36.661662+0000","last_peered":"2024-05-08T19:48:36.661662+0000","last_clean":"2024-05-08T19:48:36.661662+0000","last_became_active":"2024-05-08T19:22:24.616486+0000","last_became_peered":"2024-05-08T19:22:24.616486+0000","last_unstale":"2024-05-08T19:48:36.661662+0000","last_undegraded":"2024-05-08T19:48:36.661662+0000","last_fullsized":"2024-05-08T19:48:36.661662+0000","mapping_epoch":22,"log_start":"26'1423","ondisk_log_start":"26'1423","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7238,"log_dups_size":0,"ondisk_log_size":7238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":5028,"num_write":6258,"num_write_kb":895883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"26'2257","reported_seq":2298,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:48.540554+0000","last_change":"2024-05-08T19:48:48.540554+0000","last_active":"2024-05-08T19:48:48.540554+0000","last_peered":"2024-05-08T19:48:48.540554+0000","last_clean":"2024-05-08T19:48:48.540554+0000","last_became_active":"2024-05-08T19:22:20.445191+0000","last_became_peered":"2024-05-08T19:22:20.445191+0000","last_unstale":"2024-05-08T19:48:48.540554+0000","last_undegraded":"2024-05-08T19:48:48.540554+0000","last_fullsized":"2024-05-08T19:48:48.540554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2257","last_scrub_stamp":"2024-05-08T19:48:48.540400+0000","last_deep_scrub":"26'2257","last_deep_scrub_stamp":"2024-05-08T19:48:48.540400+0000","last_clean_scrub_stamp":"2024-05-08T19:48:48.540400+0000","objects_scrubbed":0,"log_size":2257,"log_dups_size":0,"ondisk_log_size":2257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:38.523363+0000","scrub_duration":0.0020860969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'8076","reported_seq":8118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:50.921979+0000","last_change":"2024-05-08T19:48:50.922101+0000","last_active":"2024-05-08T19:48:50.921979+0000","last_peered":"2024-05-08T19:48:50.921979+0000","last_clean":"2024-05-08T19:48:50.921979+0000","last_became_active":"2024-05-08T19:22:20.015062+0000","last_became_peered":"2024-05-08T19:22:20.015062+0000","last_unstale":"2024-05-08T19:48:50.921979+0000","last_undegraded":"2024-05-08T19:48:50.921979+0000","last_fullsized":"2024-05-08T19:48:50.921979+0000","mapping_epoch":17,"log_start":"26'1200","ondisk_log_start":"26'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8076","last_scrub_stamp":"2024-05-08T19:48:50.921951+0000","last_deep_scrub":"26'8076","last_deep_scrub_stamp":"2024-05-08T19:48:50.921951+0000","last_clean_scrub_stamp":"2024-05-08T19:48:50.921951+0000","objects_scrubbed":1,"log_size":6876,"log_dups_size":0,"ondisk_log_size":6876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:09.690484+0000","scrub_duration":0.020418589000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8080,"num_write_kb":54571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'8514","reported_seq":9514,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.275901+0000","last_change":"2024-05-08T19:22:24.614066+0000","last_active":"2024-05-08T19:48:36.275901+0000","last_peered":"2024-05-08T19:48:36.275901+0000","last_clean":"2024-05-08T19:48:36.275901+0000","last_became_active":"2024-05-08T19:22:24.613661+0000","last_became_peered":"2024-05-08T19:22:24.613661+0000","last_unstale":"2024-05-08T19:48:36.275901+0000","last_undegraded":"2024-05-08T19:48:36.275901+0000","last_fullsized":"2024-05-08T19:48:36.275901+0000","mapping_epoch":22,"log_start":"26'1305","ondisk_log_start":"26'1305","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7209,"log_dups_size":0,"ondisk_log_size":7209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":973,"num_read_kb":68996,"num_write":6084,"num_write_kb":873899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"26'6281","reported_seq":6322,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.912235+0000","last_change":"2024-05-08T19:48:54.912365+0000","last_active":"2024-05-08T19:48:54.912235+0000","last_peered":"2024-05-08T19:48:54.912235+0000","last_clean":"2024-05-08T19:48:54.912235+0000","last_became_active":"2024-05-08T19:22:20.014926+0000","last_became_peered":"2024-05-08T19:22:20.014926+0000","last_unstale":"2024-05-08T19:48:54.912235+0000","last_undegraded":"2024-05-08T19:48:54.912235+0000","last_fullsized":"2024-05-08T19:48:54.912235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6281","last_scrub_stamp":"2024-05-08T19:48:54.912210+0000","last_deep_scrub":"26'6281","last_deep_scrub_stamp":"2024-05-08T19:48:54.912210+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.912210+0000","objects_scrubbed":2,"log_size":6281,"log_dups_size":0,"ondisk_log_size":6281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:44.895173+0000","scrub_duration":0.025468606000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7231304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6276,"num_write_kb":44046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"26'2390","reported_seq":2430,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:09.662565+0000","last_change":"2024-05-08T19:49:09.662714+0000","last_active":"2024-05-08T19:49:09.662565+0000","last_peered":"2024-05-08T19:49:09.662565+0000","last_clean":"2024-05-08T19:49:09.662565+0000","last_became_active":"2024-05-08T19:22:20.446194+0000","last_became_peered":"2024-05-08T19:22:20.446194+0000","last_unstale":"2024-05-08T19:49:09.662565+0000","last_undegraded":"2024-05-08T19:49:09.662565+0000","last_fullsized":"2024-05-08T19:49:09.662565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2390","last_scrub_stamp":"2024-05-08T19:49:09.662538+0000","last_deep_scrub":"26'2390","last_deep_scrub_stamp":"2024-05-08T19:49:09.662538+0000","last_clean_scrub_stamp":"2024-05-08T19:49:09.662538+0000","objects_scrubbed":0,"log_size":2390,"log_dups_size":0,"ondisk_log_size":2390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:59.338522+0000","scrub_duration":0.0077808970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'8362","reported_seq":8758,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:39.756356+0000","last_change":"2024-05-08T19:22:24.615481+0000","last_active":"2024-05-08T19:48:39.756356+0000","last_peered":"2024-05-08T19:48:39.756356+0000","last_clean":"2024-05-08T19:48:39.756356+0000","last_became_active":"2024-05-08T19:22:24.615069+0000","last_became_peered":"2024-05-08T19:22:24.615069+0000","last_unstale":"2024-05-08T19:48:39.756356+0000","last_undegraded":"2024-05-08T19:48:39.756356+0000","last_fullsized":"2024-05-08T19:48:39.756356+0000","mapping_epoch":22,"log_start":"26'1929","ondisk_log_start":"26'1929","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6433,"log_dups_size":0,"ondisk_log_size":6433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":368,"num_read_kb":23786,"num_write":5985,"num_write_kb":964471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'5786","reported_seq":6318,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.662419+0000","last_change":"2024-05-08T19:48:51.662511+0000","last_active":"2024-05-08T19:48:51.662419+0000","last_peered":"2024-05-08T19:48:51.662419+0000","last_clean":"2024-05-08T19:48:51.662419+0000","last_became_active":"2024-05-08T19:22:20.001339+0000","last_became_peered":"2024-05-08T19:22:20.001339+0000","last_unstale":"2024-05-08T19:48:51.662419+0000","last_undegraded":"2024-05-08T19:48:51.662419+0000","last_fullsized":"2024-05-08T19:48:51.662419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5786","last_scrub_stamp":"2024-05-08T19:48:51.662392+0000","last_deep_scrub":"26'5786","last_deep_scrub_stamp":"2024-05-08T19:48:51.662392+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.662392+0000","objects_scrubbed":4,"log_size":5786,"log_dups_size":0,"ondisk_log_size":5786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:55.948554+0000","scrub_duration":0.063602542999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11721836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":3579,"num_write":6369,"num_write_kb":46119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"26'2254","reported_seq":2277,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:38.698795+0000","last_change":"2024-05-08T19:23:11.387164+0000","last_active":"2024-05-08T19:48:38.698795+0000","last_peered":"2024-05-08T19:48:38.698795+0000","last_clean":"2024-05-08T19:48:38.698795+0000","last_became_active":"2024-05-08T19:23:11.386882+0000","last_became_peered":"2024-05-08T19:23:11.386882+0000","last_unstale":"2024-05-08T19:48:38.698795+0000","last_undegraded":"2024-05-08T19:48:38.698795+0000","last_fullsized":"2024-05-08T19:48:38.698795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2254,"log_dups_size":0,"ondisk_log_size":2254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"26'8456","reported_seq":8898,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:21.124828+0000","last_change":"2024-05-08T19:49:21.124989+0000","last_active":"2024-05-08T19:49:21.124828+0000","last_peered":"2024-05-08T19:49:21.124828+0000","last_clean":"2024-05-08T19:49:21.124828+0000","last_became_active":"2024-05-08T19:22:24.614433+0000","last_became_peered":"2024-05-08T19:22:24.614433+0000","last_unstale":"2024-05-08T19:49:21.124828+0000","last_undegraded":"2024-05-08T19:49:21.124828+0000","last_fullsized":"2024-05-08T19:49:21.124828+0000","mapping_epoch":22,"log_start":"26'1215","ondisk_log_start":"26'1215","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8456","last_scrub_stamp":"2024-05-08T19:49:21.124800+0000","last_deep_scrub":"26'8456","last_deep_scrub_stamp":"2024-05-08T19:49:21.124800+0000","last_clean_scrub_stamp":"2024-05-08T19:49:21.124800+0000","objects_scrubbed":0,"log_size":7241,"log_dups_size":0,"ondisk_log_size":7241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:16.941004+0000","scrub_duration":0.031867547000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":403,"num_read_kb":32316,"num_write":6068,"num_write_kb":878068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'4080","reported_seq":4121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:52.662263+0000","last_change":"2024-05-08T19:48:52.662361+0000","last_active":"2024-05-08T19:48:52.662263+0000","last_peered":"2024-05-08T19:48:52.662263+0000","last_clean":"2024-05-08T19:48:52.662263+0000","last_became_active":"2024-05-08T19:22:20.012383+0000","last_became_peered":"2024-05-08T19:22:20.012383+0000","last_unstale":"2024-05-08T19:48:52.662263+0000","last_undegraded":"2024-05-08T19:48:52.662263+0000","last_fullsized":"2024-05-08T19:48:52.662263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4080","last_scrub_stamp":"2024-05-08T19:48:52.662236+0000","last_deep_scrub":"26'4080","last_deep_scrub_stamp":"2024-05-08T19:48:52.662236+0000","last_clean_scrub_stamp":"2024-05-08T19:48:52.662236+0000","objects_scrubbed":2,"log_size":4080,"log_dups_size":0,"ondisk_log_size":4080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:36.022871+0000","scrub_duration":0.026319581000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":4095,"num_write_kb":27507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":128316,"num_omap_keys":195,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'2300","reported_seq":2340,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:12.765796+0000","last_change":"2024-05-08T19:49:12.765909+0000","last_active":"2024-05-08T19:49:12.765796+0000","last_peered":"2024-05-08T19:49:12.765796+0000","last_clean":"2024-05-08T19:49:12.765796+0000","last_became_active":"2024-05-08T19:22:20.435680+0000","last_became_peered":"2024-05-08T19:22:20.435680+0000","last_unstale":"2024-05-08T19:49:12.765796+0000","last_undegraded":"2024-05-08T19:49:12.765796+0000","last_fullsized":"2024-05-08T19:49:12.765796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2300","last_scrub_stamp":"2024-05-08T19:49:12.765767+0000","last_deep_scrub":"26'2300","last_deep_scrub_stamp":"2024-05-08T19:49:12.765767+0000","last_clean_scrub_stamp":"2024-05-08T19:49:12.765767+0000","objects_scrubbed":0,"log_size":2300,"log_dups_size":0,"ondisk_log_size":2300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:10.453305+0000","scrub_duration":0.0051582390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"26'8822","reported_seq":9072,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:05.190182+0000","last_change":"2024-05-08T19:49:05.190347+0000","last_active":"2024-05-08T19:49:05.190182+0000","last_peered":"2024-05-08T19:49:05.190182+0000","last_clean":"2024-05-08T19:49:05.190182+0000","last_became_active":"2024-05-08T19:22:24.472782+0000","last_became_peered":"2024-05-08T19:22:24.472782+0000","last_unstale":"2024-05-08T19:49:05.190182+0000","last_undegraded":"2024-05-08T19:49:05.190182+0000","last_fullsized":"2024-05-08T19:49:05.190182+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8822","last_scrub_stamp":"2024-05-08T19:49:05.190154+0000","last_deep_scrub":"26'8822","last_deep_scrub_stamp":"2024-05-08T19:49:05.190154+0000","last_clean_scrub_stamp":"2024-05-08T19:49:05.190154+0000","objects_scrubbed":0,"log_size":7184,"log_dups_size":0,"ondisk_log_size":7184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:04.699875+0000","scrub_duration":0.032424166999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":12280,"num_write":6457,"num_write_kb":1036607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2847","reported_seq":2888,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:59.885624+0000","last_change":"2024-05-08T19:48:59.885784+0000","last_active":"2024-05-08T19:48:59.885624+0000","last_peered":"2024-05-08T19:48:59.885624+0000","last_clean":"2024-05-08T19:48:59.885624+0000","last_became_active":"2024-05-08T19:22:20.013739+0000","last_became_peered":"2024-05-08T19:22:20.013739+0000","last_unstale":"2024-05-08T19:48:59.885624+0000","last_undegraded":"2024-05-08T19:48:59.885624+0000","last_fullsized":"2024-05-08T19:48:59.885624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2847","last_scrub_stamp":"2024-05-08T19:48:59.885599+0000","last_deep_scrub":"26'2847","last_deep_scrub_stamp":"2024-05-08T19:48:59.885599+0000","last_clean_scrub_stamp":"2024-05-08T19:48:59.885599+0000","objects_scrubbed":2,"log_size":2847,"log_dups_size":0,"ondisk_log_size":2847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:00.984961+0000","scrub_duration":0.031388478999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2848,"num_write_kb":22358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"26'2333","reported_seq":2373,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:45.305790+0000","last_change":"2024-05-08T19:48:45.305902+0000","last_active":"2024-05-08T19:48:45.305790+0000","last_peered":"2024-05-08T19:48:45.305790+0000","last_clean":"2024-05-08T19:48:45.305790+0000","last_became_active":"2024-05-08T19:22:20.447180+0000","last_became_peered":"2024-05-08T19:22:20.447180+0000","last_unstale":"2024-05-08T19:48:45.305790+0000","last_undegraded":"2024-05-08T19:48:45.305790+0000","last_fullsized":"2024-05-08T19:48:45.305790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2333","last_scrub_stamp":"2024-05-08T19:48:45.305763+0000","last_deep_scrub":"26'2333","last_deep_scrub_stamp":"2024-05-08T19:48:45.305763+0000","last_clean_scrub_stamp":"2024-05-08T19:48:45.305763+0000","objects_scrubbed":0,"log_size":2333,"log_dups_size":0,"ondisk_log_size":2333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:28.666398+0000","scrub_duration":0.002168775,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"26'8924","reported_seq":9906,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:16.684753+0000","last_change":"2024-05-08T19:49:16.684917+0000","last_active":"2024-05-08T19:49:16.684753+0000","last_peered":"2024-05-08T19:49:16.684753+0000","last_clean":"2024-05-08T19:49:16.684753+0000","last_became_active":"2024-05-08T19:22:24.613677+0000","last_became_peered":"2024-05-08T19:22:24.613677+0000","last_unstale":"2024-05-08T19:49:16.684753+0000","last_undegraded":"2024-05-08T19:49:16.684753+0000","last_fullsized":"2024-05-08T19:49:16.684753+0000","mapping_epoch":22,"log_start":"26'1529","ondisk_log_start":"26'1529","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8924","last_scrub_stamp":"2024-05-08T19:49:16.684725+0000","last_deep_scrub":"26'8924","last_deep_scrub_stamp":"2024-05-08T19:49:16.684725+0000","last_clean_scrub_stamp":"2024-05-08T19:49:16.684725+0000","objects_scrubbed":0,"log_size":7395,"log_dups_size":0,"ondisk_log_size":7395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:14.372263+0000","scrub_duration":0.023951353000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":945,"num_read_kb":70780,"num_write":6622,"num_write_kb":1028558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"26'4275","reported_seq":4316,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.616175+0000","last_change":"2024-05-08T19:48:41.616298+0000","last_active":"2024-05-08T19:48:41.616175+0000","last_peered":"2024-05-08T19:48:41.616175+0000","last_clean":"2024-05-08T19:48:41.616175+0000","last_became_active":"2024-05-08T19:22:20.011262+0000","last_became_peered":"2024-05-08T19:22:20.011262+0000","last_unstale":"2024-05-08T19:48:41.616175+0000","last_undegraded":"2024-05-08T19:48:41.616175+0000","last_fullsized":"2024-05-08T19:48:41.616175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4275","last_scrub_stamp":"2024-05-08T19:48:41.616128+0000","last_deep_scrub":"26'4275","last_deep_scrub_stamp":"2024-05-08T19:48:41.616128+0000","last_clean_scrub_stamp":"2024-05-08T19:48:41.616128+0000","objects_scrubbed":2,"log_size":4275,"log_dups_size":0,"ondisk_log_size":4275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:26.145161+0000","scrub_duration":0.036942485999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4270,"num_write_kb":27446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"26'2429","reported_seq":2458,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.672769+0000","last_change":"2024-05-08T19:22:20.438689+0000","last_active":"2024-05-08T19:48:36.672769+0000","last_peered":"2024-05-08T19:48:36.672769+0000","last_clean":"2024-05-08T19:48:36.672769+0000","last_became_active":"2024-05-08T19:22:20.438434+0000","last_became_peered":"2024-05-08T19:22:20.438434+0000","last_unstale":"2024-05-08T19:48:36.672769+0000","last_undegraded":"2024-05-08T19:48:36.672769+0000","last_fullsized":"2024-05-08T19:48:36.672769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2429,"log_dups_size":0,"ondisk_log_size":2429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"26'8249","reported_seq":8526,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:12.166904+0000","last_change":"2024-05-08T19:49:12.166904+0000","last_active":"2024-05-08T19:49:12.166904+0000","last_peered":"2024-05-08T19:49:12.166904+0000","last_clean":"2024-05-08T19:49:12.166904+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:49:12.166904+0000","last_undegraded":"2024-05-08T19:49:12.166904+0000","last_fullsized":"2024-05-08T19:49:12.166904+0000","mapping_epoch":22,"log_start":"26'1106","ondisk_log_start":"26'1106","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8249","last_scrub_stamp":"2024-05-08T19:49:12.166734+0000","last_deep_scrub":"26'8249","last_deep_scrub_stamp":"2024-05-08T19:49:12.166734+0000","last_clean_scrub_stamp":"2024-05-08T19:49:12.166734+0000","objects_scrubbed":0,"log_size":7143,"log_dups_size":0,"ondisk_log_size":7143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:09.854272+0000","scrub_duration":0.028315160999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":13756,"num_write":5781,"num_write_kb":975965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"26'7372","reported_seq":7413,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.622314+0000","last_change":"2024-05-08T19:48:49.622415+0000","last_active":"2024-05-08T19:48:49.622314+0000","last_peered":"2024-05-08T19:48:49.622314+0000","last_clean":"2024-05-08T19:48:49.622314+0000","last_became_active":"2024-05-08T19:22:20.006772+0000","last_became_peered":"2024-05-08T19:22:20.006772+0000","last_unstale":"2024-05-08T19:48:49.622314+0000","last_undegraded":"2024-05-08T19:48:49.622314+0000","last_fullsized":"2024-05-08T19:48:49.622314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7372","last_scrub_stamp":"2024-05-08T19:48:49.622290+0000","last_deep_scrub":"26'7372","last_deep_scrub_stamp":"2024-05-08T19:48:49.622290+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.622290+0000","objects_scrubbed":3,"log_size":7372,"log_dups_size":0,"ondisk_log_size":7372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:32.982924+0000","scrub_duration":0.047389768999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7364,"num_write_kb":54049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"26'2338","reported_seq":2367,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:39.756228+0000","last_change":"2024-05-08T19:22:20.436696+0000","last_active":"2024-05-08T19:48:39.756228+0000","last_peered":"2024-05-08T19:48:39.756228+0000","last_clean":"2024-05-08T19:48:39.756228+0000","last_became_active":"2024-05-08T19:22:20.436373+0000","last_became_peered":"2024-05-08T19:22:20.436373+0000","last_unstale":"2024-05-08T19:48:39.756228+0000","last_undegraded":"2024-05-08T19:48:39.756228+0000","last_fullsized":"2024-05-08T19:48:39.756228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2338,"log_dups_size":0,"ondisk_log_size":2338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"26'8815","reported_seq":9455,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:09.138466+0000","last_change":"2024-05-08T19:49:09.138646+0000","last_active":"2024-05-08T19:49:09.138466+0000","last_peered":"2024-05-08T19:49:09.138466+0000","last_clean":"2024-05-08T19:49:09.138466+0000","last_became_active":"2024-05-08T19:22:24.477941+0000","last_became_peered":"2024-05-08T19:22:24.477941+0000","last_unstale":"2024-05-08T19:49:09.138466+0000","last_undegraded":"2024-05-08T19:49:09.138466+0000","last_fullsized":"2024-05-08T19:49:09.138466+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8815","last_scrub_stamp":"2024-05-08T19:49:09.138437+0000","last_deep_scrub":"26'8815","last_deep_scrub_stamp":"2024-05-08T19:49:09.138437+0000","last_clean_scrub_stamp":"2024-05-08T19:49:09.138437+0000","objects_scrubbed":0,"log_size":7177,"log_dups_size":0,"ondisk_log_size":7177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:55.097037+0000","scrub_duration":0.028237385,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":603,"num_read_kb":28586,"num_write":6338,"num_write_kb":901267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"26'6180","reported_seq":6221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:56.885764+0000","last_change":"2024-05-08T19:48:56.885764+0000","last_active":"2024-05-08T19:48:56.885764+0000","last_peered":"2024-05-08T19:48:56.885764+0000","last_clean":"2024-05-08T19:48:56.885764+0000","last_became_active":"2024-05-08T19:22:20.013748+0000","last_became_peered":"2024-05-08T19:22:20.013748+0000","last_unstale":"2024-05-08T19:48:56.885764+0000","last_undegraded":"2024-05-08T19:48:56.885764+0000","last_fullsized":"2024-05-08T19:48:56.885764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6180","last_scrub_stamp":"2024-05-08T19:48:56.885629+0000","last_deep_scrub":"26'6180","last_deep_scrub_stamp":"2024-05-08T19:48:56.885629+0000","last_clean_scrub_stamp":"2024-05-08T19:48:56.885629+0000","objects_scrubbed":1,"log_size":6180,"log_dups_size":0,"ondisk_log_size":6180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:15.175572+0000","scrub_duration":0.012091622,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6199,"num_write_kb":41171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":340,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"26'2344","reported_seq":2373,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.314963+0000","last_change":"2024-05-08T19:22:20.457103+0000","last_active":"2024-05-08T19:48:41.314963+0000","last_peered":"2024-05-08T19:48:41.314963+0000","last_clean":"2024-05-08T19:48:41.314963+0000","last_became_active":"2024-05-08T19:22:20.456850+0000","last_became_peered":"2024-05-08T19:22:20.456850+0000","last_unstale":"2024-05-08T19:48:41.314963+0000","last_undegraded":"2024-05-08T19:48:41.314963+0000","last_fullsized":"2024-05-08T19:48:41.314963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2344,"log_dups_size":0,"ondisk_log_size":2344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"26'8417","reported_seq":8861,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.314939+0000","last_change":"2024-05-08T19:22:24.614410+0000","last_active":"2024-05-08T19:48:41.314939+0000","last_peered":"2024-05-08T19:48:41.314939+0000","last_clean":"2024-05-08T19:48:41.314939+0000","last_became_active":"2024-05-08T19:22:24.613904+0000","last_became_peered":"2024-05-08T19:22:24.613904+0000","last_unstale":"2024-05-08T19:48:41.314939+0000","last_undegraded":"2024-05-08T19:48:41.314939+0000","last_fullsized":"2024-05-08T19:48:41.314939+0000","mapping_epoch":22,"log_start":"26'512","ondisk_log_start":"26'512","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7905,"log_dups_size":0,"ondisk_log_size":7905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":29592,"num_write":6013,"num_write_kb":842872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"26'8395","reported_seq":8436,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:47.025794+0000","last_change":"2024-05-08T19:48:47.025794+0000","last_active":"2024-05-08T19:48:47.025794+0000","last_peered":"2024-05-08T19:48:47.025794+0000","last_clean":"2024-05-08T19:48:47.025794+0000","last_became_active":"2024-05-08T19:22:20.000454+0000","last_became_peered":"2024-05-08T19:22:20.000454+0000","last_unstale":"2024-05-08T19:48:47.025794+0000","last_undegraded":"2024-05-08T19:48:47.025794+0000","last_fullsized":"2024-05-08T19:48:47.025794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8395","last_scrub_stamp":"2024-05-08T19:48:47.025662+0000","last_deep_scrub":"26'8395","last_deep_scrub_stamp":"2024-05-08T19:48:47.025662+0000","last_clean_scrub_stamp":"2024-05-08T19:48:47.025662+0000","objects_scrubbed":3,"log_size":8395,"log_dups_size":0,"ondisk_log_size":8395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:26.396911+0000","scrub_duration":0.054102984999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8388,"num_write_kb":54739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'2302","reported_seq":2341,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:09.930514+0000","last_change":"2024-05-08T19:49:09.930622+0000","last_active":"2024-05-08T19:49:09.930514+0000","last_peered":"2024-05-08T19:49:09.930514+0000","last_clean":"2024-05-08T19:49:09.930514+0000","last_became_active":"2024-05-08T19:22:20.456225+0000","last_became_peered":"2024-05-08T19:22:20.456225+0000","last_unstale":"2024-05-08T19:49:09.930514+0000","last_undegraded":"2024-05-08T19:49:09.930514+0000","last_fullsized":"2024-05-08T19:49:09.930514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2302","last_scrub_stamp":"2024-05-08T19:49:09.930485+0000","last_deep_scrub":"26'2302","last_deep_scrub_stamp":"2024-05-08T19:49:09.930485+0000","last_clean_scrub_stamp":"2024-05-08T19:49:09.930485+0000","objects_scrubbed":0,"log_size":2302,"log_dups_size":0,"ondisk_log_size":2302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:09.440206+0000","scrub_duration":0.0039543269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"26'8603","reported_seq":9424,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:38.170814+0000","last_change":"2024-05-08T19:22:24.473117+0000","last_active":"2024-05-08T19:48:38.170814+0000","last_peered":"2024-05-08T19:48:38.170814+0000","last_clean":"2024-05-08T19:48:38.170814+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:48:38.170814+0000","last_undegraded":"2024-05-08T19:48:38.170814+0000","last_fullsized":"2024-05-08T19:48:38.170814+0000","mapping_epoch":22,"log_start":"26'1458","ondisk_log_start":"26'1458","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":794,"num_read_kb":57832,"num_write":6099,"num_write_kb":1028205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'7807","reported_seq":7847,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:55.618149+0000","last_change":"2024-05-08T19:48:55.618256+0000","last_active":"2024-05-08T19:48:55.618149+0000","last_peered":"2024-05-08T19:48:55.618149+0000","last_clean":"2024-05-08T19:48:55.618149+0000","last_became_active":"2024-05-08T19:22:20.005996+0000","last_became_peered":"2024-05-08T19:22:20.005996+0000","last_unstale":"2024-05-08T19:48:55.618149+0000","last_undegraded":"2024-05-08T19:48:55.618149+0000","last_fullsized":"2024-05-08T19:48:55.618149+0000","mapping_epoch":17,"log_start":"26'400","ondisk_log_start":"26'400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7807","last_scrub_stamp":"2024-05-08T19:48:55.618119+0000","last_deep_scrub":"26'7807","last_deep_scrub_stamp":"2024-05-08T19:48:55.618119+0000","last_clean_scrub_stamp":"2024-05-08T19:48:55.618119+0000","objects_scrubbed":3,"log_size":7407,"log_dups_size":0,"ondisk_log_size":7407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:45.601081+0000","scrub_duration":0.038095381999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7797,"num_write_kb":54350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"26'2304","reported_seq":2333,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.829186+0000","last_change":"2024-05-08T19:22:20.452861+0000","last_active":"2024-05-08T19:48:40.829186+0000","last_peered":"2024-05-08T19:48:40.829186+0000","last_clean":"2024-05-08T19:48:40.829186+0000","last_became_active":"2024-05-08T19:22:20.452600+0000","last_became_peered":"2024-05-08T19:22:20.452600+0000","last_unstale":"2024-05-08T19:48:40.829186+0000","last_undegraded":"2024-05-08T19:48:40.829186+0000","last_fullsized":"2024-05-08T19:48:40.829186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2304,"log_dups_size":0,"ondisk_log_size":2304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"26'8464","reported_seq":9181,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.672659+0000","last_change":"2024-05-08T19:22:24.614345+0000","last_active":"2024-05-08T19:48:36.672659+0000","last_peered":"2024-05-08T19:48:36.672659+0000","last_clean":"2024-05-08T19:48:36.672659+0000","last_became_active":"2024-05-08T19:22:24.613948+0000","last_became_peered":"2024-05-08T19:22:24.613948+0000","last_unstale":"2024-05-08T19:48:36.672659+0000","last_undegraded":"2024-05-08T19:48:36.672659+0000","last_fullsized":"2024-05-08T19:48:36.672659+0000","mapping_epoch":22,"log_start":"26'935","ondisk_log_start":"26'935","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7529,"log_dups_size":0,"ondisk_log_size":7529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":690,"num_read_kb":34094,"num_write":6014,"num_write_kb":938918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"26'9153","reported_seq":9194,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:42.086898+0000","last_change":"2024-05-08T19:48:42.086898+0000","last_active":"2024-05-08T19:48:42.086898+0000","last_peered":"2024-05-08T19:48:42.086898+0000","last_clean":"2024-05-08T19:48:42.086898+0000","last_became_active":"2024-05-08T19:22:20.004254+0000","last_became_peered":"2024-05-08T19:22:20.004254+0000","last_unstale":"2024-05-08T19:48:42.086898+0000","last_undegraded":"2024-05-08T19:48:42.086898+0000","last_fullsized":"2024-05-08T19:48:42.086898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9153","last_scrub_stamp":"2024-05-08T19:48:42.086788+0000","last_deep_scrub":"26'9153","last_deep_scrub_stamp":"2024-05-08T19:48:42.086788+0000","last_clean_scrub_stamp":"2024-05-08T19:48:42.086788+0000","objects_scrubbed":6,"log_size":9153,"log_dups_size":0,"ondisk_log_size":9153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:54.814215+0000","scrub_duration":0.069169347000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":9139,"num_write_kb":67371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73643,"num_omap_keys":112,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'2210","reported_seq":2238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.970400+0000","last_change":"2024-05-08T19:22:20.455712+0000","last_active":"2024-05-08T19:48:35.970400+0000","last_peered":"2024-05-08T19:48:35.970400+0000","last_clean":"2024-05-08T19:48:35.970400+0000","last_became_active":"2024-05-08T19:22:20.455493+0000","last_became_peered":"2024-05-08T19:22:20.455493+0000","last_unstale":"2024-05-08T19:48:35.970400+0000","last_undegraded":"2024-05-08T19:48:35.970400+0000","last_fullsized":"2024-05-08T19:48:35.970400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2210,"log_dups_size":0,"ondisk_log_size":2210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"26'2266","reported_seq":2306,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:11.590104+0000","last_change":"2024-05-08T19:49:11.590212+0000","last_active":"2024-05-08T19:49:11.590104+0000","last_peered":"2024-05-08T19:49:11.590104+0000","last_clean":"2024-05-08T19:49:11.590104+0000","last_became_active":"2024-05-08T19:22:20.452169+0000","last_became_peered":"2024-05-08T19:22:20.452169+0000","last_unstale":"2024-05-08T19:49:11.590104+0000","last_undegraded":"2024-05-08T19:49:11.590104+0000","last_fullsized":"2024-05-08T19:49:11.590104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2266","last_scrub_stamp":"2024-05-08T19:49:11.590076+0000","last_deep_scrub":"26'2266","last_deep_scrub_stamp":"2024-05-08T19:49:11.590076+0000","last_clean_scrub_stamp":"2024-05-08T19:49:11.590076+0000","objects_scrubbed":0,"log_size":2266,"log_dups_size":0,"ondisk_log_size":2266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:56.979897+0000","scrub_duration":0.002202594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'2366","reported_seq":2406,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.894394+0000","last_change":"2024-05-08T19:48:49.894493+0000","last_active":"2024-05-08T19:48:49.894394+0000","last_peered":"2024-05-08T19:48:49.894394+0000","last_clean":"2024-05-08T19:48:49.894394+0000","last_became_active":"2024-05-08T19:22:20.449047+0000","last_became_peered":"2024-05-08T19:22:20.449047+0000","last_unstale":"2024-05-08T19:48:49.894394+0000","last_undegraded":"2024-05-08T19:48:49.894394+0000","last_fullsized":"2024-05-08T19:48:49.894394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2366","last_scrub_stamp":"2024-05-08T19:48:49.894367+0000","last_deep_scrub":"26'2366","last_deep_scrub_stamp":"2024-05-08T19:48:49.894367+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.894367+0000","objects_scrubbed":0,"log_size":2366,"log_dups_size":0,"ondisk_log_size":2366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:54.180529+0000","scrub_duration":0.004363408,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'2258","reported_seq":2298,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:13.119957+0000","last_change":"2024-05-08T19:49:13.120111+0000","last_active":"2024-05-08T19:49:13.119957+0000","last_peered":"2024-05-08T19:49:13.119957+0000","last_clean":"2024-05-08T19:49:13.119957+0000","last_became_active":"2024-05-08T19:22:20.451625+0000","last_became_peered":"2024-05-08T19:22:20.451625+0000","last_unstale":"2024-05-08T19:49:13.119957+0000","last_undegraded":"2024-05-08T19:49:13.119957+0000","last_fullsized":"2024-05-08T19:49:13.119957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2258","last_scrub_stamp":"2024-05-08T19:49:13.119914+0000","last_deep_scrub":"26'2258","last_deep_scrub_stamp":"2024-05-08T19:49:13.119914+0000","last_clean_scrub_stamp":"2024-05-08T19:49:13.119914+0000","objects_scrubbed":0,"log_size":2258,"log_dups_size":0,"ondisk_log_size":2258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:10.807452+0000","scrub_duration":0.0021343680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'2371","reported_seq":2408,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:35.942438+0000","last_change":"2024-05-08T19:23:11.054094+0000","last_active":"2024-05-08T19:48:35.942438+0000","last_peered":"2024-05-08T19:48:35.942438+0000","last_clean":"2024-05-08T19:48:35.942438+0000","last_became_active":"2024-05-08T19:23:11.053750+0000","last_became_peered":"2024-05-08T19:23:11.053750+0000","last_unstale":"2024-05-08T19:48:35.942438+0000","last_undegraded":"2024-05-08T19:48:35.942438+0000","last_fullsized":"2024-05-08T19:48:35.942438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2371,"log_dups_size":0,"ondisk_log_size":2371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'2321","reported_seq":2361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:09.585769+0000","last_change":"2024-05-08T19:49:09.585861+0000","last_active":"2024-05-08T19:49:09.585769+0000","last_peered":"2024-05-08T19:49:09.585769+0000","last_clean":"2024-05-08T19:49:09.585769+0000","last_became_active":"2024-05-08T19:22:20.444219+0000","last_became_peered":"2024-05-08T19:22:20.444219+0000","last_unstale":"2024-05-08T19:49:09.585769+0000","last_undegraded":"2024-05-08T19:49:09.585769+0000","last_fullsized":"2024-05-08T19:49:09.585769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2321","last_scrub_stamp":"2024-05-08T19:49:09.585741+0000","last_deep_scrub":"26'2321","last_deep_scrub_stamp":"2024-05-08T19:49:09.585741+0000","last_clean_scrub_stamp":"2024-05-08T19:49:09.585741+0000","objects_scrubbed":0,"log_size":2321,"log_dups_size":0,"ondisk_log_size":2321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:58.653100+0000","scrub_duration":0.00225486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'2227","reported_seq":2267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:12.673349+0000","last_change":"2024-05-08T19:49:12.673466+0000","last_active":"2024-05-08T19:49:12.673349+0000","last_peered":"2024-05-08T19:49:12.673349+0000","last_clean":"2024-05-08T19:49:12.673349+0000","last_became_active":"2024-05-08T19:22:20.436626+0000","last_became_peered":"2024-05-08T19:22:20.436626+0000","last_unstale":"2024-05-08T19:49:12.673349+0000","last_undegraded":"2024-05-08T19:49:12.673349+0000","last_fullsized":"2024-05-08T19:49:12.673349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2227","last_scrub_stamp":"2024-05-08T19:49:12.673320+0000","last_deep_scrub":"26'2227","last_deep_scrub_stamp":"2024-05-08T19:49:12.673320+0000","last_clean_scrub_stamp":"2024-05-08T19:49:12.673320+0000","objects_scrubbed":0,"log_size":2227,"log_dups_size":0,"ondisk_log_size":2227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:40.341977+0000","scrub_duration":0.014616664999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'2353","reported_seq":2382,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.616322+0000","last_change":"2024-05-08T19:22:20.462445+0000","last_active":"2024-05-08T19:48:36.616322+0000","last_peered":"2024-05-08T19:48:36.616322+0000","last_clean":"2024-05-08T19:48:36.616322+0000","last_became_active":"2024-05-08T19:22:20.461547+0000","last_became_peered":"2024-05-08T19:22:20.461547+0000","last_unstale":"2024-05-08T19:48:36.616322+0000","last_undegraded":"2024-05-08T19:48:36.616322+0000","last_fullsized":"2024-05-08T19:48:36.616322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2353,"log_dups_size":0,"ondisk_log_size":2353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'2321","reported_seq":2361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:39.900372+0000","last_change":"2024-05-08T19:48:39.900526+0000","last_active":"2024-05-08T19:48:39.900372+0000","last_peered":"2024-05-08T19:48:39.900372+0000","last_clean":"2024-05-08T19:48:39.900372+0000","last_became_active":"2024-05-08T19:22:20.442667+0000","last_became_peered":"2024-05-08T19:22:20.442667+0000","last_unstale":"2024-05-08T19:48:39.900372+0000","last_undegraded":"2024-05-08T19:48:39.900372+0000","last_fullsized":"2024-05-08T19:48:39.900372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2321","last_scrub_stamp":"2024-05-08T19:48:39.900327+0000","last_deep_scrub":"26'2321","last_deep_scrub_stamp":"2024-05-08T19:48:39.900327+0000","last_clean_scrub_stamp":"2024-05-08T19:48:39.900327+0000","objects_scrubbed":0,"log_size":2321,"log_dups_size":0,"ondisk_log_size":2321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:58.190270+0000","scrub_duration":0.094527218999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'2280","reported_seq":2320,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:06.295790+0000","last_change":"2024-05-08T19:49:06.295922+0000","last_active":"2024-05-08T19:49:06.295790+0000","last_peered":"2024-05-08T19:49:06.295790+0000","last_clean":"2024-05-08T19:49:06.295790+0000","last_became_active":"2024-05-08T19:22:20.448449+0000","last_became_peered":"2024-05-08T19:22:20.448449+0000","last_unstale":"2024-05-08T19:49:06.295790+0000","last_undegraded":"2024-05-08T19:49:06.295790+0000","last_fullsized":"2024-05-08T19:49:06.295790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2280","last_scrub_stamp":"2024-05-08T19:49:06.295763+0000","last_deep_scrub":"26'2280","last_deep_scrub_stamp":"2024-05-08T19:49:06.295763+0000","last_clean_scrub_stamp":"2024-05-08T19:49:06.295763+0000","objects_scrubbed":0,"log_size":2280,"log_dups_size":0,"ondisk_log_size":2280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:05.805484+0000","scrub_duration":0.0022924019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'2285","reported_seq":2325,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:44.719448+0000","last_change":"2024-05-08T19:48:44.719448+0000","last_active":"2024-05-08T19:48:44.719448+0000","last_peered":"2024-05-08T19:48:44.719448+0000","last_clean":"2024-05-08T19:48:44.719448+0000","last_became_active":"2024-05-08T19:22:20.450217+0000","last_became_peered":"2024-05-08T19:22:20.450217+0000","last_unstale":"2024-05-08T19:48:44.719448+0000","last_undegraded":"2024-05-08T19:48:44.719448+0000","last_fullsized":"2024-05-08T19:48:44.719448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2285","last_scrub_stamp":"2024-05-08T19:48:44.719301+0000","last_deep_scrub":"26'2285","last_deep_scrub_stamp":"2024-05-08T19:48:44.719301+0000","last_clean_scrub_stamp":"2024-05-08T19:48:44.719301+0000","objects_scrubbed":0,"log_size":2285,"log_dups_size":0,"ondisk_log_size":2285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:52.389992+0000","scrub_duration":0.0035809150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'2324","reported_seq":2353,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.829310+0000","last_change":"2024-05-08T19:22:20.453450+0000","last_active":"2024-05-08T19:48:40.829310+0000","last_peered":"2024-05-08T19:48:40.829310+0000","last_clean":"2024-05-08T19:48:40.829310+0000","last_became_active":"2024-05-08T19:22:20.453191+0000","last_became_peered":"2024-05-08T19:22:20.453191+0000","last_unstale":"2024-05-08T19:48:40.829310+0000","last_undegraded":"2024-05-08T19:48:40.829310+0000","last_fullsized":"2024-05-08T19:48:40.829310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'2354","reported_seq":2382,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.250642+0000","last_change":"2024-05-08T19:22:20.452591+0000","last_active":"2024-05-08T19:48:36.250642+0000","last_peered":"2024-05-08T19:48:36.250642+0000","last_clean":"2024-05-08T19:48:36.250642+0000","last_became_active":"2024-05-08T19:22:20.451209+0000","last_became_peered":"2024-05-08T19:22:20.451209+0000","last_unstale":"2024-05-08T19:48:36.250642+0000","last_undegraded":"2024-05-08T19:48:36.250642+0000","last_fullsized":"2024-05-08T19:48:36.250642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2354,"log_dups_size":0,"ondisk_log_size":2354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'2352","reported_seq":2391,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:01.519407+0000","last_change":"2024-05-08T19:49:01.519510+0000","last_active":"2024-05-08T19:49:01.519407+0000","last_peered":"2024-05-08T19:49:01.519407+0000","last_clean":"2024-05-08T19:49:01.519407+0000","last_became_active":"2024-05-08T19:22:20.461097+0000","last_became_peered":"2024-05-08T19:22:20.461097+0000","last_unstale":"2024-05-08T19:49:01.519407+0000","last_undegraded":"2024-05-08T19:49:01.519407+0000","last_fullsized":"2024-05-08T19:49:01.519407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2352","last_scrub_stamp":"2024-05-08T19:49:01.519370+0000","last_deep_scrub":"26'2352","last_deep_scrub_stamp":"2024-05-08T19:49:01.519370+0000","last_clean_scrub_stamp":"2024-05-08T19:49:01.519370+0000","objects_scrubbed":0,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:19.809313+0000","scrub_duration":0.001891829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18592,"num_read_kb":1141288,"num_write":194903,"num_write_kb":30181748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230906,"ondisk_log_size":230906,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2442,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148135,"ondisk_log_size":148135,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":241252722,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":2935,"num_read_kb":17425,"num_write":211935,"num_write_kb":1497715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":983922,"num_omap_keys":1498,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":323821568,"data_stored":482505444,"data_compressed":47939648,"data_compressed_allocated":70770688,"data_compressed_original":229515264,"omap_allocated":0,"internal_metadata":0},"log_size":196256,"ondisk_log_size":196256,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575175,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":901808,"kb_used_data":36392,"kb_used_omap":1,"kb_used_meta":865406,"kb_avail":93470032,"statfs":{"total":96636764160,"available":95713312768,"internally_reserved":0,"allocated":37265408,"data_stored":58267643,"data_compressed":5895427,"data_compressed_allocated":8474624,"data_compressed_original":29650944,"omap_allocated":1588,"internal_metadata":886176204},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.7290000000000001,"5min":2.153,"15min":1.4990000000000001},"min":{"1min":0.247,"5min":0.216,"15min":0.20699999999999999},"max":{"1min":13.09,"5min":26.544,"15min":26.544},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.7270000000000001,"5min":2.0529999999999999,"15min":1.7729999999999999},"min":{"1min":0.31900000000000001,"5min":0.27800000000000002,"15min":0.223},"max":{"1min":12.454000000000001,"5min":26.713999999999999,"15min":26.713999999999999},"last":0.65500000000000003}]},{"osd":1,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":2.0600000000000001,"15min":1.982},"min":{"1min":0.27800000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":8.9480000000000004,"5min":14.557,"15min":32.259999999999998},"last":0.626},{"interface":"front","average":{"1min":1.599,"5min":2.0699999999999998,"15min":1.6259999999999999},"min":{"1min":0.28499999999999998,"5min":0.251,"15min":0.25},"max":{"1min":6.7190000000000003,"5min":21.867000000000001,"15min":36.018000000000001},"last":0.46899999999999997}]},{"osd":2,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":2.1629999999999998,"15min":1.5169999999999999},"min":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":10.959,"5min":13.635,"15min":13.635},"last":0.66200000000000003},{"interface":"front","average":{"1min":2.2810000000000001,"5min":2.3239999999999998,"15min":1.827},"min":{"1min":0.34300000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":19.231000000000002,"5min":19.469999999999999,"15min":19.469999999999999},"last":0.48799999999999999}]},{"osd":3,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":3.9630000000000001,"5min":2.6520000000000001,"15min":1.8720000000000001},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.29299999999999998},"max":{"1min":38.195,"5min":38.195,"15min":38.195},"last":0.58699999999999997},{"interface":"front","average":{"1min":2.1269999999999998,"5min":1.996,"15min":1.806},"min":{"1min":0.373,"5min":0.33800000000000002,"15min":0.30599999999999999},"max":{"1min":14.134,"5min":14.134,"15min":26.501999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":2.2000000000000002,"15min":1.677},"min":{"1min":0.30599999999999999,"5min":0.26600000000000001,"15min":0.26100000000000001},"max":{"1min":9.2289999999999992,"5min":37.356000000000002,"15min":37.356000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.319,"5min":2.5449999999999999,"15min":1.7450000000000001},"min":{"1min":0.35799999999999998,"5min":0.253,"15min":0.253},"max":{"1min":5.9950000000000001,"5min":31.786000000000001,"15min":31.786000000000001},"last":0.55100000000000005}]},{"osd":5,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":2.2440000000000002,"15min":1.8120000000000001},"min":{"1min":0.33000000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":4.6079999999999997,"5min":29.346,"15min":35.156999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.73,"15min":1.349},"min":{"1min":0.36699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":10.848000000000001,"5min":10.848000000000001,"15min":32.988999999999997},"last":0.64200000000000002}]},{"osd":6,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.681,"5min":1.7969999999999999,"15min":1.5089999999999999},"min":{"1min":0.42799999999999999,"5min":0.315,"15min":0.308},"max":{"1min":7.9089999999999998,"5min":13.763,"15min":16.077999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":2.2799999999999998,"5min":1.962,"15min":1.605},"min":{"1min":0.45700000000000002,"5min":0.308,"15min":0.27500000000000002},"max":{"1min":28.535,"5min":28.535,"15min":28.535},"last":0.67800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575174,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1085188,"kb_used_data":49212,"kb_used_omap":1,"kb_used_meta":1035966,"kb_avail":93286652,"statfs":{"total":96636764160,"available":95525531648,"internally_reserved":0,"allocated":50393088,"data_stored":74750809,"data_compressed":7372511,"data_compressed_allocated":10829824,"data_compressed_original":35360768,"omap_allocated":1593,"internal_metadata":1060829639},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":1.9470000000000001,"15min":1.4810000000000001},"min":{"1min":0.27200000000000002,"5min":0.192,"15min":0.192},"max":{"1min":3.5470000000000002,"5min":17.488,"15min":17.488},"last":0.56000000000000005},{"interface":"front","average":{"1min":1.679,"5min":2.9009999999999998,"15min":1.962},"min":{"1min":0.313,"5min":0.26400000000000001,"15min":0.245},"max":{"1min":12.345000000000001,"5min":37.295999999999999,"15min":37.295999999999999},"last":0.44500000000000001}]},{"osd":1,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":2.8010000000000002,"15min":1.954},"min":{"1min":0.28100000000000003,"5min":0.26200000000000001,"15min":0.22800000000000001},"max":{"1min":24.649999999999999,"5min":24.649999999999999,"15min":24.649999999999999},"last":0.622},{"interface":"front","average":{"1min":1.3400000000000001,"5min":2.6840000000000002,"15min":1.9219999999999999},"min":{"1min":0.313,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":12.154999999999999,"5min":37.521000000000001,"15min":37.521000000000001},"last":0.504}]},{"osd":2,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":2.867,"15min":1.931},"min":{"1min":0.41799999999999998,"5min":0.313,"15min":0.247},"max":{"1min":6.9130000000000003,"5min":23.952999999999999,"15min":23.952999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":2.359,"5min":2.528,"15min":1.786},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.255},"max":{"1min":24.614999999999998,"5min":24.614999999999998,"15min":24.614999999999998},"last":0.58599999999999997}]},{"osd":3,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":2.448,"15min":2.0150000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.25800000000000001},"max":{"1min":8.3719999999999999,"5min":21.975000000000001,"15min":43.082999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.512,"5min":2.8460000000000001,"15min":2.177},"min":{"1min":0.437,"5min":0.35299999999999998,"15min":0.30399999999999999},"max":{"1min":7.4329999999999998,"5min":23.859000000000002,"15min":43.872999999999998},"last":0.72199999999999998}]},{"osd":4,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":2.6269999999999998,"15min":2.363},"min":{"1min":0.27800000000000002,"5min":0.26500000000000001,"15min":0.26200000000000001},"max":{"1min":7.4500000000000002,"5min":22.302,"15min":111.04900000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":1.6020000000000001,"5min":2.7730000000000001,"15min":1.8169999999999999},"min":{"1min":0.32200000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.8319999999999999,"5min":28.757999999999999,"15min":28.757999999999999},"last":0.52300000000000002}]},{"osd":5,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":3.161,"5min":2.492,"15min":1.776},"min":{"1min":0.311,"5min":0.309,"15min":0.251},"max":{"1min":24.550999999999998,"5min":24.550999999999998,"15min":39.134},"last":0.47799999999999998},{"interface":"front","average":{"1min":4.7690000000000001,"5min":3.1259999999999999,"15min":2.2879999999999998},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":89.531999999999996,"5min":89.531999999999996,"15min":89.531999999999996},"last":0.60399999999999998}]},{"osd":7,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":2.609,"5min":2.7389999999999999,"15min":1.7529999999999999},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":27.448,"5min":27.448,"15min":27.448},"last":0.66300000000000003},{"interface":"front","average":{"1min":2.274,"5min":1.9610000000000001,"15min":1.5609999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":24.588999999999999,"5min":24.588999999999999,"15min":24.588999999999999},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575174,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1188576,"kb_used_data":52632,"kb_used_omap":1,"kb_used_meta":1135934,"kb_avail":93183264,"statfs":{"total":96636764160,"available":95419662336,"internally_reserved":0,"allocated":53895168,"data_stored":78944601,"data_compressed":7659770,"data_compressed_allocated":11517952,"data_compressed_original":36741120,"omap_allocated":1594,"internal_metadata":1163196870},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":1.1200000000000001,"15min":1.1539999999999999},"min":{"1min":0.22600000000000001,"5min":0.20499999999999999,"15min":0.186},"max":{"1min":3.996,"5min":11.619999999999999,"15min":27.282},"last":0.29499999999999998},{"interface":"front","average":{"1min":2.6859999999999999,"5min":1.952,"15min":1.2290000000000001},"min":{"1min":0.245,"5min":0.217,"15min":0.186},"max":{"1min":18.614000000000001,"5min":18.614000000000001,"15min":18.614000000000001},"last":0.36499999999999999}]},{"osd":2,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":3.923,"5min":2.0310000000000001,"15min":1.3129999999999999},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20699999999999999},"max":{"1min":40.337000000000003,"5min":40.337000000000003,"15min":40.337000000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":1.423,"5min":1.3280000000000001,"15min":1.026},"min":{"1min":0.28599999999999998,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":12.145,"5min":18.058,"15min":18.058},"last":0.57099999999999995}]},{"osd":3,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.6659999999999999,"15min":1.2689999999999999},"min":{"1min":0.27900000000000003,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":12.364000000000001,"5min":18.024999999999999,"15min":18.024999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":1.9470000000000001,"5min":1.4850000000000001,"15min":1.3999999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.216},"max":{"1min":12.01,"5min":12.01,"15min":44.454999999999998},"last":0.40500000000000003}]},{"osd":4,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":4.0629999999999997,"5min":2.548,"15min":2.0139999999999998},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.27900000000000003},"max":{"1min":40.384999999999998,"5min":40.384999999999998,"15min":40.384999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":1.978,"5min":1.8740000000000001,"15min":1.829},"min":{"1min":0.38300000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":17.760999999999999,"5min":17.844999999999999,"15min":41.939},"last":0.53500000000000003}]},{"osd":5,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.9630000000000001,"5min":2.089,"15min":1.609},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.313},"max":{"1min":11.967000000000001,"5min":27.727,"15min":27.727},"last":0.46800000000000003},{"interface":"front","average":{"1min":4.1150000000000002,"5min":2.4489999999999998,"15min":1.887},"min":{"1min":0.38800000000000001,"5min":0.33900000000000002,"15min":0.318},"max":{"1min":40.292000000000002,"5min":40.292000000000002,"15min":40.292000000000002},"last":0.39600000000000002}]},{"osd":6,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":2.1859999999999999,"15min":1.78},"min":{"1min":0.375,"5min":0.375,"15min":0.314},"max":{"1min":12.039999999999999,"5min":33.189999999999998,"15min":33.189999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":4.1340000000000003,"5min":3.2949999999999999,"15min":2.2509999999999999},"min":{"1min":0.42799999999999999,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":40.362000000000002,"5min":40.362000000000002,"15min":40.362000000000002},"last":0.48999999999999999}]},{"osd":7,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.897,"5min":1.7490000000000001,"15min":1.4370000000000001},"min":{"1min":0.442,"5min":0.36399999999999999,"15min":0.35899999999999999},"max":{"1min":13.084,"5min":17.890000000000001,"15min":17.890000000000001},"last":0.505},{"interface":"front","average":{"1min":1.6579999999999999,"5min":2.306,"15min":1.7929999999999999},"min":{"1min":0.44400000000000001,"5min":0.40600000000000003,"15min":0.36099999999999999},"max":{"1min":12.683,"5min":21.039999999999999,"15min":21.039999999999999},"last":0.52000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575174,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":805416,"kb_used_data":34464,"kb_used_omap":1,"kb_used_meta":770942,"kb_avail":93566424,"statfs":{"total":96636764160,"available":95812018176,"internally_reserved":0,"allocated":35291136,"data_stored":54073395,"data_compressed":5457884,"data_compressed_allocated":7987200,"data_compressed_original":26951680,"omap_allocated":1593,"internal_metadata":789445063},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":1.78,"5min":1.756,"15min":1.74},"min":{"1min":0.29699999999999999,"5min":0.189,"15min":0.185},"max":{"1min":12.462,"5min":22.343,"15min":37.991999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.91500000000000004,"5min":1.4910000000000001,"15min":1.2769999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":7.0229999999999997,"5min":20.382000000000001,"15min":21.954000000000001},"last":0.33900000000000002}]},{"osd":2,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.236,"15min":1.1080000000000001},"min":{"1min":0.316,"5min":0.22600000000000001,"15min":0.20899999999999999},"max":{"1min":12.42,"5min":17.687999999999999,"15min":17.687999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":1.3140000000000001,"15min":1.1830000000000001},"min":{"1min":0.255,"5min":0.23200000000000001,"15min":0.20899999999999999},"max":{"1min":4.5739999999999998,"5min":20.419,"15min":22.026},"last":0.39900000000000002}]},{"osd":3,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":1.726,"5min":2.1589999999999998,"15min":1.75},"min":{"1min":0.28000000000000003,"5min":0.22,"15min":0.192},"max":{"1min":8.8569999999999993,"5min":34.515000000000001,"15min":34.515000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":1.7010000000000001,"5min":2.4500000000000002,"15min":1.6399999999999999},"min":{"1min":0.35599999999999998,"5min":0.27600000000000002,"15min":0.22600000000000001},"max":{"1min":12.364000000000001,"5min":85.606999999999999,"15min":85.606999999999999},"last":0.42299999999999999}]},{"osd":4,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":6.7450000000000001,"5min":3.5499999999999998,"15min":2.5},"min":{"1min":0.40999999999999998,"5min":0.29399999999999998,"15min":0.28199999999999997},"max":{"1min":60.851999999999997,"5min":60.851999999999997,"15min":66.331999999999994},"last":0.70799999999999996},{"interface":"front","average":{"1min":6.1539999999999999,"5min":3.6699999999999999,"15min":2.6040000000000001},"min":{"1min":0.48399999999999999,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":67.194000000000003,"5min":67.194000000000003,"15min":67.194000000000003},"last":0.54900000000000004}]},{"osd":5,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":3.4670000000000001,"5min":2.157,"15min":1.708},"min":{"1min":0.46999999999999997,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":21.18,"5min":21.18,"15min":21.981000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.829,"5min":1.792,"15min":1.601},"min":{"1min":0.34100000000000003,"5min":0.32400000000000001,"15min":0.30599999999999999},"max":{"1min":7.907,"5min":14.019,"15min":25.446999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":2.702,"5min":3.234,"15min":2.1789999999999998},"min":{"1min":0.54300000000000004,"5min":0.373,"15min":0.318},"max":{"1min":16.640000000000001,"5min":82.542000000000002,"15min":82.542000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":2.6589999999999998,"5min":2.1339999999999999,"15min":2.0129999999999999},"min":{"1min":0.45900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":16.056000000000001,"5min":25.914999999999999,"15min":25.914999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.9179999999999999,"15min":1.9870000000000001},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":4.5339999999999998,"5min":20.445,"15min":26.669},"last":0.56999999999999995},{"interface":"front","average":{"1min":3.145,"5min":2.028,"15min":1.8700000000000001},"min":{"1min":0.42499999999999999,"5min":0.38400000000000001,"15min":0.33100000000000002},"max":{"1min":17.495000000000001,"5min":17.495000000000001,"15min":20.146000000000001},"last":0.73599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575175,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":729616,"kb_used_data":40712,"kb_used_omap":1,"kb_used_meta":688894,"kb_avail":93642224,"statfs":{"total":96636764160,"available":95889637376,"internally_reserved":0,"allocated":41689088,"data_stored":58833997,"data_compressed":5586562,"data_compressed_allocated":8433664,"data_compressed_original":25743360,"omap_allocated":1594,"internal_metadata":705427910},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":1.466,"15min":1.1579999999999999},"min":{"1min":0.22,"5min":0.186,"15min":0.16900000000000001},"max":{"1min":3.419,"5min":15.834,"15min":21.475999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.3089999999999999,"15min":1.23},"min":{"1min":0.214,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":11.121,"5min":14.374000000000001,"15min":30.434999999999999},"last":0.48099999999999998}]},{"osd":1,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":2.133,"5min":1.954,"15min":1.655},"min":{"1min":0.23200000000000001,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":9.391,"5min":24.190000000000001,"15min":25.550000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":2.0179999999999998,"5min":1.2390000000000001,"15min":1.137},"min":{"1min":0.30399999999999999,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":9.3539999999999992,"5min":9.3539999999999992,"15min":20.591000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":2.6259999999999999,"5min":2.3959999999999999,"15min":1.835},"min":{"1min":0.251,"5min":0.23400000000000001,"15min":0.21099999999999999},"max":{"1min":21.16,"5min":34.598999999999997,"15min":34.598999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":2.5289999999999999,"5min":2.5619999999999998,"15min":1.7749999999999999},"min":{"1min":0.26500000000000001,"5min":0.23799999999999999,"15min":0.20399999999999999},"max":{"1min":14.199999999999999,"5min":20.491,"15min":25.827000000000002},"last":0.63}]},{"osd":4,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":1.8069999999999999,"5min":2.1890000000000001,"15min":2.371},"min":{"1min":0.373,"5min":0.32700000000000001,"15min":0.31900000000000001},"max":{"1min":12.004,"5min":15.936,"15min":67.506},"last":0.80200000000000005},{"interface":"front","average":{"1min":2.7400000000000002,"5min":2.3519999999999999,"15min":2.5630000000000002},"min":{"1min":0.45600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":14.445,"5min":14.445,"15min":111.973},"last":0.71899999999999997}]},{"osd":5,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":3.5390000000000001,"5min":2.1360000000000001,"15min":1.77},"min":{"1min":0.39800000000000002,"5min":0.318,"15min":0.308},"max":{"1min":19.506,"5min":19.506,"15min":37.496000000000002},"last":0.77400000000000002},{"interface":"front","average":{"1min":2.786,"5min":2.1880000000000002,"15min":1.7989999999999999},"min":{"1min":0.39600000000000002,"5min":0.33700000000000002,"15min":0.32600000000000001},"max":{"1min":11.926,"5min":34.545000000000002,"15min":45.997999999999998},"last":0.755}]},{"osd":6,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":3.2879999999999998,"5min":2.6070000000000002,"15min":2.1709999999999998},"min":{"1min":0.45700000000000002,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":15.334,"5min":29.954999999999998,"15min":68.453000000000003},"last":0.70599999999999996},{"interface":"front","average":{"1min":2.7789999999999999,"5min":2.4660000000000002,"15min":2.0790000000000002},"min":{"1min":0.45300000000000001,"5min":0.34899999999999998,"15min":0.34300000000000003},"max":{"1min":16.204000000000001,"5min":16.204000000000001,"15min":63.966000000000001},"last":0.83499999999999996}]},{"osd":7,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":3.661,"5min":2.2370000000000001,"15min":2.0750000000000002},"min":{"1min":0.45100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":24.030000000000001,"5min":24.030000000000001,"15min":32.700000000000003},"last":0.82199999999999995},{"interface":"front","average":{"1min":2.758,"5min":2.3799999999999999,"15min":2.173},"min":{"1min":0.501,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.946,"5min":29.881,"15min":32.840000000000003},"last":0.79300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575174,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1195628,"kb_used_data":51492,"kb_used_omap":1,"kb_used_meta":1144126,"kb_avail":93176212,"statfs":{"total":96636764160,"available":95412441088,"internally_reserved":0,"allocated":52727808,"data_stored":79806189,"data_compressed":8205315,"data_compressed_allocated":12034048,"data_compressed_original":39284736,"omap_allocated":1591,"internal_metadata":1171585481},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.4870000000000001,"15min":1.173},"min":{"1min":0.22700000000000001,"5min":0.20300000000000001,"15min":0.184},"max":{"1min":10.606999999999999,"5min":24.539999999999999,"15min":24.539999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":2.1059999999999999,"5min":1.5309999999999999,"15min":1.5760000000000001},"min":{"1min":0.218,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":30.457000000000001,"5min":30.457000000000001,"15min":95.932000000000002},"last":0.498}]},{"osd":1,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":2.8069999999999999,"5min":2.8809999999999998,"15min":2.1989999999999998},"min":{"1min":0.20399999999999999,"5min":0.20300000000000001,"15min":0.193},"max":{"1min":31.254999999999999,"5min":44.308,"15min":44.308},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.597,"5min":1.954,"15min":1.367},"min":{"1min":0.27600000000000002,"5min":0.23300000000000001,"15min":0.22},"max":{"1min":13.927,"5min":38.054000000000002,"15min":38.054000000000002},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":2.2890000000000001,"5min":2.052,"15min":1.645},"min":{"1min":0.26300000000000001,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":31.277999999999999,"5min":31.277999999999999,"15min":31.277999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.726,"5min":1.2629999999999999,"15min":1.1839999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26700000000000002},"max":{"1min":13.897,"5min":17.364000000000001,"15min":17.364000000000001},"last":0.60699999999999998}]},{"osd":4,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":1.768,"5min":1.9850000000000001,"15min":1.7150000000000001},"min":{"1min":0.31900000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":18.422999999999998,"5min":18.960000000000001,"15min":19.16},"last":0.97299999999999998},{"interface":"front","average":{"1min":3.0640000000000001,"5min":2.4780000000000002,"15min":2.2210000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.26700000000000002},"max":{"1min":31.201000000000001,"5min":31.201000000000001,"15min":31.201000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":3.0880000000000001,"5min":2.0760000000000001,"15min":2.0630000000000002},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32200000000000001},"max":{"1min":31.155999999999999,"5min":31.155999999999999,"15min":33.436999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.641,"5min":1.8340000000000001,"15min":1.6599999999999999},"min":{"1min":0.38400000000000001,"5min":0.33300000000000002,"15min":0.32000000000000001},"max":{"1min":10.579000000000001,"5min":17.329000000000001,"15min":17.329000000000001},"last":0.98899999999999999}]},{"osd":6,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":2.0779999999999998,"15min":2.0339999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":10.48,"5min":25.329000000000001,"15min":30.588000000000001},"last":1.034},{"interface":"front","average":{"1min":2.1030000000000002,"5min":2.0249999999999999,"15min":1.8999999999999999},"min":{"1min":0.40799999999999997,"5min":0.34599999999999997,"15min":0.33900000000000002},"max":{"1min":16.077000000000002,"5min":18.803000000000001,"15min":23.318999999999999},"last":0.82199999999999995}]},{"osd":7,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.7210000000000001,"15min":1.8440000000000001},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.34699999999999998},"max":{"1min":13.25,"5min":18.841999999999999,"15min":19.116},"last":0.76800000000000002},{"interface":"front","average":{"1min":3.1549999999999998,"5min":2.4830000000000001,"15min":2.1419999999999999},"min":{"1min":0.41799999999999998,"5min":0.38800000000000001,"15min":0.36399999999999999},"max":{"1min":31.23,"5min":31.23,"15min":33.505000000000003},"last":0.95499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575174,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":925352,"kb_used_data":24096,"kb_used_omap":1,"kb_used_meta":901246,"kb_avail":93446488,"statfs":{"total":96636764160,"available":95689203712,"internally_reserved":0,"allocated":24674304,"data_stored":37862603,"data_compressed":4009381,"data_compressed_allocated":5820416,"data_compressed_original":19185664,"omap_allocated":1594,"internal_metadata":922876358},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":2.593,"15min":1.7430000000000001},"min":{"1min":0.27200000000000002,"5min":0.21199999999999999,"15min":0.20899999999999999},"max":{"1min":10.792,"5min":21.062999999999999,"15min":45.375},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.587,"5min":1.919,"15min":1.74},"min":{"1min":0.29699999999999999,"5min":0.23100000000000001,"15min":0.188},"max":{"1min":12.551,"5min":12.551,"15min":35.765000000000001},"last":0.374}]},{"osd":1,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":2.4350000000000001,"5min":2.859,"15min":2.113},"min":{"1min":0.28100000000000003,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":14.561999999999999,"5min":22.718,"15min":29.928000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":1.9830000000000001,"5min":2.9420000000000002,"15min":1.7829999999999999},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.248},"max":{"1min":18.433,"5min":21.103000000000002,"15min":23.634},"last":0.40100000000000002}]},{"osd":2,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":2.4710000000000001,"5min":2.7029999999999998,"15min":1.873},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.27600000000000002},"max":{"1min":12.27,"5min":30.512,"15min":30.512},"last":0.56699999999999995},{"interface":"front","average":{"1min":1.4370000000000001,"5min":3.8959999999999999,"15min":2.1600000000000001},"min":{"1min":0.32100000000000001,"5min":0.27400000000000002,"15min":0.26300000000000001},"max":{"1min":10.868,"5min":82.847999999999999,"15min":82.847999999999999},"last":0.47299999999999998}]},{"osd":3,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.875,"15min":1.6120000000000001},"min":{"1min":0.32600000000000001,"5min":0.26600000000000001,"15min":0.23899999999999999},"max":{"1min":8.4359999999999999,"5min":11.970000000000001,"15min":22.555},"last":0.57799999999999996},{"interface":"front","average":{"1min":2.9870000000000001,"5min":3.0230000000000001,"15min":2.0950000000000002},"min":{"1min":0.379,"5min":0.35699999999999998,"15min":0.308},"max":{"1min":24.347000000000001,"5min":24.347000000000001,"15min":26.259},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":4.0620000000000003,"15min":2.1600000000000001},"min":{"1min":0.29999999999999999,"5min":0.28299999999999997,"15min":0.246},"max":{"1min":12.558999999999999,"5min":82.918999999999997,"15min":82.918999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.774,"5min":2.4780000000000002,"15min":1.8879999999999999},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":12.051,"5min":25.120000000000001,"15min":25.120000000000001},"last":0.54400000000000004}]},{"osd":6,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":2.3969999999999998,"15min":1.7649999999999999},"min":{"1min":0.317,"5min":0.313,"15min":0.252},"max":{"1min":12.365,"5min":18.141999999999999,"15min":20.562999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":1.744,"5min":3.6560000000000001,"15min":2.3180000000000001},"min":{"1min":0.36099999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":16.669,"5min":83.643000000000001,"15min":83.643000000000001},"last":0.55800000000000005}]},{"osd":7,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.988,"15min":1.7769999999999999},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":11.795999999999999,"5min":19.021999999999998,"15min":25.878},"last":0.49399999999999999},{"interface":"front","average":{"1min":2.4580000000000002,"5min":2.4300000000000002,"15min":1.863},"min":{"1min":0.441,"5min":0.308,"15min":0.27800000000000002},"max":{"1min":12.334,"5min":22.75,"15min":22.75},"last":0.621}]}]},{"osd":5,"up_from":13,"seq":55834575174,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":957096,"kb_used_data":29536,"kb_used_omap":1,"kb_used_meta":927550,"kb_avail":93414744,"statfs":{"total":96636764160,"available":95656697856,"internally_reserved":0,"allocated":30244864,"data_stored":42056871,"data_compressed":3817580,"data_compressed_allocated":5763072,"data_compressed_original":17743872,"omap_allocated":1594,"internal_metadata":949811654},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.9319999999999999,"15min":1.349},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":12.286,"5min":19.097999999999999,"15min":19.097999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.5289999999999999,"5min":2.1339999999999999,"15min":1.579},"min":{"1min":0.27300000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":9.9350000000000005,"5min":21.416,"15min":21.416},"last":0.628}]},{"osd":1,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.8200000000000001,"15min":1.6699999999999999},"min":{"1min":0.309,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":11.445,"5min":16.515000000000001,"15min":19.581},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.6000000000000001,"15min":1.337},"min":{"1min":0.28699999999999998,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":13.266999999999999,"5min":16.492999999999999,"15min":16.492999999999999},"last":0.60199999999999998}]},{"osd":2,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.397,"15min":1.4430000000000001},"min":{"1min":0.34200000000000003,"5min":0.27300000000000002,"15min":0.25700000000000001},"max":{"1min":9.9290000000000003,"5min":9.9290000000000003,"15min":21.186},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.022,"5min":1.363,"15min":1.284},"min":{"1min":0.26700000000000002,"5min":0.26200000000000001,"15min":0.25700000000000001},"max":{"1min":6.2400000000000002,"5min":8.4160000000000004,"15min":22.353999999999999},"last":0.68899999999999995}]},{"osd":3,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.9379999999999999,"15min":1.6599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.29699999999999999},"max":{"1min":11.137,"5min":16.324999999999999,"15min":17.103999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.458,"5min":2.0739999999999998,"15min":1.7390000000000001},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.29899999999999999},"max":{"1min":8.5920000000000005,"5min":18.798999999999999,"15min":23.224},"last":0.54500000000000004}]},{"osd":4,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.9350000000000001,"15min":1.548},"min":{"1min":0.29699999999999999,"5min":0.25,"15min":0.20799999999999999},"max":{"1min":6.2000000000000002,"5min":19.018999999999998,"15min":28.724},"last":0.44},{"interface":"front","average":{"1min":1.21,"5min":2.105,"15min":1.6499999999999999},"min":{"1min":0.317,"5min":0.28100000000000003,"15min":0.22800000000000001},"max":{"1min":6.7229999999999999,"5min":25.466999999999999,"15min":25.466999999999999},"last":0.45600000000000002}]},{"osd":6,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.869,"15min":1.5640000000000001},"min":{"1min":0.32800000000000001,"5min":0.28699999999999998,"15min":0.23899999999999999},"max":{"1min":7.7210000000000001,"5min":20.969999999999999,"15min":21.294},"last":0.41699999999999998},{"interface":"front","average":{"1min":1.4390000000000001,"5min":2.125,"15min":1.518},"min":{"1min":0.39700000000000002,"5min":0.34599999999999997,"15min":0.24199999999999999},"max":{"1min":6.1660000000000004,"5min":23.731000000000002,"15min":23.731000000000002},"last":0.52300000000000002}]},{"osd":7,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.8029999999999999,"15min":1.4790000000000001},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.29299999999999998},"max":{"1min":5.6920000000000002,"5min":21.462,"15min":30.076000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":1.474,"15min":1.306},"min":{"1min":0.39400000000000002,"5min":0.36699999999999999,"15min":0.26100000000000001},"max":{"1min":4.6609999999999996,"5min":14.316000000000001,"15min":21.257000000000001},"last":0.51100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34947072,"data_stored":53369286,"data_compressed":5425493,"data_compressed_allocated":7942144,"data_compressed_original":26378240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53616640,"data_stored":78830860,"data_compressed":7659770,"data_compressed_allocated":11517952,"data_compressed_original":36741120,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41410560,"data_stored":58720256,"data_compressed":5586562,"data_compressed_allocated":8433664,"data_compressed_original":25743360,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":52449280,"data_stored":79692448,"data_compressed":8205315,"data_compressed_allocated":12034048,"data_compressed_original":39284736,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24395776,"data_stored":37748862,"data_compressed":4009381,"data_compressed_allocated":5820416,"data_compressed_original":19185664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29966336,"data_stored":41943130,"data_compressed":3817580,"data_compressed_allocated":5763072,"data_compressed_original":17743872,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50114560,"data_stored":74637068,"data_compressed":7372511,"data_compressed_allocated":10829824,"data_compressed_original":35360768,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36921344,"data_stored":57563534,"data_compressed":5863036,"data_compressed_allocated":8429568,"data_compressed_original":29077504,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T19:49:23.090 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.090 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.090 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.091 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.091 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.091 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.091 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.091 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.091 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.091 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.092 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.092 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.092 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.092 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.092 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.092 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.092 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.093 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.093 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.093 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.093 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.093 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.093 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.093 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.094 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.094 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.094 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.094 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.094 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.095 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.095 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.095 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.095 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.095 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.095 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.095 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.096 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.096 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.096 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.096 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.096 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.096 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:23.096 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T19:49:42.511 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:49:42.515 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:49:43.097 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T19:49:43.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.247+0000 7fe2fcbbc700 1 Processor -- start 2024-05-08T19:49:43.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.247+0000 7fe2fcbbc700 1 -- start start 2024-05-08T19:49:43.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.248+0000 7fe2fcbbc700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2f80c2b10 0x7fe2f80a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:43.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.248+0000 7fe2fcbbc700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe2f80a89f0 0x7fe2f814ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:43.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.248+0000 7fe2fcbbc700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f80c2880 con 0x7fe2f80c1d90 2024-05-08T19:49:43.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.248+0000 7fe2fcbbc700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f80c3970 con 0x7fe2f80a89f0 2024-05-08T19:49:43.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.248+0000 7fe2fcbbc700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f80c3690 con 0x7fe2f80c2b10 2024-05-08T19:49:43.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.248+0000 7fe2f6d9d700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe2f80a89f0 0x7fe2f814ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:43.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.248+0000 7fe2f6d9d700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe2f80a89f0 0x7fe2f814ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45046/0 (socket says 172.21.15.47:45046) 2024-05-08T19:49:43.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.248+0000 7fe2f6d9d700 1 -- 172.21.15.47:0/2866366011 learned_addr learned my addr 172.21.15.47:0/2866366011 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:49:43.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.248+0000 7fe2f5d9b700 1 --2- 172.21.15.47:0/2866366011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2f80c2b10 0x7fe2f80a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:43.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.248+0000 7fe2f6d9d700 1 -- 172.21.15.47:0/2866366011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2f80c2b10 msgr2=0x7fe2f80a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:49:43.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.248+0000 7fe2f6d9d700 1 --2- 172.21.15.47:0/2866366011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2f80c2b10 0x7fe2f80a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:43.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.248+0000 7fe2f6d9d700 1 -- 172.21.15.47:0/2866366011 >> v1:172.21.15.177:6789/0 conn(0x7fe2f80c1d90 legacy=0x7fe2f80c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:49:43.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.248+0000 7fe2f6d9d700 1 -- 172.21.15.47:0/2866366011 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f8154d00 con 0x7fe2f80a89f0 2024-05-08T19:49:43.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.248+0000 7fe2f5d9b700 1 --2- 172.21.15.47:0/2866366011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2f80c2b10 0x7fe2f80a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:49:43.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.248+0000 7fe2f6d9d700 1 --2- 172.21.15.47:0/2866366011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80a89f0 0x7fe2f814ea40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009e80 tx=0x7fe2f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8295edaaf7f785ec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:49:43.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.249+0000 7fe2f559a700 1 -- 172.21.15.47:0/2866366011 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f000e070 con 0x7fe2f80a89f0 2024-05-08T19:49:43.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.249+0000 7fe2f559a700 1 -- 172.21.15.47:0/2866366011 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f0003a20 con 0x7fe2f80a89f0 2024-05-08T19:49:43.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.249+0000 7fe2f559a700 1 -- 172.21.15.47:0/2866366011 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0003dd0 con 0x7fe2f80a89f0 2024-05-08T19:49:43.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.249+0000 7fe2fcbbc700 1 -- 172.21.15.47:0/2866366011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80a89f0 msgr2=0x7fe2f814ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:43.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.249+0000 7fe2fcbbc700 1 --2- 172.21.15.47:0/2866366011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80a89f0 0x7fe2f814ea40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009e80 tx=0x7fe2f000b330 comp rx=0 tx=0).stop 2024-05-08T19:49:43.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.249+0000 7fe2fcbbc700 1 -- 172.21.15.47:0/2866366011 shutdown_connections 2024-05-08T19:49:43.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.249+0000 7fe2fcbbc700 1 --2- 172.21.15.47:0/2866366011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80a89f0 0x7fe2f814ea40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:43.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.249+0000 7fe2fcbbc700 1 --2- 172.21.15.47:0/2866366011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2f80c2b10 0x7fe2f80a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:43.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.249+0000 7fe2fcbbc700 1 -- 172.21.15.47:0/2866366011 >> 172.21.15.47:0/2866366011 conn(0x7fe2f80c3c20 msgr2=0x7fe2f80c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:49:43.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.249+0000 7fe2fcbbc700 1 -- 172.21.15.47:0/2866366011 shutdown_connections 2024-05-08T19:49:43.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.249+0000 7fe2fcbbc700 1 -- 172.21.15.47:0/2866366011 wait complete. 2024-05-08T19:49:43.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.251+0000 7fe2fcbbc700 1 Processor -- start 2024-05-08T19:49:43.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.251+0000 7fe2fcbbc700 1 -- start start 2024-05-08T19:49:43.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.251+0000 7fe2fcbbc700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2f80c1d90 0x7fe2f80c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:43.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.251+0000 7fe2fcbbc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80c2b10 0x7fe2f81dda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:43.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.251+0000 7fe2fcbbc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2f81ddfc0 0x7fe2f81444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:43.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.251+0000 7fe2fcbbc700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f80c6f90 con 0x7fe2f80c2b10 2024-05-08T19:49:43.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.251+0000 7fe2fcbbc700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f80c66a0 con 0x7fe2f81ddfc0 2024-05-08T19:49:43.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.251+0000 7fe2fcbbc700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f81ee160 con 0x7fe2f80c1d90 2024-05-08T19:49:43.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.251+0000 7fe2f5d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80c2b10 0x7fe2f81dda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:43.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2f5d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80c2b10 0x7fe2f81dda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45058/0 (socket says 172.21.15.47:45058) 2024-05-08T19:49:43.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2f5d9b700 1 -- 172.21.15.47:0/4254830621 learned_addr learned my addr 172.21.15.47:0/4254830621 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:49:43.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2f659c700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2f80c1d90 0x7fe2f80c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:43.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2f6d9d700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2f81ddfc0 0x7fe2f81444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:43.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2f5d9b700 1 -- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2f80c1d90 msgr2=0x7fe2f80c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:43.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2f5d9b700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2f80c1d90 0x7fe2f80c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:43.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2f5d9b700 1 -- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2f81ddfc0 msgr2=0x7fe2f81444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:43.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2f5d9b700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2f81ddfc0 0x7fe2f81444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:43.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2f5d9b700 1 -- 172.21.15.47:0/4254830621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f0009b30 con 0x7fe2f80c2b10 2024-05-08T19:49:43.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2f659c700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2f80c1d90 0x7fe2f80c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:49:43.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2f6d9d700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2f81ddfc0 0x7fe2f81444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:49:43.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2f5d9b700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80c2b10 0x7fe2f81dda80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00c7f0 tx=0x7fe2ec00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:49:43.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2e6ffd700 1 -- 172.21.15.47:0/4254830621 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec011800 con 0x7fe2f80c2b10 2024-05-08T19:49:43.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2e6ffd700 1 -- 172.21.15.47:0/4254830621 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec011960 con 0x7fe2f80c2b10 2024-05-08T19:49:43.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2fcbbc700 1 -- 172.21.15.47:0/4254830621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f81ed550 con 0x7fe2f80c2b10 2024-05-08T19:49:43.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2e6ffd700 1 -- 172.21.15.47:0/4254830621 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec011d10 con 0x7fe2f80c2b10 2024-05-08T19:49:43.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.252+0000 7fe2fcbbc700 1 -- 172.21.15.47:0/4254830621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f81edb10 con 0x7fe2f80c2b10 2024-05-08T19:49:43.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.253+0000 7fe2fcbbc700 1 -- 172.21.15.47:0/4254830621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f81ee2f0 con 0x7fe2f80c2b10 2024-05-08T19:49:43.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.254+0000 7fe2e6ffd700 1 -- 172.21.15.47:0/4254830621 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe2ec018360 con 0x7fe2f80c2b10 2024-05-08T19:49:43.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.254+0000 7fe2e6ffd700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe2d806acc0 0x7fe2d806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:49:43.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.254+0000 7fe2e6ffd700 1 -- 172.21.15.47:0/4254830621 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe2ec089670 con 0x7fe2f80c2b10 2024-05-08T19:49:43.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.254+0000 7fe2f659c700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe2d806acc0 0x7fe2d806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:49:43.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.255+0000 7fe2f659c700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe2d806acc0 0x7fe2d806d180 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8003f40 tx=0x7fe2e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:49:43.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.259+0000 7fe2e6ffd700 1 -- 172.21.15.47:0/4254830621 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe2ec054490 con 0x7fe2f80c2b10 2024-05-08T19:49:43.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.462+0000 7fe2fcbbc700 1 -- 172.21.15.47:0/4254830621 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2f806b7e0 con 0x7fe2d806acc0 2024-05-08T19:49:43.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.473+0000 7fe2e6ffd700 1 -- 172.21.15.47:0/4254830621 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373323 (secure 0 0 0) 0x7fe2f806b7e0 con 0x7fe2d806acc0 2024-05-08T19:49:43.468 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:49:43.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.476+0000 7fe2fcbbc700 1 -- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe2d806acc0 msgr2=0x7fe2d806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:43.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.476+0000 7fe2fcbbc700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe2d806acc0 0x7fe2d806d180 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8003f40 tx=0x7fe2e8009040 comp rx=0 tx=0).stop 2024-05-08T19:49:43.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.476+0000 7fe2fcbbc700 1 -- 172.21.15.47:0/4254830621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80c2b10 msgr2=0x7fe2f81dda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:49:43.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.476+0000 7fe2fcbbc700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80c2b10 0x7fe2f81dda80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00c7f0 tx=0x7fe2ec00cbb0 comp rx=0 tx=0).stop 2024-05-08T19:49:43.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.476+0000 7fe2fcbbc700 1 -- 172.21.15.47:0/4254830621 shutdown_connections 2024-05-08T19:49:43.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.476+0000 7fe2fcbbc700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fe2d806acc0 0x7fe2d806d180 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:43.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.476+0000 7fe2fcbbc700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2f81ddfc0 0x7fe2f81444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:43.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.476+0000 7fe2fcbbc700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2f80c1d90 0x7fe2f80c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:43.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.477+0000 7fe2fcbbc700 1 --2- 172.21.15.47:0/4254830621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2f80c2b10 0x7fe2f81dda80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:49:43.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.477+0000 7fe2fcbbc700 1 -- 172.21.15.47:0/4254830621 >> 172.21.15.47:0/4254830621 conn(0x7fe2f80c3c20 msgr2=0x7fe2f80c2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:49:43.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.477+0000 7fe2fcbbc700 1 -- 172.21.15.47:0/4254830621 shutdown_connections 2024-05-08T19:49:43.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:49:43.477+0000 7fe2fcbbc700 1 -- 172.21.15.47:0/4254830621 wait complete. 2024-05-08T19:49:43.472 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-08T19:49:43.479 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":843,"stamp":"2024-05-08T19:49:42.620728+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":241843090,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":21643,"num_read_kb":1158813,"num_write":409439,"num_write_kb":31681879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":983922,"num_omap_keys":1498,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575416,"ondisk_log_size":575416,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7772296,"kb_used_data":318536,"kb_used_omap":12,"kb_used_meta":7453683,"kb_avail":747202424,"statfs":{"total":773094113280,"available":765135282176,"internally_reserved":0,"allocated":326180864,"data_stored":484596108,"data_compressed":48004430,"data_compressed_allocated":70860800,"data_compressed_original":230662144,"omap_allocated":12741,"internal_metadata":7632571963},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003489"},"pg_stats":[{"pgid":"3.3f","version":"26'2251","reported_seq":2292,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:16.946583+0000","last_change":"2024-05-08T19:49:16.946583+0000","last_active":"2024-05-08T19:49:16.946583+0000","last_peered":"2024-05-08T19:49:16.946583+0000","last_clean":"2024-05-08T19:49:16.946583+0000","last_became_active":"2024-05-08T19:22:20.461515+0000","last_became_peered":"2024-05-08T19:22:20.461515+0000","last_unstale":"2024-05-08T19:49:16.946583+0000","last_undegraded":"2024-05-08T19:49:16.946583+0000","last_fullsized":"2024-05-08T19:49:16.946583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2251","last_scrub_stamp":"2024-05-08T19:49:16.946432+0000","last_deep_scrub":"26'2251","last_deep_scrub_stamp":"2024-05-08T19:49:16.946432+0000","last_clean_scrub_stamp":"2024-05-08T19:49:16.946432+0000","objects_scrubbed":0,"log_size":2251,"log_dups_size":0,"ondisk_log_size":2251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:14.633970+0000","scrub_duration":0.019606787000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'2273","reported_seq":2314,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:10.656598+0000","last_change":"2024-05-08T19:49:10.656598+0000","last_active":"2024-05-08T19:49:10.656598+0000","last_peered":"2024-05-08T19:49:10.656598+0000","last_clean":"2024-05-08T19:49:10.656598+0000","last_became_active":"2024-05-08T19:22:20.434629+0000","last_became_peered":"2024-05-08T19:22:20.434629+0000","last_unstale":"2024-05-08T19:49:10.656598+0000","last_undegraded":"2024-05-08T19:49:10.656598+0000","last_fullsized":"2024-05-08T19:49:10.656598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2273","last_scrub_stamp":"2024-05-08T19:49:10.656467+0000","last_deep_scrub":"26'2273","last_deep_scrub_stamp":"2024-05-08T19:49:10.656467+0000","last_clean_scrub_stamp":"2024-05-08T19:49:10.656467+0000","objects_scrubbed":0,"log_size":2273,"log_dups_size":0,"ondisk_log_size":2273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:10.166188+0000","scrub_duration":0.007619575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"26'2375","reported_seq":2416,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:01.779542+0000","last_change":"2024-05-08T19:49:01.779542+0000","last_active":"2024-05-08T19:49:01.779542+0000","last_peered":"2024-05-08T19:49:01.779542+0000","last_clean":"2024-05-08T19:49:01.779542+0000","last_became_active":"2024-05-08T19:22:20.449184+0000","last_became_peered":"2024-05-08T19:22:20.449184+0000","last_unstale":"2024-05-08T19:49:01.779542+0000","last_undegraded":"2024-05-08T19:49:01.779542+0000","last_fullsized":"2024-05-08T19:49:01.779542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2375","last_scrub_stamp":"2024-05-08T19:49:01.779390+0000","last_deep_scrub":"26'2375","last_deep_scrub_stamp":"2024-05-08T19:49:01.779390+0000","last_clean_scrub_stamp":"2024-05-08T19:49:01.779390+0000","objects_scrubbed":0,"log_size":2375,"log_dups_size":0,"ondisk_log_size":2375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:47.169212+0000","scrub_duration":0.002872987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"26'2359","reported_seq":2400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:03.254773+0000","last_change":"2024-05-08T19:49:03.255052+0000","last_active":"2024-05-08T19:49:03.254773+0000","last_peered":"2024-05-08T19:49:03.254773+0000","last_clean":"2024-05-08T19:49:03.254773+0000","last_became_active":"2024-05-08T19:22:20.449637+0000","last_became_peered":"2024-05-08T19:22:20.449637+0000","last_unstale":"2024-05-08T19:49:03.254773+0000","last_undegraded":"2024-05-08T19:49:03.254773+0000","last_fullsized":"2024-05-08T19:49:03.254773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2359","last_scrub_stamp":"2024-05-08T19:49:03.254747+0000","last_deep_scrub":"26'2359","last_deep_scrub_stamp":"2024-05-08T19:49:03.254747+0000","last_clean_scrub_stamp":"2024-05-08T19:49:03.254747+0000","objects_scrubbed":0,"log_size":2359,"log_dups_size":0,"ondisk_log_size":2359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:43.728458+0000","scrub_duration":0.002337698,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'2307","reported_seq":2345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:32.759879+0000","last_change":"2024-05-08T19:49:32.760052+0000","last_active":"2024-05-08T19:49:32.759879+0000","last_peered":"2024-05-08T19:49:32.759879+0000","last_clean":"2024-05-08T19:49:32.759879+0000","last_became_active":"2024-05-08T19:22:20.449347+0000","last_became_peered":"2024-05-08T19:22:20.449347+0000","last_unstale":"2024-05-08T19:49:32.759879+0000","last_undegraded":"2024-05-08T19:49:32.759879+0000","last_fullsized":"2024-05-08T19:49:32.759879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2307","last_scrub_stamp":"2024-05-08T19:49:32.759839+0000","last_deep_scrub":"26'2307","last_deep_scrub_stamp":"2024-05-08T19:49:32.759839+0000","last_clean_scrub_stamp":"2024-05-08T19:49:32.759839+0000","objects_scrubbed":0,"log_size":2307,"log_dups_size":0,"ondisk_log_size":2307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:32.186888+0000","scrub_duration":0.012594342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'2223","reported_seq":2255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:58.858078+0000","last_change":"2024-05-08T19:48:58.858191+0000","last_active":"2024-05-08T19:48:58.858078+0000","last_peered":"2024-05-08T19:48:58.858078+0000","last_clean":"2024-05-08T19:48:58.858078+0000","last_became_active":"2024-05-08T19:23:11.052928+0000","last_became_peered":"2024-05-08T19:23:11.052928+0000","last_unstale":"2024-05-08T19:48:58.858078+0000","last_undegraded":"2024-05-08T19:48:58.858078+0000","last_fullsized":"2024-05-08T19:48:58.858078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2223","last_scrub_stamp":"2024-05-08T19:48:58.858050+0000","last_deep_scrub":"26'2223","last_deep_scrub_stamp":"2024-05-08T19:48:58.858050+0000","last_clean_scrub_stamp":"2024-05-08T19:48:58.858050+0000","objects_scrubbed":0,"log_size":2223,"log_dups_size":0,"ondisk_log_size":2223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:59.957413+0000","scrub_duration":0.001763433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"26'2288","reported_seq":2326,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:24.809283+0000","last_change":"2024-05-08T19:49:24.809413+0000","last_active":"2024-05-08T19:49:24.809283+0000","last_peered":"2024-05-08T19:49:24.809283+0000","last_clean":"2024-05-08T19:49:24.809283+0000","last_became_active":"2024-05-08T19:22:20.446520+0000","last_became_peered":"2024-05-08T19:22:20.446520+0000","last_unstale":"2024-05-08T19:49:24.809283+0000","last_undegraded":"2024-05-08T19:49:24.809283+0000","last_fullsized":"2024-05-08T19:49:24.809283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2288","last_scrub_stamp":"2024-05-08T19:49:24.809253+0000","last_deep_scrub":"26'2288","last_deep_scrub_stamp":"2024-05-08T19:49:24.809253+0000","last_clean_scrub_stamp":"2024-05-08T19:49:24.809253+0000","objects_scrubbed":0,"log_size":2288,"log_dups_size":0,"ondisk_log_size":2288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:20.625457+0000","scrub_duration":0.0022124359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'2289","reported_seq":2327,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:40.674829+0000","last_change":"2024-05-08T19:49:40.674930+0000","last_active":"2024-05-08T19:49:40.674829+0000","last_peered":"2024-05-08T19:49:40.674829+0000","last_clean":"2024-05-08T19:49:40.674829+0000","last_became_active":"2024-05-08T19:22:20.447031+0000","last_became_peered":"2024-05-08T19:22:20.447031+0000","last_unstale":"2024-05-08T19:49:40.674829+0000","last_undegraded":"2024-05-08T19:49:40.674829+0000","last_fullsized":"2024-05-08T19:49:40.674829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2289","last_scrub_stamp":"2024-05-08T19:49:40.674801+0000","last_deep_scrub":"26'2289","last_deep_scrub_stamp":"2024-05-08T19:49:40.674801+0000","last_clean_scrub_stamp":"2024-05-08T19:49:40.674801+0000","objects_scrubbed":0,"log_size":2289,"log_dups_size":0,"ondisk_log_size":2289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:32.813133+0000","scrub_duration":0.0022182759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"26'2353","reported_seq":2392,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:26.739531+0000","last_change":"2024-05-08T19:49:26.739665+0000","last_active":"2024-05-08T19:49:26.739531+0000","last_peered":"2024-05-08T19:49:26.739531+0000","last_clean":"2024-05-08T19:49:26.739531+0000","last_became_active":"2024-05-08T19:22:20.446803+0000","last_became_peered":"2024-05-08T19:22:20.446803+0000","last_unstale":"2024-05-08T19:49:26.739531+0000","last_undegraded":"2024-05-08T19:49:26.739531+0000","last_fullsized":"2024-05-08T19:49:26.739531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2353","last_scrub_stamp":"2024-05-08T19:49:26.739505+0000","last_deep_scrub":"26'2353","last_deep_scrub_stamp":"2024-05-08T19:49:26.739505+0000","last_clean_scrub_stamp":"2024-05-08T19:49:26.739505+0000","objects_scrubbed":0,"log_size":2353,"log_dups_size":0,"ondisk_log_size":2353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:14.678734+0000","scrub_duration":0.011528883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'2369","reported_seq":2408,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:19.718394+0000","last_change":"2024-05-08T19:49:19.718539+0000","last_active":"2024-05-08T19:49:19.718394+0000","last_peered":"2024-05-08T19:49:19.718394+0000","last_clean":"2024-05-08T19:49:19.718394+0000","last_became_active":"2024-05-08T19:22:20.461395+0000","last_became_peered":"2024-05-08T19:22:20.461395+0000","last_unstale":"2024-05-08T19:49:19.718394+0000","last_undegraded":"2024-05-08T19:49:19.718394+0000","last_fullsized":"2024-05-08T19:49:19.718394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2369","last_scrub_stamp":"2024-05-08T19:49:19.718358+0000","last_deep_scrub":"26'2369","last_deep_scrub_stamp":"2024-05-08T19:49:19.718358+0000","last_clean_scrub_stamp":"2024-05-08T19:49:19.718358+0000","objects_scrubbed":0,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:05.676957+0000","scrub_duration":0.0039461089999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"26'2237","reported_seq":2276,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:15.650434+0000","last_change":"2024-05-08T19:49:15.650556+0000","last_active":"2024-05-08T19:49:15.650434+0000","last_peered":"2024-05-08T19:49:15.650434+0000","last_clean":"2024-05-08T19:49:15.650434+0000","last_became_active":"2024-05-08T19:22:20.459253+0000","last_became_peered":"2024-05-08T19:22:20.459253+0000","last_unstale":"2024-05-08T19:49:15.650434+0000","last_undegraded":"2024-05-08T19:49:15.650434+0000","last_fullsized":"2024-05-08T19:49:15.650434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2237","last_scrub_stamp":"2024-05-08T19:49:15.650406+0000","last_deep_scrub":"26'2237","last_deep_scrub_stamp":"2024-05-08T19:49:15.650406+0000","last_clean_scrub_stamp":"2024-05-08T19:49:15.650406+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:15.160128+0000","scrub_duration":0.010753660999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"26'2223","reported_seq":2262,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:53.275993+0000","last_change":"2024-05-08T19:48:53.275993+0000","last_active":"2024-05-08T19:48:53.275993+0000","last_peered":"2024-05-08T19:48:53.275993+0000","last_clean":"2024-05-08T19:48:53.275993+0000","last_became_active":"2024-05-08T19:22:20.461852+0000","last_became_peered":"2024-05-08T19:22:20.461852+0000","last_unstale":"2024-05-08T19:48:53.275993+0000","last_undegraded":"2024-05-08T19:48:53.275993+0000","last_fullsized":"2024-05-08T19:48:53.275993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2223","last_scrub_stamp":"2024-05-08T19:48:53.275860+0000","last_deep_scrub":"26'2223","last_deep_scrub_stamp":"2024-05-08T19:48:53.275860+0000","last_clean_scrub_stamp":"2024-05-08T19:48:53.275860+0000","objects_scrubbed":0,"log_size":2223,"log_dups_size":0,"ondisk_log_size":2223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:11.565803+0000","scrub_duration":0.0016971060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"26'2273","reported_seq":2312,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.733749+0000","last_change":"2024-05-08T19:48:49.733749+0000","last_active":"2024-05-08T19:48:49.733749+0000","last_peered":"2024-05-08T19:48:49.733749+0000","last_clean":"2024-05-08T19:48:49.733749+0000","last_became_active":"2024-05-08T19:22:20.452884+0000","last_became_peered":"2024-05-08T19:22:20.452884+0000","last_unstale":"2024-05-08T19:48:49.733749+0000","last_undegraded":"2024-05-08T19:48:49.733749+0000","last_fullsized":"2024-05-08T19:48:49.733749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2273","last_scrub_stamp":"2024-05-08T19:48:49.733627+0000","last_deep_scrub":"26'2273","last_deep_scrub_stamp":"2024-05-08T19:48:49.733627+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.733627+0000","objects_scrubbed":0,"log_size":2273,"log_dups_size":0,"ondisk_log_size":2273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:35.123448+0000","scrub_duration":0.011898308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"26'2298","reported_seq":2337,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.685749+0000","last_change":"2024-05-08T19:48:54.685845+0000","last_active":"2024-05-08T19:48:54.685749+0000","last_peered":"2024-05-08T19:48:54.685749+0000","last_clean":"2024-05-08T19:48:54.685749+0000","last_became_active":"2024-05-08T19:22:20.435456+0000","last_became_peered":"2024-05-08T19:22:20.435456+0000","last_unstale":"2024-05-08T19:48:54.685749+0000","last_undegraded":"2024-05-08T19:48:54.685749+0000","last_fullsized":"2024-05-08T19:48:54.685749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2298","last_scrub_stamp":"2024-05-08T19:48:54.685720+0000","last_deep_scrub":"26'2298","last_deep_scrub_stamp":"2024-05-08T19:48:54.685720+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.685720+0000","objects_scrubbed":0,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:55.785082+0000","scrub_duration":0.0058416680000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"26'2373","reported_seq":2412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.575902+0000","last_change":"2024-05-08T19:48:40.575994+0000","last_active":"2024-05-08T19:48:40.575902+0000","last_peered":"2024-05-08T19:48:40.575902+0000","last_clean":"2024-05-08T19:48:40.575902+0000","last_became_active":"2024-05-08T19:22:20.444369+0000","last_became_peered":"2024-05-08T19:22:20.444369+0000","last_unstale":"2024-05-08T19:48:40.575902+0000","last_undegraded":"2024-05-08T19:48:40.575902+0000","last_fullsized":"2024-05-08T19:48:40.575902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2373","last_scrub_stamp":"2024-05-08T19:48:40.575879+0000","last_deep_scrub":"26'2373","last_deep_scrub_stamp":"2024-05-08T19:48:40.575879+0000","last_clean_scrub_stamp":"2024-05-08T19:48:40.575879+0000","objects_scrubbed":0,"log_size":2373,"log_dups_size":0,"ondisk_log_size":2373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:57.404103+0000","scrub_duration":0.0065170310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'2274","reported_seq":2313,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:34.270153+0000","last_change":"2024-05-08T19:49:34.270263+0000","last_active":"2024-05-08T19:49:34.270153+0000","last_peered":"2024-05-08T19:49:34.270153+0000","last_clean":"2024-05-08T19:49:34.270153+0000","last_became_active":"2024-05-08T19:22:20.444996+0000","last_became_peered":"2024-05-08T19:22:20.444996+0000","last_unstale":"2024-05-08T19:49:34.270153+0000","last_undegraded":"2024-05-08T19:49:34.270153+0000","last_fullsized":"2024-05-08T19:49:34.270153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2274","last_scrub_stamp":"2024-05-08T19:49:34.270126+0000","last_deep_scrub":"26'2274","last_deep_scrub_stamp":"2024-05-08T19:49:34.270126+0000","last_clean_scrub_stamp":"2024-05-08T19:49:34.270126+0000","objects_scrubbed":0,"log_size":2274,"log_dups_size":0,"ondisk_log_size":2274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:55.122097+0000","scrub_duration":0.002197629,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"26'2337","reported_seq":2376,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:04.327857+0000","last_change":"2024-05-08T19:49:04.327997+0000","last_active":"2024-05-08T19:49:04.327857+0000","last_peered":"2024-05-08T19:49:04.327857+0000","last_clean":"2024-05-08T19:49:04.327857+0000","last_became_active":"2024-05-08T19:22:20.450843+0000","last_became_peered":"2024-05-08T19:22:20.450843+0000","last_unstale":"2024-05-08T19:49:04.327857+0000","last_undegraded":"2024-05-08T19:49:04.327857+0000","last_fullsized":"2024-05-08T19:49:04.327857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2337","last_scrub_stamp":"2024-05-08T19:49:04.327828+0000","last_deep_scrub":"26'2337","last_deep_scrub_stamp":"2024-05-08T19:49:04.327828+0000","last_clean_scrub_stamp":"2024-05-08T19:49:04.327828+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:54.003812+0000","scrub_duration":0.025184673000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'2298","reported_seq":2337,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:52.831688+0000","last_change":"2024-05-08T19:48:52.831797+0000","last_active":"2024-05-08T19:48:52.831688+0000","last_peered":"2024-05-08T19:48:52.831688+0000","last_clean":"2024-05-08T19:48:52.831688+0000","last_became_active":"2024-05-08T19:22:20.462266+0000","last_became_peered":"2024-05-08T19:22:20.462266+0000","last_unstale":"2024-05-08T19:48:52.831688+0000","last_undegraded":"2024-05-08T19:48:52.831688+0000","last_fullsized":"2024-05-08T19:48:52.831688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2298","last_scrub_stamp":"2024-05-08T19:48:52.831661+0000","last_deep_scrub":"26'2298","last_deep_scrub_stamp":"2024-05-08T19:48:52.831661+0000","last_clean_scrub_stamp":"2024-05-08T19:48:52.831661+0000","objects_scrubbed":0,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:42.814623+0000","scrub_duration":0.0019874760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"26'2369","reported_seq":2398,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.892952+0000","last_change":"2024-05-08T19:22:20.454128+0000","last_active":"2024-05-08T19:48:41.892952+0000","last_peered":"2024-05-08T19:48:41.892952+0000","last_clean":"2024-05-08T19:48:41.892952+0000","last_became_active":"2024-05-08T19:22:20.453834+0000","last_became_peered":"2024-05-08T19:22:20.453834+0000","last_unstale":"2024-05-08T19:48:41.892952+0000","last_undegraded":"2024-05-08T19:48:41.892952+0000","last_fullsized":"2024-05-08T19:48:41.892952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"26'8922","reported_seq":8999,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:39.756405+0000","last_change":"2024-05-08T19:22:24.616532+0000","last_active":"2024-05-08T19:48:39.756405+0000","last_peered":"2024-05-08T19:48:39.756405+0000","last_clean":"2024-05-08T19:48:39.756405+0000","last_became_active":"2024-05-08T19:22:24.616128+0000","last_became_peered":"2024-05-08T19:22:24.616128+0000","last_unstale":"2024-05-08T19:48:39.756405+0000","last_undegraded":"2024-05-08T19:48:39.756405+0000","last_fullsized":"2024-05-08T19:48:39.756405+0000","mapping_epoch":22,"log_start":"26'2512","ondisk_log_start":"26'2512","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6410,"log_dups_size":0,"ondisk_log_size":6410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":3400,"num_write":6578,"num_write_kb":966197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"26'2352","reported_seq":2394,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:43.584133+0000","last_change":"2024-05-08T19:48:43.584133+0000","last_active":"2024-05-08T19:48:43.584133+0000","last_peered":"2024-05-08T19:48:43.584133+0000","last_clean":"2024-05-08T19:48:43.584133+0000","last_became_active":"2024-05-08T19:22:20.012453+0000","last_became_peered":"2024-05-08T19:22:20.012453+0000","last_unstale":"2024-05-08T19:48:43.584133+0000","last_undegraded":"2024-05-08T19:48:43.584133+0000","last_fullsized":"2024-05-08T19:48:43.584133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2352","last_scrub_stamp":"2024-05-08T19:48:43.583999+0000","last_deep_scrub":"26'2352","last_deep_scrub_stamp":"2024-05-08T19:48:43.583999+0000","last_clean_scrub_stamp":"2024-05-08T19:48:43.583999+0000","objects_scrubbed":3,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:26.944633+0000","scrub_duration":0.023303528,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2351,"num_write_kb":17974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":558,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'2321","reported_seq":2362,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:36.607795+0000","last_change":"2024-05-08T19:49:36.607902+0000","last_active":"2024-05-08T19:49:36.607795+0000","last_peered":"2024-05-08T19:49:36.607795+0000","last_clean":"2024-05-08T19:49:36.607795+0000","last_became_active":"2024-05-08T19:22:20.464396+0000","last_became_peered":"2024-05-08T19:22:20.464396+0000","last_unstale":"2024-05-08T19:49:36.607795+0000","last_undegraded":"2024-05-08T19:49:36.607795+0000","last_fullsized":"2024-05-08T19:49:36.607795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2321","last_scrub_stamp":"2024-05-08T19:49:36.607768+0000","last_deep_scrub":"26'2321","last_deep_scrub_stamp":"2024-05-08T19:49:36.607768+0000","last_clean_scrub_stamp":"2024-05-08T19:49:36.607768+0000","objects_scrubbed":0,"log_size":2321,"log_dups_size":0,"ondisk_log_size":2321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:44.163851+0000","scrub_duration":0.0083147129999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"26'8798","reported_seq":9477,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:56.284630+0000","last_change":"2024-05-08T19:48:56.284630+0000","last_active":"2024-05-08T19:48:56.284630+0000","last_peered":"2024-05-08T19:48:56.284630+0000","last_clean":"2024-05-08T19:48:56.284630+0000","last_became_active":"2024-05-08T19:22:24.469161+0000","last_became_peered":"2024-05-08T19:22:24.469161+0000","last_unstale":"2024-05-08T19:48:56.284630+0000","last_undegraded":"2024-05-08T19:48:56.284630+0000","last_fullsized":"2024-05-08T19:48:56.284630+0000","mapping_epoch":22,"log_start":"26'1644","ondisk_log_start":"26'1644","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8798","last_scrub_stamp":"2024-05-08T19:48:56.284453+0000","last_deep_scrub":"26'8798","last_deep_scrub_stamp":"2024-05-08T19:48:56.284453+0000","last_clean_scrub_stamp":"2024-05-08T19:48:56.284453+0000","objects_scrubbed":0,"log_size":7154,"log_dups_size":0,"ondisk_log_size":7154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:57.383815+0000","scrub_duration":0.029791432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":642,"num_read_kb":43100,"num_write":6354,"num_write_kb":920646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"26'8079","reported_seq":8121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:55.663978+0000","last_change":"2024-05-08T19:48:55.664080+0000","last_active":"2024-05-08T19:48:55.663978+0000","last_peered":"2024-05-08T19:48:55.663978+0000","last_clean":"2024-05-08T19:48:55.663978+0000","last_became_active":"2024-05-08T19:22:20.005723+0000","last_became_peered":"2024-05-08T19:22:20.005723+0000","last_unstale":"2024-05-08T19:48:55.663978+0000","last_undegraded":"2024-05-08T19:48:55.663978+0000","last_fullsized":"2024-05-08T19:48:55.663978+0000","mapping_epoch":17,"log_start":"26'1600","ondisk_log_start":"26'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8079","last_scrub_stamp":"2024-05-08T19:48:55.663952+0000","last_deep_scrub":"26'8079","last_deep_scrub_stamp":"2024-05-08T19:48:55.663952+0000","last_clean_scrub_stamp":"2024-05-08T19:48:55.663952+0000","objects_scrubbed":3,"log_size":6479,"log_dups_size":0,"ondisk_log_size":6479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:23.332609+0000","scrub_duration":0.048122591999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8075,"num_write_kb":50504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'2316","reported_seq":2357,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:42.569048+0000","last_change":"2024-05-08T19:48:42.569048+0000","last_active":"2024-05-08T19:48:42.569048+0000","last_peered":"2024-05-08T19:48:42.569048+0000","last_clean":"2024-05-08T19:48:42.569048+0000","last_became_active":"2024-05-08T19:22:20.446380+0000","last_became_peered":"2024-05-08T19:22:20.446380+0000","last_unstale":"2024-05-08T19:48:42.569048+0000","last_undegraded":"2024-05-08T19:48:42.569048+0000","last_fullsized":"2024-05-08T19:48:42.569048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2316","last_scrub_stamp":"2024-05-08T19:48:42.568919+0000","last_deep_scrub":"26'2316","last_deep_scrub_stamp":"2024-05-08T19:48:42.568919+0000","last_clean_scrub_stamp":"2024-05-08T19:48:42.568919+0000","objects_scrubbed":0,"log_size":2316,"log_dups_size":0,"ondisk_log_size":2316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:21.940168+0000","scrub_duration":0.017202281999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"26'8187","reported_seq":8827,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:34.299253+0000","last_change":"2024-05-08T19:49:34.299442+0000","last_active":"2024-05-08T19:49:34.299253+0000","last_peered":"2024-05-08T19:49:34.299253+0000","last_clean":"2024-05-08T19:49:34.299253+0000","last_became_active":"2024-05-08T19:22:24.464669+0000","last_became_peered":"2024-05-08T19:22:24.464669+0000","last_unstale":"2024-05-08T19:49:34.299253+0000","last_undegraded":"2024-05-08T19:49:34.299253+0000","last_fullsized":"2024-05-08T19:49:34.299253+0000","mapping_epoch":22,"log_start":"26'1003","ondisk_log_start":"26'1003","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8187","last_scrub_stamp":"2024-05-08T19:49:34.299227+0000","last_deep_scrub":"26'8187","last_deep_scrub_stamp":"2024-05-08T19:49:34.299227+0000","last_clean_scrub_stamp":"2024-05-08T19:49:34.299227+0000","objects_scrubbed":0,"log_size":7184,"log_dups_size":0,"ondisk_log_size":7184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:55.151198+0000","scrub_duration":0.025463639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":604,"num_read_kb":22018,"num_write":5721,"num_write_kb":861918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'9230","reported_seq":9269,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:06.001201+0000","last_change":"2024-05-08T19:49:06.001307+0000","last_active":"2024-05-08T19:49:06.001201+0000","last_peered":"2024-05-08T19:49:06.001201+0000","last_clean":"2024-05-08T19:49:06.001201+0000","last_became_active":"2024-05-08T19:22:20.014239+0000","last_became_peered":"2024-05-08T19:22:20.014239+0000","last_unstale":"2024-05-08T19:49:06.001201+0000","last_undegraded":"2024-05-08T19:49:06.001201+0000","last_fullsized":"2024-05-08T19:49:06.001201+0000","mapping_epoch":17,"log_start":"26'2400","ondisk_log_start":"26'2400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9230","last_scrub_stamp":"2024-05-08T19:49:06.001176+0000","last_deep_scrub":"26'9230","last_deep_scrub_stamp":"2024-05-08T19:49:06.001176+0000","last_clean_scrub_stamp":"2024-05-08T19:49:06.001176+0000","objects_scrubbed":4,"log_size":6830,"log_dups_size":0,"ondisk_log_size":6830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:51.390997+0000","scrub_duration":0.063126971000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":9240,"num_write_kb":71812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":103994,"num_omap_keys":158,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'2400","reported_seq":2432,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:09.940152+0000","last_change":"2024-05-08T19:49:09.940263+0000","last_active":"2024-05-08T19:49:09.940152+0000","last_peered":"2024-05-08T19:49:09.940152+0000","last_clean":"2024-05-08T19:49:09.940152+0000","last_became_active":"2024-05-08T19:23:11.054036+0000","last_became_peered":"2024-05-08T19:23:11.054036+0000","last_unstale":"2024-05-08T19:49:09.940152+0000","last_undegraded":"2024-05-08T19:49:09.940152+0000","last_fullsized":"2024-05-08T19:49:09.940152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2400","last_scrub_stamp":"2024-05-08T19:49:09.940123+0000","last_deep_scrub":"26'2400","last_deep_scrub_stamp":"2024-05-08T19:49:09.940123+0000","last_clean_scrub_stamp":"2024-05-08T19:49:09.940123+0000","objects_scrubbed":0,"log_size":2400,"log_dups_size":0,"ondisk_log_size":2400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:09.449845+0000","scrub_duration":0.0021755020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"26'8213","reported_seq":8491,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:03.258346+0000","last_change":"2024-05-08T19:49:03.258502+0000","last_active":"2024-05-08T19:49:03.258346+0000","last_peered":"2024-05-08T19:49:03.258346+0000","last_clean":"2024-05-08T19:49:03.258346+0000","last_became_active":"2024-05-08T19:22:24.479255+0000","last_became_peered":"2024-05-08T19:22:24.479255+0000","last_unstale":"2024-05-08T19:49:03.258346+0000","last_undegraded":"2024-05-08T19:49:03.258346+0000","last_fullsized":"2024-05-08T19:49:03.258346+0000","mapping_epoch":22,"log_start":"26'1000","ondisk_log_start":"26'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8213","last_scrub_stamp":"2024-05-08T19:49:03.258320+0000","last_deep_scrub":"26'8213","last_deep_scrub_stamp":"2024-05-08T19:49:03.258320+0000","last_clean_scrub_stamp":"2024-05-08T19:49:03.258320+0000","objects_scrubbed":0,"log_size":7213,"log_dups_size":0,"ondisk_log_size":7213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:52.934304+0000","scrub_duration":0.032424343000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":15390,"num_write":5835,"num_write_kb":1051850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6116","reported_seq":6155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.885993+0000","last_change":"2024-05-08T19:48:51.886082+0000","last_active":"2024-05-08T19:48:51.885993+0000","last_peered":"2024-05-08T19:48:51.885993+0000","last_clean":"2024-05-08T19:48:51.885993+0000","last_became_active":"2024-05-08T19:22:20.013793+0000","last_became_peered":"2024-05-08T19:22:20.013793+0000","last_unstale":"2024-05-08T19:48:51.885993+0000","last_undegraded":"2024-05-08T19:48:51.885993+0000","last_fullsized":"2024-05-08T19:48:51.885993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6116","last_scrub_stamp":"2024-05-08T19:48:51.885971+0000","last_deep_scrub":"26'6116","last_deep_scrub_stamp":"2024-05-08T19:48:51.885971+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.885971+0000","objects_scrubbed":2,"log_size":6116,"log_dups_size":0,"ondisk_log_size":6116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:56.172133+0000","scrub_duration":0.024158046999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6127,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":53996,"num_omap_keys":82,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'2307","reported_seq":2345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:22.107359+0000","last_change":"2024-05-08T19:49:22.107485+0000","last_active":"2024-05-08T19:49:22.107359+0000","last_peered":"2024-05-08T19:49:22.107359+0000","last_clean":"2024-05-08T19:49:22.107359+0000","last_became_active":"2024-05-08T19:22:20.455148+0000","last_became_peered":"2024-05-08T19:22:20.455148+0000","last_unstale":"2024-05-08T19:49:22.107359+0000","last_undegraded":"2024-05-08T19:49:22.107359+0000","last_fullsized":"2024-05-08T19:49:22.107359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2307","last_scrub_stamp":"2024-05-08T19:49:22.107331+0000","last_deep_scrub":"26'2307","last_deep_scrub_stamp":"2024-05-08T19:49:22.107331+0000","last_clean_scrub_stamp":"2024-05-08T19:49:22.107331+0000","objects_scrubbed":0,"log_size":2307,"log_dups_size":0,"ondisk_log_size":2307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:11.174690+0000","scrub_duration":0.0059349040000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"26'8426","reported_seq":9287,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.672405+0000","last_change":"2024-05-08T19:22:24.465009+0000","last_active":"2024-05-08T19:48:36.672405+0000","last_peered":"2024-05-08T19:48:36.672405+0000","last_clean":"2024-05-08T19:48:36.672405+0000","last_became_active":"2024-05-08T19:22:24.464422+0000","last_became_peered":"2024-05-08T19:22:24.464422+0000","last_unstale":"2024-05-08T19:48:36.672405+0000","last_undegraded":"2024-05-08T19:48:36.672405+0000","last_fullsized":"2024-05-08T19:48:36.672405+0000","mapping_epoch":22,"log_start":"26'2000","ondisk_log_start":"26'2000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6426,"log_dups_size":0,"ondisk_log_size":6426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":836,"num_read_kb":58598,"num_write":5984,"num_write_kb":988108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"26'8502","reported_seq":8541,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:00.593259+0000","last_change":"2024-05-08T19:49:00.593376+0000","last_active":"2024-05-08T19:49:00.593259+0000","last_peered":"2024-05-08T19:49:00.593259+0000","last_clean":"2024-05-08T19:49:00.593259+0000","last_became_active":"2024-05-08T19:22:20.011183+0000","last_became_peered":"2024-05-08T19:22:20.011183+0000","last_unstale":"2024-05-08T19:49:00.593259+0000","last_undegraded":"2024-05-08T19:49:00.593259+0000","last_fullsized":"2024-05-08T19:49:00.593259+0000","mapping_epoch":17,"log_start":"26'2100","ondisk_log_start":"26'2100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8502","last_scrub_stamp":"2024-05-08T19:49:00.593234+0000","last_deep_scrub":"26'8502","last_deep_scrub_stamp":"2024-05-08T19:49:00.593234+0000","last_clean_scrub_stamp":"2024-05-08T19:49:00.593234+0000","objects_scrubbed":1,"log_size":6402,"log_dups_size":0,"ondisk_log_size":6402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:58.280772+0000","scrub_duration":0.022856498999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8495,"num_write_kb":66920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'2343","reported_seq":2381,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:44.327490+0000","last_change":"2024-05-08T19:48:44.327587+0000","last_active":"2024-05-08T19:48:44.327490+0000","last_peered":"2024-05-08T19:48:44.327490+0000","last_clean":"2024-05-08T19:48:44.327490+0000","last_became_active":"2024-05-08T19:22:20.439096+0000","last_became_peered":"2024-05-08T19:22:20.439096+0000","last_unstale":"2024-05-08T19:48:44.327490+0000","last_undegraded":"2024-05-08T19:48:44.327490+0000","last_fullsized":"2024-05-08T19:48:44.327490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2343","last_scrub_stamp":"2024-05-08T19:48:44.327466+0000","last_deep_scrub":"26'2343","last_deep_scrub_stamp":"2024-05-08T19:48:44.327466+0000","last_clean_scrub_stamp":"2024-05-08T19:48:44.327466+0000","objects_scrubbed":0,"log_size":2343,"log_dups_size":0,"ondisk_log_size":2343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:23.698715+0000","scrub_duration":0.006452167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'8654","reported_seq":9396,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:55.867163+0000","last_change":"2024-05-08T19:48:55.867311+0000","last_active":"2024-05-08T19:48:55.867163+0000","last_peered":"2024-05-08T19:48:55.867163+0000","last_clean":"2024-05-08T19:48:55.867163+0000","last_became_active":"2024-05-08T19:23:11.529451+0000","last_became_peered":"2024-05-08T19:23:11.529451+0000","last_unstale":"2024-05-08T19:48:55.867163+0000","last_undegraded":"2024-05-08T19:48:55.867163+0000","last_fullsized":"2024-05-08T19:48:55.867163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8654","last_scrub_stamp":"2024-05-08T19:48:55.867135+0000","last_deep_scrub":"26'8654","last_deep_scrub_stamp":"2024-05-08T19:48:55.867135+0000","last_clean_scrub_stamp":"2024-05-08T19:48:55.867135+0000","objects_scrubbed":0,"log_size":8654,"log_dups_size":0,"ondisk_log_size":8654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:14.157078+0000","scrub_duration":0.021771672999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":696,"num_read_kb":42234,"num_write":6185,"num_write_kb":1013081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"26'10410","reported_seq":10450,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:46.696452+0000","last_change":"2024-05-08T19:48:46.696452+0000","last_active":"2024-05-08T19:48:46.696452+0000","last_peered":"2024-05-08T19:48:46.696452+0000","last_clean":"2024-05-08T19:48:46.696452+0000","last_became_active":"2024-05-08T19:22:20.003513+0000","last_became_peered":"2024-05-08T19:22:20.003513+0000","last_unstale":"2024-05-08T19:48:46.696452+0000","last_undegraded":"2024-05-08T19:48:46.696452+0000","last_fullsized":"2024-05-08T19:48:46.696452+0000","mapping_epoch":17,"log_start":"26'2500","ondisk_log_start":"26'2500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10410","last_scrub_stamp":"2024-05-08T19:48:46.696293+0000","last_deep_scrub":"26'10410","last_deep_scrub_stamp":"2024-05-08T19:48:46.696293+0000","last_clean_scrub_stamp":"2024-05-08T19:48:46.696293+0000","objects_scrubbed":2,"log_size":7910,"log_dups_size":0,"ondisk_log_size":7910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:59.423720+0000","scrub_duration":0.035260540999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10404,"num_write_kb":72564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'2281","reported_seq":2319,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.643324+0000","last_change":"2024-05-08T19:48:51.643437+0000","last_active":"2024-05-08T19:48:51.643324+0000","last_peered":"2024-05-08T19:48:51.643324+0000","last_clean":"2024-05-08T19:48:51.643324+0000","last_became_active":"2024-05-08T19:22:20.445238+0000","last_became_peered":"2024-05-08T19:22:20.445238+0000","last_unstale":"2024-05-08T19:48:51.643324+0000","last_undegraded":"2024-05-08T19:48:51.643324+0000","last_fullsized":"2024-05-08T19:48:51.643324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2281","last_scrub_stamp":"2024-05-08T19:48:51.643299+0000","last_deep_scrub":"26'2281","last_deep_scrub_stamp":"2024-05-08T19:48:51.643299+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.643299+0000","objects_scrubbed":0,"log_size":2281,"log_dups_size":0,"ondisk_log_size":2281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:09.933242+0000","scrub_duration":0.0060195379999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'8267","reported_seq":10736,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.361450+0000","last_change":"2024-05-08T19:22:24.479665+0000","last_active":"2024-05-08T19:48:41.361450+0000","last_peered":"2024-05-08T19:48:41.361450+0000","last_clean":"2024-05-08T19:48:41.361450+0000","last_became_active":"2024-05-08T19:22:24.478998+0000","last_became_peered":"2024-05-08T19:22:24.478998+0000","last_unstale":"2024-05-08T19:48:41.361450+0000","last_undegraded":"2024-05-08T19:48:41.361450+0000","last_fullsized":"2024-05-08T19:48:41.361450+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7967,"log_dups_size":0,"ondisk_log_size":7967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2441,"num_read_kb":165440,"num_write":5908,"num_write_kb":873319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"26'5852","reported_seq":5892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:08.600865+0000","last_change":"2024-05-08T19:49:08.600961+0000","last_active":"2024-05-08T19:49:08.600865+0000","last_peered":"2024-05-08T19:49:08.600865+0000","last_clean":"2024-05-08T19:49:08.600865+0000","last_became_active":"2024-05-08T19:22:20.002534+0000","last_became_peered":"2024-05-08T19:22:20.002534+0000","last_unstale":"2024-05-08T19:49:08.600865+0000","last_undegraded":"2024-05-08T19:49:08.600865+0000","last_fullsized":"2024-05-08T19:49:08.600865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5852","last_scrub_stamp":"2024-05-08T19:49:08.600840+0000","last_deep_scrub":"26'5852","last_deep_scrub_stamp":"2024-05-08T19:49:08.600840+0000","last_clean_scrub_stamp":"2024-05-08T19:49:08.600840+0000","objects_scrubbed":1,"log_size":5852,"log_dups_size":0,"ondisk_log_size":5852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:04.417043+0000","scrub_duration":0.024786341999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5849,"num_write_kb":40670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"26'2373","reported_seq":2412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:53.652188+0000","last_change":"2024-05-08T19:48:53.652188+0000","last_active":"2024-05-08T19:48:53.652188+0000","last_peered":"2024-05-08T19:48:53.652188+0000","last_clean":"2024-05-08T19:48:53.652188+0000","last_became_active":"2024-05-08T19:22:20.436431+0000","last_became_peered":"2024-05-08T19:22:20.436431+0000","last_unstale":"2024-05-08T19:48:53.652188+0000","last_undegraded":"2024-05-08T19:48:53.652188+0000","last_fullsized":"2024-05-08T19:48:53.652188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2373","last_scrub_stamp":"2024-05-08T19:48:53.652045+0000","last_deep_scrub":"26'2373","last_deep_scrub_stamp":"2024-05-08T19:48:53.652045+0000","last_clean_scrub_stamp":"2024-05-08T19:48:53.652045+0000","objects_scrubbed":0,"log_size":2373,"log_dups_size":0,"ondisk_log_size":2373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:53.161766+0000","scrub_duration":0.0018538879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'8472","reported_seq":9214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:34.756860+0000","last_change":"2024-05-08T19:49:34.757030+0000","last_active":"2024-05-08T19:49:34.756860+0000","last_peered":"2024-05-08T19:49:34.756860+0000","last_clean":"2024-05-08T19:49:34.756860+0000","last_became_active":"2024-05-08T19:22:24.617030+0000","last_became_peered":"2024-05-08T19:22:24.617030+0000","last_unstale":"2024-05-08T19:49:34.756860+0000","last_undegraded":"2024-05-08T19:49:34.756860+0000","last_fullsized":"2024-05-08T19:49:34.756860+0000","mapping_epoch":22,"log_start":"26'1302","ondisk_log_start":"26'1302","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8472","last_scrub_stamp":"2024-05-08T19:49:34.756829+0000","last_deep_scrub":"26'8472","last_deep_scrub_stamp":"2024-05-08T19:49:34.756829+0000","last_clean_scrub_stamp":"2024-05-08T19:49:34.756829+0000","objects_scrubbed":0,"log_size":7170,"log_dups_size":0,"ondisk_log_size":7170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:09.745219+0000","scrub_duration":0.025991957,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":49016,"num_write":6130,"num_write_kb":1037918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"26'9202","reported_seq":9242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:46.507455+0000","last_change":"2024-05-08T19:48:46.507455+0000","last_active":"2024-05-08T19:48:46.507455+0000","last_peered":"2024-05-08T19:48:46.507455+0000","last_clean":"2024-05-08T19:48:46.507455+0000","last_became_active":"2024-05-08T19:22:20.003365+0000","last_became_peered":"2024-05-08T19:22:20.003365+0000","last_unstale":"2024-05-08T19:48:46.507455+0000","last_undegraded":"2024-05-08T19:48:46.507455+0000","last_fullsized":"2024-05-08T19:48:46.507455+0000","mapping_epoch":17,"log_start":"26'1700","ondisk_log_start":"26'1700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9202","last_scrub_stamp":"2024-05-08T19:48:46.507282+0000","last_deep_scrub":"26'9202","last_deep_scrub_stamp":"2024-05-08T19:48:46.507282+0000","last_clean_scrub_stamp":"2024-05-08T19:48:46.507282+0000","objects_scrubbed":0,"log_size":7502,"log_dups_size":0,"ondisk_log_size":7502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:29.867916+0000","scrub_duration":0.0077823199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9189,"num_write_kb":63509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"26'2305","reported_seq":2344,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:00.639014+0000","last_change":"2024-05-08T19:49:00.639014+0000","last_active":"2024-05-08T19:49:00.639014+0000","last_peered":"2024-05-08T19:49:00.639014+0000","last_clean":"2024-05-08T19:49:00.639014+0000","last_became_active":"2024-05-08T19:22:20.437214+0000","last_became_peered":"2024-05-08T19:22:20.437214+0000","last_unstale":"2024-05-08T19:49:00.639014+0000","last_undegraded":"2024-05-08T19:49:00.639014+0000","last_fullsized":"2024-05-08T19:49:00.639014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2305","last_scrub_stamp":"2024-05-08T19:49:00.638891+0000","last_deep_scrub":"26'2305","last_deep_scrub_stamp":"2024-05-08T19:49:00.638891+0000","last_clean_scrub_stamp":"2024-05-08T19:49:00.638891+0000","objects_scrubbed":0,"log_size":2305,"log_dups_size":0,"ondisk_log_size":2305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.738253+0000","scrub_duration":0.0074742209999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"26'8428","reported_seq":8897,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.658615+0000","last_change":"2024-05-08T19:22:24.615730+0000","last_active":"2024-05-08T19:48:36.658615+0000","last_peered":"2024-05-08T19:48:36.658615+0000","last_clean":"2024-05-08T19:48:36.658615+0000","last_became_active":"2024-05-08T19:22:24.615351+0000","last_became_peered":"2024-05-08T19:22:24.615351+0000","last_unstale":"2024-05-08T19:48:36.658615+0000","last_undegraded":"2024-05-08T19:48:36.658615+0000","last_fullsized":"2024-05-08T19:48:36.658615+0000","mapping_epoch":22,"log_start":"26'2014","ondisk_log_start":"26'2014","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6414,"log_dups_size":0,"ondisk_log_size":6414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":19968,"num_write":5955,"num_write_kb":994501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"26'7043","reported_seq":7921,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.648311+0000","last_change":"2024-05-08T19:48:54.648311+0000","last_active":"2024-05-08T19:48:54.648311+0000","last_peered":"2024-05-08T19:48:54.648311+0000","last_clean":"2024-05-08T19:48:54.648311+0000","last_became_active":"2024-05-08T19:22:20.001990+0000","last_became_peered":"2024-05-08T19:22:20.001990+0000","last_unstale":"2024-05-08T19:48:54.648311+0000","last_undegraded":"2024-05-08T19:48:54.648311+0000","last_fullsized":"2024-05-08T19:48:54.648311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7043","last_scrub_stamp":"2024-05-08T19:48:54.648187+0000","last_deep_scrub":"26'7043","last_deep_scrub_stamp":"2024-05-08T19:48:54.648187+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.648187+0000","objects_scrubbed":2,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:58.934349+0000","scrub_duration":0.038308684000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":838,"num_read_kb":4635,"num_write":7034,"num_write_kb":49678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"26'2319","reported_seq":2358,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:08.220801+0000","last_change":"2024-05-08T19:49:08.220920+0000","last_active":"2024-05-08T19:49:08.220801+0000","last_peered":"2024-05-08T19:49:08.220801+0000","last_clean":"2024-05-08T19:49:08.220801+0000","last_became_active":"2024-05-08T19:22:20.447475+0000","last_became_peered":"2024-05-08T19:22:20.447475+0000","last_unstale":"2024-05-08T19:49:08.220801+0000","last_undegraded":"2024-05-08T19:49:08.220801+0000","last_fullsized":"2024-05-08T19:49:08.220801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2319","last_scrub_stamp":"2024-05-08T19:49:08.220776+0000","last_deep_scrub":"26'2319","last_deep_scrub_stamp":"2024-05-08T19:49:08.220776+0000","last_clean_scrub_stamp":"2024-05-08T19:49:08.220776+0000","objects_scrubbed":0,"log_size":2319,"log_dups_size":0,"ondisk_log_size":2319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:35.889432+0000","scrub_duration":0.005478826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'7961","reported_seq":8450,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.577762+0000","last_change":"2024-05-08T19:23:11.054182+0000","last_active":"2024-05-08T19:48:36.577762+0000","last_peered":"2024-05-08T19:48:36.577762+0000","last_clean":"2024-05-08T19:48:36.577762+0000","last_became_active":"2024-05-08T19:23:11.053733+0000","last_became_peered":"2024-05-08T19:23:11.053733+0000","last_unstale":"2024-05-08T19:48:36.577762+0000","last_undegraded":"2024-05-08T19:48:36.577762+0000","last_fullsized":"2024-05-08T19:48:36.577762+0000","mapping_epoch":25,"log_start":"26'1500","ondisk_log_start":"26'1500","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6461,"log_dups_size":0,"ondisk_log_size":6461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":453,"num_read_kb":17282,"num_write":5569,"num_write_kb":1020101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"26'6225","reported_seq":6265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:48.436975+0000","last_change":"2024-05-08T19:48:48.436975+0000","last_active":"2024-05-08T19:48:48.436975+0000","last_peered":"2024-05-08T19:48:48.436975+0000","last_clean":"2024-05-08T19:48:48.436975+0000","last_became_active":"2024-05-08T19:22:20.000981+0000","last_became_peered":"2024-05-08T19:22:20.000981+0000","last_unstale":"2024-05-08T19:48:48.436975+0000","last_undegraded":"2024-05-08T19:48:48.436975+0000","last_fullsized":"2024-05-08T19:48:48.436975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6225","last_scrub_stamp":"2024-05-08T19:48:48.436851+0000","last_deep_scrub":"26'6225","last_deep_scrub_stamp":"2024-05-08T19:48:48.436851+0000","last_clean_scrub_stamp":"2024-05-08T19:48:48.436851+0000","objects_scrubbed":1,"log_size":6225,"log_dups_size":0,"ondisk_log_size":6225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:52.723014+0000","scrub_duration":0.024176517000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6227,"num_write_kb":45123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"26'2337","reported_seq":2376,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:07.756473+0000","last_change":"2024-05-08T19:49:07.756598+0000","last_active":"2024-05-08T19:49:07.756473+0000","last_peered":"2024-05-08T19:49:07.756473+0000","last_clean":"2024-05-08T19:49:07.756473+0000","last_became_active":"2024-05-08T19:22:20.446644+0000","last_became_peered":"2024-05-08T19:22:20.446644+0000","last_unstale":"2024-05-08T19:49:07.756473+0000","last_undegraded":"2024-05-08T19:49:07.756473+0000","last_fullsized":"2024-05-08T19:49:07.756473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2337","last_scrub_stamp":"2024-05-08T19:49:07.756442+0000","last_deep_scrub":"26'2337","last_deep_scrub_stamp":"2024-05-08T19:49:07.756442+0000","last_clean_scrub_stamp":"2024-05-08T19:49:07.756442+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:28.707928+0000","scrub_duration":0.010132966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"26'8308","reported_seq":8840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:02.281238+0000","last_change":"2024-05-08T19:49:02.281396+0000","last_active":"2024-05-08T19:49:02.281238+0000","last_peered":"2024-05-08T19:49:02.281238+0000","last_clean":"2024-05-08T19:49:02.281238+0000","last_became_active":"2024-05-08T19:22:24.464178+0000","last_became_peered":"2024-05-08T19:22:24.464178+0000","last_unstale":"2024-05-08T19:49:02.281238+0000","last_undegraded":"2024-05-08T19:49:02.281238+0000","last_fullsized":"2024-05-08T19:49:02.281238+0000","mapping_epoch":22,"log_start":"26'1100","ondisk_log_start":"26'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8308","last_scrub_stamp":"2024-05-08T19:49:02.281211+0000","last_deep_scrub":"26'8308","last_deep_scrub_stamp":"2024-05-08T19:49:02.281211+0000","last_clean_scrub_stamp":"2024-05-08T19:49:02.281211+0000","objects_scrubbed":0,"log_size":7208,"log_dups_size":0,"ondisk_log_size":7208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:42.754921+0000","scrub_duration":0.025608511,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":27360,"num_write":5875,"num_write_kb":879779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'6730","reported_seq":6770,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:57.645430+0000","last_change":"2024-05-08T19:48:57.645543+0000","last_active":"2024-05-08T19:48:57.645430+0000","last_peered":"2024-05-08T19:48:57.645430+0000","last_clean":"2024-05-08T19:48:57.645430+0000","last_became_active":"2024-05-08T19:22:20.000985+0000","last_became_peered":"2024-05-08T19:22:20.000985+0000","last_unstale":"2024-05-08T19:48:57.645430+0000","last_undegraded":"2024-05-08T19:48:57.645430+0000","last_fullsized":"2024-05-08T19:48:57.645430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6730","last_scrub_stamp":"2024-05-08T19:48:57.645404+0000","last_deep_scrub":"26'6730","last_deep_scrub_stamp":"2024-05-08T19:48:57.645404+0000","last_clean_scrub_stamp":"2024-05-08T19:48:57.645404+0000","objects_scrubbed":4,"log_size":6730,"log_dups_size":0,"ondisk_log_size":6730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:15.935347+0000","scrub_duration":0.038479950999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":6744,"num_write_kb":41825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":41485,"num_omap_keys":63,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'2335","reported_seq":2374,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:47.378684+0000","last_change":"2024-05-08T19:48:47.378803+0000","last_active":"2024-05-08T19:48:47.378684+0000","last_peered":"2024-05-08T19:48:47.378684+0000","last_clean":"2024-05-08T19:48:47.378684+0000","last_became_active":"2024-05-08T19:22:20.447538+0000","last_became_peered":"2024-05-08T19:22:20.447538+0000","last_unstale":"2024-05-08T19:48:47.378684+0000","last_undegraded":"2024-05-08T19:48:47.378684+0000","last_fullsized":"2024-05-08T19:48:47.378684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2335","last_scrub_stamp":"2024-05-08T19:48:47.378653+0000","last_deep_scrub":"26'2335","last_deep_scrub_stamp":"2024-05-08T19:48:47.378653+0000","last_clean_scrub_stamp":"2024-05-08T19:48:47.378653+0000","objects_scrubbed":0,"log_size":2335,"log_dups_size":0,"ondisk_log_size":2335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:51.664816+0000","scrub_duration":0.0017606900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"26'8591","reported_seq":9145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:38.586463+0000","last_change":"2024-05-08T19:49:38.586637+0000","last_active":"2024-05-08T19:49:38.586463+0000","last_peered":"2024-05-08T19:49:38.586463+0000","last_clean":"2024-05-08T19:49:38.586463+0000","last_became_active":"2024-05-08T19:22:24.479071+0000","last_became_peered":"2024-05-08T19:22:24.479071+0000","last_unstale":"2024-05-08T19:49:38.586463+0000","last_undegraded":"2024-05-08T19:49:38.586463+0000","last_fullsized":"2024-05-08T19:49:38.586463+0000","mapping_epoch":22,"log_start":"26'1203","ondisk_log_start":"26'1203","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8591","last_scrub_stamp":"2024-05-08T19:49:38.586434+0000","last_deep_scrub":"26'8591","last_deep_scrub_stamp":"2024-05-08T19:49:38.586434+0000","last_clean_scrub_stamp":"2024-05-08T19:49:38.586434+0000","objects_scrubbed":0,"log_size":7388,"log_dups_size":0,"ondisk_log_size":7388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:59.438404+0000","scrub_duration":0.028133993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":517,"num_read_kb":30942,"num_write":6185,"num_write_kb":930944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'10879","reported_seq":11547,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.708511+0000","last_change":"2024-05-08T19:48:51.708629+0000","last_active":"2024-05-08T19:48:51.708511+0000","last_peered":"2024-05-08T19:48:51.708511+0000","last_clean":"2024-05-08T19:48:51.708511+0000","last_became_active":"2024-05-08T19:22:20.011331+0000","last_became_peered":"2024-05-08T19:22:20.011331+0000","last_unstale":"2024-05-08T19:48:51.708511+0000","last_undegraded":"2024-05-08T19:48:51.708511+0000","last_fullsized":"2024-05-08T19:48:51.708511+0000","mapping_epoch":17,"log_start":"26'2900","ondisk_log_start":"26'2900","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10879","last_scrub_stamp":"2024-05-08T19:48:51.708487+0000","last_deep_scrub":"26'10879","last_deep_scrub_stamp":"2024-05-08T19:48:51.708487+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.708487+0000","objects_scrubbed":6,"log_size":7979,"log_dups_size":0,"ondisk_log_size":7979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:31.079736+0000","scrub_duration":0.057288780999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":630,"num_read_kb":4505,"num_write":10869,"num_write_kb":72957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":113207,"num_omap_keys":172,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"26'2256","reported_seq":2284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.892919+0000","last_change":"2024-05-08T19:22:20.447583+0000","last_active":"2024-05-08T19:48:41.892919+0000","last_peered":"2024-05-08T19:48:41.892919+0000","last_clean":"2024-05-08T19:48:41.892919+0000","last_became_active":"2024-05-08T19:22:20.447243+0000","last_became_peered":"2024-05-08T19:22:20.447243+0000","last_unstale":"2024-05-08T19:48:41.892919+0000","last_undegraded":"2024-05-08T19:48:41.892919+0000","last_fullsized":"2024-05-08T19:48:41.892919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2256,"log_dups_size":0,"ondisk_log_size":2256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'8691","reported_seq":9094,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.829360+0000","last_change":"2024-05-08T19:22:24.615622+0000","last_active":"2024-05-08T19:48:40.829360+0000","last_peered":"2024-05-08T19:48:40.829360+0000","last_clean":"2024-05-08T19:48:40.829360+0000","last_became_active":"2024-05-08T19:22:24.614790+0000","last_became_peered":"2024-05-08T19:22:24.614790+0000","last_unstale":"2024-05-08T19:48:40.829360+0000","last_undegraded":"2024-05-08T19:48:40.829360+0000","last_fullsized":"2024-05-08T19:48:40.829360+0000","mapping_epoch":22,"log_start":"26'1126","ondisk_log_start":"26'1126","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7565,"log_dups_size":0,"ondisk_log_size":7565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":377,"num_read_kb":22514,"num_write":6361,"num_write_kb":865965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"26'5001","reported_seq":5041,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:45.598699+0000","last_change":"2024-05-08T19:48:45.598794+0000","last_active":"2024-05-08T19:48:45.598699+0000","last_peered":"2024-05-08T19:48:45.598699+0000","last_clean":"2024-05-08T19:48:45.598699+0000","last_became_active":"2024-05-08T19:22:20.005738+0000","last_became_peered":"2024-05-08T19:22:20.005738+0000","last_unstale":"2024-05-08T19:48:45.598699+0000","last_undegraded":"2024-05-08T19:48:45.598699+0000","last_fullsized":"2024-05-08T19:48:45.598699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5001","last_scrub_stamp":"2024-05-08T19:48:45.598671+0000","last_deep_scrub":"26'5001","last_deep_scrub_stamp":"2024-05-08T19:48:45.598671+0000","last_clean_scrub_stamp":"2024-05-08T19:48:45.598671+0000","objects_scrubbed":3,"log_size":5001,"log_dups_size":0,"ondisk_log_size":5001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:49.884833+0000","scrub_duration":0.024799128,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5000,"num_write_kb":36069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"26'2337","reported_seq":2376,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:05.739978+0000","last_change":"2024-05-08T19:49:05.740082+0000","last_active":"2024-05-08T19:49:05.739978+0000","last_peered":"2024-05-08T19:49:05.739978+0000","last_clean":"2024-05-08T19:49:05.739978+0000","last_became_active":"2024-05-08T19:22:20.448268+0000","last_became_peered":"2024-05-08T19:22:20.448268+0000","last_unstale":"2024-05-08T19:49:05.739978+0000","last_undegraded":"2024-05-08T19:49:05.739978+0000","last_fullsized":"2024-05-08T19:49:05.739978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2337","last_scrub_stamp":"2024-05-08T19:49:05.739949+0000","last_deep_scrub":"26'2337","last_deep_scrub_stamp":"2024-05-08T19:49:05.739949+0000","last_clean_scrub_stamp":"2024-05-08T19:49:05.739949+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:05.249670+0000","scrub_duration":0.0023711069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"26'8215","reported_seq":8340,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.604342+0000","last_change":"2024-05-08T19:22:24.614076+0000","last_active":"2024-05-08T19:48:36.604342+0000","last_peered":"2024-05-08T19:48:36.604342+0000","last_clean":"2024-05-08T19:48:36.604342+0000","last_became_active":"2024-05-08T19:22:24.613698+0000","last_became_peered":"2024-05-08T19:22:24.613698+0000","last_unstale":"2024-05-08T19:48:36.604342+0000","last_undegraded":"2024-05-08T19:48:36.604342+0000","last_fullsized":"2024-05-08T19:48:36.604342+0000","mapping_epoch":22,"log_start":"26'1759","ondisk_log_start":"26'1759","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6456,"log_dups_size":0,"ondisk_log_size":6456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":5304,"num_write":5835,"num_write_kb":1072126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'2641","reported_seq":2681,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:57.371355+0000","last_change":"2024-05-08T19:48:57.371495+0000","last_active":"2024-05-08T19:48:57.371355+0000","last_peered":"2024-05-08T19:48:57.371355+0000","last_clean":"2024-05-08T19:48:57.371355+0000","last_became_active":"2024-05-08T19:22:20.011188+0000","last_became_peered":"2024-05-08T19:22:20.011188+0000","last_unstale":"2024-05-08T19:48:57.371355+0000","last_undegraded":"2024-05-08T19:48:57.371355+0000","last_fullsized":"2024-05-08T19:48:57.371355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2641","last_scrub_stamp":"2024-05-08T19:48:57.371296+0000","last_deep_scrub":"26'2641","last_deep_scrub_stamp":"2024-05-08T19:48:57.371296+0000","last_clean_scrub_stamp":"2024-05-08T19:48:57.371296+0000","objects_scrubbed":1,"log_size":2641,"log_dups_size":0,"ondisk_log_size":2641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:58.470658+0000","scrub_duration":0.02237304,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2647,"num_write_kb":22132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'2373","reported_seq":2412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:42.845985+0000","last_change":"2024-05-08T19:48:42.846073+0000","last_active":"2024-05-08T19:48:42.845985+0000","last_peered":"2024-05-08T19:48:42.845985+0000","last_clean":"2024-05-08T19:48:42.845985+0000","last_became_active":"2024-05-08T19:22:20.455562+0000","last_became_peered":"2024-05-08T19:22:20.455562+0000","last_unstale":"2024-05-08T19:48:42.845985+0000","last_undegraded":"2024-05-08T19:48:42.845985+0000","last_fullsized":"2024-05-08T19:48:42.845985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2373","last_scrub_stamp":"2024-05-08T19:48:42.845961+0000","last_deep_scrub":"26'2373","last_deep_scrub_stamp":"2024-05-08T19:48:42.845961+0000","last_clean_scrub_stamp":"2024-05-08T19:48:42.845961+0000","objects_scrubbed":0,"log_size":2373,"log_dups_size":0,"ondisk_log_size":2373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:59.674185+0000","scrub_duration":0.0025479779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"26'8227","reported_seq":8405,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:39.756325+0000","last_change":"2024-05-08T19:22:24.616812+0000","last_active":"2024-05-08T19:48:39.756325+0000","last_peered":"2024-05-08T19:48:39.756325+0000","last_clean":"2024-05-08T19:48:39.756325+0000","last_became_active":"2024-05-08T19:22:24.615618+0000","last_became_peered":"2024-05-08T19:22:24.615618+0000","last_unstale":"2024-05-08T19:48:39.756325+0000","last_undegraded":"2024-05-08T19:48:39.756325+0000","last_fullsized":"2024-05-08T19:48:39.756325+0000","mapping_epoch":22,"log_start":"26'1815","ondisk_log_start":"26'1815","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6412,"log_dups_size":0,"ondisk_log_size":6412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":3194,"num_write":5725,"num_write_kb":833306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"26'3932","reported_seq":3972,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:44.648094+0000","last_change":"2024-05-08T19:48:44.648189+0000","last_active":"2024-05-08T19:48:44.648094+0000","last_peered":"2024-05-08T19:48:44.648094+0000","last_clean":"2024-05-08T19:48:44.648094+0000","last_became_active":"2024-05-08T19:22:20.003725+0000","last_became_peered":"2024-05-08T19:22:20.003725+0000","last_unstale":"2024-05-08T19:48:44.648094+0000","last_undegraded":"2024-05-08T19:48:44.648094+0000","last_fullsized":"2024-05-08T19:48:44.648094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3932","last_scrub_stamp":"2024-05-08T19:48:44.648068+0000","last_deep_scrub":"26'3932","last_deep_scrub_stamp":"2024-05-08T19:48:44.648068+0000","last_clean_scrub_stamp":"2024-05-08T19:48:44.648068+0000","objects_scrubbed":2,"log_size":3932,"log_dups_size":0,"ondisk_log_size":3932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:01.476291+0000","scrub_duration":0.034361632000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3928,"num_write_kb":31166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"26'2246","reported_seq":2285,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:04.571285+0000","last_change":"2024-05-08T19:49:04.571392+0000","last_active":"2024-05-08T19:49:04.571285+0000","last_peered":"2024-05-08T19:49:04.571285+0000","last_clean":"2024-05-08T19:49:04.571285+0000","last_became_active":"2024-05-08T19:22:20.452496+0000","last_became_peered":"2024-05-08T19:22:20.452496+0000","last_unstale":"2024-05-08T19:49:04.571285+0000","last_undegraded":"2024-05-08T19:49:04.571285+0000","last_fullsized":"2024-05-08T19:49:04.571285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2246","last_scrub_stamp":"2024-05-08T19:49:04.571260+0000","last_deep_scrub":"26'2246","last_deep_scrub_stamp":"2024-05-08T19:49:04.571260+0000","last_clean_scrub_stamp":"2024-05-08T19:49:04.571260+0000","objects_scrubbed":0,"log_size":2246,"log_dups_size":0,"ondisk_log_size":2246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:05.670622+0000","scrub_duration":0.00192366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"26'8446","reported_seq":9063,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:39.745460+0000","last_change":"2024-05-08T19:49:39.745636+0000","last_active":"2024-05-08T19:49:39.745460+0000","last_peered":"2024-05-08T19:49:39.745460+0000","last_clean":"2024-05-08T19:49:39.745460+0000","last_became_active":"2024-05-08T19:22:24.477728+0000","last_became_peered":"2024-05-08T19:22:24.477728+0000","last_unstale":"2024-05-08T19:49:39.745460+0000","last_undegraded":"2024-05-08T19:49:39.745460+0000","last_fullsized":"2024-05-08T19:49:39.745460+0000","mapping_epoch":22,"log_start":"26'1217","ondisk_log_start":"26'1217","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8446","last_scrub_stamp":"2024-05-08T19:49:39.745431+0000","last_deep_scrub":"26'8446","last_deep_scrub_stamp":"2024-05-08T19:49:39.745431+0000","last_clean_scrub_stamp":"2024-05-08T19:49:39.745431+0000","objects_scrubbed":0,"log_size":7229,"log_dups_size":0,"ondisk_log_size":7229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:39.208288+0000","scrub_duration":0.027670303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":39960,"num_write":6024,"num_write_kb":827712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"26'5273","reported_seq":5313,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:47.999042+0000","last_change":"2024-05-08T19:48:47.999179+0000","last_active":"2024-05-08T19:48:47.999042+0000","last_peered":"2024-05-08T19:48:47.999042+0000","last_clean":"2024-05-08T19:48:47.999042+0000","last_became_active":"2024-05-08T19:22:20.007985+0000","last_became_peered":"2024-05-08T19:22:20.007985+0000","last_unstale":"2024-05-08T19:48:47.999042+0000","last_undegraded":"2024-05-08T19:48:47.999042+0000","last_fullsized":"2024-05-08T19:48:47.999042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5273","last_scrub_stamp":"2024-05-08T19:48:47.999018+0000","last_deep_scrub":"26'5273","last_deep_scrub_stamp":"2024-05-08T19:48:47.999018+0000","last_clean_scrub_stamp":"2024-05-08T19:48:47.999018+0000","objects_scrubbed":9,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:31.359653+0000","scrub_duration":0.067476978000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":5295,"num_write_kb":36936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":463383,"num_omap_keys":704,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"26'2365","reported_seq":2404,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:43.835331+0000","last_change":"2024-05-08T19:48:43.835445+0000","last_active":"2024-05-08T19:48:43.835331+0000","last_peered":"2024-05-08T19:48:43.835331+0000","last_clean":"2024-05-08T19:48:43.835331+0000","last_became_active":"2024-05-08T19:22:20.458588+0000","last_became_peered":"2024-05-08T19:22:20.458588+0000","last_unstale":"2024-05-08T19:48:43.835331+0000","last_undegraded":"2024-05-08T19:48:43.835331+0000","last_fullsized":"2024-05-08T19:48:43.835331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2365","last_scrub_stamp":"2024-05-08T19:48:43.835306+0000","last_deep_scrub":"26'2365","last_deep_scrub_stamp":"2024-05-08T19:48:43.835306+0000","last_clean_scrub_stamp":"2024-05-08T19:48:43.835306+0000","objects_scrubbed":0,"log_size":2365,"log_dups_size":0,"ondisk_log_size":2365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:28.364339+0000","scrub_duration":0.001815826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"26'8533","reported_seq":10215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:22.144613+0000","last_change":"2024-05-08T19:49:22.144774+0000","last_active":"2024-05-08T19:49:22.144613+0000","last_peered":"2024-05-08T19:49:22.144613+0000","last_clean":"2024-05-08T19:49:22.144613+0000","last_became_active":"2024-05-08T19:22:24.463741+0000","last_became_peered":"2024-05-08T19:22:24.463741+0000","last_unstale":"2024-05-08T19:49:22.144613+0000","last_undegraded":"2024-05-08T19:49:22.144613+0000","last_fullsized":"2024-05-08T19:49:22.144613+0000","mapping_epoch":22,"log_start":"26'1304","ondisk_log_start":"26'1304","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8533","last_scrub_stamp":"2024-05-08T19:49:22.144585+0000","last_deep_scrub":"26'8533","last_deep_scrub_stamp":"2024-05-08T19:49:22.144585+0000","last_clean_scrub_stamp":"2024-05-08T19:49:22.144585+0000","objects_scrubbed":0,"log_size":7229,"log_dups_size":0,"ondisk_log_size":7229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:11.211944+0000","scrub_duration":0.020974245999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1644,"num_read_kb":83588,"num_write":6135,"num_write_kb":944540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"26'5914","reported_seq":5955,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.373290+0000","last_change":"2024-05-08T19:48:40.373290+0000","last_active":"2024-05-08T19:48:40.373290+0000","last_peered":"2024-05-08T19:48:40.373290+0000","last_clean":"2024-05-08T19:48:40.373290+0000","last_became_active":"2024-05-08T19:22:20.005680+0000","last_became_peered":"2024-05-08T19:22:20.005680+0000","last_unstale":"2024-05-08T19:48:40.373290+0000","last_undegraded":"2024-05-08T19:48:40.373290+0000","last_fullsized":"2024-05-08T19:48:40.373290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5914","last_scrub_stamp":"2024-05-08T19:48:40.373183+0000","last_deep_scrub":"26'5914","last_deep_scrub_stamp":"2024-05-08T19:48:40.373183+0000","last_clean_scrub_stamp":"2024-05-08T19:48:40.373183+0000","objects_scrubbed":3,"log_size":5914,"log_dups_size":0,"ondisk_log_size":5914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:53.100609+0000","scrub_duration":0.036371251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5920,"num_write_kb":40735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"26'2309","reported_seq":2349,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:11.899815+0000","last_change":"2024-05-08T19:49:11.899815+0000","last_active":"2024-05-08T19:49:11.899815+0000","last_peered":"2024-05-08T19:49:11.899815+0000","last_clean":"2024-05-08T19:49:11.899815+0000","last_became_active":"2024-05-08T19:22:20.449512+0000","last_became_peered":"2024-05-08T19:22:20.449512+0000","last_unstale":"2024-05-08T19:49:11.899815+0000","last_undegraded":"2024-05-08T19:49:11.899815+0000","last_fullsized":"2024-05-08T19:49:11.899815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2309","last_scrub_stamp":"2024-05-08T19:49:11.899665+0000","last_deep_scrub":"26'2309","last_deep_scrub_stamp":"2024-05-08T19:49:11.899665+0000","last_clean_scrub_stamp":"2024-05-08T19:49:11.899665+0000","objects_scrubbed":0,"log_size":2309,"log_dups_size":0,"ondisk_log_size":2309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:39.568321+0000","scrub_duration":0.0016931680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"26'8843","reported_seq":9140,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:25.551342+0000","last_change":"2024-05-08T19:49:25.551342+0000","last_active":"2024-05-08T19:49:25.551342+0000","last_peered":"2024-05-08T19:49:25.551342+0000","last_clean":"2024-05-08T19:49:25.551342+0000","last_became_active":"2024-05-08T19:22:24.478248+0000","last_became_peered":"2024-05-08T19:22:24.478248+0000","last_unstale":"2024-05-08T19:49:25.551342+0000","last_undegraded":"2024-05-08T19:49:25.551342+0000","last_fullsized":"2024-05-08T19:49:25.551342+0000","mapping_epoch":22,"log_start":"26'1512","ondisk_log_start":"26'1512","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8843","last_scrub_stamp":"2024-05-08T19:49:25.551173+0000","last_deep_scrub":"26'8843","last_deep_scrub_stamp":"2024-05-08T19:49:25.551173+0000","last_clean_scrub_stamp":"2024-05-08T19:49:25.551173+0000","objects_scrubbed":0,"log_size":7331,"log_dups_size":0,"ondisk_log_size":7331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:21.367377+0000","scrub_duration":0.025640639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":14826,"num_write":6450,"num_write_kb":856300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"26'7016","reported_seq":7058,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:48.585465+0000","last_change":"2024-05-08T19:48:48.585465+0000","last_active":"2024-05-08T19:48:48.585465+0000","last_peered":"2024-05-08T19:48:48.585465+0000","last_clean":"2024-05-08T19:48:48.585465+0000","last_became_active":"2024-05-08T19:22:20.003055+0000","last_became_peered":"2024-05-08T19:22:20.003055+0000","last_unstale":"2024-05-08T19:48:48.585465+0000","last_undegraded":"2024-05-08T19:48:48.585465+0000","last_fullsized":"2024-05-08T19:48:48.585465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7016","last_scrub_stamp":"2024-05-08T19:48:48.585336+0000","last_deep_scrub":"26'7016","last_deep_scrub_stamp":"2024-05-08T19:48:48.585336+0000","last_clean_scrub_stamp":"2024-05-08T19:48:48.585336+0000","objects_scrubbed":2,"log_size":7016,"log_dups_size":0,"ondisk_log_size":7016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.956585+0000","scrub_duration":0.041923031999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7021,"num_write_kb":53638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"26'2305","reported_seq":2346,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:45.486911+0000","last_change":"2024-05-08T19:48:45.486911+0000","last_active":"2024-05-08T19:48:45.486911+0000","last_peered":"2024-05-08T19:48:45.486911+0000","last_clean":"2024-05-08T19:48:45.486911+0000","last_became_active":"2024-05-08T19:22:20.449693+0000","last_became_peered":"2024-05-08T19:22:20.449693+0000","last_unstale":"2024-05-08T19:48:45.486911+0000","last_undegraded":"2024-05-08T19:48:45.486911+0000","last_fullsized":"2024-05-08T19:48:45.486911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2305","last_scrub_stamp":"2024-05-08T19:48:45.486775+0000","last_deep_scrub":"26'2305","last_deep_scrub_stamp":"2024-05-08T19:48:45.486775+0000","last_clean_scrub_stamp":"2024-05-08T19:48:45.486775+0000","objects_scrubbed":0,"log_size":2305,"log_dups_size":0,"ondisk_log_size":2305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:24.858024+0000","scrub_duration":0.0061246510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'8998","reported_seq":9182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:27.535597+0000","last_change":"2024-05-08T19:49:27.535597+0000","last_active":"2024-05-08T19:49:27.535597+0000","last_peered":"2024-05-08T19:49:27.535597+0000","last_clean":"2024-05-08T19:49:27.535597+0000","last_became_active":"2024-05-08T19:22:24.472518+0000","last_became_peered":"2024-05-08T19:22:24.472518+0000","last_unstale":"2024-05-08T19:49:27.535597+0000","last_undegraded":"2024-05-08T19:49:27.535597+0000","last_fullsized":"2024-05-08T19:49:27.535597+0000","mapping_epoch":22,"log_start":"26'1583","ondisk_log_start":"26'1583","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8998","last_scrub_stamp":"2024-05-08T19:49:27.535411+0000","last_deep_scrub":"26'8998","last_deep_scrub_stamp":"2024-05-08T19:49:27.535411+0000","last_clean_scrub_stamp":"2024-05-08T19:49:27.535411+0000","objects_scrubbed":0,"log_size":7415,"log_dups_size":0,"ondisk_log_size":7415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:15.474640+0000","scrub_duration":0.029089591000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":5460,"num_write":6563,"num_write_kb":1024036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"26'7864","reported_seq":7906,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.424101+0000","last_change":"2024-05-08T19:48:54.424101+0000","last_active":"2024-05-08T19:48:54.424101+0000","last_peered":"2024-05-08T19:48:54.424101+0000","last_clean":"2024-05-08T19:48:54.424101+0000","last_became_active":"2024-05-08T19:22:20.007542+0000","last_became_peered":"2024-05-08T19:22:20.007542+0000","last_unstale":"2024-05-08T19:48:54.424101+0000","last_undegraded":"2024-05-08T19:48:54.424101+0000","last_fullsized":"2024-05-08T19:48:54.424101+0000","mapping_epoch":17,"log_start":"26'300","ondisk_log_start":"26'300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7864","last_scrub_stamp":"2024-05-08T19:48:54.423939+0000","last_deep_scrub":"26'7864","last_deep_scrub_stamp":"2024-05-08T19:48:54.423939+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.423939+0000","objects_scrubbed":0,"log_size":7564,"log_dups_size":0,"ondisk_log_size":7564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:12.713883+0000","scrub_duration":0.007576635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7858,"num_write_kb":54448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'2322","reported_seq":2363,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.283508+0000","last_change":"2024-05-08T19:48:51.283508+0000","last_active":"2024-05-08T19:48:51.283508+0000","last_peered":"2024-05-08T19:48:51.283508+0000","last_clean":"2024-05-08T19:48:51.283508+0000","last_became_active":"2024-05-08T19:22:20.443049+0000","last_became_peered":"2024-05-08T19:22:20.443049+0000","last_unstale":"2024-05-08T19:48:51.283508+0000","last_undegraded":"2024-05-08T19:48:51.283508+0000","last_fullsized":"2024-05-08T19:48:51.283508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2322","last_scrub_stamp":"2024-05-08T19:48:51.283371+0000","last_deep_scrub":"26'2322","last_deep_scrub_stamp":"2024-05-08T19:48:51.283371+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.283371+0000","objects_scrubbed":0,"log_size":2322,"log_dups_size":0,"ondisk_log_size":2322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:41.266333+0000","scrub_duration":0.0034339180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"26'8111","reported_seq":9106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:05.878734+0000","last_change":"2024-05-08T19:49:05.878734+0000","last_active":"2024-05-08T19:49:05.878734+0000","last_peered":"2024-05-08T19:49:05.878734+0000","last_clean":"2024-05-08T19:49:05.878734+0000","last_became_active":"2024-05-08T19:23:11.532148+0000","last_became_peered":"2024-05-08T19:23:11.532148+0000","last_unstale":"2024-05-08T19:49:05.878734+0000","last_undegraded":"2024-05-08T19:49:05.878734+0000","last_fullsized":"2024-05-08T19:49:05.878734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8111","last_scrub_stamp":"2024-05-08T19:49:05.878535+0000","last_deep_scrub":"26'8111","last_deep_scrub_stamp":"2024-05-08T19:49:05.878535+0000","last_clean_scrub_stamp":"2024-05-08T19:49:05.878535+0000","objects_scrubbed":0,"log_size":8111,"log_dups_size":0,"ondisk_log_size":8111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:51.268356+0000","scrub_duration":0.036970507,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":959,"num_read_kb":67642,"num_write":5666,"num_write_kb":895823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'2313","reported_seq":2354,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:13.665463+0000","last_change":"2024-05-08T19:49:13.665588+0000","last_active":"2024-05-08T19:49:13.665463+0000","last_peered":"2024-05-08T19:49:13.665463+0000","last_clean":"2024-05-08T19:49:13.665463+0000","last_became_active":"2024-05-08T19:22:20.449709+0000","last_became_peered":"2024-05-08T19:22:20.449709+0000","last_unstale":"2024-05-08T19:49:13.665463+0000","last_undegraded":"2024-05-08T19:49:13.665463+0000","last_fullsized":"2024-05-08T19:49:13.665463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2313","last_scrub_stamp":"2024-05-08T19:49:13.665434+0000","last_deep_scrub":"26'2313","last_deep_scrub_stamp":"2024-05-08T19:49:13.665434+0000","last_clean_scrub_stamp":"2024-05-08T19:49:13.665434+0000","objects_scrubbed":0,"log_size":2313,"log_dups_size":0,"ondisk_log_size":2313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:59.624034+0000","scrub_duration":0.001892431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'7717","reported_seq":8694,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.096442+0000","last_change":"2024-05-08T19:48:40.096442+0000","last_active":"2024-05-08T19:48:40.096442+0000","last_peered":"2024-05-08T19:48:40.096442+0000","last_clean":"2024-05-08T19:48:40.096442+0000","last_became_active":"2024-05-08T19:22:20.004404+0000","last_became_peered":"2024-05-08T19:22:20.004404+0000","last_unstale":"2024-05-08T19:48:40.096442+0000","last_undegraded":"2024-05-08T19:48:40.096442+0000","last_fullsized":"2024-05-08T19:48:40.096442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7717","last_scrub_stamp":"2024-05-08T19:48:40.096323+0000","last_deep_scrub":"26'7717","last_deep_scrub_stamp":"2024-05-08T19:48:40.096323+0000","last_clean_scrub_stamp":"2024-05-08T19:48:40.096323+0000","objects_scrubbed":2,"log_size":7717,"log_dups_size":0,"ondisk_log_size":7717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:30.861928+0000","scrub_duration":0.037188867,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":935,"num_read_kb":4706,"num_write":7717,"num_write_kb":54235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"26'8484","reported_seq":9053,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:38.682638+0000","last_change":"2024-05-08T19:49:38.682638+0000","last_active":"2024-05-08T19:49:38.682638+0000","last_peered":"2024-05-08T19:49:38.682638+0000","last_clean":"2024-05-08T19:49:38.682638+0000","last_became_active":"2024-05-08T19:22:24.617627+0000","last_became_peered":"2024-05-08T19:22:24.617627+0000","last_unstale":"2024-05-08T19:49:38.682638+0000","last_undegraded":"2024-05-08T19:49:38.682638+0000","last_fullsized":"2024-05-08T19:49:38.682638+0000","mapping_epoch":22,"log_start":"26'574","ondisk_log_start":"26'574","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8484","last_scrub_stamp":"2024-05-08T19:49:38.682469+0000","last_deep_scrub":"26'8484","last_deep_scrub_stamp":"2024-05-08T19:49:38.682469+0000","last_clean_scrub_stamp":"2024-05-08T19:49:38.682469+0000","objects_scrubbed":0,"log_size":7910,"log_dups_size":0,"ondisk_log_size":7910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:47.622612+0000","scrub_duration":0.029399029,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":27006,"num_write":6146,"num_write_kb":958865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"26'2364","reported_seq":2405,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:30.494468+0000","last_change":"2024-05-08T19:49:30.494468+0000","last_active":"2024-05-08T19:49:30.494468+0000","last_peered":"2024-05-08T19:49:30.494468+0000","last_clean":"2024-05-08T19:49:30.494468+0000","last_became_active":"2024-05-08T19:22:20.446864+0000","last_became_peered":"2024-05-08T19:22:20.446864+0000","last_unstale":"2024-05-08T19:49:30.494468+0000","last_undegraded":"2024-05-08T19:49:30.494468+0000","last_fullsized":"2024-05-08T19:49:30.494468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2364","last_scrub_stamp":"2024-05-08T19:49:30.494328+0000","last_deep_scrub":"26'2364","last_deep_scrub_stamp":"2024-05-08T19:49:30.494328+0000","last_clean_scrub_stamp":"2024-05-08T19:49:30.494328+0000","objects_scrubbed":0,"log_size":2364,"log_dups_size":0,"ondisk_log_size":2364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:29.957185+0000","scrub_duration":0.002579989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'5126","reported_seq":5168,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:52.379727+0000","last_change":"2024-05-08T19:48:52.379727+0000","last_active":"2024-05-08T19:48:52.379727+0000","last_peered":"2024-05-08T19:48:52.379727+0000","last_clean":"2024-05-08T19:48:52.379727+0000","last_became_active":"2024-05-08T19:22:20.003441+0000","last_became_peered":"2024-05-08T19:22:20.003441+0000","last_unstale":"2024-05-08T19:48:52.379727+0000","last_undegraded":"2024-05-08T19:48:52.379727+0000","last_fullsized":"2024-05-08T19:48:52.379727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5126","last_scrub_stamp":"2024-05-08T19:48:52.379584+0000","last_deep_scrub":"26'5126","last_deep_scrub_stamp":"2024-05-08T19:48:52.379584+0000","last_clean_scrub_stamp":"2024-05-08T19:48:52.379584+0000","objects_scrubbed":0,"log_size":5126,"log_dups_size":0,"ondisk_log_size":5126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:42.362547+0000","scrub_duration":0.0049865459999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5120,"num_write_kb":36122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.898947+0000","last_change":"2024-05-08T19:48:49.899073+0000","last_active":"2024-05-08T19:48:49.898947+0000","last_peered":"2024-05-08T19:48:49.898947+0000","last_clean":"2024-05-08T19:48:49.898947+0000","last_became_active":"2024-05-08T19:22:17.116272+0000","last_became_peered":"2024-05-08T19:22:17.116272+0000","last_unstale":"2024-05-08T19:48:49.898947+0000","last_undegraded":"2024-05-08T19:48:49.898947+0000","last_fullsized":"2024-05-08T19:48:49.898947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-05-08T19:48:49.898920+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-05-08T19:48:49.898920+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.898920+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:35.156807+0000","scrub_duration":0.007153057,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'8661","reported_seq":8779,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:35.753923+0000","last_change":"2024-05-08T19:49:35.754095+0000","last_active":"2024-05-08T19:49:35.753923+0000","last_peered":"2024-05-08T19:49:35.753923+0000","last_clean":"2024-05-08T19:49:35.753923+0000","last_became_active":"2024-05-08T19:22:24.616486+0000","last_became_peered":"2024-05-08T19:22:24.616486+0000","last_unstale":"2024-05-08T19:49:35.753923+0000","last_undegraded":"2024-05-08T19:49:35.753923+0000","last_fullsized":"2024-05-08T19:49:35.753923+0000","mapping_epoch":22,"log_start":"26'1423","ondisk_log_start":"26'1423","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8661","last_scrub_stamp":"2024-05-08T19:49:35.753895+0000","last_deep_scrub":"26'8661","last_deep_scrub_stamp":"2024-05-08T19:49:35.753895+0000","last_clean_scrub_stamp":"2024-05-08T19:49:35.753895+0000","objects_scrubbed":0,"log_size":7238,"log_dups_size":0,"ondisk_log_size":7238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:07.603479+0000","scrub_duration":0.025977360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":5028,"num_write":6258,"num_write_kb":895883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"26'2257","reported_seq":2298,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:48.540554+0000","last_change":"2024-05-08T19:48:48.540554+0000","last_active":"2024-05-08T19:48:48.540554+0000","last_peered":"2024-05-08T19:48:48.540554+0000","last_clean":"2024-05-08T19:48:48.540554+0000","last_became_active":"2024-05-08T19:22:20.445191+0000","last_became_peered":"2024-05-08T19:22:20.445191+0000","last_unstale":"2024-05-08T19:48:48.540554+0000","last_undegraded":"2024-05-08T19:48:48.540554+0000","last_fullsized":"2024-05-08T19:48:48.540554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2257","last_scrub_stamp":"2024-05-08T19:48:48.540400+0000","last_deep_scrub":"26'2257","last_deep_scrub_stamp":"2024-05-08T19:48:48.540400+0000","last_clean_scrub_stamp":"2024-05-08T19:48:48.540400+0000","objects_scrubbed":0,"log_size":2257,"log_dups_size":0,"ondisk_log_size":2257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:38.523363+0000","scrub_duration":0.0020860969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'8076","reported_seq":8118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:50.921979+0000","last_change":"2024-05-08T19:48:50.922101+0000","last_active":"2024-05-08T19:48:50.921979+0000","last_peered":"2024-05-08T19:48:50.921979+0000","last_clean":"2024-05-08T19:48:50.921979+0000","last_became_active":"2024-05-08T19:22:20.015062+0000","last_became_peered":"2024-05-08T19:22:20.015062+0000","last_unstale":"2024-05-08T19:48:50.921979+0000","last_undegraded":"2024-05-08T19:48:50.921979+0000","last_fullsized":"2024-05-08T19:48:50.921979+0000","mapping_epoch":17,"log_start":"26'1200","ondisk_log_start":"26'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8076","last_scrub_stamp":"2024-05-08T19:48:50.921951+0000","last_deep_scrub":"26'8076","last_deep_scrub_stamp":"2024-05-08T19:48:50.921951+0000","last_clean_scrub_stamp":"2024-05-08T19:48:50.921951+0000","objects_scrubbed":1,"log_size":6876,"log_dups_size":0,"ondisk_log_size":6876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:09.690484+0000","scrub_duration":0.020418589000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8080,"num_write_kb":54571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'8514","reported_seq":9526,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:28.817546+0000","last_change":"2024-05-08T19:49:28.817546+0000","last_active":"2024-05-08T19:49:28.817546+0000","last_peered":"2024-05-08T19:49:28.817546+0000","last_clean":"2024-05-08T19:49:28.817546+0000","last_became_active":"2024-05-08T19:22:24.613661+0000","last_became_peered":"2024-05-08T19:22:24.613661+0000","last_unstale":"2024-05-08T19:49:28.817546+0000","last_undegraded":"2024-05-08T19:49:28.817546+0000","last_fullsized":"2024-05-08T19:49:28.817546+0000","mapping_epoch":22,"log_start":"26'1305","ondisk_log_start":"26'1305","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8514","last_scrub_stamp":"2024-05-08T19:49:28.817351+0000","last_deep_scrub":"26'8514","last_deep_scrub_stamp":"2024-05-08T19:49:28.817351+0000","last_clean_scrub_stamp":"2024-05-08T19:49:28.817351+0000","objects_scrubbed":0,"log_size":7209,"log_dups_size":0,"ondisk_log_size":7209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:28.244399+0000","scrub_duration":0.024666029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":973,"num_read_kb":68996,"num_write":6084,"num_write_kb":873899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"26'6281","reported_seq":6323,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.912365+0000","last_change":"2024-05-08T19:48:54.912365+0000","last_active":"2024-05-08T19:48:54.912365+0000","last_peered":"2024-05-08T19:48:54.912365+0000","last_clean":"2024-05-08T19:48:54.912365+0000","last_became_active":"2024-05-08T19:22:20.014926+0000","last_became_peered":"2024-05-08T19:22:20.014926+0000","last_unstale":"2024-05-08T19:48:54.912365+0000","last_undegraded":"2024-05-08T19:48:54.912365+0000","last_fullsized":"2024-05-08T19:48:54.912365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6281","last_scrub_stamp":"2024-05-08T19:48:54.912210+0000","last_deep_scrub":"26'6281","last_deep_scrub_stamp":"2024-05-08T19:48:54.912210+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.912210+0000","objects_scrubbed":2,"log_size":6281,"log_dups_size":0,"ondisk_log_size":6281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:44.895173+0000","scrub_duration":0.025468606000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7231304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6276,"num_write_kb":44046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"26'2390","reported_seq":2431,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:09.662714+0000","last_change":"2024-05-08T19:49:09.662714+0000","last_active":"2024-05-08T19:49:09.662714+0000","last_peered":"2024-05-08T19:49:09.662714+0000","last_clean":"2024-05-08T19:49:09.662714+0000","last_became_active":"2024-05-08T19:22:20.446194+0000","last_became_peered":"2024-05-08T19:22:20.446194+0000","last_unstale":"2024-05-08T19:49:09.662714+0000","last_undegraded":"2024-05-08T19:49:09.662714+0000","last_fullsized":"2024-05-08T19:49:09.662714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2390","last_scrub_stamp":"2024-05-08T19:49:09.662538+0000","last_deep_scrub":"26'2390","last_deep_scrub_stamp":"2024-05-08T19:49:09.662538+0000","last_clean_scrub_stamp":"2024-05-08T19:49:09.662538+0000","objects_scrubbed":0,"log_size":2390,"log_dups_size":0,"ondisk_log_size":2390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:59.338522+0000","scrub_duration":0.0077808970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'8362","reported_seq":8758,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:39.756356+0000","last_change":"2024-05-08T19:22:24.615481+0000","last_active":"2024-05-08T19:48:39.756356+0000","last_peered":"2024-05-08T19:48:39.756356+0000","last_clean":"2024-05-08T19:48:39.756356+0000","last_became_active":"2024-05-08T19:22:24.615069+0000","last_became_peered":"2024-05-08T19:22:24.615069+0000","last_unstale":"2024-05-08T19:48:39.756356+0000","last_undegraded":"2024-05-08T19:48:39.756356+0000","last_fullsized":"2024-05-08T19:48:39.756356+0000","mapping_epoch":22,"log_start":"26'1929","ondisk_log_start":"26'1929","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":6433,"log_dups_size":0,"ondisk_log_size":6433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":368,"num_read_kb":23786,"num_write":5985,"num_write_kb":964471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'5786","reported_seq":6318,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.662419+0000","last_change":"2024-05-08T19:48:51.662511+0000","last_active":"2024-05-08T19:48:51.662419+0000","last_peered":"2024-05-08T19:48:51.662419+0000","last_clean":"2024-05-08T19:48:51.662419+0000","last_became_active":"2024-05-08T19:22:20.001339+0000","last_became_peered":"2024-05-08T19:22:20.001339+0000","last_unstale":"2024-05-08T19:48:51.662419+0000","last_undegraded":"2024-05-08T19:48:51.662419+0000","last_fullsized":"2024-05-08T19:48:51.662419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5786","last_scrub_stamp":"2024-05-08T19:48:51.662392+0000","last_deep_scrub":"26'5786","last_deep_scrub_stamp":"2024-05-08T19:48:51.662392+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.662392+0000","objects_scrubbed":4,"log_size":5786,"log_dups_size":0,"ondisk_log_size":5786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:55.948554+0000","scrub_duration":0.063602542999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11721836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":3579,"num_write":6369,"num_write_kb":46119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"26'2254","reported_seq":2277,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:38.698795+0000","last_change":"2024-05-08T19:23:11.387164+0000","last_active":"2024-05-08T19:48:38.698795+0000","last_peered":"2024-05-08T19:48:38.698795+0000","last_clean":"2024-05-08T19:48:38.698795+0000","last_became_active":"2024-05-08T19:23:11.386882+0000","last_became_peered":"2024-05-08T19:23:11.386882+0000","last_unstale":"2024-05-08T19:48:38.698795+0000","last_undegraded":"2024-05-08T19:48:38.698795+0000","last_fullsized":"2024-05-08T19:48:38.698795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:19.981999+0000","last_clean_scrub_stamp":"2024-05-08T19:22:19.981999+0000","objects_scrubbed":0,"log_size":2254,"log_dups_size":0,"ondisk_log_size":2254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"26'8456","reported_seq":8898,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:21.124828+0000","last_change":"2024-05-08T19:49:21.124989+0000","last_active":"2024-05-08T19:49:21.124828+0000","last_peered":"2024-05-08T19:49:21.124828+0000","last_clean":"2024-05-08T19:49:21.124828+0000","last_became_active":"2024-05-08T19:22:24.614433+0000","last_became_peered":"2024-05-08T19:22:24.614433+0000","last_unstale":"2024-05-08T19:49:21.124828+0000","last_undegraded":"2024-05-08T19:49:21.124828+0000","last_fullsized":"2024-05-08T19:49:21.124828+0000","mapping_epoch":22,"log_start":"26'1215","ondisk_log_start":"26'1215","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8456","last_scrub_stamp":"2024-05-08T19:49:21.124800+0000","last_deep_scrub":"26'8456","last_deep_scrub_stamp":"2024-05-08T19:49:21.124800+0000","last_clean_scrub_stamp":"2024-05-08T19:49:21.124800+0000","objects_scrubbed":0,"log_size":7241,"log_dups_size":0,"ondisk_log_size":7241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:16.941004+0000","scrub_duration":0.031867547000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":403,"num_read_kb":32316,"num_write":6068,"num_write_kb":878068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'4080","reported_seq":4121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:52.662263+0000","last_change":"2024-05-08T19:48:52.662361+0000","last_active":"2024-05-08T19:48:52.662263+0000","last_peered":"2024-05-08T19:48:52.662263+0000","last_clean":"2024-05-08T19:48:52.662263+0000","last_became_active":"2024-05-08T19:22:20.012383+0000","last_became_peered":"2024-05-08T19:22:20.012383+0000","last_unstale":"2024-05-08T19:48:52.662263+0000","last_undegraded":"2024-05-08T19:48:52.662263+0000","last_fullsized":"2024-05-08T19:48:52.662263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4080","last_scrub_stamp":"2024-05-08T19:48:52.662236+0000","last_deep_scrub":"26'4080","last_deep_scrub_stamp":"2024-05-08T19:48:52.662236+0000","last_clean_scrub_stamp":"2024-05-08T19:48:52.662236+0000","objects_scrubbed":2,"log_size":4080,"log_dups_size":0,"ondisk_log_size":4080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:36.022871+0000","scrub_duration":0.026319581000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":4095,"num_write_kb":27507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":128316,"num_omap_keys":195,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'2300","reported_seq":2340,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:12.765796+0000","last_change":"2024-05-08T19:49:12.765909+0000","last_active":"2024-05-08T19:49:12.765796+0000","last_peered":"2024-05-08T19:49:12.765796+0000","last_clean":"2024-05-08T19:49:12.765796+0000","last_became_active":"2024-05-08T19:22:20.435680+0000","last_became_peered":"2024-05-08T19:22:20.435680+0000","last_unstale":"2024-05-08T19:49:12.765796+0000","last_undegraded":"2024-05-08T19:49:12.765796+0000","last_fullsized":"2024-05-08T19:49:12.765796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2300","last_scrub_stamp":"2024-05-08T19:49:12.765767+0000","last_deep_scrub":"26'2300","last_deep_scrub_stamp":"2024-05-08T19:49:12.765767+0000","last_clean_scrub_stamp":"2024-05-08T19:49:12.765767+0000","objects_scrubbed":0,"log_size":2300,"log_dups_size":0,"ondisk_log_size":2300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:10.453305+0000","scrub_duration":0.0051582390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"26'8822","reported_seq":9073,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:05.190347+0000","last_change":"2024-05-08T19:49:05.190347+0000","last_active":"2024-05-08T19:49:05.190347+0000","last_peered":"2024-05-08T19:49:05.190347+0000","last_clean":"2024-05-08T19:49:05.190347+0000","last_became_active":"2024-05-08T19:22:24.472782+0000","last_became_peered":"2024-05-08T19:22:24.472782+0000","last_unstale":"2024-05-08T19:49:05.190347+0000","last_undegraded":"2024-05-08T19:49:05.190347+0000","last_fullsized":"2024-05-08T19:49:05.190347+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8822","last_scrub_stamp":"2024-05-08T19:49:05.190154+0000","last_deep_scrub":"26'8822","last_deep_scrub_stamp":"2024-05-08T19:49:05.190154+0000","last_clean_scrub_stamp":"2024-05-08T19:49:05.190154+0000","objects_scrubbed":0,"log_size":7184,"log_dups_size":0,"ondisk_log_size":7184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:04.699875+0000","scrub_duration":0.032424166999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":12280,"num_write":6457,"num_write_kb":1036607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2847","reported_seq":2888,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:59.885624+0000","last_change":"2024-05-08T19:48:59.885784+0000","last_active":"2024-05-08T19:48:59.885624+0000","last_peered":"2024-05-08T19:48:59.885624+0000","last_clean":"2024-05-08T19:48:59.885624+0000","last_became_active":"2024-05-08T19:22:20.013739+0000","last_became_peered":"2024-05-08T19:22:20.013739+0000","last_unstale":"2024-05-08T19:48:59.885624+0000","last_undegraded":"2024-05-08T19:48:59.885624+0000","last_fullsized":"2024-05-08T19:48:59.885624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2847","last_scrub_stamp":"2024-05-08T19:48:59.885599+0000","last_deep_scrub":"26'2847","last_deep_scrub_stamp":"2024-05-08T19:48:59.885599+0000","last_clean_scrub_stamp":"2024-05-08T19:48:59.885599+0000","objects_scrubbed":2,"log_size":2847,"log_dups_size":0,"ondisk_log_size":2847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:00.984961+0000","scrub_duration":0.031388478999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2848,"num_write_kb":22358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"26'2333","reported_seq":2373,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:45.305790+0000","last_change":"2024-05-08T19:48:45.305902+0000","last_active":"2024-05-08T19:48:45.305790+0000","last_peered":"2024-05-08T19:48:45.305790+0000","last_clean":"2024-05-08T19:48:45.305790+0000","last_became_active":"2024-05-08T19:22:20.447180+0000","last_became_peered":"2024-05-08T19:22:20.447180+0000","last_unstale":"2024-05-08T19:48:45.305790+0000","last_undegraded":"2024-05-08T19:48:45.305790+0000","last_fullsized":"2024-05-08T19:48:45.305790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2333","last_scrub_stamp":"2024-05-08T19:48:45.305763+0000","last_deep_scrub":"26'2333","last_deep_scrub_stamp":"2024-05-08T19:48:45.305763+0000","last_clean_scrub_stamp":"2024-05-08T19:48:45.305763+0000","objects_scrubbed":0,"log_size":2333,"log_dups_size":0,"ondisk_log_size":2333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:28.666398+0000","scrub_duration":0.002168775,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"26'8924","reported_seq":9907,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:16.684917+0000","last_change":"2024-05-08T19:49:16.684917+0000","last_active":"2024-05-08T19:49:16.684917+0000","last_peered":"2024-05-08T19:49:16.684917+0000","last_clean":"2024-05-08T19:49:16.684917+0000","last_became_active":"2024-05-08T19:22:24.613677+0000","last_became_peered":"2024-05-08T19:22:24.613677+0000","last_unstale":"2024-05-08T19:49:16.684917+0000","last_undegraded":"2024-05-08T19:49:16.684917+0000","last_fullsized":"2024-05-08T19:49:16.684917+0000","mapping_epoch":22,"log_start":"26'1529","ondisk_log_start":"26'1529","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8924","last_scrub_stamp":"2024-05-08T19:49:16.684725+0000","last_deep_scrub":"26'8924","last_deep_scrub_stamp":"2024-05-08T19:49:16.684725+0000","last_clean_scrub_stamp":"2024-05-08T19:49:16.684725+0000","objects_scrubbed":0,"log_size":7395,"log_dups_size":0,"ondisk_log_size":7395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:14.372263+0000","scrub_duration":0.023951353000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":945,"num_read_kb":70780,"num_write":6622,"num_write_kb":1028558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"26'4275","reported_seq":4316,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.616175+0000","last_change":"2024-05-08T19:48:41.616298+0000","last_active":"2024-05-08T19:48:41.616175+0000","last_peered":"2024-05-08T19:48:41.616175+0000","last_clean":"2024-05-08T19:48:41.616175+0000","last_became_active":"2024-05-08T19:22:20.011262+0000","last_became_peered":"2024-05-08T19:22:20.011262+0000","last_unstale":"2024-05-08T19:48:41.616175+0000","last_undegraded":"2024-05-08T19:48:41.616175+0000","last_fullsized":"2024-05-08T19:48:41.616175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4275","last_scrub_stamp":"2024-05-08T19:48:41.616128+0000","last_deep_scrub":"26'4275","last_deep_scrub_stamp":"2024-05-08T19:48:41.616128+0000","last_clean_scrub_stamp":"2024-05-08T19:48:41.616128+0000","objects_scrubbed":2,"log_size":4275,"log_dups_size":0,"ondisk_log_size":4275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:26.145161+0000","scrub_duration":0.036942485999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4270,"num_write_kb":27446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"26'2429","reported_seq":2469,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:21.492196+0000","last_change":"2024-05-08T19:49:21.492325+0000","last_active":"2024-05-08T19:49:21.492196+0000","last_peered":"2024-05-08T19:49:21.492196+0000","last_clean":"2024-05-08T19:49:21.492196+0000","last_became_active":"2024-05-08T19:22:20.438434+0000","last_became_peered":"2024-05-08T19:22:20.438434+0000","last_unstale":"2024-05-08T19:49:21.492196+0000","last_undegraded":"2024-05-08T19:49:21.492196+0000","last_fullsized":"2024-05-08T19:49:21.492196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2429","last_scrub_stamp":"2024-05-08T19:49:21.492167+0000","last_deep_scrub":"26'2429","last_deep_scrub_stamp":"2024-05-08T19:49:21.492167+0000","last_clean_scrub_stamp":"2024-05-08T19:49:21.492167+0000","objects_scrubbed":0,"log_size":2429,"log_dups_size":0,"ondisk_log_size":2429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:42.344138+0000","scrub_duration":0.001928342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"26'8249","reported_seq":8526,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:12.166904+0000","last_change":"2024-05-08T19:49:12.166904+0000","last_active":"2024-05-08T19:49:12.166904+0000","last_peered":"2024-05-08T19:49:12.166904+0000","last_clean":"2024-05-08T19:49:12.166904+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:49:12.166904+0000","last_undegraded":"2024-05-08T19:49:12.166904+0000","last_fullsized":"2024-05-08T19:49:12.166904+0000","mapping_epoch":22,"log_start":"26'1106","ondisk_log_start":"26'1106","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8249","last_scrub_stamp":"2024-05-08T19:49:12.166734+0000","last_deep_scrub":"26'8249","last_deep_scrub_stamp":"2024-05-08T19:49:12.166734+0000","last_clean_scrub_stamp":"2024-05-08T19:49:12.166734+0000","objects_scrubbed":0,"log_size":7143,"log_dups_size":0,"ondisk_log_size":7143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:09.854272+0000","scrub_duration":0.028315160999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":13756,"num_write":5781,"num_write_kb":975965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"26'7372","reported_seq":7413,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.622314+0000","last_change":"2024-05-08T19:48:49.622415+0000","last_active":"2024-05-08T19:48:49.622314+0000","last_peered":"2024-05-08T19:48:49.622314+0000","last_clean":"2024-05-08T19:48:49.622314+0000","last_became_active":"2024-05-08T19:22:20.006772+0000","last_became_peered":"2024-05-08T19:22:20.006772+0000","last_unstale":"2024-05-08T19:48:49.622314+0000","last_undegraded":"2024-05-08T19:48:49.622314+0000","last_fullsized":"2024-05-08T19:48:49.622314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7372","last_scrub_stamp":"2024-05-08T19:48:49.622290+0000","last_deep_scrub":"26'7372","last_deep_scrub_stamp":"2024-05-08T19:48:49.622290+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.622290+0000","objects_scrubbed":3,"log_size":7372,"log_dups_size":0,"ondisk_log_size":7372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:32.982924+0000","scrub_duration":0.047389768999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7364,"num_write_kb":54049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"26'2338","reported_seq":2378,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:25.515130+0000","last_change":"2024-05-08T19:49:25.515384+0000","last_active":"2024-05-08T19:49:25.515130+0000","last_peered":"2024-05-08T19:49:25.515130+0000","last_clean":"2024-05-08T19:49:25.515130+0000","last_became_active":"2024-05-08T19:22:20.436373+0000","last_became_peered":"2024-05-08T19:22:20.436373+0000","last_unstale":"2024-05-08T19:49:25.515130+0000","last_undegraded":"2024-05-08T19:49:25.515130+0000","last_fullsized":"2024-05-08T19:49:25.515130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2338","last_scrub_stamp":"2024-05-08T19:49:25.515093+0000","last_deep_scrub":"26'2338","last_deep_scrub_stamp":"2024-05-08T19:49:25.515093+0000","last_clean_scrub_stamp":"2024-05-08T19:49:25.515093+0000","objects_scrubbed":0,"log_size":2338,"log_dups_size":0,"ondisk_log_size":2338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:16.883906+0000","scrub_duration":0.0075960410000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"26'8815","reported_seq":9456,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:09.138646+0000","last_change":"2024-05-08T19:49:09.138646+0000","last_active":"2024-05-08T19:49:09.138646+0000","last_peered":"2024-05-08T19:49:09.138646+0000","last_clean":"2024-05-08T19:49:09.138646+0000","last_became_active":"2024-05-08T19:22:24.477941+0000","last_became_peered":"2024-05-08T19:22:24.477941+0000","last_unstale":"2024-05-08T19:49:09.138646+0000","last_undegraded":"2024-05-08T19:49:09.138646+0000","last_fullsized":"2024-05-08T19:49:09.138646+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8815","last_scrub_stamp":"2024-05-08T19:49:09.138437+0000","last_deep_scrub":"26'8815","last_deep_scrub_stamp":"2024-05-08T19:49:09.138437+0000","last_clean_scrub_stamp":"2024-05-08T19:49:09.138437+0000","objects_scrubbed":0,"log_size":7177,"log_dups_size":0,"ondisk_log_size":7177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:55.097037+0000","scrub_duration":0.028237385,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":603,"num_read_kb":28586,"num_write":6338,"num_write_kb":901267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"26'6180","reported_seq":6221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:56.885764+0000","last_change":"2024-05-08T19:48:56.885764+0000","last_active":"2024-05-08T19:48:56.885764+0000","last_peered":"2024-05-08T19:48:56.885764+0000","last_clean":"2024-05-08T19:48:56.885764+0000","last_became_active":"2024-05-08T19:22:20.013748+0000","last_became_peered":"2024-05-08T19:22:20.013748+0000","last_unstale":"2024-05-08T19:48:56.885764+0000","last_undegraded":"2024-05-08T19:48:56.885764+0000","last_fullsized":"2024-05-08T19:48:56.885764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6180","last_scrub_stamp":"2024-05-08T19:48:56.885629+0000","last_deep_scrub":"26'6180","last_deep_scrub_stamp":"2024-05-08T19:48:56.885629+0000","last_clean_scrub_stamp":"2024-05-08T19:48:56.885629+0000","objects_scrubbed":1,"log_size":6180,"log_dups_size":0,"ondisk_log_size":6180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:15.175572+0000","scrub_duration":0.012091622,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6199,"num_write_kb":41171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":340,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"26'2344","reported_seq":2384,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:22.705949+0000","last_change":"2024-05-08T19:49:22.706063+0000","last_active":"2024-05-08T19:49:22.705949+0000","last_peered":"2024-05-08T19:49:22.705949+0000","last_clean":"2024-05-08T19:49:22.705949+0000","last_became_active":"2024-05-08T19:22:20.456850+0000","last_became_peered":"2024-05-08T19:22:20.456850+0000","last_unstale":"2024-05-08T19:49:22.705949+0000","last_undegraded":"2024-05-08T19:49:22.705949+0000","last_fullsized":"2024-05-08T19:49:22.705949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2344","last_scrub_stamp":"2024-05-08T19:49:22.705922+0000","last_deep_scrub":"26'2344","last_deep_scrub_stamp":"2024-05-08T19:49:22.705922+0000","last_clean_scrub_stamp":"2024-05-08T19:49:22.705922+0000","objects_scrubbed":0,"log_size":2344,"log_dups_size":0,"ondisk_log_size":2344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:20.393460+0000","scrub_duration":0.001675586,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"26'8417","reported_seq":8872,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:32.738412+0000","last_change":"2024-05-08T19:49:32.738553+0000","last_active":"2024-05-08T19:49:32.738412+0000","last_peered":"2024-05-08T19:49:32.738412+0000","last_clean":"2024-05-08T19:49:32.738412+0000","last_became_active":"2024-05-08T19:22:24.613904+0000","last_became_peered":"2024-05-08T19:22:24.613904+0000","last_unstale":"2024-05-08T19:49:32.738412+0000","last_undegraded":"2024-05-08T19:49:32.738412+0000","last_fullsized":"2024-05-08T19:49:32.738412+0000","mapping_epoch":22,"log_start":"26'512","ondisk_log_start":"26'512","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8417","last_scrub_stamp":"2024-05-08T19:49:32.738385+0000","last_deep_scrub":"26'8417","last_deep_scrub_stamp":"2024-05-08T19:49:32.738385+0000","last_clean_scrub_stamp":"2024-05-08T19:49:32.738385+0000","objects_scrubbed":0,"log_size":7905,"log_dups_size":0,"ondisk_log_size":7905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:21.805744+0000","scrub_duration":0.023639915000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":29592,"num_write":6013,"num_write_kb":842872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"26'8395","reported_seq":8436,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:47.025794+0000","last_change":"2024-05-08T19:48:47.025794+0000","last_active":"2024-05-08T19:48:47.025794+0000","last_peered":"2024-05-08T19:48:47.025794+0000","last_clean":"2024-05-08T19:48:47.025794+0000","last_became_active":"2024-05-08T19:22:20.000454+0000","last_became_peered":"2024-05-08T19:22:20.000454+0000","last_unstale":"2024-05-08T19:48:47.025794+0000","last_undegraded":"2024-05-08T19:48:47.025794+0000","last_fullsized":"2024-05-08T19:48:47.025794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8395","last_scrub_stamp":"2024-05-08T19:48:47.025662+0000","last_deep_scrub":"26'8395","last_deep_scrub_stamp":"2024-05-08T19:48:47.025662+0000","last_clean_scrub_stamp":"2024-05-08T19:48:47.025662+0000","objects_scrubbed":3,"log_size":8395,"log_dups_size":0,"ondisk_log_size":8395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:26.396911+0000","scrub_duration":0.054102984999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8388,"num_write_kb":54739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'2302","reported_seq":2342,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:09.930622+0000","last_change":"2024-05-08T19:49:09.930622+0000","last_active":"2024-05-08T19:49:09.930622+0000","last_peered":"2024-05-08T19:49:09.930622+0000","last_clean":"2024-05-08T19:49:09.930622+0000","last_became_active":"2024-05-08T19:22:20.456225+0000","last_became_peered":"2024-05-08T19:22:20.456225+0000","last_unstale":"2024-05-08T19:49:09.930622+0000","last_undegraded":"2024-05-08T19:49:09.930622+0000","last_fullsized":"2024-05-08T19:49:09.930622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2302","last_scrub_stamp":"2024-05-08T19:49:09.930485+0000","last_deep_scrub":"26'2302","last_deep_scrub_stamp":"2024-05-08T19:49:09.930485+0000","last_clean_scrub_stamp":"2024-05-08T19:49:09.930485+0000","objects_scrubbed":0,"log_size":2302,"log_dups_size":0,"ondisk_log_size":2302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:09.440206+0000","scrub_duration":0.0039543269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"26'8603","reported_seq":9435,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:32.789582+0000","last_change":"2024-05-08T19:49:32.789748+0000","last_active":"2024-05-08T19:49:32.789582+0000","last_peered":"2024-05-08T19:49:32.789582+0000","last_clean":"2024-05-08T19:49:32.789582+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:49:32.789582+0000","last_undegraded":"2024-05-08T19:49:32.789582+0000","last_fullsized":"2024-05-08T19:49:32.789582+0000","mapping_epoch":22,"log_start":"26'1458","ondisk_log_start":"26'1458","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8603","last_scrub_stamp":"2024-05-08T19:49:32.789546+0000","last_deep_scrub":"26'8603","last_deep_scrub_stamp":"2024-05-08T19:49:32.789546+0000","last_clean_scrub_stamp":"2024-05-08T19:49:32.789546+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:53.641516+0000","scrub_duration":0.019011726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":794,"num_read_kb":57832,"num_write":6099,"num_write_kb":1028205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'7807","reported_seq":7848,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:55.618256+0000","last_change":"2024-05-08T19:48:55.618256+0000","last_active":"2024-05-08T19:48:55.618256+0000","last_peered":"2024-05-08T19:48:55.618256+0000","last_clean":"2024-05-08T19:48:55.618256+0000","last_became_active":"2024-05-08T19:22:20.005996+0000","last_became_peered":"2024-05-08T19:22:20.005996+0000","last_unstale":"2024-05-08T19:48:55.618256+0000","last_undegraded":"2024-05-08T19:48:55.618256+0000","last_fullsized":"2024-05-08T19:48:55.618256+0000","mapping_epoch":17,"log_start":"26'400","ondisk_log_start":"26'400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7807","last_scrub_stamp":"2024-05-08T19:48:55.618119+0000","last_deep_scrub":"26'7807","last_deep_scrub_stamp":"2024-05-08T19:48:55.618119+0000","last_clean_scrub_stamp":"2024-05-08T19:48:55.618119+0000","objects_scrubbed":3,"log_size":7407,"log_dups_size":0,"ondisk_log_size":7407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:45.601081+0000","scrub_duration":0.038095381999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7797,"num_write_kb":54350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"26'2304","reported_seq":2344,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:21.094962+0000","last_change":"2024-05-08T19:49:21.095076+0000","last_active":"2024-05-08T19:49:21.094962+0000","last_peered":"2024-05-08T19:49:21.094962+0000","last_clean":"2024-05-08T19:49:21.094962+0000","last_became_active":"2024-05-08T19:22:20.452600+0000","last_became_peered":"2024-05-08T19:22:20.452600+0000","last_unstale":"2024-05-08T19:49:21.094962+0000","last_undegraded":"2024-05-08T19:49:21.094962+0000","last_fullsized":"2024-05-08T19:49:21.094962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2304","last_scrub_stamp":"2024-05-08T19:49:21.094936+0000","last_deep_scrub":"26'2304","last_deep_scrub_stamp":"2024-05-08T19:49:21.094936+0000","last_clean_scrub_stamp":"2024-05-08T19:49:21.094936+0000","objects_scrubbed":0,"log_size":2304,"log_dups_size":0,"ondisk_log_size":2304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:16.911139+0000","scrub_duration":0.0023665800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"26'8464","reported_seq":9181,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:36.672659+0000","last_change":"2024-05-08T19:22:24.614345+0000","last_active":"2024-05-08T19:48:36.672659+0000","last_peered":"2024-05-08T19:48:36.672659+0000","last_clean":"2024-05-08T19:48:36.672659+0000","last_became_active":"2024-05-08T19:22:24.613948+0000","last_became_peered":"2024-05-08T19:22:24.613948+0000","last_unstale":"2024-05-08T19:48:36.672659+0000","last_undegraded":"2024-05-08T19:48:36.672659+0000","last_fullsized":"2024-05-08T19:48:36.672659+0000","mapping_epoch":22,"log_start":"26'935","ondisk_log_start":"26'935","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T19:22:23.440344+0000","last_clean_scrub_stamp":"2024-05-08T19:22:23.440344+0000","objects_scrubbed":0,"log_size":7529,"log_dups_size":0,"ondisk_log_size":7529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":690,"num_read_kb":34094,"num_write":6014,"num_write_kb":938918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"26'9153","reported_seq":9194,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:42.086898+0000","last_change":"2024-05-08T19:48:42.086898+0000","last_active":"2024-05-08T19:48:42.086898+0000","last_peered":"2024-05-08T19:48:42.086898+0000","last_clean":"2024-05-08T19:48:42.086898+0000","last_became_active":"2024-05-08T19:22:20.004254+0000","last_became_peered":"2024-05-08T19:22:20.004254+0000","last_unstale":"2024-05-08T19:48:42.086898+0000","last_undegraded":"2024-05-08T19:48:42.086898+0000","last_fullsized":"2024-05-08T19:48:42.086898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9153","last_scrub_stamp":"2024-05-08T19:48:42.086788+0000","last_deep_scrub":"26'9153","last_deep_scrub_stamp":"2024-05-08T19:48:42.086788+0000","last_clean_scrub_stamp":"2024-05-08T19:48:42.086788+0000","objects_scrubbed":6,"log_size":9153,"log_dups_size":0,"ondisk_log_size":9153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:54.814215+0000","scrub_duration":0.069169347000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":9139,"num_write_kb":67371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73643,"num_omap_keys":112,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'2210","reported_seq":2250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:36.666544+0000","last_change":"2024-05-08T19:49:36.666663+0000","last_active":"2024-05-08T19:49:36.666544+0000","last_peered":"2024-05-08T19:49:36.666544+0000","last_clean":"2024-05-08T19:49:36.666544+0000","last_became_active":"2024-05-08T19:22:20.455493+0000","last_became_peered":"2024-05-08T19:22:20.455493+0000","last_unstale":"2024-05-08T19:49:36.666544+0000","last_undegraded":"2024-05-08T19:49:36.666544+0000","last_fullsized":"2024-05-08T19:49:36.666544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2210","last_scrub_stamp":"2024-05-08T19:49:36.666517+0000","last_deep_scrub":"26'2210","last_deep_scrub_stamp":"2024-05-08T19:49:36.666517+0000","last_clean_scrub_stamp":"2024-05-08T19:49:36.666517+0000","objects_scrubbed":0,"log_size":2210,"log_dups_size":0,"ondisk_log_size":2210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:57.518487+0000","scrub_duration":0.011239582999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"26'2266","reported_seq":2307,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:11.590212+0000","last_change":"2024-05-08T19:49:11.590212+0000","last_active":"2024-05-08T19:49:11.590212+0000","last_peered":"2024-05-08T19:49:11.590212+0000","last_clean":"2024-05-08T19:49:11.590212+0000","last_became_active":"2024-05-08T19:22:20.452169+0000","last_became_peered":"2024-05-08T19:22:20.452169+0000","last_unstale":"2024-05-08T19:49:11.590212+0000","last_undegraded":"2024-05-08T19:49:11.590212+0000","last_fullsized":"2024-05-08T19:49:11.590212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2266","last_scrub_stamp":"2024-05-08T19:49:11.590076+0000","last_deep_scrub":"26'2266","last_deep_scrub_stamp":"2024-05-08T19:49:11.590076+0000","last_clean_scrub_stamp":"2024-05-08T19:49:11.590076+0000","objects_scrubbed":0,"log_size":2266,"log_dups_size":0,"ondisk_log_size":2266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:56.979897+0000","scrub_duration":0.002202594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'2366","reported_seq":2407,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.894493+0000","last_change":"2024-05-08T19:48:49.894493+0000","last_active":"2024-05-08T19:48:49.894493+0000","last_peered":"2024-05-08T19:48:49.894493+0000","last_clean":"2024-05-08T19:48:49.894493+0000","last_became_active":"2024-05-08T19:22:20.449047+0000","last_became_peered":"2024-05-08T19:22:20.449047+0000","last_unstale":"2024-05-08T19:48:49.894493+0000","last_undegraded":"2024-05-08T19:48:49.894493+0000","last_fullsized":"2024-05-08T19:48:49.894493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2366","last_scrub_stamp":"2024-05-08T19:48:49.894367+0000","last_deep_scrub":"26'2366","last_deep_scrub_stamp":"2024-05-08T19:48:49.894367+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.894367+0000","objects_scrubbed":0,"log_size":2366,"log_dups_size":0,"ondisk_log_size":2366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:54.180529+0000","scrub_duration":0.004363408,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'2258","reported_seq":2299,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:13.120111+0000","last_change":"2024-05-08T19:49:13.120111+0000","last_active":"2024-05-08T19:49:13.120111+0000","last_peered":"2024-05-08T19:49:13.120111+0000","last_clean":"2024-05-08T19:49:13.120111+0000","last_became_active":"2024-05-08T19:22:20.451625+0000","last_became_peered":"2024-05-08T19:22:20.451625+0000","last_unstale":"2024-05-08T19:49:13.120111+0000","last_undegraded":"2024-05-08T19:49:13.120111+0000","last_fullsized":"2024-05-08T19:49:13.120111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2258","last_scrub_stamp":"2024-05-08T19:49:13.119914+0000","last_deep_scrub":"26'2258","last_deep_scrub_stamp":"2024-05-08T19:49:13.119914+0000","last_clean_scrub_stamp":"2024-05-08T19:49:13.119914+0000","objects_scrubbed":0,"log_size":2258,"log_dups_size":0,"ondisk_log_size":2258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:10.807452+0000","scrub_duration":0.0021343680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'2371","reported_seq":2420,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:20.789676+0000","last_change":"2024-05-08T19:49:20.789676+0000","last_active":"2024-05-08T19:49:20.789676+0000","last_peered":"2024-05-08T19:49:20.789676+0000","last_clean":"2024-05-08T19:49:20.789676+0000","last_became_active":"2024-05-08T19:23:11.053750+0000","last_became_peered":"2024-05-08T19:23:11.053750+0000","last_unstale":"2024-05-08T19:49:20.789676+0000","last_undegraded":"2024-05-08T19:49:20.789676+0000","last_fullsized":"2024-05-08T19:49:20.789676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2371","last_scrub_stamp":"2024-05-08T19:49:20.789483+0000","last_deep_scrub":"26'2371","last_deep_scrub_stamp":"2024-05-08T19:49:20.789483+0000","last_clean_scrub_stamp":"2024-05-08T19:49:20.789483+0000","objects_scrubbed":0,"log_size":2371,"log_dups_size":0,"ondisk_log_size":2371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:16.605686+0000","scrub_duration":0.0066788660000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'2321","reported_seq":2361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:09.585769+0000","last_change":"2024-05-08T19:49:09.585861+0000","last_active":"2024-05-08T19:49:09.585769+0000","last_peered":"2024-05-08T19:49:09.585769+0000","last_clean":"2024-05-08T19:49:09.585769+0000","last_became_active":"2024-05-08T19:22:20.444219+0000","last_became_peered":"2024-05-08T19:22:20.444219+0000","last_unstale":"2024-05-08T19:49:09.585769+0000","last_undegraded":"2024-05-08T19:49:09.585769+0000","last_fullsized":"2024-05-08T19:49:09.585769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2321","last_scrub_stamp":"2024-05-08T19:49:09.585741+0000","last_deep_scrub":"26'2321","last_deep_scrub_stamp":"2024-05-08T19:49:09.585741+0000","last_clean_scrub_stamp":"2024-05-08T19:49:09.585741+0000","objects_scrubbed":0,"log_size":2321,"log_dups_size":0,"ondisk_log_size":2321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:58.653100+0000","scrub_duration":0.00225486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'2227","reported_seq":2267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:12.673349+0000","last_change":"2024-05-08T19:49:12.673466+0000","last_active":"2024-05-08T19:49:12.673349+0000","last_peered":"2024-05-08T19:49:12.673349+0000","last_clean":"2024-05-08T19:49:12.673349+0000","last_became_active":"2024-05-08T19:22:20.436626+0000","last_became_peered":"2024-05-08T19:22:20.436626+0000","last_unstale":"2024-05-08T19:49:12.673349+0000","last_undegraded":"2024-05-08T19:49:12.673349+0000","last_fullsized":"2024-05-08T19:49:12.673349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2227","last_scrub_stamp":"2024-05-08T19:49:12.673320+0000","last_deep_scrub":"26'2227","last_deep_scrub_stamp":"2024-05-08T19:49:12.673320+0000","last_clean_scrub_stamp":"2024-05-08T19:49:12.673320+0000","objects_scrubbed":0,"log_size":2227,"log_dups_size":0,"ondisk_log_size":2227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:40.341977+0000","scrub_duration":0.014616664999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'2353","reported_seq":2393,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:31.733909+0000","last_change":"2024-05-08T19:49:31.734015+0000","last_active":"2024-05-08T19:49:31.733909+0000","last_peered":"2024-05-08T19:49:31.733909+0000","last_clean":"2024-05-08T19:49:31.733909+0000","last_became_active":"2024-05-08T19:22:20.461547+0000","last_became_peered":"2024-05-08T19:22:20.461547+0000","last_unstale":"2024-05-08T19:49:31.733909+0000","last_undegraded":"2024-05-08T19:49:31.733909+0000","last_fullsized":"2024-05-08T19:49:31.733909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2353","last_scrub_stamp":"2024-05-08T19:49:31.733880+0000","last_deep_scrub":"26'2353","last_deep_scrub_stamp":"2024-05-08T19:49:31.733880+0000","last_clean_scrub_stamp":"2024-05-08T19:49:31.733880+0000","objects_scrubbed":0,"log_size":2353,"log_dups_size":0,"ondisk_log_size":2353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:27.550083+0000","scrub_duration":0.001826301,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'2321","reported_seq":2361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:39.900372+0000","last_change":"2024-05-08T19:48:39.900526+0000","last_active":"2024-05-08T19:48:39.900372+0000","last_peered":"2024-05-08T19:48:39.900372+0000","last_clean":"2024-05-08T19:48:39.900372+0000","last_became_active":"2024-05-08T19:22:20.442667+0000","last_became_peered":"2024-05-08T19:22:20.442667+0000","last_unstale":"2024-05-08T19:48:39.900372+0000","last_undegraded":"2024-05-08T19:48:39.900372+0000","last_fullsized":"2024-05-08T19:48:39.900372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2321","last_scrub_stamp":"2024-05-08T19:48:39.900327+0000","last_deep_scrub":"26'2321","last_deep_scrub_stamp":"2024-05-08T19:48:39.900327+0000","last_clean_scrub_stamp":"2024-05-08T19:48:39.900327+0000","objects_scrubbed":0,"log_size":2321,"log_dups_size":0,"ondisk_log_size":2321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:58.190270+0000","scrub_duration":0.094527218999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'2280","reported_seq":2320,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:06.295790+0000","last_change":"2024-05-08T19:49:06.295922+0000","last_active":"2024-05-08T19:49:06.295790+0000","last_peered":"2024-05-08T19:49:06.295790+0000","last_clean":"2024-05-08T19:49:06.295790+0000","last_became_active":"2024-05-08T19:22:20.448449+0000","last_became_peered":"2024-05-08T19:22:20.448449+0000","last_unstale":"2024-05-08T19:49:06.295790+0000","last_undegraded":"2024-05-08T19:49:06.295790+0000","last_fullsized":"2024-05-08T19:49:06.295790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2280","last_scrub_stamp":"2024-05-08T19:49:06.295763+0000","last_deep_scrub":"26'2280","last_deep_scrub_stamp":"2024-05-08T19:49:06.295763+0000","last_clean_scrub_stamp":"2024-05-08T19:49:06.295763+0000","objects_scrubbed":0,"log_size":2280,"log_dups_size":0,"ondisk_log_size":2280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:05.805484+0000","scrub_duration":0.0022924019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'2285","reported_seq":2325,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:44.719448+0000","last_change":"2024-05-08T19:48:44.719448+0000","last_active":"2024-05-08T19:48:44.719448+0000","last_peered":"2024-05-08T19:48:44.719448+0000","last_clean":"2024-05-08T19:48:44.719448+0000","last_became_active":"2024-05-08T19:22:20.450217+0000","last_became_peered":"2024-05-08T19:22:20.450217+0000","last_unstale":"2024-05-08T19:48:44.719448+0000","last_undegraded":"2024-05-08T19:48:44.719448+0000","last_fullsized":"2024-05-08T19:48:44.719448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2285","last_scrub_stamp":"2024-05-08T19:48:44.719301+0000","last_deep_scrub":"26'2285","last_deep_scrub_stamp":"2024-05-08T19:48:44.719301+0000","last_clean_scrub_stamp":"2024-05-08T19:48:44.719301+0000","objects_scrubbed":0,"log_size":2285,"log_dups_size":0,"ondisk_log_size":2285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:52.389992+0000","scrub_duration":0.0035809150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'2324","reported_seq":2364,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:38.258851+0000","last_change":"2024-05-08T19:49:38.258963+0000","last_active":"2024-05-08T19:49:38.258851+0000","last_peered":"2024-05-08T19:49:38.258851+0000","last_clean":"2024-05-08T19:49:38.258851+0000","last_became_active":"2024-05-08T19:22:20.453191+0000","last_became_peered":"2024-05-08T19:22:20.453191+0000","last_unstale":"2024-05-08T19:49:38.258851+0000","last_undegraded":"2024-05-08T19:49:38.258851+0000","last_fullsized":"2024-05-08T19:49:38.258851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2324","last_scrub_stamp":"2024-05-08T19:49:38.258825+0000","last_deep_scrub":"26'2324","last_deep_scrub_stamp":"2024-05-08T19:49:38.258825+0000","last_clean_scrub_stamp":"2024-05-08T19:49:38.258825+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:29.627638+0000","scrub_duration":0.001776417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'2354","reported_seq":2394,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:22.790482+0000","last_change":"2024-05-08T19:49:22.790482+0000","last_active":"2024-05-08T19:49:22.790482+0000","last_peered":"2024-05-08T19:49:22.790482+0000","last_clean":"2024-05-08T19:49:22.790482+0000","last_became_active":"2024-05-08T19:22:20.451209+0000","last_became_peered":"2024-05-08T19:22:20.451209+0000","last_unstale":"2024-05-08T19:49:22.790482+0000","last_undegraded":"2024-05-08T19:49:22.790482+0000","last_fullsized":"2024-05-08T19:49:22.790482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2354","last_scrub_stamp":"2024-05-08T19:49:22.790353+0000","last_deep_scrub":"26'2354","last_deep_scrub_stamp":"2024-05-08T19:49:22.790353+0000","last_clean_scrub_stamp":"2024-05-08T19:49:22.790353+0000","objects_scrubbed":0,"log_size":2354,"log_dups_size":0,"ondisk_log_size":2354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:10.729582+0000","scrub_duration":0.0053609419999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'2352","reported_seq":2392,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:01.519510+0000","last_change":"2024-05-08T19:49:01.519510+0000","last_active":"2024-05-08T19:49:01.519510+0000","last_peered":"2024-05-08T19:49:01.519510+0000","last_clean":"2024-05-08T19:49:01.519510+0000","last_became_active":"2024-05-08T19:22:20.461097+0000","last_became_peered":"2024-05-08T19:22:20.461097+0000","last_unstale":"2024-05-08T19:49:01.519510+0000","last_undegraded":"2024-05-08T19:49:01.519510+0000","last_fullsized":"2024-05-08T19:49:01.519510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2352","last_scrub_stamp":"2024-05-08T19:49:01.519370+0000","last_deep_scrub":"26'2352","last_deep_scrub_stamp":"2024-05-08T19:49:01.519370+0000","last_clean_scrub_stamp":"2024-05-08T19:49:01.519370+0000","objects_scrubbed":0,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:19.809313+0000","scrub_duration":0.001891829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18592,"num_read_kb":1141288,"num_write":194903,"num_write_kb":30181748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230906,"ondisk_log_size":230906,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2442,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148135,"ondisk_log_size":148135,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":241252722,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":2935,"num_read_kb":17425,"num_write":211935,"num_write_kb":1497715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":983922,"num_omap_keys":1498,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":323821568,"data_stored":482505444,"data_compressed":47939648,"data_compressed_allocated":70770688,"data_compressed_original":229515264,"omap_allocated":0,"internal_metadata":0},"log_size":196256,"ondisk_log_size":196256,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575179,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":901808,"kb_used_data":36392,"kb_used_omap":1,"kb_used_meta":865406,"kb_avail":93470032,"statfs":{"total":96636764160,"available":95713312768,"internally_reserved":0,"allocated":37265408,"data_stored":58267643,"data_compressed":5895427,"data_compressed_allocated":8474624,"data_compressed_original":29650944,"omap_allocated":1588,"internal_metadata":886176204},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.7290000000000001,"5min":2.153,"15min":1.4990000000000001},"min":{"1min":0.247,"5min":0.216,"15min":0.20699999999999999},"max":{"1min":13.09,"5min":26.544,"15min":26.544},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.7270000000000001,"5min":2.0529999999999999,"15min":1.7729999999999999},"min":{"1min":0.31900000000000001,"5min":0.27800000000000002,"15min":0.223},"max":{"1min":12.454000000000001,"5min":26.713999999999999,"15min":26.713999999999999},"last":0.58499999999999996}]},{"osd":1,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":2.0600000000000001,"15min":1.982},"min":{"1min":0.27800000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":8.9480000000000004,"5min":14.557,"15min":32.259999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.599,"5min":2.0699999999999998,"15min":1.6259999999999999},"min":{"1min":0.28499999999999998,"5min":0.251,"15min":0.25},"max":{"1min":6.7190000000000003,"5min":21.867000000000001,"15min":36.018000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":2.1629999999999998,"15min":1.5169999999999999},"min":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":10.959,"5min":13.635,"15min":13.635},"last":0.61299999999999999},{"interface":"front","average":{"1min":2.2810000000000001,"5min":2.3239999999999998,"15min":1.827},"min":{"1min":0.34300000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":19.231000000000002,"5min":19.469999999999999,"15min":19.469999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":3.9630000000000001,"5min":2.6520000000000001,"15min":1.8720000000000001},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.29299999999999998},"max":{"1min":38.195,"5min":38.195,"15min":38.195},"last":0.629},{"interface":"front","average":{"1min":2.1269999999999998,"5min":1.996,"15min":1.806},"min":{"1min":0.373,"5min":0.33800000000000002,"15min":0.30599999999999999},"max":{"1min":14.134,"5min":14.134,"15min":26.501999999999999},"last":0.51700000000000002}]},{"osd":4,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":2.2000000000000002,"15min":1.677},"min":{"1min":0.30599999999999999,"5min":0.26600000000000001,"15min":0.26100000000000001},"max":{"1min":9.2289999999999992,"5min":37.356000000000002,"15min":37.356000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.319,"5min":2.5449999999999999,"15min":1.7450000000000001},"min":{"1min":0.35799999999999998,"5min":0.253,"15min":0.253},"max":{"1min":5.9950000000000001,"5min":31.786000000000001,"15min":31.786000000000001},"last":0.439}]},{"osd":5,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":2.2440000000000002,"15min":1.8120000000000001},"min":{"1min":0.33000000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":4.6079999999999997,"5min":29.346,"15min":35.156999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.73,"15min":1.349},"min":{"1min":0.36699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":10.848000000000001,"5min":10.848000000000001,"15min":32.988999999999997},"last":0.48199999999999998}]},{"osd":6,"last update":"Wed May 8 19:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.681,"5min":1.7969999999999999,"15min":1.5089999999999999},"min":{"1min":0.42799999999999999,"5min":0.315,"15min":0.308},"max":{"1min":7.9089999999999998,"5min":13.763,"15min":16.077999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":2.2799999999999998,"5min":1.962,"15min":1.605},"min":{"1min":0.45700000000000002,"5min":0.308,"15min":0.27500000000000002},"max":{"1min":28.535,"5min":28.535,"15min":28.535},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575178,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1085188,"kb_used_data":49212,"kb_used_omap":1,"kb_used_meta":1035966,"kb_avail":93286652,"statfs":{"total":96636764160,"available":95525531648,"internally_reserved":0,"allocated":50393088,"data_stored":74750809,"data_compressed":7372511,"data_compressed_allocated":10829824,"data_compressed_original":35360768,"omap_allocated":1593,"internal_metadata":1060829639},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":1.9470000000000001,"15min":1.4810000000000001},"min":{"1min":0.27200000000000002,"5min":0.192,"15min":0.192},"max":{"1min":3.5470000000000002,"5min":17.488,"15min":17.488},"last":0.439},{"interface":"front","average":{"1min":1.679,"5min":2.9009999999999998,"15min":1.962},"min":{"1min":0.313,"5min":0.26400000000000001,"15min":0.245},"max":{"1min":12.345000000000001,"5min":37.295999999999999,"15min":37.295999999999999},"last":0.628}]},{"osd":1,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":2.8010000000000002,"15min":1.954},"min":{"1min":0.28100000000000003,"5min":0.26200000000000001,"15min":0.22800000000000001},"max":{"1min":24.649999999999999,"5min":24.649999999999999,"15min":24.649999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":2.6840000000000002,"15min":1.9219999999999999},"min":{"1min":0.313,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":12.154999999999999,"5min":37.521000000000001,"15min":37.521000000000001},"last":0.40600000000000003}]},{"osd":2,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":2.867,"15min":1.931},"min":{"1min":0.41799999999999998,"5min":0.313,"15min":0.247},"max":{"1min":6.9130000000000003,"5min":23.952999999999999,"15min":23.952999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":2.359,"5min":2.528,"15min":1.786},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.255},"max":{"1min":24.614999999999998,"5min":24.614999999999998,"15min":24.614999999999998},"last":0.45100000000000001}]},{"osd":3,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":2.448,"15min":2.0150000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.25800000000000001},"max":{"1min":8.3719999999999999,"5min":21.975000000000001,"15min":43.082999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":1.512,"5min":2.8460000000000001,"15min":2.177},"min":{"1min":0.437,"5min":0.35299999999999998,"15min":0.30399999999999999},"max":{"1min":7.4329999999999998,"5min":23.859000000000002,"15min":43.872999999999998},"last":0.57399999999999995}]},{"osd":4,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":2.6269999999999998,"15min":2.363},"min":{"1min":0.27800000000000002,"5min":0.26500000000000001,"15min":0.26200000000000001},"max":{"1min":7.4500000000000002,"5min":22.302,"15min":111.04900000000001},"last":0.29199999999999998},{"interface":"front","average":{"1min":1.6020000000000001,"5min":2.7730000000000001,"15min":1.8169999999999999},"min":{"1min":0.32200000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.8319999999999999,"5min":28.757999999999999,"15min":28.757999999999999},"last":0.499}]},{"osd":5,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":3.161,"5min":2.492,"15min":1.776},"min":{"1min":0.311,"5min":0.309,"15min":0.251},"max":{"1min":24.550999999999998,"5min":24.550999999999998,"15min":39.134},"last":0.42499999999999999},{"interface":"front","average":{"1min":4.7690000000000001,"5min":3.1259999999999999,"15min":2.2879999999999998},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":89.531999999999996,"5min":89.531999999999996,"15min":89.531999999999996},"last":0.33300000000000002}]},{"osd":7,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":2.609,"5min":2.7389999999999999,"15min":1.7529999999999999},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":27.448,"5min":27.448,"15min":27.448},"last":0.59899999999999998},{"interface":"front","average":{"1min":2.274,"5min":1.9610000000000001,"15min":1.5609999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":24.588999999999999,"5min":24.588999999999999,"15min":24.588999999999999},"last":0.38300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575178,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1188576,"kb_used_data":52632,"kb_used_omap":1,"kb_used_meta":1135934,"kb_avail":93183264,"statfs":{"total":96636764160,"available":95419662336,"internally_reserved":0,"allocated":53895168,"data_stored":78944601,"data_compressed":7659770,"data_compressed_allocated":11517952,"data_compressed_original":36741120,"omap_allocated":1594,"internal_metadata":1163196870},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":1.1200000000000001,"15min":1.1539999999999999},"min":{"1min":0.22600000000000001,"5min":0.20499999999999999,"15min":0.186},"max":{"1min":3.996,"5min":11.619999999999999,"15min":27.282},"last":0.311},{"interface":"front","average":{"1min":2.6859999999999999,"5min":1.952,"15min":1.2290000000000001},"min":{"1min":0.245,"5min":0.217,"15min":0.186},"max":{"1min":18.614000000000001,"5min":18.614000000000001,"15min":18.614000000000001},"last":0.38100000000000001}]},{"osd":2,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":3.923,"5min":2.0310000000000001,"15min":1.3129999999999999},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20699999999999999},"max":{"1min":40.337000000000003,"5min":40.337000000000003,"15min":40.337000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":1.423,"5min":1.3280000000000001,"15min":1.026},"min":{"1min":0.28599999999999998,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":12.145,"5min":18.058,"15min":18.058},"last":0.52500000000000002}]},{"osd":3,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.6659999999999999,"15min":1.2689999999999999},"min":{"1min":0.27900000000000003,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":12.364000000000001,"5min":18.024999999999999,"15min":18.024999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":1.9470000000000001,"5min":1.4850000000000001,"15min":1.3999999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.216},"max":{"1min":12.01,"5min":12.01,"15min":44.454999999999998},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":4.0629999999999997,"5min":2.548,"15min":2.0139999999999998},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.27900000000000003},"max":{"1min":40.384999999999998,"5min":40.384999999999998,"15min":40.384999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.978,"5min":1.8740000000000001,"15min":1.829},"min":{"1min":0.38300000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":17.760999999999999,"5min":17.844999999999999,"15min":41.939},"last":0.68799999999999994}]},{"osd":5,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.9630000000000001,"5min":2.089,"15min":1.609},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.313},"max":{"1min":11.967000000000001,"5min":27.727,"15min":27.727},"last":0.626},{"interface":"front","average":{"1min":4.1150000000000002,"5min":2.4489999999999998,"15min":1.887},"min":{"1min":0.38800000000000001,"5min":0.33900000000000002,"15min":0.318},"max":{"1min":40.292000000000002,"5min":40.292000000000002,"15min":40.292000000000002},"last":0.71599999999999997}]},{"osd":6,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":2.1859999999999999,"15min":1.78},"min":{"1min":0.375,"5min":0.375,"15min":0.314},"max":{"1min":12.039999999999999,"5min":33.189999999999998,"15min":33.189999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":4.1340000000000003,"5min":3.2949999999999999,"15min":2.2509999999999999},"min":{"1min":0.42799999999999999,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":40.362000000000002,"5min":40.362000000000002,"15min":40.362000000000002},"last":0.86099999999999999}]},{"osd":7,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.897,"5min":1.7490000000000001,"15min":1.4370000000000001},"min":{"1min":0.442,"5min":0.36399999999999999,"15min":0.35899999999999999},"max":{"1min":13.084,"5min":17.890000000000001,"15min":17.890000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.6579999999999999,"5min":2.306,"15min":1.7929999999999999},"min":{"1min":0.44400000000000001,"5min":0.40600000000000003,"15min":0.36099999999999999},"max":{"1min":12.683,"5min":21.039999999999999,"15min":21.039999999999999},"last":0.81799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575178,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":805416,"kb_used_data":34464,"kb_used_omap":1,"kb_used_meta":770942,"kb_avail":93566424,"statfs":{"total":96636764160,"available":95812018176,"internally_reserved":0,"allocated":35291136,"data_stored":54073395,"data_compressed":5457884,"data_compressed_allocated":7987200,"data_compressed_original":26951680,"omap_allocated":1593,"internal_metadata":789445063},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":1.78,"5min":1.756,"15min":1.74},"min":{"1min":0.29699999999999999,"5min":0.189,"15min":0.185},"max":{"1min":12.462,"5min":22.343,"15min":37.991999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":1.4910000000000001,"15min":1.2769999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":7.0229999999999997,"5min":20.382000000000001,"15min":21.954000000000001},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.236,"15min":1.1080000000000001},"min":{"1min":0.316,"5min":0.22600000000000001,"15min":0.20899999999999999},"max":{"1min":12.42,"5min":17.687999999999999,"15min":17.687999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":1.3140000000000001,"15min":1.1830000000000001},"min":{"1min":0.255,"5min":0.23200000000000001,"15min":0.20899999999999999},"max":{"1min":4.5739999999999998,"5min":20.419,"15min":22.026},"last":0.51100000000000001}]},{"osd":3,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":1.726,"5min":2.1589999999999998,"15min":1.75},"min":{"1min":0.28000000000000003,"5min":0.22,"15min":0.192},"max":{"1min":8.8569999999999993,"5min":34.515000000000001,"15min":34.515000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.7010000000000001,"5min":2.4500000000000002,"15min":1.6399999999999999},"min":{"1min":0.35599999999999998,"5min":0.27600000000000002,"15min":0.22600000000000001},"max":{"1min":12.364000000000001,"5min":85.606999999999999,"15min":85.606999999999999},"last":0.59699999999999998}]},{"osd":4,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":6.7450000000000001,"5min":3.5499999999999998,"15min":2.5},"min":{"1min":0.40999999999999998,"5min":0.29399999999999998,"15min":0.28199999999999997},"max":{"1min":60.851999999999997,"5min":60.851999999999997,"15min":66.331999999999994},"last":0.64900000000000002},{"interface":"front","average":{"1min":6.1539999999999999,"5min":3.6699999999999999,"15min":2.6040000000000001},"min":{"1min":0.48399999999999999,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":67.194000000000003,"5min":67.194000000000003,"15min":67.194000000000003},"last":0.75800000000000001}]},{"osd":5,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":3.4670000000000001,"5min":2.157,"15min":1.708},"min":{"1min":0.46999999999999997,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":21.18,"5min":21.18,"15min":21.981000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.829,"5min":1.792,"15min":1.601},"min":{"1min":0.34100000000000003,"5min":0.32400000000000001,"15min":0.30599999999999999},"max":{"1min":7.907,"5min":14.019,"15min":25.446999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":2.702,"5min":3.234,"15min":2.1789999999999998},"min":{"1min":0.54300000000000004,"5min":0.373,"15min":0.318},"max":{"1min":16.640000000000001,"5min":82.542000000000002,"15min":82.542000000000002},"last":0.92800000000000005},{"interface":"front","average":{"1min":2.6589999999999998,"5min":2.1339999999999999,"15min":2.0129999999999999},"min":{"1min":0.45900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":16.056000000000001,"5min":25.914999999999999,"15min":25.914999999999999},"last":0.89400000000000002}]},{"osd":7,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.9179999999999999,"15min":1.9870000000000001},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":4.5339999999999998,"5min":20.445,"15min":26.669},"last":0.86099999999999999},{"interface":"front","average":{"1min":3.145,"5min":2.028,"15min":1.8700000000000001},"min":{"1min":0.42499999999999999,"5min":0.38400000000000001,"15min":0.33100000000000002},"max":{"1min":17.495000000000001,"5min":17.495000000000001,"15min":20.146000000000001},"last":0.873}]}]},{"osd":2,"up_from":13,"seq":55834575179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":729616,"kb_used_data":40712,"kb_used_omap":1,"kb_used_meta":688894,"kb_avail":93642224,"statfs":{"total":96636764160,"available":95889637376,"internally_reserved":0,"allocated":41689088,"data_stored":58833997,"data_compressed":5586562,"data_compressed_allocated":8433664,"data_compressed_original":25743360,"omap_allocated":1594,"internal_metadata":705427910},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":1.466,"15min":1.1579999999999999},"min":{"1min":0.22,"5min":0.186,"15min":0.16900000000000001},"max":{"1min":3.419,"5min":15.834,"15min":21.475999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.3089999999999999,"15min":1.23},"min":{"1min":0.214,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":11.121,"5min":14.374000000000001,"15min":30.434999999999999},"last":0.78700000000000003}]},{"osd":1,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":2.133,"5min":1.954,"15min":1.655},"min":{"1min":0.23200000000000001,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":9.391,"5min":24.190000000000001,"15min":25.550000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":2.0179999999999998,"5min":1.2390000000000001,"15min":1.137},"min":{"1min":0.30399999999999999,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":9.3539999999999992,"5min":9.3539999999999992,"15min":20.591000000000001},"last":0.67100000000000004}]},{"osd":3,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":2.6259999999999999,"5min":2.3959999999999999,"15min":1.835},"min":{"1min":0.251,"5min":0.23400000000000001,"15min":0.21099999999999999},"max":{"1min":21.16,"5min":34.598999999999997,"15min":34.598999999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":2.5289999999999999,"5min":2.5619999999999998,"15min":1.7749999999999999},"min":{"1min":0.26500000000000001,"5min":0.23799999999999999,"15min":0.20399999999999999},"max":{"1min":14.199999999999999,"5min":20.491,"15min":25.827000000000002},"last":0.752}]},{"osd":4,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":1.8069999999999999,"5min":2.1890000000000001,"15min":2.371},"min":{"1min":0.373,"5min":0.32700000000000001,"15min":0.31900000000000001},"max":{"1min":12.004,"5min":15.936,"15min":67.506},"last":0.95699999999999996},{"interface":"front","average":{"1min":2.7400000000000002,"5min":2.3519999999999999,"15min":2.5630000000000002},"min":{"1min":0.45600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":14.445,"5min":14.445,"15min":111.973},"last":0.89300000000000002}]},{"osd":5,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":3.5390000000000001,"5min":2.1360000000000001,"15min":1.77},"min":{"1min":0.39800000000000002,"5min":0.318,"15min":0.308},"max":{"1min":19.506,"5min":19.506,"15min":37.496000000000002},"last":1.0069999999999999},{"interface":"front","average":{"1min":2.786,"5min":2.1880000000000002,"15min":1.7989999999999999},"min":{"1min":0.39600000000000002,"5min":0.33700000000000002,"15min":0.32600000000000001},"max":{"1min":11.926,"5min":34.545000000000002,"15min":45.997999999999998},"last":1.05}]},{"osd":6,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":3.2879999999999998,"5min":2.6070000000000002,"15min":2.1709999999999998},"min":{"1min":0.45700000000000002,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":15.334,"5min":29.954999999999998,"15min":68.453000000000003},"last":1.113},{"interface":"front","average":{"1min":2.7789999999999999,"5min":2.4660000000000002,"15min":2.0790000000000002},"min":{"1min":0.45300000000000001,"5min":0.34899999999999998,"15min":0.34300000000000003},"max":{"1min":16.204000000000001,"5min":16.204000000000001,"15min":63.966000000000001},"last":1.022}]},{"osd":7,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":3.661,"5min":2.2370000000000001,"15min":2.0750000000000002},"min":{"1min":0.45100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":24.030000000000001,"5min":24.030000000000001,"15min":32.700000000000003},"last":1.036},{"interface":"front","average":{"1min":2.758,"5min":2.3799999999999999,"15min":2.173},"min":{"1min":0.501,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.946,"5min":29.881,"15min":32.840000000000003},"last":1.0860000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575178,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1179244,"kb_used_data":51492,"kb_used_omap":1,"kb_used_meta":1127742,"kb_avail":93192596,"statfs":{"total":96636764160,"available":95429218304,"internally_reserved":0,"allocated":52727808,"data_stored":79806189,"data_compressed":8205315,"data_compressed_allocated":12034048,"data_compressed_original":39284736,"omap_allocated":1591,"internal_metadata":1154808265},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.4870000000000001,"15min":1.173},"min":{"1min":0.22700000000000001,"5min":0.20300000000000001,"15min":0.184},"max":{"1min":10.606999999999999,"5min":24.539999999999999,"15min":24.539999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":2.1059999999999999,"5min":1.5309999999999999,"15min":1.5760000000000001},"min":{"1min":0.218,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":30.457000000000001,"5min":30.457000000000001,"15min":95.932000000000002},"last":0.46400000000000002}]},{"osd":1,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":2.8069999999999999,"5min":2.8809999999999998,"15min":2.1989999999999998},"min":{"1min":0.20399999999999999,"5min":0.20300000000000001,"15min":0.193},"max":{"1min":31.254999999999999,"5min":44.308,"15min":44.308},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.597,"5min":1.954,"15min":1.367},"min":{"1min":0.27600000000000002,"5min":0.23300000000000001,"15min":0.22},"max":{"1min":13.927,"5min":38.054000000000002,"15min":38.054000000000002},"last":0.53000000000000003}]},{"osd":2,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":2.2890000000000001,"5min":2.052,"15min":1.645},"min":{"1min":0.26300000000000001,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":31.277999999999999,"5min":31.277999999999999,"15min":31.277999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":1.726,"5min":1.2629999999999999,"15min":1.1839999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26700000000000002},"max":{"1min":13.897,"5min":17.364000000000001,"15min":17.364000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":1.768,"5min":1.9850000000000001,"15min":1.7150000000000001},"min":{"1min":0.31900000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":18.422999999999998,"5min":18.960000000000001,"15min":19.16},"last":0.69699999999999995},{"interface":"front","average":{"1min":3.0640000000000001,"5min":2.4780000000000002,"15min":2.2210000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.26700000000000002},"max":{"1min":31.201000000000001,"5min":31.201000000000001,"15min":31.201000000000001},"last":0.629}]},{"osd":5,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":3.0880000000000001,"5min":2.0760000000000001,"15min":2.0630000000000002},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32200000000000001},"max":{"1min":31.155999999999999,"5min":31.155999999999999,"15min":33.436999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.641,"5min":1.8340000000000001,"15min":1.6599999999999999},"min":{"1min":0.38400000000000001,"5min":0.33300000000000002,"15min":0.32000000000000001},"max":{"1min":10.579000000000001,"5min":17.329000000000001,"15min":17.329000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":2.0779999999999998,"15min":2.0339999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":10.48,"5min":25.329000000000001,"15min":30.588000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":2.1030000000000002,"5min":2.0249999999999999,"15min":1.8999999999999999},"min":{"1min":0.40799999999999997,"5min":0.34599999999999997,"15min":0.33900000000000002},"max":{"1min":16.077000000000002,"5min":18.803000000000001,"15min":23.318999999999999},"last":0.77600000000000002}]},{"osd":7,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.7210000000000001,"15min":1.8440000000000001},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.34699999999999998},"max":{"1min":13.25,"5min":18.841999999999999,"15min":19.116},"last":0.80500000000000005},{"interface":"front","average":{"1min":3.1549999999999998,"5min":2.4830000000000001,"15min":2.1419999999999999},"min":{"1min":0.41799999999999998,"5min":0.38800000000000001,"15min":0.36399999999999999},"max":{"1min":31.23,"5min":31.23,"15min":33.505000000000003},"last":0.68799999999999994}]}]},{"osd":4,"up_from":13,"seq":55834575178,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":925352,"kb_used_data":24096,"kb_used_omap":1,"kb_used_meta":901246,"kb_avail":93446488,"statfs":{"total":96636764160,"available":95689203712,"internally_reserved":0,"allocated":24674304,"data_stored":37862603,"data_compressed":4009381,"data_compressed_allocated":5820416,"data_compressed_original":19185664,"omap_allocated":1594,"internal_metadata":922876358},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":2.593,"15min":1.7430000000000001},"min":{"1min":0.27200000000000002,"5min":0.21199999999999999,"15min":0.20899999999999999},"max":{"1min":10.792,"5min":21.062999999999999,"15min":45.375},"last":0.752},{"interface":"front","average":{"1min":1.587,"5min":1.919,"15min":1.74},"min":{"1min":0.29699999999999999,"5min":0.23100000000000001,"15min":0.188},"max":{"1min":12.551,"5min":12.551,"15min":35.765000000000001},"last":0.59399999999999997}]},{"osd":1,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":2.4350000000000001,"5min":2.859,"15min":2.113},"min":{"1min":0.28100000000000003,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":14.561999999999999,"5min":22.718,"15min":29.928000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.9830000000000001,"5min":2.9420000000000002,"15min":1.7829999999999999},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.248},"max":{"1min":18.433,"5min":21.103000000000002,"15min":23.634},"last":0.61099999999999999}]},{"osd":2,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":2.4710000000000001,"5min":2.7029999999999998,"15min":1.873},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.27600000000000002},"max":{"1min":12.27,"5min":30.512,"15min":30.512},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.4370000000000001,"5min":3.8959999999999999,"15min":2.1600000000000001},"min":{"1min":0.32100000000000001,"5min":0.27400000000000002,"15min":0.26300000000000001},"max":{"1min":10.868,"5min":82.847999999999999,"15min":82.847999999999999},"last":0.71299999999999997}]},{"osd":3,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.875,"15min":1.6120000000000001},"min":{"1min":0.32600000000000001,"5min":0.26600000000000001,"15min":0.23899999999999999},"max":{"1min":8.4359999999999999,"5min":11.970000000000001,"15min":22.555},"last":0.624},{"interface":"front","average":{"1min":2.9870000000000001,"5min":3.0230000000000001,"15min":2.0950000000000002},"min":{"1min":0.379,"5min":0.35699999999999998,"15min":0.308},"max":{"1min":24.347000000000001,"5min":24.347000000000001,"15min":26.259},"last":0.76700000000000002}]},{"osd":5,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":4.0620000000000003,"15min":2.1600000000000001},"min":{"1min":0.29999999999999999,"5min":0.28299999999999997,"15min":0.246},"max":{"1min":12.558999999999999,"5min":82.918999999999997,"15min":82.918999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":1.774,"5min":2.4780000000000002,"15min":1.8879999999999999},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":12.051,"5min":25.120000000000001,"15min":25.120000000000001},"last":0.72399999999999998}]},{"osd":6,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":2.3969999999999998,"15min":1.7649999999999999},"min":{"1min":0.317,"5min":0.313,"15min":0.252},"max":{"1min":12.365,"5min":18.141999999999999,"15min":20.562999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.744,"5min":3.6560000000000001,"15min":2.3180000000000001},"min":{"1min":0.36099999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":16.669,"5min":83.643000000000001,"15min":83.643000000000001},"last":0.64500000000000002}]},{"osd":7,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.988,"15min":1.7769999999999999},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":11.795999999999999,"5min":19.021999999999998,"15min":25.878},"last":0.67500000000000004},{"interface":"front","average":{"1min":2.4580000000000002,"5min":2.4300000000000002,"15min":1.863},"min":{"1min":0.441,"5min":0.308,"15min":0.27800000000000002},"max":{"1min":12.334,"5min":22.75,"15min":22.75},"last":0.73799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575178,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":957096,"kb_used_data":29536,"kb_used_omap":1,"kb_used_meta":927550,"kb_avail":93414744,"statfs":{"total":96636764160,"available":95656697856,"internally_reserved":0,"allocated":30244864,"data_stored":42056871,"data_compressed":3817580,"data_compressed_allocated":5763072,"data_compressed_original":17743872,"omap_allocated":1594,"internal_metadata":949811654},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.9319999999999999,"15min":1.349},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":12.286,"5min":19.097999999999999,"15min":19.097999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.5289999999999999,"5min":2.1339999999999999,"15min":1.579},"min":{"1min":0.27300000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":9.9350000000000005,"5min":21.416,"15min":21.416},"last":0.69399999999999995}]},{"osd":1,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.8200000000000001,"15min":1.6699999999999999},"min":{"1min":0.309,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":11.445,"5min":16.515000000000001,"15min":19.581},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.6000000000000001,"15min":1.337},"min":{"1min":0.28699999999999998,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":13.266999999999999,"5min":16.492999999999999,"15min":16.492999999999999},"last":0.621}]},{"osd":2,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.397,"15min":1.4430000000000001},"min":{"1min":0.34200000000000003,"5min":0.27300000000000002,"15min":0.25700000000000001},"max":{"1min":9.9290000000000003,"5min":9.9290000000000003,"15min":21.186},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.022,"5min":1.363,"15min":1.284},"min":{"1min":0.26700000000000002,"5min":0.26200000000000001,"15min":0.25700000000000001},"max":{"1min":6.2400000000000002,"5min":8.4160000000000004,"15min":22.353999999999999},"last":0.74399999999999999}]},{"osd":3,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.9379999999999999,"15min":1.6599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.29699999999999999},"max":{"1min":11.137,"5min":16.324999999999999,"15min":17.103999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.458,"5min":2.0739999999999998,"15min":1.7390000000000001},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.29899999999999999},"max":{"1min":8.5920000000000005,"5min":18.798999999999999,"15min":23.224},"last":0.754}]},{"osd":4,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.9350000000000001,"15min":1.548},"min":{"1min":0.29699999999999999,"5min":0.25,"15min":0.20799999999999999},"max":{"1min":6.2000000000000002,"5min":19.018999999999998,"15min":28.724},"last":0.47399999999999998},{"interface":"front","average":{"1min":1.21,"5min":2.105,"15min":1.6499999999999999},"min":{"1min":0.317,"5min":0.28100000000000003,"15min":0.22800000000000001},"max":{"1min":6.7229999999999999,"5min":25.466999999999999,"15min":25.466999999999999},"last":0.60199999999999998}]},{"osd":6,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.869,"15min":1.5640000000000001},"min":{"1min":0.32800000000000001,"5min":0.28699999999999998,"15min":0.23899999999999999},"max":{"1min":7.7210000000000001,"5min":20.969999999999999,"15min":21.294},"last":0.498},{"interface":"front","average":{"1min":1.4390000000000001,"5min":2.125,"15min":1.518},"min":{"1min":0.39700000000000002,"5min":0.34599999999999997,"15min":0.24199999999999999},"max":{"1min":6.1660000000000004,"5min":23.731000000000002,"15min":23.731000000000002},"last":0.54800000000000004}]},{"osd":7,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.8029999999999999,"15min":1.4790000000000001},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.29299999999999998},"max":{"1min":5.6920000000000002,"5min":21.462,"15min":30.076000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.82699999999999996,"5min":1.474,"15min":1.306},"min":{"1min":0.39400000000000002,"5min":0.36699999999999999,"15min":0.26100000000000001},"max":{"1min":4.6609999999999996,"5min":14.316000000000001,"15min":21.257000000000001},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34947072,"data_stored":53369286,"data_compressed":5425493,"data_compressed_allocated":7942144,"data_compressed_original":26378240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53616640,"data_stored":78830860,"data_compressed":7659770,"data_compressed_allocated":11517952,"data_compressed_original":36741120,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41410560,"data_stored":58720256,"data_compressed":5586562,"data_compressed_allocated":8433664,"data_compressed_original":25743360,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":52449280,"data_stored":79692448,"data_compressed":8205315,"data_compressed_allocated":12034048,"data_compressed_original":39284736,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24395776,"data_stored":37748862,"data_compressed":4009381,"data_compressed_allocated":5820416,"data_compressed_original":19185664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29966336,"data_stored":41943130,"data_compressed":3817580,"data_compressed_allocated":5763072,"data_compressed_original":17743872,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50114560,"data_stored":74637068,"data_compressed":7372511,"data_compressed_allocated":10829824,"data_compressed_original":35360768,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36921344,"data_stored":57563534,"data_compressed":5863036,"data_compressed_allocated":8429568,"data_compressed_original":29077504,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T19:49:43.486 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:43.486 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:43.487 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:43.487 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:43.487 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:43.487 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:43.487 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:43.487 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:43.488 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:43.488 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:43.488 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:43.488 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T19:22:19.981999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:43.489 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T19:22:23.440344+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=23, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=19, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T19:49:43.489 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T19:50:03.490 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T19:50:03.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.651+0000 7f40bcaa6700 1 Processor -- start 2024-05-08T19:50:03.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.651+0000 7f40bcaa6700 1 -- start start 2024-05-08T19:50:03.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.652+0000 7f40bcaa6700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f40b806e6e0 0x7f40b8152170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:03.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.652+0000 7f40bcaa6700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b8071ab0 con 0x7f40b80723f0 2024-05-08T19:50:03.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.652+0000 7f40bcaa6700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b80c1bc0 con 0x7f40b8071f40 2024-05-08T19:50:03.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.652+0000 7f40bcaa6700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b81526b0 con 0x7f40b806e6e0 2024-05-08T19:50:03.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.652+0000 7f40b659c700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f40b806e6e0 0x7f40b8152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:03.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.652+0000 7f40b659c700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f40b806e6e0 0x7f40b8152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44098/0 (socket says 172.21.15.47:44098) 2024-05-08T19:50:03.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.652+0000 7f40b659c700 1 -- 172.21.15.47:0/2373765073 learned_addr learned my addr 172.21.15.47:0/2373765073 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:50:03.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.652+0000 7f40b6d9d700 1 --1- 172.21.15.47:0/2373765073 >> v1:172.21.15.47:6789/0 conn(0x7f40b80723f0 0x7f40b815c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44188/0 (socket says 172.21.15.47:44188) 2024-05-08T19:50:03.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.653+0000 7f40b659c700 1 -- 172.21.15.47:0/2373765073 >> v1:172.21.15.177:6789/0 conn(0x7f40b8071f40 legacy=0x7f40b806eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:03.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.653+0000 7f40b659c700 1 -- 172.21.15.47:0/2373765073 >> v1:172.21.15.47:6789/0 conn(0x7f40b80723f0 legacy=0x7f40b815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:03.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.653+0000 7f40b559a700 1 -- 172.21.15.47:0/2373765073 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881789864 0 0) 0x7f40b8071ab0 con 0x7f40b80723f0 2024-05-08T19:50:03.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.653+0000 7f40b659c700 1 -- 172.21.15.47:0/2373765073 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b80c1e60 con 0x7f40b806e6e0 2024-05-08T19:50:03.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.653+0000 7f40b659c700 1 --2- 172.21.15.47:0/2373765073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b806e6e0 0x7f40b8152170 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f40a80098f0 tx=0x7f40a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a906688b23ac9a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:03.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.653+0000 7f40b559a700 1 -- 172.21.15.47:0/2373765073 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8004230 con 0x7f40b806e6e0 2024-05-08T19:50:03.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.653+0000 7f40b559a700 1 -- 172.21.15.47:0/2373765073 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a8004390 con 0x7f40b806e6e0 2024-05-08T19:50:03.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.653+0000 7f40b559a700 1 -- 172.21.15.47:0/2373765073 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a80036a0 con 0x7f40b806e6e0 2024-05-08T19:50:03.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.654+0000 7f40bcaa6700 1 -- 172.21.15.47:0/2373765073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b806e6e0 msgr2=0x7f40b8152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:03.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.654+0000 7f40bcaa6700 1 --2- 172.21.15.47:0/2373765073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b806e6e0 0x7f40b8152170 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f40a80098f0 tx=0x7f40a8009c00 comp rx=0 tx=0).stop 2024-05-08T19:50:03.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.654+0000 7f40bcaa6700 1 -- 172.21.15.47:0/2373765073 shutdown_connections 2024-05-08T19:50:03.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.654+0000 7f40bcaa6700 1 --2- 172.21.15.47:0/2373765073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b806e6e0 0x7f40b8152170 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:03.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.654+0000 7f40bcaa6700 1 -- 172.21.15.47:0/2373765073 >> 172.21.15.47:0/2373765073 conn(0x7f40b80c7120 msgr2=0x7f40b80c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:03.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.654+0000 7f40bcaa6700 1 -- 172.21.15.47:0/2373765073 shutdown_connections 2024-05-08T19:50:03.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.654+0000 7f40bcaa6700 1 -- 172.21.15.47:0/2373765073 wait complete. 2024-05-08T19:50:03.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.655+0000 7f40bcaa6700 1 Processor -- start 2024-05-08T19:50:03.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.655+0000 7f40bcaa6700 1 -- start start 2024-05-08T19:50:03.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.656+0000 7f40bcaa6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b806e6e0 0x7f40b813a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:03.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.656+0000 7f40bcaa6700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40b8071f40 0x7f40b8142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:03.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.656+0000 7f40bcaa6700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40b80723f0 0x7f40b81500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:03.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.656+0000 7f40bcaa6700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b814fc10 con 0x7f40b806e6e0 2024-05-08T19:50:03.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.656+0000 7f40bcaa6700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b814f600 con 0x7f40b80723f0 2024-05-08T19:50:03.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.656+0000 7f40bcaa6700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8143510 con 0x7f40b8071f40 2024-05-08T19:50:03.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.656+0000 7f40b659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b806e6e0 0x7f40b813a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:03.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.656+0000 7f40b659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b806e6e0 0x7f40b813a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44106/0 (socket says 172.21.15.47:44106) 2024-05-08T19:50:03.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.656+0000 7f40b659c700 1 -- 172.21.15.47:0/2718391395 learned_addr learned my addr 172.21.15.47:0/2718391395 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:50:03.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.657+0000 7f40b6d9d700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40b80723f0 0x7f40b81500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:03.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.657+0000 7f40b659c700 1 -- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40b8071f40 msgr2=0x7f40b8142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:03.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.657+0000 7f40b5d9b700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40b8071f40 0x7f40b8142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:03.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.657+0000 7f40b659c700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40b8071f40 0x7f40b8142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:03.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.657+0000 7f40b659c700 1 -- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40b80723f0 msgr2=0x7f40b81500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:03.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.657+0000 7f40b659c700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40b80723f0 0x7f40b81500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:03.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.657+0000 7f40b659c700 1 -- 172.21.15.47:0/2718391395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a8009550 con 0x7f40b806e6e0 2024-05-08T19:50:03.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.657+0000 7f40b6d9d700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40b80723f0 0x7f40b81500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:50:03.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.657+0000 7f40b5d9b700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40b8071f40 0x7f40b8142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:50:03.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.657+0000 7f40b659c700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b806e6e0 0x7f40b813a5d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f40b8072fc0 tx=0x7f40a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:03.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.657+0000 7f40a6ffd700 1 -- 172.21.15.47:0/2718391395 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8003dc0 con 0x7f40b806e6e0 2024-05-08T19:50:03.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.657+0000 7f40a6ffd700 1 -- 172.21.15.47:0/2718391395 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a801f070 con 0x7f40b806e6e0 2024-05-08T19:50:03.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.657+0000 7f40bcaa6700 1 -- 172.21.15.47:0/2718391395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b81505e0 con 0x7f40b806e6e0 2024-05-08T19:50:03.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.657+0000 7f40a6ffd700 1 -- 172.21.15.47:0/2718391395 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a800b8a0 con 0x7f40b806e6e0 2024-05-08T19:50:03.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.657+0000 7f40bcaa6700 1 -- 172.21.15.47:0/2718391395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b814f8a0 con 0x7f40b806e6e0 2024-05-08T19:50:03.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.658+0000 7f40bcaa6700 1 -- 172.21.15.47:0/2718391395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b804ec60 con 0x7f40b806e6e0 2024-05-08T19:50:03.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.659+0000 7f40a6ffd700 1 -- 172.21.15.47:0/2718391395 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f40a8021030 con 0x7f40b806e6e0 2024-05-08T19:50:03.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.659+0000 7f40a6ffd700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f409806ac90 0x7f409806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:03.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.659+0000 7f40a6ffd700 1 -- 172.21.15.47:0/2718391395 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f40a808ae20 con 0x7f40b806e6e0 2024-05-08T19:50:03.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.659+0000 7f40b5d9b700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f409806ac90 0x7f409806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:03.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.660+0000 7f40b5d9b700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f409806ac90 0x7f409806d150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f40b813ab10 tx=0x7f40ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:03.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.664+0000 7f40a6ffd700 1 -- 172.21.15.47:0/2718391395 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f40a8055cd0 con 0x7f40b806e6e0 2024-05-08T19:50:03.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.865+0000 7f40bcaa6700 1 -- 172.21.15.47:0/2718391395 --> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40b8152be0 con 0x7f409806ac90 2024-05-08T19:50:03.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.877+0000 7f40a6ffd700 1 -- 172.21.15.47:0/2718391395 <== mgr.4108 v2:172.21.15.177:6832/46523 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+374246 (secure 0 0 0) 0x7f40ac014420 con 0x7f409806ac90 2024-05-08T19:50:03.871 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:50:03.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.880+0000 7f40bcaa6700 1 -- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f409806ac90 msgr2=0x7f409806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:03.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.880+0000 7f40bcaa6700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f409806ac90 0x7f409806d150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f40b813ab10 tx=0x7f40ac009040 comp rx=0 tx=0).stop 2024-05-08T19:50:03.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.880+0000 7f40bcaa6700 1 -- 172.21.15.47:0/2718391395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b806e6e0 msgr2=0x7f40b813a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:03.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.880+0000 7f40bcaa6700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b806e6e0 0x7f40b813a5d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f40b8072fc0 tx=0x7f40a8004750 comp rx=0 tx=0).stop 2024-05-08T19:50:03.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.880+0000 7f40bcaa6700 1 -- 172.21.15.47:0/2718391395 shutdown_connections 2024-05-08T19:50:03.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.880+0000 7f40bcaa6700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f409806ac90 0x7f409806d150 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:03.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.880+0000 7f40bcaa6700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b806e6e0 0x7f40b813a5d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:03.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.880+0000 7f40bcaa6700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40b80723f0 0x7f40b81500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:03.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.880+0000 7f40bcaa6700 1 --2- 172.21.15.47:0/2718391395 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40b8071f40 0x7f40b8142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:03.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.880+0000 7f40bcaa6700 1 -- 172.21.15.47:0/2718391395 >> 172.21.15.47:0/2718391395 conn(0x7f40b80c7120 msgr2=0x7f40b806aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:03.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.880+0000 7f40bcaa6700 1 -- 172.21.15.47:0/2718391395 shutdown_connections 2024-05-08T19:50:03.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:03.880+0000 7f40bcaa6700 1 -- 172.21.15.47:0/2718391395 wait complete. 2024-05-08T19:50:03.875 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-08T19:50:03.883 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":853,"stamp":"2024-05-08T19:50:02.626937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":241843090,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":21643,"num_read_kb":1158813,"num_write":409439,"num_write_kb":31681879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":983922,"num_omap_keys":1498,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575416,"ondisk_log_size":575416,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7772296,"kb_used_data":318536,"kb_used_omap":12,"kb_used_meta":7453683,"kb_avail":747202424,"statfs":{"total":773094113280,"available":765135282176,"internally_reserved":0,"allocated":326180864,"data_stored":484596108,"data_compressed":48004430,"data_compressed_allocated":70860800,"data_compressed_original":230662144,"omap_allocated":12741,"internal_metadata":7632571963},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003722"},"pg_stats":[{"pgid":"3.3f","version":"26'2251","reported_seq":2292,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:16.946583+0000","last_change":"2024-05-08T19:49:16.946583+0000","last_active":"2024-05-08T19:49:16.946583+0000","last_peered":"2024-05-08T19:49:16.946583+0000","last_clean":"2024-05-08T19:49:16.946583+0000","last_became_active":"2024-05-08T19:22:20.461515+0000","last_became_peered":"2024-05-08T19:22:20.461515+0000","last_unstale":"2024-05-08T19:49:16.946583+0000","last_undegraded":"2024-05-08T19:49:16.946583+0000","last_fullsized":"2024-05-08T19:49:16.946583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2251","last_scrub_stamp":"2024-05-08T19:49:16.946432+0000","last_deep_scrub":"26'2251","last_deep_scrub_stamp":"2024-05-08T19:49:16.946432+0000","last_clean_scrub_stamp":"2024-05-08T19:49:16.946432+0000","objects_scrubbed":0,"log_size":2251,"log_dups_size":0,"ondisk_log_size":2251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:14.633970+0000","scrub_duration":0.019606787000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'2273","reported_seq":2314,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:10.656598+0000","last_change":"2024-05-08T19:49:10.656598+0000","last_active":"2024-05-08T19:49:10.656598+0000","last_peered":"2024-05-08T19:49:10.656598+0000","last_clean":"2024-05-08T19:49:10.656598+0000","last_became_active":"2024-05-08T19:22:20.434629+0000","last_became_peered":"2024-05-08T19:22:20.434629+0000","last_unstale":"2024-05-08T19:49:10.656598+0000","last_undegraded":"2024-05-08T19:49:10.656598+0000","last_fullsized":"2024-05-08T19:49:10.656598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2273","last_scrub_stamp":"2024-05-08T19:49:10.656467+0000","last_deep_scrub":"26'2273","last_deep_scrub_stamp":"2024-05-08T19:49:10.656467+0000","last_clean_scrub_stamp":"2024-05-08T19:49:10.656467+0000","objects_scrubbed":0,"log_size":2273,"log_dups_size":0,"ondisk_log_size":2273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:10.166188+0000","scrub_duration":0.007619575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"26'2375","reported_seq":2416,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:01.779542+0000","last_change":"2024-05-08T19:49:01.779542+0000","last_active":"2024-05-08T19:49:01.779542+0000","last_peered":"2024-05-08T19:49:01.779542+0000","last_clean":"2024-05-08T19:49:01.779542+0000","last_became_active":"2024-05-08T19:22:20.449184+0000","last_became_peered":"2024-05-08T19:22:20.449184+0000","last_unstale":"2024-05-08T19:49:01.779542+0000","last_undegraded":"2024-05-08T19:49:01.779542+0000","last_fullsized":"2024-05-08T19:49:01.779542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2375","last_scrub_stamp":"2024-05-08T19:49:01.779390+0000","last_deep_scrub":"26'2375","last_deep_scrub_stamp":"2024-05-08T19:49:01.779390+0000","last_clean_scrub_stamp":"2024-05-08T19:49:01.779390+0000","objects_scrubbed":0,"log_size":2375,"log_dups_size":0,"ondisk_log_size":2375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:47.169212+0000","scrub_duration":0.002872987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"26'2359","reported_seq":2400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:03.254773+0000","last_change":"2024-05-08T19:49:03.255052+0000","last_active":"2024-05-08T19:49:03.254773+0000","last_peered":"2024-05-08T19:49:03.254773+0000","last_clean":"2024-05-08T19:49:03.254773+0000","last_became_active":"2024-05-08T19:22:20.449637+0000","last_became_peered":"2024-05-08T19:22:20.449637+0000","last_unstale":"2024-05-08T19:49:03.254773+0000","last_undegraded":"2024-05-08T19:49:03.254773+0000","last_fullsized":"2024-05-08T19:49:03.254773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2359","last_scrub_stamp":"2024-05-08T19:49:03.254747+0000","last_deep_scrub":"26'2359","last_deep_scrub_stamp":"2024-05-08T19:49:03.254747+0000","last_clean_scrub_stamp":"2024-05-08T19:49:03.254747+0000","objects_scrubbed":0,"log_size":2359,"log_dups_size":0,"ondisk_log_size":2359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:43.728458+0000","scrub_duration":0.002337698,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'2307","reported_seq":2346,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:32.760052+0000","last_change":"2024-05-08T19:49:32.760052+0000","last_active":"2024-05-08T19:49:32.760052+0000","last_peered":"2024-05-08T19:49:32.760052+0000","last_clean":"2024-05-08T19:49:32.760052+0000","last_became_active":"2024-05-08T19:22:20.449347+0000","last_became_peered":"2024-05-08T19:22:20.449347+0000","last_unstale":"2024-05-08T19:49:32.760052+0000","last_undegraded":"2024-05-08T19:49:32.760052+0000","last_fullsized":"2024-05-08T19:49:32.760052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2307","last_scrub_stamp":"2024-05-08T19:49:32.759839+0000","last_deep_scrub":"26'2307","last_deep_scrub_stamp":"2024-05-08T19:49:32.759839+0000","last_clean_scrub_stamp":"2024-05-08T19:49:32.759839+0000","objects_scrubbed":0,"log_size":2307,"log_dups_size":0,"ondisk_log_size":2307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:32.186888+0000","scrub_duration":0.012594342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'2223","reported_seq":2255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:58.858078+0000","last_change":"2024-05-08T19:48:58.858191+0000","last_active":"2024-05-08T19:48:58.858078+0000","last_peered":"2024-05-08T19:48:58.858078+0000","last_clean":"2024-05-08T19:48:58.858078+0000","last_became_active":"2024-05-08T19:23:11.052928+0000","last_became_peered":"2024-05-08T19:23:11.052928+0000","last_unstale":"2024-05-08T19:48:58.858078+0000","last_undegraded":"2024-05-08T19:48:58.858078+0000","last_fullsized":"2024-05-08T19:48:58.858078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2223","last_scrub_stamp":"2024-05-08T19:48:58.858050+0000","last_deep_scrub":"26'2223","last_deep_scrub_stamp":"2024-05-08T19:48:58.858050+0000","last_clean_scrub_stamp":"2024-05-08T19:48:58.858050+0000","objects_scrubbed":0,"log_size":2223,"log_dups_size":0,"ondisk_log_size":2223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:59.957413+0000","scrub_duration":0.001763433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"26'2288","reported_seq":2327,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:24.809413+0000","last_change":"2024-05-08T19:49:24.809413+0000","last_active":"2024-05-08T19:49:24.809413+0000","last_peered":"2024-05-08T19:49:24.809413+0000","last_clean":"2024-05-08T19:49:24.809413+0000","last_became_active":"2024-05-08T19:22:20.446520+0000","last_became_peered":"2024-05-08T19:22:20.446520+0000","last_unstale":"2024-05-08T19:49:24.809413+0000","last_undegraded":"2024-05-08T19:49:24.809413+0000","last_fullsized":"2024-05-08T19:49:24.809413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2288","last_scrub_stamp":"2024-05-08T19:49:24.809253+0000","last_deep_scrub":"26'2288","last_deep_scrub_stamp":"2024-05-08T19:49:24.809253+0000","last_clean_scrub_stamp":"2024-05-08T19:49:24.809253+0000","objects_scrubbed":0,"log_size":2288,"log_dups_size":0,"ondisk_log_size":2288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:20.625457+0000","scrub_duration":0.0022124359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'2289","reported_seq":2328,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:40.674930+0000","last_change":"2024-05-08T19:49:40.674930+0000","last_active":"2024-05-08T19:49:40.674930+0000","last_peered":"2024-05-08T19:49:40.674930+0000","last_clean":"2024-05-08T19:49:40.674930+0000","last_became_active":"2024-05-08T19:22:20.447031+0000","last_became_peered":"2024-05-08T19:22:20.447031+0000","last_unstale":"2024-05-08T19:49:40.674930+0000","last_undegraded":"2024-05-08T19:49:40.674930+0000","last_fullsized":"2024-05-08T19:49:40.674930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2289","last_scrub_stamp":"2024-05-08T19:49:40.674801+0000","last_deep_scrub":"26'2289","last_deep_scrub_stamp":"2024-05-08T19:49:40.674801+0000","last_clean_scrub_stamp":"2024-05-08T19:49:40.674801+0000","objects_scrubbed":0,"log_size":2289,"log_dups_size":0,"ondisk_log_size":2289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:32.813133+0000","scrub_duration":0.0022182759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"26'2353","reported_seq":2392,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:26.739531+0000","last_change":"2024-05-08T19:49:26.739665+0000","last_active":"2024-05-08T19:49:26.739531+0000","last_peered":"2024-05-08T19:49:26.739531+0000","last_clean":"2024-05-08T19:49:26.739531+0000","last_became_active":"2024-05-08T19:22:20.446803+0000","last_became_peered":"2024-05-08T19:22:20.446803+0000","last_unstale":"2024-05-08T19:49:26.739531+0000","last_undegraded":"2024-05-08T19:49:26.739531+0000","last_fullsized":"2024-05-08T19:49:26.739531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2353","last_scrub_stamp":"2024-05-08T19:49:26.739505+0000","last_deep_scrub":"26'2353","last_deep_scrub_stamp":"2024-05-08T19:49:26.739505+0000","last_clean_scrub_stamp":"2024-05-08T19:49:26.739505+0000","objects_scrubbed":0,"log_size":2353,"log_dups_size":0,"ondisk_log_size":2353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:14.678734+0000","scrub_duration":0.011528883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'2369","reported_seq":2408,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:19.718394+0000","last_change":"2024-05-08T19:49:19.718539+0000","last_active":"2024-05-08T19:49:19.718394+0000","last_peered":"2024-05-08T19:49:19.718394+0000","last_clean":"2024-05-08T19:49:19.718394+0000","last_became_active":"2024-05-08T19:22:20.461395+0000","last_became_peered":"2024-05-08T19:22:20.461395+0000","last_unstale":"2024-05-08T19:49:19.718394+0000","last_undegraded":"2024-05-08T19:49:19.718394+0000","last_fullsized":"2024-05-08T19:49:19.718394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2369","last_scrub_stamp":"2024-05-08T19:49:19.718358+0000","last_deep_scrub":"26'2369","last_deep_scrub_stamp":"2024-05-08T19:49:19.718358+0000","last_clean_scrub_stamp":"2024-05-08T19:49:19.718358+0000","objects_scrubbed":0,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:05.676957+0000","scrub_duration":0.0039461089999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"26'2237","reported_seq":2276,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:15.650434+0000","last_change":"2024-05-08T19:49:15.650556+0000","last_active":"2024-05-08T19:49:15.650434+0000","last_peered":"2024-05-08T19:49:15.650434+0000","last_clean":"2024-05-08T19:49:15.650434+0000","last_became_active":"2024-05-08T19:22:20.459253+0000","last_became_peered":"2024-05-08T19:22:20.459253+0000","last_unstale":"2024-05-08T19:49:15.650434+0000","last_undegraded":"2024-05-08T19:49:15.650434+0000","last_fullsized":"2024-05-08T19:49:15.650434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2237","last_scrub_stamp":"2024-05-08T19:49:15.650406+0000","last_deep_scrub":"26'2237","last_deep_scrub_stamp":"2024-05-08T19:49:15.650406+0000","last_clean_scrub_stamp":"2024-05-08T19:49:15.650406+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:15.160128+0000","scrub_duration":0.010753660999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"26'2223","reported_seq":2262,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:53.275993+0000","last_change":"2024-05-08T19:48:53.275993+0000","last_active":"2024-05-08T19:48:53.275993+0000","last_peered":"2024-05-08T19:48:53.275993+0000","last_clean":"2024-05-08T19:48:53.275993+0000","last_became_active":"2024-05-08T19:22:20.461852+0000","last_became_peered":"2024-05-08T19:22:20.461852+0000","last_unstale":"2024-05-08T19:48:53.275993+0000","last_undegraded":"2024-05-08T19:48:53.275993+0000","last_fullsized":"2024-05-08T19:48:53.275993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2223","last_scrub_stamp":"2024-05-08T19:48:53.275860+0000","last_deep_scrub":"26'2223","last_deep_scrub_stamp":"2024-05-08T19:48:53.275860+0000","last_clean_scrub_stamp":"2024-05-08T19:48:53.275860+0000","objects_scrubbed":0,"log_size":2223,"log_dups_size":0,"ondisk_log_size":2223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:11.565803+0000","scrub_duration":0.0016971060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"26'2273","reported_seq":2312,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.733749+0000","last_change":"2024-05-08T19:48:49.733749+0000","last_active":"2024-05-08T19:48:49.733749+0000","last_peered":"2024-05-08T19:48:49.733749+0000","last_clean":"2024-05-08T19:48:49.733749+0000","last_became_active":"2024-05-08T19:22:20.452884+0000","last_became_peered":"2024-05-08T19:22:20.452884+0000","last_unstale":"2024-05-08T19:48:49.733749+0000","last_undegraded":"2024-05-08T19:48:49.733749+0000","last_fullsized":"2024-05-08T19:48:49.733749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2273","last_scrub_stamp":"2024-05-08T19:48:49.733627+0000","last_deep_scrub":"26'2273","last_deep_scrub_stamp":"2024-05-08T19:48:49.733627+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.733627+0000","objects_scrubbed":0,"log_size":2273,"log_dups_size":0,"ondisk_log_size":2273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:35.123448+0000","scrub_duration":0.011898308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"26'2298","reported_seq":2337,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.685749+0000","last_change":"2024-05-08T19:48:54.685845+0000","last_active":"2024-05-08T19:48:54.685749+0000","last_peered":"2024-05-08T19:48:54.685749+0000","last_clean":"2024-05-08T19:48:54.685749+0000","last_became_active":"2024-05-08T19:22:20.435456+0000","last_became_peered":"2024-05-08T19:22:20.435456+0000","last_unstale":"2024-05-08T19:48:54.685749+0000","last_undegraded":"2024-05-08T19:48:54.685749+0000","last_fullsized":"2024-05-08T19:48:54.685749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2298","last_scrub_stamp":"2024-05-08T19:48:54.685720+0000","last_deep_scrub":"26'2298","last_deep_scrub_stamp":"2024-05-08T19:48:54.685720+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.685720+0000","objects_scrubbed":0,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:55.785082+0000","scrub_duration":0.0058416680000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"26'2373","reported_seq":2412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.575902+0000","last_change":"2024-05-08T19:48:40.575994+0000","last_active":"2024-05-08T19:48:40.575902+0000","last_peered":"2024-05-08T19:48:40.575902+0000","last_clean":"2024-05-08T19:48:40.575902+0000","last_became_active":"2024-05-08T19:22:20.444369+0000","last_became_peered":"2024-05-08T19:22:20.444369+0000","last_unstale":"2024-05-08T19:48:40.575902+0000","last_undegraded":"2024-05-08T19:48:40.575902+0000","last_fullsized":"2024-05-08T19:48:40.575902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2373","last_scrub_stamp":"2024-05-08T19:48:40.575879+0000","last_deep_scrub":"26'2373","last_deep_scrub_stamp":"2024-05-08T19:48:40.575879+0000","last_clean_scrub_stamp":"2024-05-08T19:48:40.575879+0000","objects_scrubbed":0,"log_size":2373,"log_dups_size":0,"ondisk_log_size":2373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:57.404103+0000","scrub_duration":0.0065170310000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'2274","reported_seq":2313,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:34.270153+0000","last_change":"2024-05-08T19:49:34.270263+0000","last_active":"2024-05-08T19:49:34.270153+0000","last_peered":"2024-05-08T19:49:34.270153+0000","last_clean":"2024-05-08T19:49:34.270153+0000","last_became_active":"2024-05-08T19:22:20.444996+0000","last_became_peered":"2024-05-08T19:22:20.444996+0000","last_unstale":"2024-05-08T19:49:34.270153+0000","last_undegraded":"2024-05-08T19:49:34.270153+0000","last_fullsized":"2024-05-08T19:49:34.270153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2274","last_scrub_stamp":"2024-05-08T19:49:34.270126+0000","last_deep_scrub":"26'2274","last_deep_scrub_stamp":"2024-05-08T19:49:34.270126+0000","last_clean_scrub_stamp":"2024-05-08T19:49:34.270126+0000","objects_scrubbed":0,"log_size":2274,"log_dups_size":0,"ondisk_log_size":2274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:55.122097+0000","scrub_duration":0.002197629,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"26'2337","reported_seq":2376,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:04.327857+0000","last_change":"2024-05-08T19:49:04.327997+0000","last_active":"2024-05-08T19:49:04.327857+0000","last_peered":"2024-05-08T19:49:04.327857+0000","last_clean":"2024-05-08T19:49:04.327857+0000","last_became_active":"2024-05-08T19:22:20.450843+0000","last_became_peered":"2024-05-08T19:22:20.450843+0000","last_unstale":"2024-05-08T19:49:04.327857+0000","last_undegraded":"2024-05-08T19:49:04.327857+0000","last_fullsized":"2024-05-08T19:49:04.327857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2337","last_scrub_stamp":"2024-05-08T19:49:04.327828+0000","last_deep_scrub":"26'2337","last_deep_scrub_stamp":"2024-05-08T19:49:04.327828+0000","last_clean_scrub_stamp":"2024-05-08T19:49:04.327828+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:54.003812+0000","scrub_duration":0.025184673000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'2298","reported_seq":2337,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:52.831688+0000","last_change":"2024-05-08T19:48:52.831797+0000","last_active":"2024-05-08T19:48:52.831688+0000","last_peered":"2024-05-08T19:48:52.831688+0000","last_clean":"2024-05-08T19:48:52.831688+0000","last_became_active":"2024-05-08T19:22:20.462266+0000","last_became_peered":"2024-05-08T19:22:20.462266+0000","last_unstale":"2024-05-08T19:48:52.831688+0000","last_undegraded":"2024-05-08T19:48:52.831688+0000","last_fullsized":"2024-05-08T19:48:52.831688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2298","last_scrub_stamp":"2024-05-08T19:48:52.831661+0000","last_deep_scrub":"26'2298","last_deep_scrub_stamp":"2024-05-08T19:48:52.831661+0000","last_clean_scrub_stamp":"2024-05-08T19:48:52.831661+0000","objects_scrubbed":0,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:42.814623+0000","scrub_duration":0.0019874760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"26'2369","reported_seq":2409,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:39.698207+0000","last_change":"2024-05-08T19:49:39.698337+0000","last_active":"2024-05-08T19:49:39.698207+0000","last_peered":"2024-05-08T19:49:39.698207+0000","last_clean":"2024-05-08T19:49:39.698207+0000","last_became_active":"2024-05-08T19:22:20.453834+0000","last_became_peered":"2024-05-08T19:22:20.453834+0000","last_unstale":"2024-05-08T19:49:39.698207+0000","last_undegraded":"2024-05-08T19:49:39.698207+0000","last_fullsized":"2024-05-08T19:49:39.698207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2369","last_scrub_stamp":"2024-05-08T19:49:39.698182+0000","last_deep_scrub":"26'2369","last_deep_scrub_stamp":"2024-05-08T19:49:39.698182+0000","last_clean_scrub_stamp":"2024-05-08T19:49:39.698182+0000","objects_scrubbed":0,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:11.547766+0000","scrub_duration":0.002355649,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"26'8922","reported_seq":9010,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:52.484440+0000","last_change":"2024-05-08T19:49:52.484599+0000","last_active":"2024-05-08T19:49:52.484440+0000","last_peered":"2024-05-08T19:49:52.484440+0000","last_clean":"2024-05-08T19:49:52.484440+0000","last_became_active":"2024-05-08T19:22:24.616128+0000","last_became_peered":"2024-05-08T19:22:24.616128+0000","last_unstale":"2024-05-08T19:49:52.484440+0000","last_undegraded":"2024-05-08T19:49:52.484440+0000","last_fullsized":"2024-05-08T19:49:52.484440+0000","mapping_epoch":22,"log_start":"26'2512","ondisk_log_start":"26'2512","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8922","last_scrub_stamp":"2024-05-08T19:49:52.484410+0000","last_deep_scrub":"26'8922","last_deep_scrub_stamp":"2024-05-08T19:49:52.484410+0000","last_clean_scrub_stamp":"2024-05-08T19:49:52.484410+0000","objects_scrubbed":0,"log_size":6410,"log_dups_size":0,"ondisk_log_size":6410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:39:50.711136+0000","scrub_duration":0.035431443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":3400,"num_write":6578,"num_write_kb":966197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"26'2352","reported_seq":2394,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:43.584133+0000","last_change":"2024-05-08T19:48:43.584133+0000","last_active":"2024-05-08T19:48:43.584133+0000","last_peered":"2024-05-08T19:48:43.584133+0000","last_clean":"2024-05-08T19:48:43.584133+0000","last_became_active":"2024-05-08T19:22:20.012453+0000","last_became_peered":"2024-05-08T19:22:20.012453+0000","last_unstale":"2024-05-08T19:48:43.584133+0000","last_undegraded":"2024-05-08T19:48:43.584133+0000","last_fullsized":"2024-05-08T19:48:43.584133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2352","last_scrub_stamp":"2024-05-08T19:48:43.583999+0000","last_deep_scrub":"26'2352","last_deep_scrub_stamp":"2024-05-08T19:48:43.583999+0000","last_clean_scrub_stamp":"2024-05-08T19:48:43.583999+0000","objects_scrubbed":3,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:26.944633+0000","scrub_duration":0.023303528,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2351,"num_write_kb":17974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":558,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'2321","reported_seq":2362,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:36.607795+0000","last_change":"2024-05-08T19:49:36.607902+0000","last_active":"2024-05-08T19:49:36.607795+0000","last_peered":"2024-05-08T19:49:36.607795+0000","last_clean":"2024-05-08T19:49:36.607795+0000","last_became_active":"2024-05-08T19:22:20.464396+0000","last_became_peered":"2024-05-08T19:22:20.464396+0000","last_unstale":"2024-05-08T19:49:36.607795+0000","last_undegraded":"2024-05-08T19:49:36.607795+0000","last_fullsized":"2024-05-08T19:49:36.607795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2321","last_scrub_stamp":"2024-05-08T19:49:36.607768+0000","last_deep_scrub":"26'2321","last_deep_scrub_stamp":"2024-05-08T19:49:36.607768+0000","last_clean_scrub_stamp":"2024-05-08T19:49:36.607768+0000","objects_scrubbed":0,"log_size":2321,"log_dups_size":0,"ondisk_log_size":2321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:44.163851+0000","scrub_duration":0.0083147129999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"26'8798","reported_seq":9477,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:56.284630+0000","last_change":"2024-05-08T19:48:56.284630+0000","last_active":"2024-05-08T19:48:56.284630+0000","last_peered":"2024-05-08T19:48:56.284630+0000","last_clean":"2024-05-08T19:48:56.284630+0000","last_became_active":"2024-05-08T19:22:24.469161+0000","last_became_peered":"2024-05-08T19:22:24.469161+0000","last_unstale":"2024-05-08T19:48:56.284630+0000","last_undegraded":"2024-05-08T19:48:56.284630+0000","last_fullsized":"2024-05-08T19:48:56.284630+0000","mapping_epoch":22,"log_start":"26'1644","ondisk_log_start":"26'1644","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8798","last_scrub_stamp":"2024-05-08T19:48:56.284453+0000","last_deep_scrub":"26'8798","last_deep_scrub_stamp":"2024-05-08T19:48:56.284453+0000","last_clean_scrub_stamp":"2024-05-08T19:48:56.284453+0000","objects_scrubbed":0,"log_size":7154,"log_dups_size":0,"ondisk_log_size":7154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:57.383815+0000","scrub_duration":0.029791432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":642,"num_read_kb":43100,"num_write":6354,"num_write_kb":920646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"26'8079","reported_seq":8121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:55.663978+0000","last_change":"2024-05-08T19:48:55.664080+0000","last_active":"2024-05-08T19:48:55.663978+0000","last_peered":"2024-05-08T19:48:55.663978+0000","last_clean":"2024-05-08T19:48:55.663978+0000","last_became_active":"2024-05-08T19:22:20.005723+0000","last_became_peered":"2024-05-08T19:22:20.005723+0000","last_unstale":"2024-05-08T19:48:55.663978+0000","last_undegraded":"2024-05-08T19:48:55.663978+0000","last_fullsized":"2024-05-08T19:48:55.663978+0000","mapping_epoch":17,"log_start":"26'1600","ondisk_log_start":"26'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8079","last_scrub_stamp":"2024-05-08T19:48:55.663952+0000","last_deep_scrub":"26'8079","last_deep_scrub_stamp":"2024-05-08T19:48:55.663952+0000","last_clean_scrub_stamp":"2024-05-08T19:48:55.663952+0000","objects_scrubbed":3,"log_size":6479,"log_dups_size":0,"ondisk_log_size":6479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:23.332609+0000","scrub_duration":0.048122591999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8075,"num_write_kb":50504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'2316","reported_seq":2357,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:42.569048+0000","last_change":"2024-05-08T19:48:42.569048+0000","last_active":"2024-05-08T19:48:42.569048+0000","last_peered":"2024-05-08T19:48:42.569048+0000","last_clean":"2024-05-08T19:48:42.569048+0000","last_became_active":"2024-05-08T19:22:20.446380+0000","last_became_peered":"2024-05-08T19:22:20.446380+0000","last_unstale":"2024-05-08T19:48:42.569048+0000","last_undegraded":"2024-05-08T19:48:42.569048+0000","last_fullsized":"2024-05-08T19:48:42.569048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2316","last_scrub_stamp":"2024-05-08T19:48:42.568919+0000","last_deep_scrub":"26'2316","last_deep_scrub_stamp":"2024-05-08T19:48:42.568919+0000","last_clean_scrub_stamp":"2024-05-08T19:48:42.568919+0000","objects_scrubbed":0,"log_size":2316,"log_dups_size":0,"ondisk_log_size":2316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:21.940168+0000","scrub_duration":0.017202281999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"26'8187","reported_seq":8828,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:34.299442+0000","last_change":"2024-05-08T19:49:34.299442+0000","last_active":"2024-05-08T19:49:34.299442+0000","last_peered":"2024-05-08T19:49:34.299442+0000","last_clean":"2024-05-08T19:49:34.299442+0000","last_became_active":"2024-05-08T19:22:24.464669+0000","last_became_peered":"2024-05-08T19:22:24.464669+0000","last_unstale":"2024-05-08T19:49:34.299442+0000","last_undegraded":"2024-05-08T19:49:34.299442+0000","last_fullsized":"2024-05-08T19:49:34.299442+0000","mapping_epoch":22,"log_start":"26'1003","ondisk_log_start":"26'1003","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8187","last_scrub_stamp":"2024-05-08T19:49:34.299227+0000","last_deep_scrub":"26'8187","last_deep_scrub_stamp":"2024-05-08T19:49:34.299227+0000","last_clean_scrub_stamp":"2024-05-08T19:49:34.299227+0000","objects_scrubbed":0,"log_size":7184,"log_dups_size":0,"ondisk_log_size":7184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:55.151198+0000","scrub_duration":0.025463639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":604,"num_read_kb":22018,"num_write":5721,"num_write_kb":861918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'9230","reported_seq":9270,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:06.001307+0000","last_change":"2024-05-08T19:49:06.001307+0000","last_active":"2024-05-08T19:49:06.001307+0000","last_peered":"2024-05-08T19:49:06.001307+0000","last_clean":"2024-05-08T19:49:06.001307+0000","last_became_active":"2024-05-08T19:22:20.014239+0000","last_became_peered":"2024-05-08T19:22:20.014239+0000","last_unstale":"2024-05-08T19:49:06.001307+0000","last_undegraded":"2024-05-08T19:49:06.001307+0000","last_fullsized":"2024-05-08T19:49:06.001307+0000","mapping_epoch":17,"log_start":"26'2400","ondisk_log_start":"26'2400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9230","last_scrub_stamp":"2024-05-08T19:49:06.001176+0000","last_deep_scrub":"26'9230","last_deep_scrub_stamp":"2024-05-08T19:49:06.001176+0000","last_clean_scrub_stamp":"2024-05-08T19:49:06.001176+0000","objects_scrubbed":4,"log_size":6830,"log_dups_size":0,"ondisk_log_size":6830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:51.390997+0000","scrub_duration":0.063126971000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":9240,"num_write_kb":71812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":103994,"num_omap_keys":158,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'2400","reported_seq":2432,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:09.940152+0000","last_change":"2024-05-08T19:49:09.940263+0000","last_active":"2024-05-08T19:49:09.940152+0000","last_peered":"2024-05-08T19:49:09.940152+0000","last_clean":"2024-05-08T19:49:09.940152+0000","last_became_active":"2024-05-08T19:23:11.054036+0000","last_became_peered":"2024-05-08T19:23:11.054036+0000","last_unstale":"2024-05-08T19:49:09.940152+0000","last_undegraded":"2024-05-08T19:49:09.940152+0000","last_fullsized":"2024-05-08T19:49:09.940152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2400","last_scrub_stamp":"2024-05-08T19:49:09.940123+0000","last_deep_scrub":"26'2400","last_deep_scrub_stamp":"2024-05-08T19:49:09.940123+0000","last_clean_scrub_stamp":"2024-05-08T19:49:09.940123+0000","objects_scrubbed":0,"log_size":2400,"log_dups_size":0,"ondisk_log_size":2400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:09.449845+0000","scrub_duration":0.0021755020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"26'8213","reported_seq":8492,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:03.258502+0000","last_change":"2024-05-08T19:49:03.258502+0000","last_active":"2024-05-08T19:49:03.258502+0000","last_peered":"2024-05-08T19:49:03.258502+0000","last_clean":"2024-05-08T19:49:03.258502+0000","last_became_active":"2024-05-08T19:22:24.479255+0000","last_became_peered":"2024-05-08T19:22:24.479255+0000","last_unstale":"2024-05-08T19:49:03.258502+0000","last_undegraded":"2024-05-08T19:49:03.258502+0000","last_fullsized":"2024-05-08T19:49:03.258502+0000","mapping_epoch":22,"log_start":"26'1000","ondisk_log_start":"26'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8213","last_scrub_stamp":"2024-05-08T19:49:03.258320+0000","last_deep_scrub":"26'8213","last_deep_scrub_stamp":"2024-05-08T19:49:03.258320+0000","last_clean_scrub_stamp":"2024-05-08T19:49:03.258320+0000","objects_scrubbed":0,"log_size":7213,"log_dups_size":0,"ondisk_log_size":7213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:52.934304+0000","scrub_duration":0.032424343000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":15390,"num_write":5835,"num_write_kb":1051850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6116","reported_seq":6156,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.886082+0000","last_change":"2024-05-08T19:48:51.886082+0000","last_active":"2024-05-08T19:48:51.886082+0000","last_peered":"2024-05-08T19:48:51.886082+0000","last_clean":"2024-05-08T19:48:51.886082+0000","last_became_active":"2024-05-08T19:22:20.013793+0000","last_became_peered":"2024-05-08T19:22:20.013793+0000","last_unstale":"2024-05-08T19:48:51.886082+0000","last_undegraded":"2024-05-08T19:48:51.886082+0000","last_fullsized":"2024-05-08T19:48:51.886082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6116","last_scrub_stamp":"2024-05-08T19:48:51.885971+0000","last_deep_scrub":"26'6116","last_deep_scrub_stamp":"2024-05-08T19:48:51.885971+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.885971+0000","objects_scrubbed":2,"log_size":6116,"log_dups_size":0,"ondisk_log_size":6116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:56.172133+0000","scrub_duration":0.024158046999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6127,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":53996,"num_omap_keys":82,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'2307","reported_seq":2345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:22.107359+0000","last_change":"2024-05-08T19:49:22.107485+0000","last_active":"2024-05-08T19:49:22.107359+0000","last_peered":"2024-05-08T19:49:22.107359+0000","last_clean":"2024-05-08T19:49:22.107359+0000","last_became_active":"2024-05-08T19:22:20.455148+0000","last_became_peered":"2024-05-08T19:22:20.455148+0000","last_unstale":"2024-05-08T19:49:22.107359+0000","last_undegraded":"2024-05-08T19:49:22.107359+0000","last_fullsized":"2024-05-08T19:49:22.107359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2307","last_scrub_stamp":"2024-05-08T19:49:22.107331+0000","last_deep_scrub":"26'2307","last_deep_scrub_stamp":"2024-05-08T19:49:22.107331+0000","last_clean_scrub_stamp":"2024-05-08T19:49:22.107331+0000","objects_scrubbed":0,"log_size":2307,"log_dups_size":0,"ondisk_log_size":2307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:11.174690+0000","scrub_duration":0.0059349040000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"26'8426","reported_seq":9298,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:45.595822+0000","last_change":"2024-05-08T19:49:45.595982+0000","last_active":"2024-05-08T19:49:45.595822+0000","last_peered":"2024-05-08T19:49:45.595822+0000","last_clean":"2024-05-08T19:49:45.595822+0000","last_became_active":"2024-05-08T19:22:24.464422+0000","last_became_peered":"2024-05-08T19:22:24.464422+0000","last_unstale":"2024-05-08T19:49:45.595822+0000","last_undegraded":"2024-05-08T19:49:45.595822+0000","last_fullsized":"2024-05-08T19:49:45.595822+0000","mapping_epoch":22,"log_start":"26'2000","ondisk_log_start":"26'2000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8426","last_scrub_stamp":"2024-05-08T19:49:45.595793+0000","last_deep_scrub":"26'8426","last_deep_scrub_stamp":"2024-05-08T19:49:45.595793+0000","last_clean_scrub_stamp":"2024-05-08T19:49:45.595793+0000","objects_scrubbed":0,"log_size":6426,"log_dups_size":0,"ondisk_log_size":6426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:49.397680+0000","scrub_duration":0.030553016999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":836,"num_read_kb":58598,"num_write":5984,"num_write_kb":988108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"26'8502","reported_seq":8542,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:00.593376+0000","last_change":"2024-05-08T19:49:00.593376+0000","last_active":"2024-05-08T19:49:00.593376+0000","last_peered":"2024-05-08T19:49:00.593376+0000","last_clean":"2024-05-08T19:49:00.593376+0000","last_became_active":"2024-05-08T19:22:20.011183+0000","last_became_peered":"2024-05-08T19:22:20.011183+0000","last_unstale":"2024-05-08T19:49:00.593376+0000","last_undegraded":"2024-05-08T19:49:00.593376+0000","last_fullsized":"2024-05-08T19:49:00.593376+0000","mapping_epoch":17,"log_start":"26'2100","ondisk_log_start":"26'2100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8502","last_scrub_stamp":"2024-05-08T19:49:00.593234+0000","last_deep_scrub":"26'8502","last_deep_scrub_stamp":"2024-05-08T19:49:00.593234+0000","last_clean_scrub_stamp":"2024-05-08T19:49:00.593234+0000","objects_scrubbed":1,"log_size":6402,"log_dups_size":0,"ondisk_log_size":6402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:09:58.280772+0000","scrub_duration":0.022856498999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8495,"num_write_kb":66920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'2343","reported_seq":2382,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:44.327587+0000","last_change":"2024-05-08T19:48:44.327587+0000","last_active":"2024-05-08T19:48:44.327587+0000","last_peered":"2024-05-08T19:48:44.327587+0000","last_clean":"2024-05-08T19:48:44.327587+0000","last_became_active":"2024-05-08T19:22:20.439096+0000","last_became_peered":"2024-05-08T19:22:20.439096+0000","last_unstale":"2024-05-08T19:48:44.327587+0000","last_undegraded":"2024-05-08T19:48:44.327587+0000","last_fullsized":"2024-05-08T19:48:44.327587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2343","last_scrub_stamp":"2024-05-08T19:48:44.327466+0000","last_deep_scrub":"26'2343","last_deep_scrub_stamp":"2024-05-08T19:48:44.327466+0000","last_clean_scrub_stamp":"2024-05-08T19:48:44.327466+0000","objects_scrubbed":0,"log_size":2343,"log_dups_size":0,"ondisk_log_size":2343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:23.698715+0000","scrub_duration":0.006452167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'8654","reported_seq":9397,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:55.867311+0000","last_change":"2024-05-08T19:48:55.867311+0000","last_active":"2024-05-08T19:48:55.867311+0000","last_peered":"2024-05-08T19:48:55.867311+0000","last_clean":"2024-05-08T19:48:55.867311+0000","last_became_active":"2024-05-08T19:23:11.529451+0000","last_became_peered":"2024-05-08T19:23:11.529451+0000","last_unstale":"2024-05-08T19:48:55.867311+0000","last_undegraded":"2024-05-08T19:48:55.867311+0000","last_fullsized":"2024-05-08T19:48:55.867311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8654","last_scrub_stamp":"2024-05-08T19:48:55.867135+0000","last_deep_scrub":"26'8654","last_deep_scrub_stamp":"2024-05-08T19:48:55.867135+0000","last_clean_scrub_stamp":"2024-05-08T19:48:55.867135+0000","objects_scrubbed":0,"log_size":8654,"log_dups_size":0,"ondisk_log_size":8654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:14.157078+0000","scrub_duration":0.021771672999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":696,"num_read_kb":42234,"num_write":6185,"num_write_kb":1013081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"26'10410","reported_seq":10450,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:46.696452+0000","last_change":"2024-05-08T19:48:46.696452+0000","last_active":"2024-05-08T19:48:46.696452+0000","last_peered":"2024-05-08T19:48:46.696452+0000","last_clean":"2024-05-08T19:48:46.696452+0000","last_became_active":"2024-05-08T19:22:20.003513+0000","last_became_peered":"2024-05-08T19:22:20.003513+0000","last_unstale":"2024-05-08T19:48:46.696452+0000","last_undegraded":"2024-05-08T19:48:46.696452+0000","last_fullsized":"2024-05-08T19:48:46.696452+0000","mapping_epoch":17,"log_start":"26'2500","ondisk_log_start":"26'2500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10410","last_scrub_stamp":"2024-05-08T19:48:46.696293+0000","last_deep_scrub":"26'10410","last_deep_scrub_stamp":"2024-05-08T19:48:46.696293+0000","last_clean_scrub_stamp":"2024-05-08T19:48:46.696293+0000","objects_scrubbed":2,"log_size":7910,"log_dups_size":0,"ondisk_log_size":7910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:59.423720+0000","scrub_duration":0.035260540999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10404,"num_write_kb":72564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'2281","reported_seq":2320,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.643437+0000","last_change":"2024-05-08T19:48:51.643437+0000","last_active":"2024-05-08T19:48:51.643437+0000","last_peered":"2024-05-08T19:48:51.643437+0000","last_clean":"2024-05-08T19:48:51.643437+0000","last_became_active":"2024-05-08T19:22:20.445238+0000","last_became_peered":"2024-05-08T19:22:20.445238+0000","last_unstale":"2024-05-08T19:48:51.643437+0000","last_undegraded":"2024-05-08T19:48:51.643437+0000","last_fullsized":"2024-05-08T19:48:51.643437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2281","last_scrub_stamp":"2024-05-08T19:48:51.643299+0000","last_deep_scrub":"26'2281","last_deep_scrub_stamp":"2024-05-08T19:48:51.643299+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.643299+0000","objects_scrubbed":0,"log_size":2281,"log_dups_size":0,"ondisk_log_size":2281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:09.933242+0000","scrub_duration":0.0060195379999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'8267","reported_seq":10747,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:43.774504+0000","last_change":"2024-05-08T19:49:43.774676+0000","last_active":"2024-05-08T19:49:43.774504+0000","last_peered":"2024-05-08T19:49:43.774504+0000","last_clean":"2024-05-08T19:49:43.774504+0000","last_became_active":"2024-05-08T19:22:24.478998+0000","last_became_peered":"2024-05-08T19:22:24.478998+0000","last_unstale":"2024-05-08T19:49:43.774504+0000","last_undegraded":"2024-05-08T19:49:43.774504+0000","last_fullsized":"2024-05-08T19:49:43.774504+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8267","last_scrub_stamp":"2024-05-08T19:49:43.774479+0000","last_deep_scrub":"26'8267","last_deep_scrub_stamp":"2024-05-08T19:49:43.774479+0000","last_clean_scrub_stamp":"2024-05-08T19:49:43.774479+0000","objects_scrubbed":0,"log_size":7967,"log_dups_size":0,"ondisk_log_size":7967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:04.626449+0000","scrub_duration":0.023564380999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2441,"num_read_kb":165440,"num_write":5908,"num_write_kb":873319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"26'5852","reported_seq":5892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:08.600865+0000","last_change":"2024-05-08T19:49:08.600961+0000","last_active":"2024-05-08T19:49:08.600865+0000","last_peered":"2024-05-08T19:49:08.600865+0000","last_clean":"2024-05-08T19:49:08.600865+0000","last_became_active":"2024-05-08T19:22:20.002534+0000","last_became_peered":"2024-05-08T19:22:20.002534+0000","last_unstale":"2024-05-08T19:49:08.600865+0000","last_undegraded":"2024-05-08T19:49:08.600865+0000","last_fullsized":"2024-05-08T19:49:08.600865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5852","last_scrub_stamp":"2024-05-08T19:49:08.600840+0000","last_deep_scrub":"26'5852","last_deep_scrub_stamp":"2024-05-08T19:49:08.600840+0000","last_clean_scrub_stamp":"2024-05-08T19:49:08.600840+0000","objects_scrubbed":1,"log_size":5852,"log_dups_size":0,"ondisk_log_size":5852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:04.417043+0000","scrub_duration":0.024786341999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5849,"num_write_kb":40670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"26'2373","reported_seq":2412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:53.652188+0000","last_change":"2024-05-08T19:48:53.652188+0000","last_active":"2024-05-08T19:48:53.652188+0000","last_peered":"2024-05-08T19:48:53.652188+0000","last_clean":"2024-05-08T19:48:53.652188+0000","last_became_active":"2024-05-08T19:22:20.436431+0000","last_became_peered":"2024-05-08T19:22:20.436431+0000","last_unstale":"2024-05-08T19:48:53.652188+0000","last_undegraded":"2024-05-08T19:48:53.652188+0000","last_fullsized":"2024-05-08T19:48:53.652188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2373","last_scrub_stamp":"2024-05-08T19:48:53.652045+0000","last_deep_scrub":"26'2373","last_deep_scrub_stamp":"2024-05-08T19:48:53.652045+0000","last_clean_scrub_stamp":"2024-05-08T19:48:53.652045+0000","objects_scrubbed":0,"log_size":2373,"log_dups_size":0,"ondisk_log_size":2373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:53.161766+0000","scrub_duration":0.0018538879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'8472","reported_seq":9214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:34.756860+0000","last_change":"2024-05-08T19:49:34.757030+0000","last_active":"2024-05-08T19:49:34.756860+0000","last_peered":"2024-05-08T19:49:34.756860+0000","last_clean":"2024-05-08T19:49:34.756860+0000","last_became_active":"2024-05-08T19:22:24.617030+0000","last_became_peered":"2024-05-08T19:22:24.617030+0000","last_unstale":"2024-05-08T19:49:34.756860+0000","last_undegraded":"2024-05-08T19:49:34.756860+0000","last_fullsized":"2024-05-08T19:49:34.756860+0000","mapping_epoch":22,"log_start":"26'1302","ondisk_log_start":"26'1302","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8472","last_scrub_stamp":"2024-05-08T19:49:34.756829+0000","last_deep_scrub":"26'8472","last_deep_scrub_stamp":"2024-05-08T19:49:34.756829+0000","last_clean_scrub_stamp":"2024-05-08T19:49:34.756829+0000","objects_scrubbed":0,"log_size":7170,"log_dups_size":0,"ondisk_log_size":7170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:09.745219+0000","scrub_duration":0.025991957,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":49016,"num_write":6130,"num_write_kb":1037918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"26'9202","reported_seq":9242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:46.507455+0000","last_change":"2024-05-08T19:48:46.507455+0000","last_active":"2024-05-08T19:48:46.507455+0000","last_peered":"2024-05-08T19:48:46.507455+0000","last_clean":"2024-05-08T19:48:46.507455+0000","last_became_active":"2024-05-08T19:22:20.003365+0000","last_became_peered":"2024-05-08T19:22:20.003365+0000","last_unstale":"2024-05-08T19:48:46.507455+0000","last_undegraded":"2024-05-08T19:48:46.507455+0000","last_fullsized":"2024-05-08T19:48:46.507455+0000","mapping_epoch":17,"log_start":"26'1700","ondisk_log_start":"26'1700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9202","last_scrub_stamp":"2024-05-08T19:48:46.507282+0000","last_deep_scrub":"26'9202","last_deep_scrub_stamp":"2024-05-08T19:48:46.507282+0000","last_clean_scrub_stamp":"2024-05-08T19:48:46.507282+0000","objects_scrubbed":0,"log_size":7502,"log_dups_size":0,"ondisk_log_size":7502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:29.867916+0000","scrub_duration":0.0077823199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9189,"num_write_kb":63509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"26'2305","reported_seq":2344,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:00.639014+0000","last_change":"2024-05-08T19:49:00.639014+0000","last_active":"2024-05-08T19:49:00.639014+0000","last_peered":"2024-05-08T19:49:00.639014+0000","last_clean":"2024-05-08T19:49:00.639014+0000","last_became_active":"2024-05-08T19:22:20.437214+0000","last_became_peered":"2024-05-08T19:22:20.437214+0000","last_unstale":"2024-05-08T19:49:00.639014+0000","last_undegraded":"2024-05-08T19:49:00.639014+0000","last_fullsized":"2024-05-08T19:49:00.639014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2305","last_scrub_stamp":"2024-05-08T19:49:00.638891+0000","last_deep_scrub":"26'2305","last_deep_scrub_stamp":"2024-05-08T19:49:00.638891+0000","last_clean_scrub_stamp":"2024-05-08T19:49:00.638891+0000","objects_scrubbed":0,"log_size":2305,"log_dups_size":0,"ondisk_log_size":2305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.738253+0000","scrub_duration":0.0074742209999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"26'8428","reported_seq":8908,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:47.553846+0000","last_change":"2024-05-08T19:49:47.554025+0000","last_active":"2024-05-08T19:49:47.553846+0000","last_peered":"2024-05-08T19:49:47.553846+0000","last_clean":"2024-05-08T19:49:47.553846+0000","last_became_active":"2024-05-08T19:22:24.615351+0000","last_became_peered":"2024-05-08T19:22:24.615351+0000","last_unstale":"2024-05-08T19:49:47.553846+0000","last_undegraded":"2024-05-08T19:49:47.553846+0000","last_fullsized":"2024-05-08T19:49:47.553846+0000","mapping_epoch":22,"log_start":"26'2014","ondisk_log_start":"26'2014","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8428","last_scrub_stamp":"2024-05-08T19:49:47.553818+0000","last_deep_scrub":"26'8428","last_deep_scrub_stamp":"2024-05-08T19:49:47.553818+0000","last_clean_scrub_stamp":"2024-05-08T19:49:47.553818+0000","objects_scrubbed":0,"log_size":6414,"log_dups_size":0,"ondisk_log_size":6414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:18.883148+0000","scrub_duration":0.030594326000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":19968,"num_write":5955,"num_write_kb":994501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"26'7043","reported_seq":7921,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.648311+0000","last_change":"2024-05-08T19:48:54.648311+0000","last_active":"2024-05-08T19:48:54.648311+0000","last_peered":"2024-05-08T19:48:54.648311+0000","last_clean":"2024-05-08T19:48:54.648311+0000","last_became_active":"2024-05-08T19:22:20.001990+0000","last_became_peered":"2024-05-08T19:22:20.001990+0000","last_unstale":"2024-05-08T19:48:54.648311+0000","last_undegraded":"2024-05-08T19:48:54.648311+0000","last_fullsized":"2024-05-08T19:48:54.648311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7043","last_scrub_stamp":"2024-05-08T19:48:54.648187+0000","last_deep_scrub":"26'7043","last_deep_scrub_stamp":"2024-05-08T19:48:54.648187+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.648187+0000","objects_scrubbed":2,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:58.934349+0000","scrub_duration":0.038308684000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":838,"num_read_kb":4635,"num_write":7034,"num_write_kb":49678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"26'2319","reported_seq":2358,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:08.220801+0000","last_change":"2024-05-08T19:49:08.220920+0000","last_active":"2024-05-08T19:49:08.220801+0000","last_peered":"2024-05-08T19:49:08.220801+0000","last_clean":"2024-05-08T19:49:08.220801+0000","last_became_active":"2024-05-08T19:22:20.447475+0000","last_became_peered":"2024-05-08T19:22:20.447475+0000","last_unstale":"2024-05-08T19:49:08.220801+0000","last_undegraded":"2024-05-08T19:49:08.220801+0000","last_fullsized":"2024-05-08T19:49:08.220801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2319","last_scrub_stamp":"2024-05-08T19:49:08.220776+0000","last_deep_scrub":"26'2319","last_deep_scrub_stamp":"2024-05-08T19:49:08.220776+0000","last_clean_scrub_stamp":"2024-05-08T19:49:08.220776+0000","objects_scrubbed":0,"log_size":2319,"log_dups_size":0,"ondisk_log_size":2319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:35.889432+0000","scrub_duration":0.005478826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'7961","reported_seq":8461,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:43.671887+0000","last_change":"2024-05-08T19:49:43.671999+0000","last_active":"2024-05-08T19:49:43.671887+0000","last_peered":"2024-05-08T19:49:43.671887+0000","last_clean":"2024-05-08T19:49:43.671887+0000","last_became_active":"2024-05-08T19:23:11.053733+0000","last_became_peered":"2024-05-08T19:23:11.053733+0000","last_unstale":"2024-05-08T19:49:43.671887+0000","last_undegraded":"2024-05-08T19:49:43.671887+0000","last_fullsized":"2024-05-08T19:49:43.671887+0000","mapping_epoch":25,"log_start":"26'1500","ondisk_log_start":"26'1500","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7961","last_scrub_stamp":"2024-05-08T19:49:43.671863+0000","last_deep_scrub":"26'7961","last_deep_scrub_stamp":"2024-05-08T19:49:43.671863+0000","last_clean_scrub_stamp":"2024-05-08T19:49:43.671863+0000","objects_scrubbed":0,"log_size":6461,"log_dups_size":0,"ondisk_log_size":6461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:01.034953+0000","scrub_duration":0.025539182000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":453,"num_read_kb":17282,"num_write":5569,"num_write_kb":1020101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"26'6225","reported_seq":6265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:48.436975+0000","last_change":"2024-05-08T19:48:48.436975+0000","last_active":"2024-05-08T19:48:48.436975+0000","last_peered":"2024-05-08T19:48:48.436975+0000","last_clean":"2024-05-08T19:48:48.436975+0000","last_became_active":"2024-05-08T19:22:20.000981+0000","last_became_peered":"2024-05-08T19:22:20.000981+0000","last_unstale":"2024-05-08T19:48:48.436975+0000","last_undegraded":"2024-05-08T19:48:48.436975+0000","last_fullsized":"2024-05-08T19:48:48.436975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6225","last_scrub_stamp":"2024-05-08T19:48:48.436851+0000","last_deep_scrub":"26'6225","last_deep_scrub_stamp":"2024-05-08T19:48:48.436851+0000","last_clean_scrub_stamp":"2024-05-08T19:48:48.436851+0000","objects_scrubbed":1,"log_size":6225,"log_dups_size":0,"ondisk_log_size":6225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:52.723014+0000","scrub_duration":0.024176517000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6227,"num_write_kb":45123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"26'2337","reported_seq":2376,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:07.756473+0000","last_change":"2024-05-08T19:49:07.756598+0000","last_active":"2024-05-08T19:49:07.756473+0000","last_peered":"2024-05-08T19:49:07.756473+0000","last_clean":"2024-05-08T19:49:07.756473+0000","last_became_active":"2024-05-08T19:22:20.446644+0000","last_became_peered":"2024-05-08T19:22:20.446644+0000","last_unstale":"2024-05-08T19:49:07.756473+0000","last_undegraded":"2024-05-08T19:49:07.756473+0000","last_fullsized":"2024-05-08T19:49:07.756473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2337","last_scrub_stamp":"2024-05-08T19:49:07.756442+0000","last_deep_scrub":"26'2337","last_deep_scrub_stamp":"2024-05-08T19:49:07.756442+0000","last_clean_scrub_stamp":"2024-05-08T19:49:07.756442+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:28.707928+0000","scrub_duration":0.010132966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"26'8308","reported_seq":8840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:02.281238+0000","last_change":"2024-05-08T19:49:02.281396+0000","last_active":"2024-05-08T19:49:02.281238+0000","last_peered":"2024-05-08T19:49:02.281238+0000","last_clean":"2024-05-08T19:49:02.281238+0000","last_became_active":"2024-05-08T19:22:24.464178+0000","last_became_peered":"2024-05-08T19:22:24.464178+0000","last_unstale":"2024-05-08T19:49:02.281238+0000","last_undegraded":"2024-05-08T19:49:02.281238+0000","last_fullsized":"2024-05-08T19:49:02.281238+0000","mapping_epoch":22,"log_start":"26'1100","ondisk_log_start":"26'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8308","last_scrub_stamp":"2024-05-08T19:49:02.281211+0000","last_deep_scrub":"26'8308","last_deep_scrub_stamp":"2024-05-08T19:49:02.281211+0000","last_clean_scrub_stamp":"2024-05-08T19:49:02.281211+0000","objects_scrubbed":0,"log_size":7208,"log_dups_size":0,"ondisk_log_size":7208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:42.754921+0000","scrub_duration":0.025608511,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":27360,"num_write":5875,"num_write_kb":879779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'6730","reported_seq":6770,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:57.645430+0000","last_change":"2024-05-08T19:48:57.645543+0000","last_active":"2024-05-08T19:48:57.645430+0000","last_peered":"2024-05-08T19:48:57.645430+0000","last_clean":"2024-05-08T19:48:57.645430+0000","last_became_active":"2024-05-08T19:22:20.000985+0000","last_became_peered":"2024-05-08T19:22:20.000985+0000","last_unstale":"2024-05-08T19:48:57.645430+0000","last_undegraded":"2024-05-08T19:48:57.645430+0000","last_fullsized":"2024-05-08T19:48:57.645430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6730","last_scrub_stamp":"2024-05-08T19:48:57.645404+0000","last_deep_scrub":"26'6730","last_deep_scrub_stamp":"2024-05-08T19:48:57.645404+0000","last_clean_scrub_stamp":"2024-05-08T19:48:57.645404+0000","objects_scrubbed":4,"log_size":6730,"log_dups_size":0,"ondisk_log_size":6730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:15.935347+0000","scrub_duration":0.038479950999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":6744,"num_write_kb":41825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":41485,"num_omap_keys":63,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'2335","reported_seq":2374,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:47.378684+0000","last_change":"2024-05-08T19:48:47.378803+0000","last_active":"2024-05-08T19:48:47.378684+0000","last_peered":"2024-05-08T19:48:47.378684+0000","last_clean":"2024-05-08T19:48:47.378684+0000","last_became_active":"2024-05-08T19:22:20.447538+0000","last_became_peered":"2024-05-08T19:22:20.447538+0000","last_unstale":"2024-05-08T19:48:47.378684+0000","last_undegraded":"2024-05-08T19:48:47.378684+0000","last_fullsized":"2024-05-08T19:48:47.378684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2335","last_scrub_stamp":"2024-05-08T19:48:47.378653+0000","last_deep_scrub":"26'2335","last_deep_scrub_stamp":"2024-05-08T19:48:47.378653+0000","last_clean_scrub_stamp":"2024-05-08T19:48:47.378653+0000","objects_scrubbed":0,"log_size":2335,"log_dups_size":0,"ondisk_log_size":2335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:51.664816+0000","scrub_duration":0.0017606900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"26'8591","reported_seq":9145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:38.586463+0000","last_change":"2024-05-08T19:49:38.586637+0000","last_active":"2024-05-08T19:49:38.586463+0000","last_peered":"2024-05-08T19:49:38.586463+0000","last_clean":"2024-05-08T19:49:38.586463+0000","last_became_active":"2024-05-08T19:22:24.479071+0000","last_became_peered":"2024-05-08T19:22:24.479071+0000","last_unstale":"2024-05-08T19:49:38.586463+0000","last_undegraded":"2024-05-08T19:49:38.586463+0000","last_fullsized":"2024-05-08T19:49:38.586463+0000","mapping_epoch":22,"log_start":"26'1203","ondisk_log_start":"26'1203","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8591","last_scrub_stamp":"2024-05-08T19:49:38.586434+0000","last_deep_scrub":"26'8591","last_deep_scrub_stamp":"2024-05-08T19:49:38.586434+0000","last_clean_scrub_stamp":"2024-05-08T19:49:38.586434+0000","objects_scrubbed":0,"log_size":7388,"log_dups_size":0,"ondisk_log_size":7388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:59.438404+0000","scrub_duration":0.028133993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":517,"num_read_kb":30942,"num_write":6185,"num_write_kb":930944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'10879","reported_seq":11547,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.708511+0000","last_change":"2024-05-08T19:48:51.708629+0000","last_active":"2024-05-08T19:48:51.708511+0000","last_peered":"2024-05-08T19:48:51.708511+0000","last_clean":"2024-05-08T19:48:51.708511+0000","last_became_active":"2024-05-08T19:22:20.011331+0000","last_became_peered":"2024-05-08T19:22:20.011331+0000","last_unstale":"2024-05-08T19:48:51.708511+0000","last_undegraded":"2024-05-08T19:48:51.708511+0000","last_fullsized":"2024-05-08T19:48:51.708511+0000","mapping_epoch":17,"log_start":"26'2900","ondisk_log_start":"26'2900","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10879","last_scrub_stamp":"2024-05-08T19:48:51.708487+0000","last_deep_scrub":"26'10879","last_deep_scrub_stamp":"2024-05-08T19:48:51.708487+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.708487+0000","objects_scrubbed":6,"log_size":7979,"log_dups_size":0,"ondisk_log_size":7979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:31.079736+0000","scrub_duration":0.057288780999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":630,"num_read_kb":4505,"num_write":10869,"num_write_kb":72957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":113207,"num_omap_keys":172,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"26'2256","reported_seq":2295,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:38.658381+0000","last_change":"2024-05-08T19:49:38.658473+0000","last_active":"2024-05-08T19:49:38.658381+0000","last_peered":"2024-05-08T19:49:38.658381+0000","last_clean":"2024-05-08T19:49:38.658381+0000","last_became_active":"2024-05-08T19:22:20.447243+0000","last_became_peered":"2024-05-08T19:22:20.447243+0000","last_unstale":"2024-05-08T19:49:38.658381+0000","last_undegraded":"2024-05-08T19:49:38.658381+0000","last_fullsized":"2024-05-08T19:49:38.658381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2256","last_scrub_stamp":"2024-05-08T19:49:38.658350+0000","last_deep_scrub":"26'2256","last_deep_scrub_stamp":"2024-05-08T19:49:38.658350+0000","last_clean_scrub_stamp":"2024-05-08T19:49:38.658350+0000","objects_scrubbed":0,"log_size":2256,"log_dups_size":0,"ondisk_log_size":2256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:13.646739+0000","scrub_duration":0.0038894189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'8691","reported_seq":9105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:45.350905+0000","last_change":"2024-05-08T19:49:45.351055+0000","last_active":"2024-05-08T19:49:45.350905+0000","last_peered":"2024-05-08T19:49:45.350905+0000","last_clean":"2024-05-08T19:49:45.350905+0000","last_became_active":"2024-05-08T19:22:24.614790+0000","last_became_peered":"2024-05-08T19:22:24.614790+0000","last_unstale":"2024-05-08T19:49:45.350905+0000","last_undegraded":"2024-05-08T19:49:45.350905+0000","last_fullsized":"2024-05-08T19:49:45.350905+0000","mapping_epoch":22,"log_start":"26'1126","ondisk_log_start":"26'1126","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8691","last_scrub_stamp":"2024-05-08T19:49:45.350878+0000","last_deep_scrub":"26'8691","last_deep_scrub_stamp":"2024-05-08T19:49:45.350878+0000","last_clean_scrub_stamp":"2024-05-08T19:49:45.350878+0000","objects_scrubbed":0,"log_size":7565,"log_dups_size":0,"ondisk_log_size":7565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:02:03.149960+0000","scrub_duration":0.027897755,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":377,"num_read_kb":22514,"num_write":6361,"num_write_kb":865965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"26'5001","reported_seq":5041,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:45.598699+0000","last_change":"2024-05-08T19:48:45.598794+0000","last_active":"2024-05-08T19:48:45.598699+0000","last_peered":"2024-05-08T19:48:45.598699+0000","last_clean":"2024-05-08T19:48:45.598699+0000","last_became_active":"2024-05-08T19:22:20.005738+0000","last_became_peered":"2024-05-08T19:22:20.005738+0000","last_unstale":"2024-05-08T19:48:45.598699+0000","last_undegraded":"2024-05-08T19:48:45.598699+0000","last_fullsized":"2024-05-08T19:48:45.598699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5001","last_scrub_stamp":"2024-05-08T19:48:45.598671+0000","last_deep_scrub":"26'5001","last_deep_scrub_stamp":"2024-05-08T19:48:45.598671+0000","last_clean_scrub_stamp":"2024-05-08T19:48:45.598671+0000","objects_scrubbed":3,"log_size":5001,"log_dups_size":0,"ondisk_log_size":5001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:49.884833+0000","scrub_duration":0.024799128,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5000,"num_write_kb":36069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"26'2337","reported_seq":2376,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:05.739978+0000","last_change":"2024-05-08T19:49:05.740082+0000","last_active":"2024-05-08T19:49:05.739978+0000","last_peered":"2024-05-08T19:49:05.739978+0000","last_clean":"2024-05-08T19:49:05.739978+0000","last_became_active":"2024-05-08T19:22:20.448268+0000","last_became_peered":"2024-05-08T19:22:20.448268+0000","last_unstale":"2024-05-08T19:49:05.739978+0000","last_undegraded":"2024-05-08T19:49:05.739978+0000","last_fullsized":"2024-05-08T19:49:05.739978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2337","last_scrub_stamp":"2024-05-08T19:49:05.739949+0000","last_deep_scrub":"26'2337","last_deep_scrub_stamp":"2024-05-08T19:49:05.739949+0000","last_clean_scrub_stamp":"2024-05-08T19:49:05.739949+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:05.249670+0000","scrub_duration":0.0023711069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"26'8215","reported_seq":8351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:46.568752+0000","last_change":"2024-05-08T19:49:46.568912+0000","last_active":"2024-05-08T19:49:46.568752+0000","last_peered":"2024-05-08T19:49:46.568752+0000","last_clean":"2024-05-08T19:49:46.568752+0000","last_became_active":"2024-05-08T19:22:24.613698+0000","last_became_peered":"2024-05-08T19:22:24.613698+0000","last_unstale":"2024-05-08T19:49:46.568752+0000","last_undegraded":"2024-05-08T19:49:46.568752+0000","last_fullsized":"2024-05-08T19:49:46.568752+0000","mapping_epoch":22,"log_start":"26'1759","ondisk_log_start":"26'1759","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8215","last_scrub_stamp":"2024-05-08T19:49:46.568725+0000","last_deep_scrub":"26'8215","last_deep_scrub_stamp":"2024-05-08T19:49:46.568725+0000","last_clean_scrub_stamp":"2024-05-08T19:49:46.568725+0000","objects_scrubbed":0,"log_size":6456,"log_dups_size":0,"ondisk_log_size":6456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:51:32.714877+0000","scrub_duration":0.022731174999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":5304,"num_write":5835,"num_write_kb":1072126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'2641","reported_seq":2681,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:57.371355+0000","last_change":"2024-05-08T19:48:57.371495+0000","last_active":"2024-05-08T19:48:57.371355+0000","last_peered":"2024-05-08T19:48:57.371355+0000","last_clean":"2024-05-08T19:48:57.371355+0000","last_became_active":"2024-05-08T19:22:20.011188+0000","last_became_peered":"2024-05-08T19:22:20.011188+0000","last_unstale":"2024-05-08T19:48:57.371355+0000","last_undegraded":"2024-05-08T19:48:57.371355+0000","last_fullsized":"2024-05-08T19:48:57.371355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2641","last_scrub_stamp":"2024-05-08T19:48:57.371296+0000","last_deep_scrub":"26'2641","last_deep_scrub_stamp":"2024-05-08T19:48:57.371296+0000","last_clean_scrub_stamp":"2024-05-08T19:48:57.371296+0000","objects_scrubbed":1,"log_size":2641,"log_dups_size":0,"ondisk_log_size":2641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:05:58.470658+0000","scrub_duration":0.02237304,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2647,"num_write_kb":22132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'2373","reported_seq":2412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:42.845985+0000","last_change":"2024-05-08T19:48:42.846073+0000","last_active":"2024-05-08T19:48:42.845985+0000","last_peered":"2024-05-08T19:48:42.845985+0000","last_clean":"2024-05-08T19:48:42.845985+0000","last_became_active":"2024-05-08T19:22:20.455562+0000","last_became_peered":"2024-05-08T19:22:20.455562+0000","last_unstale":"2024-05-08T19:48:42.845985+0000","last_undegraded":"2024-05-08T19:48:42.845985+0000","last_fullsized":"2024-05-08T19:48:42.845985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2373","last_scrub_stamp":"2024-05-08T19:48:42.845961+0000","last_deep_scrub":"26'2373","last_deep_scrub_stamp":"2024-05-08T19:48:42.845961+0000","last_clean_scrub_stamp":"2024-05-08T19:48:42.845961+0000","objects_scrubbed":0,"log_size":2373,"log_dups_size":0,"ondisk_log_size":2373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:59.674185+0000","scrub_duration":0.0025479779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"26'8227","reported_seq":8416,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:48.522259+0000","last_change":"2024-05-08T19:49:48.522430+0000","last_active":"2024-05-08T19:49:48.522259+0000","last_peered":"2024-05-08T19:49:48.522259+0000","last_clean":"2024-05-08T19:49:48.522259+0000","last_became_active":"2024-05-08T19:22:24.615618+0000","last_became_peered":"2024-05-08T19:22:24.615618+0000","last_unstale":"2024-05-08T19:49:48.522259+0000","last_undegraded":"2024-05-08T19:49:48.522259+0000","last_fullsized":"2024-05-08T19:49:48.522259+0000","mapping_epoch":22,"log_start":"26'1815","ondisk_log_start":"26'1815","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8227","last_scrub_stamp":"2024-05-08T19:49:48.522232+0000","last_deep_scrub":"26'8227","last_deep_scrub_stamp":"2024-05-08T19:49:48.522232+0000","last_clean_scrub_stamp":"2024-05-08T19:49:48.522232+0000","objects_scrubbed":0,"log_size":6412,"log_dups_size":0,"ondisk_log_size":6412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:04.461747+0000","scrub_duration":0.027107539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":3194,"num_write":5725,"num_write_kb":833306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"26'3932","reported_seq":3972,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:44.648094+0000","last_change":"2024-05-08T19:48:44.648189+0000","last_active":"2024-05-08T19:48:44.648094+0000","last_peered":"2024-05-08T19:48:44.648094+0000","last_clean":"2024-05-08T19:48:44.648094+0000","last_became_active":"2024-05-08T19:22:20.003725+0000","last_became_peered":"2024-05-08T19:22:20.003725+0000","last_unstale":"2024-05-08T19:48:44.648094+0000","last_undegraded":"2024-05-08T19:48:44.648094+0000","last_fullsized":"2024-05-08T19:48:44.648094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3932","last_scrub_stamp":"2024-05-08T19:48:44.648068+0000","last_deep_scrub":"26'3932","last_deep_scrub_stamp":"2024-05-08T19:48:44.648068+0000","last_clean_scrub_stamp":"2024-05-08T19:48:44.648068+0000","objects_scrubbed":2,"log_size":3932,"log_dups_size":0,"ondisk_log_size":3932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:01.476291+0000","scrub_duration":0.034361632000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3928,"num_write_kb":31166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"26'2246","reported_seq":2285,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:04.571285+0000","last_change":"2024-05-08T19:49:04.571392+0000","last_active":"2024-05-08T19:49:04.571285+0000","last_peered":"2024-05-08T19:49:04.571285+0000","last_clean":"2024-05-08T19:49:04.571285+0000","last_became_active":"2024-05-08T19:22:20.452496+0000","last_became_peered":"2024-05-08T19:22:20.452496+0000","last_unstale":"2024-05-08T19:49:04.571285+0000","last_undegraded":"2024-05-08T19:49:04.571285+0000","last_fullsized":"2024-05-08T19:49:04.571285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2246","last_scrub_stamp":"2024-05-08T19:49:04.571260+0000","last_deep_scrub":"26'2246","last_deep_scrub_stamp":"2024-05-08T19:49:04.571260+0000","last_clean_scrub_stamp":"2024-05-08T19:49:04.571260+0000","objects_scrubbed":0,"log_size":2246,"log_dups_size":0,"ondisk_log_size":2246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:05.670622+0000","scrub_duration":0.00192366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"26'8446","reported_seq":9063,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:39.745460+0000","last_change":"2024-05-08T19:49:39.745636+0000","last_active":"2024-05-08T19:49:39.745460+0000","last_peered":"2024-05-08T19:49:39.745460+0000","last_clean":"2024-05-08T19:49:39.745460+0000","last_became_active":"2024-05-08T19:22:24.477728+0000","last_became_peered":"2024-05-08T19:22:24.477728+0000","last_unstale":"2024-05-08T19:49:39.745460+0000","last_undegraded":"2024-05-08T19:49:39.745460+0000","last_fullsized":"2024-05-08T19:49:39.745460+0000","mapping_epoch":22,"log_start":"26'1217","ondisk_log_start":"26'1217","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8446","last_scrub_stamp":"2024-05-08T19:49:39.745431+0000","last_deep_scrub":"26'8446","last_deep_scrub_stamp":"2024-05-08T19:49:39.745431+0000","last_clean_scrub_stamp":"2024-05-08T19:49:39.745431+0000","objects_scrubbed":0,"log_size":7229,"log_dups_size":0,"ondisk_log_size":7229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:39.208288+0000","scrub_duration":0.027670303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":39960,"num_write":6024,"num_write_kb":827712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"26'5273","reported_seq":5313,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:47.999042+0000","last_change":"2024-05-08T19:48:47.999179+0000","last_active":"2024-05-08T19:48:47.999042+0000","last_peered":"2024-05-08T19:48:47.999042+0000","last_clean":"2024-05-08T19:48:47.999042+0000","last_became_active":"2024-05-08T19:22:20.007985+0000","last_became_peered":"2024-05-08T19:22:20.007985+0000","last_unstale":"2024-05-08T19:48:47.999042+0000","last_undegraded":"2024-05-08T19:48:47.999042+0000","last_fullsized":"2024-05-08T19:48:47.999042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5273","last_scrub_stamp":"2024-05-08T19:48:47.999018+0000","last_deep_scrub":"26'5273","last_deep_scrub_stamp":"2024-05-08T19:48:47.999018+0000","last_clean_scrub_stamp":"2024-05-08T19:48:47.999018+0000","objects_scrubbed":9,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:31.359653+0000","scrub_duration":0.067476978000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":5295,"num_write_kb":36936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":463383,"num_omap_keys":704,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"26'2365","reported_seq":2404,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:43.835331+0000","last_change":"2024-05-08T19:48:43.835445+0000","last_active":"2024-05-08T19:48:43.835331+0000","last_peered":"2024-05-08T19:48:43.835331+0000","last_clean":"2024-05-08T19:48:43.835331+0000","last_became_active":"2024-05-08T19:22:20.458588+0000","last_became_peered":"2024-05-08T19:22:20.458588+0000","last_unstale":"2024-05-08T19:48:43.835331+0000","last_undegraded":"2024-05-08T19:48:43.835331+0000","last_fullsized":"2024-05-08T19:48:43.835331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2365","last_scrub_stamp":"2024-05-08T19:48:43.835306+0000","last_deep_scrub":"26'2365","last_deep_scrub_stamp":"2024-05-08T19:48:43.835306+0000","last_clean_scrub_stamp":"2024-05-08T19:48:43.835306+0000","objects_scrubbed":0,"log_size":2365,"log_dups_size":0,"ondisk_log_size":2365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:28.364339+0000","scrub_duration":0.001815826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"26'8533","reported_seq":10215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:22.144613+0000","last_change":"2024-05-08T19:49:22.144774+0000","last_active":"2024-05-08T19:49:22.144613+0000","last_peered":"2024-05-08T19:49:22.144613+0000","last_clean":"2024-05-08T19:49:22.144613+0000","last_became_active":"2024-05-08T19:22:24.463741+0000","last_became_peered":"2024-05-08T19:22:24.463741+0000","last_unstale":"2024-05-08T19:49:22.144613+0000","last_undegraded":"2024-05-08T19:49:22.144613+0000","last_fullsized":"2024-05-08T19:49:22.144613+0000","mapping_epoch":22,"log_start":"26'1304","ondisk_log_start":"26'1304","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8533","last_scrub_stamp":"2024-05-08T19:49:22.144585+0000","last_deep_scrub":"26'8533","last_deep_scrub_stamp":"2024-05-08T19:49:22.144585+0000","last_clean_scrub_stamp":"2024-05-08T19:49:22.144585+0000","objects_scrubbed":0,"log_size":7229,"log_dups_size":0,"ondisk_log_size":7229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:11.211944+0000","scrub_duration":0.020974245999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1644,"num_read_kb":83588,"num_write":6135,"num_write_kb":944540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"26'5914","reported_seq":5955,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.373290+0000","last_change":"2024-05-08T19:48:40.373290+0000","last_active":"2024-05-08T19:48:40.373290+0000","last_peered":"2024-05-08T19:48:40.373290+0000","last_clean":"2024-05-08T19:48:40.373290+0000","last_became_active":"2024-05-08T19:22:20.005680+0000","last_became_peered":"2024-05-08T19:22:20.005680+0000","last_unstale":"2024-05-08T19:48:40.373290+0000","last_undegraded":"2024-05-08T19:48:40.373290+0000","last_fullsized":"2024-05-08T19:48:40.373290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5914","last_scrub_stamp":"2024-05-08T19:48:40.373183+0000","last_deep_scrub":"26'5914","last_deep_scrub_stamp":"2024-05-08T19:48:40.373183+0000","last_clean_scrub_stamp":"2024-05-08T19:48:40.373183+0000","objects_scrubbed":3,"log_size":5914,"log_dups_size":0,"ondisk_log_size":5914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:53.100609+0000","scrub_duration":0.036371251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5920,"num_write_kb":40735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"26'2309","reported_seq":2349,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:11.899815+0000","last_change":"2024-05-08T19:49:11.899815+0000","last_active":"2024-05-08T19:49:11.899815+0000","last_peered":"2024-05-08T19:49:11.899815+0000","last_clean":"2024-05-08T19:49:11.899815+0000","last_became_active":"2024-05-08T19:22:20.449512+0000","last_became_peered":"2024-05-08T19:22:20.449512+0000","last_unstale":"2024-05-08T19:49:11.899815+0000","last_undegraded":"2024-05-08T19:49:11.899815+0000","last_fullsized":"2024-05-08T19:49:11.899815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2309","last_scrub_stamp":"2024-05-08T19:49:11.899665+0000","last_deep_scrub":"26'2309","last_deep_scrub_stamp":"2024-05-08T19:49:11.899665+0000","last_clean_scrub_stamp":"2024-05-08T19:49:11.899665+0000","objects_scrubbed":0,"log_size":2309,"log_dups_size":0,"ondisk_log_size":2309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:39.568321+0000","scrub_duration":0.0016931680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"26'8843","reported_seq":9140,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:25.551342+0000","last_change":"2024-05-08T19:49:25.551342+0000","last_active":"2024-05-08T19:49:25.551342+0000","last_peered":"2024-05-08T19:49:25.551342+0000","last_clean":"2024-05-08T19:49:25.551342+0000","last_became_active":"2024-05-08T19:22:24.478248+0000","last_became_peered":"2024-05-08T19:22:24.478248+0000","last_unstale":"2024-05-08T19:49:25.551342+0000","last_undegraded":"2024-05-08T19:49:25.551342+0000","last_fullsized":"2024-05-08T19:49:25.551342+0000","mapping_epoch":22,"log_start":"26'1512","ondisk_log_start":"26'1512","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8843","last_scrub_stamp":"2024-05-08T19:49:25.551173+0000","last_deep_scrub":"26'8843","last_deep_scrub_stamp":"2024-05-08T19:49:25.551173+0000","last_clean_scrub_stamp":"2024-05-08T19:49:25.551173+0000","objects_scrubbed":0,"log_size":7331,"log_dups_size":0,"ondisk_log_size":7331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:21.367377+0000","scrub_duration":0.025640639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":14826,"num_write":6450,"num_write_kb":856300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"26'7016","reported_seq":7058,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:48.585465+0000","last_change":"2024-05-08T19:48:48.585465+0000","last_active":"2024-05-08T19:48:48.585465+0000","last_peered":"2024-05-08T19:48:48.585465+0000","last_clean":"2024-05-08T19:48:48.585465+0000","last_became_active":"2024-05-08T19:22:20.003055+0000","last_became_peered":"2024-05-08T19:22:20.003055+0000","last_unstale":"2024-05-08T19:48:48.585465+0000","last_undegraded":"2024-05-08T19:48:48.585465+0000","last_fullsized":"2024-05-08T19:48:48.585465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7016","last_scrub_stamp":"2024-05-08T19:48:48.585336+0000","last_deep_scrub":"26'7016","last_deep_scrub_stamp":"2024-05-08T19:48:48.585336+0000","last_clean_scrub_stamp":"2024-05-08T19:48:48.585336+0000","objects_scrubbed":2,"log_size":7016,"log_dups_size":0,"ondisk_log_size":7016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:27.956585+0000","scrub_duration":0.041923031999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7021,"num_write_kb":53638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"26'2305","reported_seq":2346,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:45.486911+0000","last_change":"2024-05-08T19:48:45.486911+0000","last_active":"2024-05-08T19:48:45.486911+0000","last_peered":"2024-05-08T19:48:45.486911+0000","last_clean":"2024-05-08T19:48:45.486911+0000","last_became_active":"2024-05-08T19:22:20.449693+0000","last_became_peered":"2024-05-08T19:22:20.449693+0000","last_unstale":"2024-05-08T19:48:45.486911+0000","last_undegraded":"2024-05-08T19:48:45.486911+0000","last_fullsized":"2024-05-08T19:48:45.486911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2305","last_scrub_stamp":"2024-05-08T19:48:45.486775+0000","last_deep_scrub":"26'2305","last_deep_scrub_stamp":"2024-05-08T19:48:45.486775+0000","last_clean_scrub_stamp":"2024-05-08T19:48:45.486775+0000","objects_scrubbed":0,"log_size":2305,"log_dups_size":0,"ondisk_log_size":2305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:24.858024+0000","scrub_duration":0.0061246510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'8998","reported_seq":9182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:27.535597+0000","last_change":"2024-05-08T19:49:27.535597+0000","last_active":"2024-05-08T19:49:27.535597+0000","last_peered":"2024-05-08T19:49:27.535597+0000","last_clean":"2024-05-08T19:49:27.535597+0000","last_became_active":"2024-05-08T19:22:24.472518+0000","last_became_peered":"2024-05-08T19:22:24.472518+0000","last_unstale":"2024-05-08T19:49:27.535597+0000","last_undegraded":"2024-05-08T19:49:27.535597+0000","last_fullsized":"2024-05-08T19:49:27.535597+0000","mapping_epoch":22,"log_start":"26'1583","ondisk_log_start":"26'1583","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8998","last_scrub_stamp":"2024-05-08T19:49:27.535411+0000","last_deep_scrub":"26'8998","last_deep_scrub_stamp":"2024-05-08T19:49:27.535411+0000","last_clean_scrub_stamp":"2024-05-08T19:49:27.535411+0000","objects_scrubbed":0,"log_size":7415,"log_dups_size":0,"ondisk_log_size":7415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:15.474640+0000","scrub_duration":0.029089591000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":5460,"num_write":6563,"num_write_kb":1024036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"26'7864","reported_seq":7906,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.424101+0000","last_change":"2024-05-08T19:48:54.424101+0000","last_active":"2024-05-08T19:48:54.424101+0000","last_peered":"2024-05-08T19:48:54.424101+0000","last_clean":"2024-05-08T19:48:54.424101+0000","last_became_active":"2024-05-08T19:22:20.007542+0000","last_became_peered":"2024-05-08T19:22:20.007542+0000","last_unstale":"2024-05-08T19:48:54.424101+0000","last_undegraded":"2024-05-08T19:48:54.424101+0000","last_fullsized":"2024-05-08T19:48:54.424101+0000","mapping_epoch":17,"log_start":"26'300","ondisk_log_start":"26'300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7864","last_scrub_stamp":"2024-05-08T19:48:54.423939+0000","last_deep_scrub":"26'7864","last_deep_scrub_stamp":"2024-05-08T19:48:54.423939+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.423939+0000","objects_scrubbed":0,"log_size":7564,"log_dups_size":0,"ondisk_log_size":7564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:12.713883+0000","scrub_duration":0.007576635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7858,"num_write_kb":54448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'2322","reported_seq":2363,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.283508+0000","last_change":"2024-05-08T19:48:51.283508+0000","last_active":"2024-05-08T19:48:51.283508+0000","last_peered":"2024-05-08T19:48:51.283508+0000","last_clean":"2024-05-08T19:48:51.283508+0000","last_became_active":"2024-05-08T19:22:20.443049+0000","last_became_peered":"2024-05-08T19:22:20.443049+0000","last_unstale":"2024-05-08T19:48:51.283508+0000","last_undegraded":"2024-05-08T19:48:51.283508+0000","last_fullsized":"2024-05-08T19:48:51.283508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2322","last_scrub_stamp":"2024-05-08T19:48:51.283371+0000","last_deep_scrub":"26'2322","last_deep_scrub_stamp":"2024-05-08T19:48:51.283371+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.283371+0000","objects_scrubbed":0,"log_size":2322,"log_dups_size":0,"ondisk_log_size":2322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:41.266333+0000","scrub_duration":0.0034339180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"26'8111","reported_seq":9106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:05.878734+0000","last_change":"2024-05-08T19:49:05.878734+0000","last_active":"2024-05-08T19:49:05.878734+0000","last_peered":"2024-05-08T19:49:05.878734+0000","last_clean":"2024-05-08T19:49:05.878734+0000","last_became_active":"2024-05-08T19:23:11.532148+0000","last_became_peered":"2024-05-08T19:23:11.532148+0000","last_unstale":"2024-05-08T19:49:05.878734+0000","last_undegraded":"2024-05-08T19:49:05.878734+0000","last_fullsized":"2024-05-08T19:49:05.878734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8111","last_scrub_stamp":"2024-05-08T19:49:05.878535+0000","last_deep_scrub":"26'8111","last_deep_scrub_stamp":"2024-05-08T19:49:05.878535+0000","last_clean_scrub_stamp":"2024-05-08T19:49:05.878535+0000","objects_scrubbed":0,"log_size":8111,"log_dups_size":0,"ondisk_log_size":8111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:51.268356+0000","scrub_duration":0.036970507,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":959,"num_read_kb":67642,"num_write":5666,"num_write_kb":895823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'2313","reported_seq":2354,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:13.665463+0000","last_change":"2024-05-08T19:49:13.665588+0000","last_active":"2024-05-08T19:49:13.665463+0000","last_peered":"2024-05-08T19:49:13.665463+0000","last_clean":"2024-05-08T19:49:13.665463+0000","last_became_active":"2024-05-08T19:22:20.449709+0000","last_became_peered":"2024-05-08T19:22:20.449709+0000","last_unstale":"2024-05-08T19:49:13.665463+0000","last_undegraded":"2024-05-08T19:49:13.665463+0000","last_fullsized":"2024-05-08T19:49:13.665463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2313","last_scrub_stamp":"2024-05-08T19:49:13.665434+0000","last_deep_scrub":"26'2313","last_deep_scrub_stamp":"2024-05-08T19:49:13.665434+0000","last_clean_scrub_stamp":"2024-05-08T19:49:13.665434+0000","objects_scrubbed":0,"log_size":2313,"log_dups_size":0,"ondisk_log_size":2313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:59.624034+0000","scrub_duration":0.001892431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'7717","reported_seq":8694,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:40.096442+0000","last_change":"2024-05-08T19:48:40.096442+0000","last_active":"2024-05-08T19:48:40.096442+0000","last_peered":"2024-05-08T19:48:40.096442+0000","last_clean":"2024-05-08T19:48:40.096442+0000","last_became_active":"2024-05-08T19:22:20.004404+0000","last_became_peered":"2024-05-08T19:22:20.004404+0000","last_unstale":"2024-05-08T19:48:40.096442+0000","last_undegraded":"2024-05-08T19:48:40.096442+0000","last_fullsized":"2024-05-08T19:48:40.096442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7717","last_scrub_stamp":"2024-05-08T19:48:40.096323+0000","last_deep_scrub":"26'7717","last_deep_scrub_stamp":"2024-05-08T19:48:40.096323+0000","last_clean_scrub_stamp":"2024-05-08T19:48:40.096323+0000","objects_scrubbed":2,"log_size":7717,"log_dups_size":0,"ondisk_log_size":7717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:30.861928+0000","scrub_duration":0.037188867,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":935,"num_read_kb":4706,"num_write":7717,"num_write_kb":54235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"26'8484","reported_seq":9053,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:38.682638+0000","last_change":"2024-05-08T19:49:38.682638+0000","last_active":"2024-05-08T19:49:38.682638+0000","last_peered":"2024-05-08T19:49:38.682638+0000","last_clean":"2024-05-08T19:49:38.682638+0000","last_became_active":"2024-05-08T19:22:24.617627+0000","last_became_peered":"2024-05-08T19:22:24.617627+0000","last_unstale":"2024-05-08T19:49:38.682638+0000","last_undegraded":"2024-05-08T19:49:38.682638+0000","last_fullsized":"2024-05-08T19:49:38.682638+0000","mapping_epoch":22,"log_start":"26'574","ondisk_log_start":"26'574","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8484","last_scrub_stamp":"2024-05-08T19:49:38.682469+0000","last_deep_scrub":"26'8484","last_deep_scrub_stamp":"2024-05-08T19:49:38.682469+0000","last_clean_scrub_stamp":"2024-05-08T19:49:38.682469+0000","objects_scrubbed":0,"log_size":7910,"log_dups_size":0,"ondisk_log_size":7910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:47.622612+0000","scrub_duration":0.029399029,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":27006,"num_write":6146,"num_write_kb":958865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"26'2364","reported_seq":2405,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:30.494468+0000","last_change":"2024-05-08T19:49:30.494468+0000","last_active":"2024-05-08T19:49:30.494468+0000","last_peered":"2024-05-08T19:49:30.494468+0000","last_clean":"2024-05-08T19:49:30.494468+0000","last_became_active":"2024-05-08T19:22:20.446864+0000","last_became_peered":"2024-05-08T19:22:20.446864+0000","last_unstale":"2024-05-08T19:49:30.494468+0000","last_undegraded":"2024-05-08T19:49:30.494468+0000","last_fullsized":"2024-05-08T19:49:30.494468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2364","last_scrub_stamp":"2024-05-08T19:49:30.494328+0000","last_deep_scrub":"26'2364","last_deep_scrub_stamp":"2024-05-08T19:49:30.494328+0000","last_clean_scrub_stamp":"2024-05-08T19:49:30.494328+0000","objects_scrubbed":0,"log_size":2364,"log_dups_size":0,"ondisk_log_size":2364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:29.957185+0000","scrub_duration":0.002579989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'5126","reported_seq":5168,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:52.379727+0000","last_change":"2024-05-08T19:48:52.379727+0000","last_active":"2024-05-08T19:48:52.379727+0000","last_peered":"2024-05-08T19:48:52.379727+0000","last_clean":"2024-05-08T19:48:52.379727+0000","last_became_active":"2024-05-08T19:22:20.003441+0000","last_became_peered":"2024-05-08T19:22:20.003441+0000","last_unstale":"2024-05-08T19:48:52.379727+0000","last_undegraded":"2024-05-08T19:48:52.379727+0000","last_fullsized":"2024-05-08T19:48:52.379727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5126","last_scrub_stamp":"2024-05-08T19:48:52.379584+0000","last_deep_scrub":"26'5126","last_deep_scrub_stamp":"2024-05-08T19:48:52.379584+0000","last_clean_scrub_stamp":"2024-05-08T19:48:52.379584+0000","objects_scrubbed":0,"log_size":5126,"log_dups_size":0,"ondisk_log_size":5126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:42.362547+0000","scrub_duration":0.0049865459999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5120,"num_write_kb":36122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.898947+0000","last_change":"2024-05-08T19:48:49.899073+0000","last_active":"2024-05-08T19:48:49.898947+0000","last_peered":"2024-05-08T19:48:49.898947+0000","last_clean":"2024-05-08T19:48:49.898947+0000","last_became_active":"2024-05-08T19:22:17.116272+0000","last_became_peered":"2024-05-08T19:22:17.116272+0000","last_unstale":"2024-05-08T19:48:49.898947+0000","last_undegraded":"2024-05-08T19:48:49.898947+0000","last_fullsized":"2024-05-08T19:48:49.898947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-05-08T19:48:49.898920+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-05-08T19:48:49.898920+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.898920+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:35.156807+0000","scrub_duration":0.007153057,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'8661","reported_seq":8779,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:35.753923+0000","last_change":"2024-05-08T19:49:35.754095+0000","last_active":"2024-05-08T19:49:35.753923+0000","last_peered":"2024-05-08T19:49:35.753923+0000","last_clean":"2024-05-08T19:49:35.753923+0000","last_became_active":"2024-05-08T19:22:24.616486+0000","last_became_peered":"2024-05-08T19:22:24.616486+0000","last_unstale":"2024-05-08T19:49:35.753923+0000","last_undegraded":"2024-05-08T19:49:35.753923+0000","last_fullsized":"2024-05-08T19:49:35.753923+0000","mapping_epoch":22,"log_start":"26'1423","ondisk_log_start":"26'1423","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8661","last_scrub_stamp":"2024-05-08T19:49:35.753895+0000","last_deep_scrub":"26'8661","last_deep_scrub_stamp":"2024-05-08T19:49:35.753895+0000","last_clean_scrub_stamp":"2024-05-08T19:49:35.753895+0000","objects_scrubbed":0,"log_size":7238,"log_dups_size":0,"ondisk_log_size":7238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:07.603479+0000","scrub_duration":0.025977360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":5028,"num_write":6258,"num_write_kb":895883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"26'2257","reported_seq":2298,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:48.540554+0000","last_change":"2024-05-08T19:48:48.540554+0000","last_active":"2024-05-08T19:48:48.540554+0000","last_peered":"2024-05-08T19:48:48.540554+0000","last_clean":"2024-05-08T19:48:48.540554+0000","last_became_active":"2024-05-08T19:22:20.445191+0000","last_became_peered":"2024-05-08T19:22:20.445191+0000","last_unstale":"2024-05-08T19:48:48.540554+0000","last_undegraded":"2024-05-08T19:48:48.540554+0000","last_fullsized":"2024-05-08T19:48:48.540554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2257","last_scrub_stamp":"2024-05-08T19:48:48.540400+0000","last_deep_scrub":"26'2257","last_deep_scrub_stamp":"2024-05-08T19:48:48.540400+0000","last_clean_scrub_stamp":"2024-05-08T19:48:48.540400+0000","objects_scrubbed":0,"log_size":2257,"log_dups_size":0,"ondisk_log_size":2257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:38.523363+0000","scrub_duration":0.0020860969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'8076","reported_seq":8118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:50.921979+0000","last_change":"2024-05-08T19:48:50.922101+0000","last_active":"2024-05-08T19:48:50.921979+0000","last_peered":"2024-05-08T19:48:50.921979+0000","last_clean":"2024-05-08T19:48:50.921979+0000","last_became_active":"2024-05-08T19:22:20.015062+0000","last_became_peered":"2024-05-08T19:22:20.015062+0000","last_unstale":"2024-05-08T19:48:50.921979+0000","last_undegraded":"2024-05-08T19:48:50.921979+0000","last_fullsized":"2024-05-08T19:48:50.921979+0000","mapping_epoch":17,"log_start":"26'1200","ondisk_log_start":"26'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8076","last_scrub_stamp":"2024-05-08T19:48:50.921951+0000","last_deep_scrub":"26'8076","last_deep_scrub_stamp":"2024-05-08T19:48:50.921951+0000","last_clean_scrub_stamp":"2024-05-08T19:48:50.921951+0000","objects_scrubbed":1,"log_size":6876,"log_dups_size":0,"ondisk_log_size":6876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:09.690484+0000","scrub_duration":0.020418589000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8080,"num_write_kb":54571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'8514","reported_seq":9526,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:28.817546+0000","last_change":"2024-05-08T19:49:28.817546+0000","last_active":"2024-05-08T19:49:28.817546+0000","last_peered":"2024-05-08T19:49:28.817546+0000","last_clean":"2024-05-08T19:49:28.817546+0000","last_became_active":"2024-05-08T19:22:24.613661+0000","last_became_peered":"2024-05-08T19:22:24.613661+0000","last_unstale":"2024-05-08T19:49:28.817546+0000","last_undegraded":"2024-05-08T19:49:28.817546+0000","last_fullsized":"2024-05-08T19:49:28.817546+0000","mapping_epoch":22,"log_start":"26'1305","ondisk_log_start":"26'1305","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8514","last_scrub_stamp":"2024-05-08T19:49:28.817351+0000","last_deep_scrub":"26'8514","last_deep_scrub_stamp":"2024-05-08T19:49:28.817351+0000","last_clean_scrub_stamp":"2024-05-08T19:49:28.817351+0000","objects_scrubbed":0,"log_size":7209,"log_dups_size":0,"ondisk_log_size":7209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:28.244399+0000","scrub_duration":0.024666029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":973,"num_read_kb":68996,"num_write":6084,"num_write_kb":873899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"26'6281","reported_seq":6323,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:54.912365+0000","last_change":"2024-05-08T19:48:54.912365+0000","last_active":"2024-05-08T19:48:54.912365+0000","last_peered":"2024-05-08T19:48:54.912365+0000","last_clean":"2024-05-08T19:48:54.912365+0000","last_became_active":"2024-05-08T19:22:20.014926+0000","last_became_peered":"2024-05-08T19:22:20.014926+0000","last_unstale":"2024-05-08T19:48:54.912365+0000","last_undegraded":"2024-05-08T19:48:54.912365+0000","last_fullsized":"2024-05-08T19:48:54.912365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6281","last_scrub_stamp":"2024-05-08T19:48:54.912210+0000","last_deep_scrub":"26'6281","last_deep_scrub_stamp":"2024-05-08T19:48:54.912210+0000","last_clean_scrub_stamp":"2024-05-08T19:48:54.912210+0000","objects_scrubbed":2,"log_size":6281,"log_dups_size":0,"ondisk_log_size":6281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:44.895173+0000","scrub_duration":0.025468606000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7231304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6276,"num_write_kb":44046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"26'2390","reported_seq":2431,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:09.662714+0000","last_change":"2024-05-08T19:49:09.662714+0000","last_active":"2024-05-08T19:49:09.662714+0000","last_peered":"2024-05-08T19:49:09.662714+0000","last_clean":"2024-05-08T19:49:09.662714+0000","last_became_active":"2024-05-08T19:22:20.446194+0000","last_became_peered":"2024-05-08T19:22:20.446194+0000","last_unstale":"2024-05-08T19:49:09.662714+0000","last_undegraded":"2024-05-08T19:49:09.662714+0000","last_fullsized":"2024-05-08T19:49:09.662714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2390","last_scrub_stamp":"2024-05-08T19:49:09.662538+0000","last_deep_scrub":"26'2390","last_deep_scrub_stamp":"2024-05-08T19:49:09.662538+0000","last_clean_scrub_stamp":"2024-05-08T19:49:09.662538+0000","objects_scrubbed":0,"log_size":2390,"log_dups_size":0,"ondisk_log_size":2390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:59.338522+0000","scrub_duration":0.0077808970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'8362","reported_seq":8769,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:41.674576+0000","last_change":"2024-05-08T19:49:41.674718+0000","last_active":"2024-05-08T19:49:41.674576+0000","last_peered":"2024-05-08T19:49:41.674576+0000","last_clean":"2024-05-08T19:49:41.674576+0000","last_became_active":"2024-05-08T19:22:24.615069+0000","last_became_peered":"2024-05-08T19:22:24.615069+0000","last_unstale":"2024-05-08T19:49:41.674576+0000","last_undegraded":"2024-05-08T19:49:41.674576+0000","last_fullsized":"2024-05-08T19:49:41.674576+0000","mapping_epoch":22,"log_start":"26'1929","ondisk_log_start":"26'1929","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8362","last_scrub_stamp":"2024-05-08T19:49:41.674550+0000","last_deep_scrub":"26'8362","last_deep_scrub_stamp":"2024-05-08T19:49:41.674550+0000","last_clean_scrub_stamp":"2024-05-08T19:49:41.674550+0000","objects_scrubbed":0,"log_size":6433,"log_dups_size":0,"ondisk_log_size":6433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:42.212624+0000","scrub_duration":0.031670924000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":368,"num_read_kb":23786,"num_write":5985,"num_write_kb":964471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'5786","reported_seq":6318,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:51.662419+0000","last_change":"2024-05-08T19:48:51.662511+0000","last_active":"2024-05-08T19:48:51.662419+0000","last_peered":"2024-05-08T19:48:51.662419+0000","last_clean":"2024-05-08T19:48:51.662419+0000","last_became_active":"2024-05-08T19:22:20.001339+0000","last_became_peered":"2024-05-08T19:22:20.001339+0000","last_unstale":"2024-05-08T19:48:51.662419+0000","last_undegraded":"2024-05-08T19:48:51.662419+0000","last_fullsized":"2024-05-08T19:48:51.662419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5786","last_scrub_stamp":"2024-05-08T19:48:51.662392+0000","last_deep_scrub":"26'5786","last_deep_scrub_stamp":"2024-05-08T19:48:51.662392+0000","last_clean_scrub_stamp":"2024-05-08T19:48:51.662392+0000","objects_scrubbed":4,"log_size":5786,"log_dups_size":0,"ondisk_log_size":5786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:55.948554+0000","scrub_duration":0.063602542999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11721836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":3579,"num_write":6369,"num_write_kb":46119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"26'2254","reported_seq":2288,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:42.509883+0000","last_change":"2024-05-08T19:49:42.509996+0000","last_active":"2024-05-08T19:49:42.509883+0000","last_peered":"2024-05-08T19:49:42.509883+0000","last_clean":"2024-05-08T19:49:42.509883+0000","last_became_active":"2024-05-08T19:23:11.386882+0000","last_became_peered":"2024-05-08T19:23:11.386882+0000","last_unstale":"2024-05-08T19:49:42.509883+0000","last_undegraded":"2024-05-08T19:49:42.509883+0000","last_fullsized":"2024-05-08T19:49:42.509883+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2254","last_scrub_stamp":"2024-05-08T19:49:42.509855+0000","last_deep_scrub":"26'2254","last_deep_scrub_stamp":"2024-05-08T19:49:42.509855+0000","last_clean_scrub_stamp":"2024-05-08T19:49:42.509855+0000","objects_scrubbed":0,"log_size":2254,"log_dups_size":0,"ondisk_log_size":2254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:33.878668+0000","scrub_duration":0.0083583310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"26'8456","reported_seq":8898,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:21.124828+0000","last_change":"2024-05-08T19:49:21.124989+0000","last_active":"2024-05-08T19:49:21.124828+0000","last_peered":"2024-05-08T19:49:21.124828+0000","last_clean":"2024-05-08T19:49:21.124828+0000","last_became_active":"2024-05-08T19:22:24.614433+0000","last_became_peered":"2024-05-08T19:22:24.614433+0000","last_unstale":"2024-05-08T19:49:21.124828+0000","last_undegraded":"2024-05-08T19:49:21.124828+0000","last_fullsized":"2024-05-08T19:49:21.124828+0000","mapping_epoch":22,"log_start":"26'1215","ondisk_log_start":"26'1215","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8456","last_scrub_stamp":"2024-05-08T19:49:21.124800+0000","last_deep_scrub":"26'8456","last_deep_scrub_stamp":"2024-05-08T19:49:21.124800+0000","last_clean_scrub_stamp":"2024-05-08T19:49:21.124800+0000","objects_scrubbed":0,"log_size":7241,"log_dups_size":0,"ondisk_log_size":7241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:16.941004+0000","scrub_duration":0.031867547000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":403,"num_read_kb":32316,"num_write":6068,"num_write_kb":878068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'4080","reported_seq":4121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:52.662263+0000","last_change":"2024-05-08T19:48:52.662361+0000","last_active":"2024-05-08T19:48:52.662263+0000","last_peered":"2024-05-08T19:48:52.662263+0000","last_clean":"2024-05-08T19:48:52.662263+0000","last_became_active":"2024-05-08T19:22:20.012383+0000","last_became_peered":"2024-05-08T19:22:20.012383+0000","last_unstale":"2024-05-08T19:48:52.662263+0000","last_undegraded":"2024-05-08T19:48:52.662263+0000","last_fullsized":"2024-05-08T19:48:52.662263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4080","last_scrub_stamp":"2024-05-08T19:48:52.662236+0000","last_deep_scrub":"26'4080","last_deep_scrub_stamp":"2024-05-08T19:48:52.662236+0000","last_clean_scrub_stamp":"2024-05-08T19:48:52.662236+0000","objects_scrubbed":2,"log_size":4080,"log_dups_size":0,"ondisk_log_size":4080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:36.022871+0000","scrub_duration":0.026319581000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":4095,"num_write_kb":27507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":128316,"num_omap_keys":195,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'2300","reported_seq":2340,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:12.765796+0000","last_change":"2024-05-08T19:49:12.765909+0000","last_active":"2024-05-08T19:49:12.765796+0000","last_peered":"2024-05-08T19:49:12.765796+0000","last_clean":"2024-05-08T19:49:12.765796+0000","last_became_active":"2024-05-08T19:22:20.435680+0000","last_became_peered":"2024-05-08T19:22:20.435680+0000","last_unstale":"2024-05-08T19:49:12.765796+0000","last_undegraded":"2024-05-08T19:49:12.765796+0000","last_fullsized":"2024-05-08T19:49:12.765796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2300","last_scrub_stamp":"2024-05-08T19:49:12.765767+0000","last_deep_scrub":"26'2300","last_deep_scrub_stamp":"2024-05-08T19:49:12.765767+0000","last_clean_scrub_stamp":"2024-05-08T19:49:12.765767+0000","objects_scrubbed":0,"log_size":2300,"log_dups_size":0,"ondisk_log_size":2300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:10.453305+0000","scrub_duration":0.0051582390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"26'8822","reported_seq":9073,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:05.190347+0000","last_change":"2024-05-08T19:49:05.190347+0000","last_active":"2024-05-08T19:49:05.190347+0000","last_peered":"2024-05-08T19:49:05.190347+0000","last_clean":"2024-05-08T19:49:05.190347+0000","last_became_active":"2024-05-08T19:22:24.472782+0000","last_became_peered":"2024-05-08T19:22:24.472782+0000","last_unstale":"2024-05-08T19:49:05.190347+0000","last_undegraded":"2024-05-08T19:49:05.190347+0000","last_fullsized":"2024-05-08T19:49:05.190347+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8822","last_scrub_stamp":"2024-05-08T19:49:05.190154+0000","last_deep_scrub":"26'8822","last_deep_scrub_stamp":"2024-05-08T19:49:05.190154+0000","last_clean_scrub_stamp":"2024-05-08T19:49:05.190154+0000","objects_scrubbed":0,"log_size":7184,"log_dups_size":0,"ondisk_log_size":7184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:04.699875+0000","scrub_duration":0.032424166999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":12280,"num_write":6457,"num_write_kb":1036607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2847","reported_seq":2888,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:59.885624+0000","last_change":"2024-05-08T19:48:59.885784+0000","last_active":"2024-05-08T19:48:59.885624+0000","last_peered":"2024-05-08T19:48:59.885624+0000","last_clean":"2024-05-08T19:48:59.885624+0000","last_became_active":"2024-05-08T19:22:20.013739+0000","last_became_peered":"2024-05-08T19:22:20.013739+0000","last_unstale":"2024-05-08T19:48:59.885624+0000","last_undegraded":"2024-05-08T19:48:59.885624+0000","last_fullsized":"2024-05-08T19:48:59.885624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2847","last_scrub_stamp":"2024-05-08T19:48:59.885599+0000","last_deep_scrub":"26'2847","last_deep_scrub_stamp":"2024-05-08T19:48:59.885599+0000","last_clean_scrub_stamp":"2024-05-08T19:48:59.885599+0000","objects_scrubbed":2,"log_size":2847,"log_dups_size":0,"ondisk_log_size":2847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:00.984961+0000","scrub_duration":0.031388478999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2848,"num_write_kb":22358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"26'2333","reported_seq":2373,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:45.305790+0000","last_change":"2024-05-08T19:48:45.305902+0000","last_active":"2024-05-08T19:48:45.305790+0000","last_peered":"2024-05-08T19:48:45.305790+0000","last_clean":"2024-05-08T19:48:45.305790+0000","last_became_active":"2024-05-08T19:22:20.447180+0000","last_became_peered":"2024-05-08T19:22:20.447180+0000","last_unstale":"2024-05-08T19:48:45.305790+0000","last_undegraded":"2024-05-08T19:48:45.305790+0000","last_fullsized":"2024-05-08T19:48:45.305790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2333","last_scrub_stamp":"2024-05-08T19:48:45.305763+0000","last_deep_scrub":"26'2333","last_deep_scrub_stamp":"2024-05-08T19:48:45.305763+0000","last_clean_scrub_stamp":"2024-05-08T19:48:45.305763+0000","objects_scrubbed":0,"log_size":2333,"log_dups_size":0,"ondisk_log_size":2333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:28.666398+0000","scrub_duration":0.002168775,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"26'8924","reported_seq":9907,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:16.684917+0000","last_change":"2024-05-08T19:49:16.684917+0000","last_active":"2024-05-08T19:49:16.684917+0000","last_peered":"2024-05-08T19:49:16.684917+0000","last_clean":"2024-05-08T19:49:16.684917+0000","last_became_active":"2024-05-08T19:22:24.613677+0000","last_became_peered":"2024-05-08T19:22:24.613677+0000","last_unstale":"2024-05-08T19:49:16.684917+0000","last_undegraded":"2024-05-08T19:49:16.684917+0000","last_fullsized":"2024-05-08T19:49:16.684917+0000","mapping_epoch":22,"log_start":"26'1529","ondisk_log_start":"26'1529","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8924","last_scrub_stamp":"2024-05-08T19:49:16.684725+0000","last_deep_scrub":"26'8924","last_deep_scrub_stamp":"2024-05-08T19:49:16.684725+0000","last_clean_scrub_stamp":"2024-05-08T19:49:16.684725+0000","objects_scrubbed":0,"log_size":7395,"log_dups_size":0,"ondisk_log_size":7395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:14.372263+0000","scrub_duration":0.023951353000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":945,"num_read_kb":70780,"num_write":6622,"num_write_kb":1028558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"26'4275","reported_seq":4316,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:41.616175+0000","last_change":"2024-05-08T19:48:41.616298+0000","last_active":"2024-05-08T19:48:41.616175+0000","last_peered":"2024-05-08T19:48:41.616175+0000","last_clean":"2024-05-08T19:48:41.616175+0000","last_became_active":"2024-05-08T19:22:20.011262+0000","last_became_peered":"2024-05-08T19:22:20.011262+0000","last_unstale":"2024-05-08T19:48:41.616175+0000","last_undegraded":"2024-05-08T19:48:41.616175+0000","last_fullsized":"2024-05-08T19:48:41.616175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4275","last_scrub_stamp":"2024-05-08T19:48:41.616128+0000","last_deep_scrub":"26'4275","last_deep_scrub_stamp":"2024-05-08T19:48:41.616128+0000","last_clean_scrub_stamp":"2024-05-08T19:48:41.616128+0000","objects_scrubbed":2,"log_size":4275,"log_dups_size":0,"ondisk_log_size":4275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:26.145161+0000","scrub_duration":0.036942485999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4270,"num_write_kb":27446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"26'2429","reported_seq":2469,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:21.492196+0000","last_change":"2024-05-08T19:49:21.492325+0000","last_active":"2024-05-08T19:49:21.492196+0000","last_peered":"2024-05-08T19:49:21.492196+0000","last_clean":"2024-05-08T19:49:21.492196+0000","last_became_active":"2024-05-08T19:22:20.438434+0000","last_became_peered":"2024-05-08T19:22:20.438434+0000","last_unstale":"2024-05-08T19:49:21.492196+0000","last_undegraded":"2024-05-08T19:49:21.492196+0000","last_fullsized":"2024-05-08T19:49:21.492196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2429","last_scrub_stamp":"2024-05-08T19:49:21.492167+0000","last_deep_scrub":"26'2429","last_deep_scrub_stamp":"2024-05-08T19:49:21.492167+0000","last_clean_scrub_stamp":"2024-05-08T19:49:21.492167+0000","objects_scrubbed":0,"log_size":2429,"log_dups_size":0,"ondisk_log_size":2429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:42.344138+0000","scrub_duration":0.001928342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"26'8249","reported_seq":8526,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:12.166904+0000","last_change":"2024-05-08T19:49:12.166904+0000","last_active":"2024-05-08T19:49:12.166904+0000","last_peered":"2024-05-08T19:49:12.166904+0000","last_clean":"2024-05-08T19:49:12.166904+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:49:12.166904+0000","last_undegraded":"2024-05-08T19:49:12.166904+0000","last_fullsized":"2024-05-08T19:49:12.166904+0000","mapping_epoch":22,"log_start":"26'1106","ondisk_log_start":"26'1106","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8249","last_scrub_stamp":"2024-05-08T19:49:12.166734+0000","last_deep_scrub":"26'8249","last_deep_scrub_stamp":"2024-05-08T19:49:12.166734+0000","last_clean_scrub_stamp":"2024-05-08T19:49:12.166734+0000","objects_scrubbed":0,"log_size":7143,"log_dups_size":0,"ondisk_log_size":7143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:09.854272+0000","scrub_duration":0.028315160999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":13756,"num_write":5781,"num_write_kb":975965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"26'7372","reported_seq":7413,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.622314+0000","last_change":"2024-05-08T19:48:49.622415+0000","last_active":"2024-05-08T19:48:49.622314+0000","last_peered":"2024-05-08T19:48:49.622314+0000","last_clean":"2024-05-08T19:48:49.622314+0000","last_became_active":"2024-05-08T19:22:20.006772+0000","last_became_peered":"2024-05-08T19:22:20.006772+0000","last_unstale":"2024-05-08T19:48:49.622314+0000","last_undegraded":"2024-05-08T19:48:49.622314+0000","last_fullsized":"2024-05-08T19:48:49.622314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7372","last_scrub_stamp":"2024-05-08T19:48:49.622290+0000","last_deep_scrub":"26'7372","last_deep_scrub_stamp":"2024-05-08T19:48:49.622290+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.622290+0000","objects_scrubbed":3,"log_size":7372,"log_dups_size":0,"ondisk_log_size":7372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:32.982924+0000","scrub_duration":0.047389768999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7364,"num_write_kb":54049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"26'2338","reported_seq":2378,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:25.515130+0000","last_change":"2024-05-08T19:49:25.515384+0000","last_active":"2024-05-08T19:49:25.515130+0000","last_peered":"2024-05-08T19:49:25.515130+0000","last_clean":"2024-05-08T19:49:25.515130+0000","last_became_active":"2024-05-08T19:22:20.436373+0000","last_became_peered":"2024-05-08T19:22:20.436373+0000","last_unstale":"2024-05-08T19:49:25.515130+0000","last_undegraded":"2024-05-08T19:49:25.515130+0000","last_fullsized":"2024-05-08T19:49:25.515130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2338","last_scrub_stamp":"2024-05-08T19:49:25.515093+0000","last_deep_scrub":"26'2338","last_deep_scrub_stamp":"2024-05-08T19:49:25.515093+0000","last_clean_scrub_stamp":"2024-05-08T19:49:25.515093+0000","objects_scrubbed":0,"log_size":2338,"log_dups_size":0,"ondisk_log_size":2338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:16.883906+0000","scrub_duration":0.0075960410000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"26'8815","reported_seq":9456,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:09.138646+0000","last_change":"2024-05-08T19:49:09.138646+0000","last_active":"2024-05-08T19:49:09.138646+0000","last_peered":"2024-05-08T19:49:09.138646+0000","last_clean":"2024-05-08T19:49:09.138646+0000","last_became_active":"2024-05-08T19:22:24.477941+0000","last_became_peered":"2024-05-08T19:22:24.477941+0000","last_unstale":"2024-05-08T19:49:09.138646+0000","last_undegraded":"2024-05-08T19:49:09.138646+0000","last_fullsized":"2024-05-08T19:49:09.138646+0000","mapping_epoch":22,"log_start":"26'1638","ondisk_log_start":"26'1638","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8815","last_scrub_stamp":"2024-05-08T19:49:09.138437+0000","last_deep_scrub":"26'8815","last_deep_scrub_stamp":"2024-05-08T19:49:09.138437+0000","last_clean_scrub_stamp":"2024-05-08T19:49:09.138437+0000","objects_scrubbed":0,"log_size":7177,"log_dups_size":0,"ondisk_log_size":7177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:55.097037+0000","scrub_duration":0.028237385,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":603,"num_read_kb":28586,"num_write":6338,"num_write_kb":901267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"26'6180","reported_seq":6221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:56.885764+0000","last_change":"2024-05-08T19:48:56.885764+0000","last_active":"2024-05-08T19:48:56.885764+0000","last_peered":"2024-05-08T19:48:56.885764+0000","last_clean":"2024-05-08T19:48:56.885764+0000","last_became_active":"2024-05-08T19:22:20.013748+0000","last_became_peered":"2024-05-08T19:22:20.013748+0000","last_unstale":"2024-05-08T19:48:56.885764+0000","last_undegraded":"2024-05-08T19:48:56.885764+0000","last_fullsized":"2024-05-08T19:48:56.885764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6180","last_scrub_stamp":"2024-05-08T19:48:56.885629+0000","last_deep_scrub":"26'6180","last_deep_scrub_stamp":"2024-05-08T19:48:56.885629+0000","last_clean_scrub_stamp":"2024-05-08T19:48:56.885629+0000","objects_scrubbed":1,"log_size":6180,"log_dups_size":0,"ondisk_log_size":6180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:15.175572+0000","scrub_duration":0.012091622,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6199,"num_write_kb":41171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":340,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"26'2344","reported_seq":2384,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:22.705949+0000","last_change":"2024-05-08T19:49:22.706063+0000","last_active":"2024-05-08T19:49:22.705949+0000","last_peered":"2024-05-08T19:49:22.705949+0000","last_clean":"2024-05-08T19:49:22.705949+0000","last_became_active":"2024-05-08T19:22:20.456850+0000","last_became_peered":"2024-05-08T19:22:20.456850+0000","last_unstale":"2024-05-08T19:49:22.705949+0000","last_undegraded":"2024-05-08T19:49:22.705949+0000","last_fullsized":"2024-05-08T19:49:22.705949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2344","last_scrub_stamp":"2024-05-08T19:49:22.705922+0000","last_deep_scrub":"26'2344","last_deep_scrub_stamp":"2024-05-08T19:49:22.705922+0000","last_clean_scrub_stamp":"2024-05-08T19:49:22.705922+0000","objects_scrubbed":0,"log_size":2344,"log_dups_size":0,"ondisk_log_size":2344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:20.393460+0000","scrub_duration":0.001675586,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"26'8417","reported_seq":8872,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:32.738412+0000","last_change":"2024-05-08T19:49:32.738553+0000","last_active":"2024-05-08T19:49:32.738412+0000","last_peered":"2024-05-08T19:49:32.738412+0000","last_clean":"2024-05-08T19:49:32.738412+0000","last_became_active":"2024-05-08T19:22:24.613904+0000","last_became_peered":"2024-05-08T19:22:24.613904+0000","last_unstale":"2024-05-08T19:49:32.738412+0000","last_undegraded":"2024-05-08T19:49:32.738412+0000","last_fullsized":"2024-05-08T19:49:32.738412+0000","mapping_epoch":22,"log_start":"26'512","ondisk_log_start":"26'512","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8417","last_scrub_stamp":"2024-05-08T19:49:32.738385+0000","last_deep_scrub":"26'8417","last_deep_scrub_stamp":"2024-05-08T19:49:32.738385+0000","last_clean_scrub_stamp":"2024-05-08T19:49:32.738385+0000","objects_scrubbed":0,"log_size":7905,"log_dups_size":0,"ondisk_log_size":7905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:21.805744+0000","scrub_duration":0.023639915000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":29592,"num_write":6013,"num_write_kb":842872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"26'8395","reported_seq":8436,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:47.025794+0000","last_change":"2024-05-08T19:48:47.025794+0000","last_active":"2024-05-08T19:48:47.025794+0000","last_peered":"2024-05-08T19:48:47.025794+0000","last_clean":"2024-05-08T19:48:47.025794+0000","last_became_active":"2024-05-08T19:22:20.000454+0000","last_became_peered":"2024-05-08T19:22:20.000454+0000","last_unstale":"2024-05-08T19:48:47.025794+0000","last_undegraded":"2024-05-08T19:48:47.025794+0000","last_fullsized":"2024-05-08T19:48:47.025794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8395","last_scrub_stamp":"2024-05-08T19:48:47.025662+0000","last_deep_scrub":"26'8395","last_deep_scrub_stamp":"2024-05-08T19:48:47.025662+0000","last_clean_scrub_stamp":"2024-05-08T19:48:47.025662+0000","objects_scrubbed":3,"log_size":8395,"log_dups_size":0,"ondisk_log_size":8395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:26.396911+0000","scrub_duration":0.054102984999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8388,"num_write_kb":54739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'2302","reported_seq":2342,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:09.930622+0000","last_change":"2024-05-08T19:49:09.930622+0000","last_active":"2024-05-08T19:49:09.930622+0000","last_peered":"2024-05-08T19:49:09.930622+0000","last_clean":"2024-05-08T19:49:09.930622+0000","last_became_active":"2024-05-08T19:22:20.456225+0000","last_became_peered":"2024-05-08T19:22:20.456225+0000","last_unstale":"2024-05-08T19:49:09.930622+0000","last_undegraded":"2024-05-08T19:49:09.930622+0000","last_fullsized":"2024-05-08T19:49:09.930622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2302","last_scrub_stamp":"2024-05-08T19:49:09.930485+0000","last_deep_scrub":"26'2302","last_deep_scrub_stamp":"2024-05-08T19:49:09.930485+0000","last_clean_scrub_stamp":"2024-05-08T19:49:09.930485+0000","objects_scrubbed":0,"log_size":2302,"log_dups_size":0,"ondisk_log_size":2302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:09.440206+0000","scrub_duration":0.0039543269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"26'8603","reported_seq":9435,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:32.789582+0000","last_change":"2024-05-08T19:49:32.789748+0000","last_active":"2024-05-08T19:49:32.789582+0000","last_peered":"2024-05-08T19:49:32.789582+0000","last_clean":"2024-05-08T19:49:32.789582+0000","last_became_active":"2024-05-08T19:22:24.472765+0000","last_became_peered":"2024-05-08T19:22:24.472765+0000","last_unstale":"2024-05-08T19:49:32.789582+0000","last_undegraded":"2024-05-08T19:49:32.789582+0000","last_fullsized":"2024-05-08T19:49:32.789582+0000","mapping_epoch":22,"log_start":"26'1458","ondisk_log_start":"26'1458","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8603","last_scrub_stamp":"2024-05-08T19:49:32.789546+0000","last_deep_scrub":"26'8603","last_deep_scrub_stamp":"2024-05-08T19:49:32.789546+0000","last_clean_scrub_stamp":"2024-05-08T19:49:32.789546+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:53.641516+0000","scrub_duration":0.019011726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":794,"num_read_kb":57832,"num_write":6099,"num_write_kb":1028205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'7807","reported_seq":7848,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:55.618256+0000","last_change":"2024-05-08T19:48:55.618256+0000","last_active":"2024-05-08T19:48:55.618256+0000","last_peered":"2024-05-08T19:48:55.618256+0000","last_clean":"2024-05-08T19:48:55.618256+0000","last_became_active":"2024-05-08T19:22:20.005996+0000","last_became_peered":"2024-05-08T19:22:20.005996+0000","last_unstale":"2024-05-08T19:48:55.618256+0000","last_undegraded":"2024-05-08T19:48:55.618256+0000","last_fullsized":"2024-05-08T19:48:55.618256+0000","mapping_epoch":17,"log_start":"26'400","ondisk_log_start":"26'400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7807","last_scrub_stamp":"2024-05-08T19:48:55.618119+0000","last_deep_scrub":"26'7807","last_deep_scrub_stamp":"2024-05-08T19:48:55.618119+0000","last_clean_scrub_stamp":"2024-05-08T19:48:55.618119+0000","objects_scrubbed":3,"log_size":7407,"log_dups_size":0,"ondisk_log_size":7407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:45.601081+0000","scrub_duration":0.038095381999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7797,"num_write_kb":54350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"26'2304","reported_seq":2344,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:21.094962+0000","last_change":"2024-05-08T19:49:21.095076+0000","last_active":"2024-05-08T19:49:21.094962+0000","last_peered":"2024-05-08T19:49:21.094962+0000","last_clean":"2024-05-08T19:49:21.094962+0000","last_became_active":"2024-05-08T19:22:20.452600+0000","last_became_peered":"2024-05-08T19:22:20.452600+0000","last_unstale":"2024-05-08T19:49:21.094962+0000","last_undegraded":"2024-05-08T19:49:21.094962+0000","last_fullsized":"2024-05-08T19:49:21.094962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2304","last_scrub_stamp":"2024-05-08T19:49:21.094936+0000","last_deep_scrub":"26'2304","last_deep_scrub_stamp":"2024-05-08T19:49:21.094936+0000","last_clean_scrub_stamp":"2024-05-08T19:49:21.094936+0000","objects_scrubbed":0,"log_size":2304,"log_dups_size":0,"ondisk_log_size":2304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:16.911139+0000","scrub_duration":0.0023665800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"26'8464","reported_seq":9192,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:49.480138+0000","last_change":"2024-05-08T19:49:49.480304+0000","last_active":"2024-05-08T19:49:49.480138+0000","last_peered":"2024-05-08T19:49:49.480138+0000","last_clean":"2024-05-08T19:49:49.480138+0000","last_became_active":"2024-05-08T19:22:24.613948+0000","last_became_peered":"2024-05-08T19:22:24.613948+0000","last_unstale":"2024-05-08T19:49:49.480138+0000","last_undegraded":"2024-05-08T19:49:49.480138+0000","last_fullsized":"2024-05-08T19:49:49.480138+0000","mapping_epoch":22,"log_start":"26'935","ondisk_log_start":"26'935","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8464","last_scrub_stamp":"2024-05-08T19:49:49.480111+0000","last_deep_scrub":"26'8464","last_deep_scrub_stamp":"2024-05-08T19:49:49.480111+0000","last_clean_scrub_stamp":"2024-05-08T19:49:49.480111+0000","objects_scrubbed":0,"log_size":7529,"log_dups_size":0,"ondisk_log_size":7529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:34.090316+0000","scrub_duration":0.02979122,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":690,"num_read_kb":34094,"num_write":6014,"num_write_kb":938918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"26'9153","reported_seq":9194,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:42.086898+0000","last_change":"2024-05-08T19:48:42.086898+0000","last_active":"2024-05-08T19:48:42.086898+0000","last_peered":"2024-05-08T19:48:42.086898+0000","last_clean":"2024-05-08T19:48:42.086898+0000","last_became_active":"2024-05-08T19:22:20.004254+0000","last_became_peered":"2024-05-08T19:22:20.004254+0000","last_unstale":"2024-05-08T19:48:42.086898+0000","last_undegraded":"2024-05-08T19:48:42.086898+0000","last_fullsized":"2024-05-08T19:48:42.086898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9153","last_scrub_stamp":"2024-05-08T19:48:42.086788+0000","last_deep_scrub":"26'9153","last_deep_scrub_stamp":"2024-05-08T19:48:42.086788+0000","last_clean_scrub_stamp":"2024-05-08T19:48:42.086788+0000","objects_scrubbed":6,"log_size":9153,"log_dups_size":0,"ondisk_log_size":9153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:54.814215+0000","scrub_duration":0.069169347000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":9139,"num_write_kb":67371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73643,"num_omap_keys":112,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'2210","reported_seq":2250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:36.666544+0000","last_change":"2024-05-08T19:49:36.666663+0000","last_active":"2024-05-08T19:49:36.666544+0000","last_peered":"2024-05-08T19:49:36.666544+0000","last_clean":"2024-05-08T19:49:36.666544+0000","last_became_active":"2024-05-08T19:22:20.455493+0000","last_became_peered":"2024-05-08T19:22:20.455493+0000","last_unstale":"2024-05-08T19:49:36.666544+0000","last_undegraded":"2024-05-08T19:49:36.666544+0000","last_fullsized":"2024-05-08T19:49:36.666544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2210","last_scrub_stamp":"2024-05-08T19:49:36.666517+0000","last_deep_scrub":"26'2210","last_deep_scrub_stamp":"2024-05-08T19:49:36.666517+0000","last_clean_scrub_stamp":"2024-05-08T19:49:36.666517+0000","objects_scrubbed":0,"log_size":2210,"log_dups_size":0,"ondisk_log_size":2210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:57.518487+0000","scrub_duration":0.011239582999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"26'2266","reported_seq":2307,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:11.590212+0000","last_change":"2024-05-08T19:49:11.590212+0000","last_active":"2024-05-08T19:49:11.590212+0000","last_peered":"2024-05-08T19:49:11.590212+0000","last_clean":"2024-05-08T19:49:11.590212+0000","last_became_active":"2024-05-08T19:22:20.452169+0000","last_became_peered":"2024-05-08T19:22:20.452169+0000","last_unstale":"2024-05-08T19:49:11.590212+0000","last_undegraded":"2024-05-08T19:49:11.590212+0000","last_fullsized":"2024-05-08T19:49:11.590212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2266","last_scrub_stamp":"2024-05-08T19:49:11.590076+0000","last_deep_scrub":"26'2266","last_deep_scrub_stamp":"2024-05-08T19:49:11.590076+0000","last_clean_scrub_stamp":"2024-05-08T19:49:11.590076+0000","objects_scrubbed":0,"log_size":2266,"log_dups_size":0,"ondisk_log_size":2266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:56.979897+0000","scrub_duration":0.002202594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'2366","reported_seq":2407,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:49.894493+0000","last_change":"2024-05-08T19:48:49.894493+0000","last_active":"2024-05-08T19:48:49.894493+0000","last_peered":"2024-05-08T19:48:49.894493+0000","last_clean":"2024-05-08T19:48:49.894493+0000","last_became_active":"2024-05-08T19:22:20.449047+0000","last_became_peered":"2024-05-08T19:22:20.449047+0000","last_unstale":"2024-05-08T19:48:49.894493+0000","last_undegraded":"2024-05-08T19:48:49.894493+0000","last_fullsized":"2024-05-08T19:48:49.894493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2366","last_scrub_stamp":"2024-05-08T19:48:49.894367+0000","last_deep_scrub":"26'2366","last_deep_scrub_stamp":"2024-05-08T19:48:49.894367+0000","last_clean_scrub_stamp":"2024-05-08T19:48:49.894367+0000","objects_scrubbed":0,"log_size":2366,"log_dups_size":0,"ondisk_log_size":2366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:54.180529+0000","scrub_duration":0.004363408,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'2258","reported_seq":2299,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:13.120111+0000","last_change":"2024-05-08T19:49:13.120111+0000","last_active":"2024-05-08T19:49:13.120111+0000","last_peered":"2024-05-08T19:49:13.120111+0000","last_clean":"2024-05-08T19:49:13.120111+0000","last_became_active":"2024-05-08T19:22:20.451625+0000","last_became_peered":"2024-05-08T19:22:20.451625+0000","last_unstale":"2024-05-08T19:49:13.120111+0000","last_undegraded":"2024-05-08T19:49:13.120111+0000","last_fullsized":"2024-05-08T19:49:13.120111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2258","last_scrub_stamp":"2024-05-08T19:49:13.119914+0000","last_deep_scrub":"26'2258","last_deep_scrub_stamp":"2024-05-08T19:49:13.119914+0000","last_clean_scrub_stamp":"2024-05-08T19:49:13.119914+0000","objects_scrubbed":0,"log_size":2258,"log_dups_size":0,"ondisk_log_size":2258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:10.807452+0000","scrub_duration":0.0021343680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'2371","reported_seq":2420,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:20.789676+0000","last_change":"2024-05-08T19:49:20.789676+0000","last_active":"2024-05-08T19:49:20.789676+0000","last_peered":"2024-05-08T19:49:20.789676+0000","last_clean":"2024-05-08T19:49:20.789676+0000","last_became_active":"2024-05-08T19:23:11.053750+0000","last_became_peered":"2024-05-08T19:23:11.053750+0000","last_unstale":"2024-05-08T19:49:20.789676+0000","last_undegraded":"2024-05-08T19:49:20.789676+0000","last_fullsized":"2024-05-08T19:49:20.789676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2371","last_scrub_stamp":"2024-05-08T19:49:20.789483+0000","last_deep_scrub":"26'2371","last_deep_scrub_stamp":"2024-05-08T19:49:20.789483+0000","last_clean_scrub_stamp":"2024-05-08T19:49:20.789483+0000","objects_scrubbed":0,"log_size":2371,"log_dups_size":0,"ondisk_log_size":2371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:16.605686+0000","scrub_duration":0.0066788660000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'2321","reported_seq":2361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:09.585769+0000","last_change":"2024-05-08T19:49:09.585861+0000","last_active":"2024-05-08T19:49:09.585769+0000","last_peered":"2024-05-08T19:49:09.585769+0000","last_clean":"2024-05-08T19:49:09.585769+0000","last_became_active":"2024-05-08T19:22:20.444219+0000","last_became_peered":"2024-05-08T19:22:20.444219+0000","last_unstale":"2024-05-08T19:49:09.585769+0000","last_undegraded":"2024-05-08T19:49:09.585769+0000","last_fullsized":"2024-05-08T19:49:09.585769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2321","last_scrub_stamp":"2024-05-08T19:49:09.585741+0000","last_deep_scrub":"26'2321","last_deep_scrub_stamp":"2024-05-08T19:49:09.585741+0000","last_clean_scrub_stamp":"2024-05-08T19:49:09.585741+0000","objects_scrubbed":0,"log_size":2321,"log_dups_size":0,"ondisk_log_size":2321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:58.653100+0000","scrub_duration":0.00225486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'2227","reported_seq":2267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:12.673349+0000","last_change":"2024-05-08T19:49:12.673466+0000","last_active":"2024-05-08T19:49:12.673349+0000","last_peered":"2024-05-08T19:49:12.673349+0000","last_clean":"2024-05-08T19:49:12.673349+0000","last_became_active":"2024-05-08T19:22:20.436626+0000","last_became_peered":"2024-05-08T19:22:20.436626+0000","last_unstale":"2024-05-08T19:49:12.673349+0000","last_undegraded":"2024-05-08T19:49:12.673349+0000","last_fullsized":"2024-05-08T19:49:12.673349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2227","last_scrub_stamp":"2024-05-08T19:49:12.673320+0000","last_deep_scrub":"26'2227","last_deep_scrub_stamp":"2024-05-08T19:49:12.673320+0000","last_clean_scrub_stamp":"2024-05-08T19:49:12.673320+0000","objects_scrubbed":0,"log_size":2227,"log_dups_size":0,"ondisk_log_size":2227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:40.341977+0000","scrub_duration":0.014616664999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'2353","reported_seq":2393,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:31.733909+0000","last_change":"2024-05-08T19:49:31.734015+0000","last_active":"2024-05-08T19:49:31.733909+0000","last_peered":"2024-05-08T19:49:31.733909+0000","last_clean":"2024-05-08T19:49:31.733909+0000","last_became_active":"2024-05-08T19:22:20.461547+0000","last_became_peered":"2024-05-08T19:22:20.461547+0000","last_unstale":"2024-05-08T19:49:31.733909+0000","last_undegraded":"2024-05-08T19:49:31.733909+0000","last_fullsized":"2024-05-08T19:49:31.733909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2353","last_scrub_stamp":"2024-05-08T19:49:31.733880+0000","last_deep_scrub":"26'2353","last_deep_scrub_stamp":"2024-05-08T19:49:31.733880+0000","last_clean_scrub_stamp":"2024-05-08T19:49:31.733880+0000","objects_scrubbed":0,"log_size":2353,"log_dups_size":0,"ondisk_log_size":2353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:30:27.550083+0000","scrub_duration":0.001826301,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'2321","reported_seq":2361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:39.900372+0000","last_change":"2024-05-08T19:48:39.900526+0000","last_active":"2024-05-08T19:48:39.900372+0000","last_peered":"2024-05-08T19:48:39.900372+0000","last_clean":"2024-05-08T19:48:39.900372+0000","last_became_active":"2024-05-08T19:22:20.442667+0000","last_became_peered":"2024-05-08T19:22:20.442667+0000","last_unstale":"2024-05-08T19:48:39.900372+0000","last_undegraded":"2024-05-08T19:48:39.900372+0000","last_fullsized":"2024-05-08T19:48:39.900372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2321","last_scrub_stamp":"2024-05-08T19:48:39.900327+0000","last_deep_scrub":"26'2321","last_deep_scrub_stamp":"2024-05-08T19:48:39.900327+0000","last_clean_scrub_stamp":"2024-05-08T19:48:39.900327+0000","objects_scrubbed":0,"log_size":2321,"log_dups_size":0,"ondisk_log_size":2321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:58.190270+0000","scrub_duration":0.094527218999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'2280","reported_seq":2320,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:06.295790+0000","last_change":"2024-05-08T19:49:06.295922+0000","last_active":"2024-05-08T19:49:06.295790+0000","last_peered":"2024-05-08T19:49:06.295790+0000","last_clean":"2024-05-08T19:49:06.295790+0000","last_became_active":"2024-05-08T19:22:20.448449+0000","last_became_peered":"2024-05-08T19:22:20.448449+0000","last_unstale":"2024-05-08T19:49:06.295790+0000","last_undegraded":"2024-05-08T19:49:06.295790+0000","last_fullsized":"2024-05-08T19:49:06.295790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2280","last_scrub_stamp":"2024-05-08T19:49:06.295763+0000","last_deep_scrub":"26'2280","last_deep_scrub_stamp":"2024-05-08T19:49:06.295763+0000","last_clean_scrub_stamp":"2024-05-08T19:49:06.295763+0000","objects_scrubbed":0,"log_size":2280,"log_dups_size":0,"ondisk_log_size":2280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:55:05.805484+0000","scrub_duration":0.0022924019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'2285","reported_seq":2325,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:48:44.719448+0000","last_change":"2024-05-08T19:48:44.719448+0000","last_active":"2024-05-08T19:48:44.719448+0000","last_peered":"2024-05-08T19:48:44.719448+0000","last_clean":"2024-05-08T19:48:44.719448+0000","last_became_active":"2024-05-08T19:22:20.450217+0000","last_became_peered":"2024-05-08T19:22:20.450217+0000","last_unstale":"2024-05-08T19:48:44.719448+0000","last_undegraded":"2024-05-08T19:48:44.719448+0000","last_fullsized":"2024-05-08T19:48:44.719448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2285","last_scrub_stamp":"2024-05-08T19:48:44.719301+0000","last_deep_scrub":"26'2285","last_deep_scrub_stamp":"2024-05-08T19:48:44.719301+0000","last_clean_scrub_stamp":"2024-05-08T19:48:44.719301+0000","objects_scrubbed":0,"log_size":2285,"log_dups_size":0,"ondisk_log_size":2285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:52.389992+0000","scrub_duration":0.0035809150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'2324","reported_seq":2364,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:38.258851+0000","last_change":"2024-05-08T19:49:38.258963+0000","last_active":"2024-05-08T19:49:38.258851+0000","last_peered":"2024-05-08T19:49:38.258851+0000","last_clean":"2024-05-08T19:49:38.258851+0000","last_became_active":"2024-05-08T19:22:20.453191+0000","last_became_peered":"2024-05-08T19:22:20.453191+0000","last_unstale":"2024-05-08T19:49:38.258851+0000","last_undegraded":"2024-05-08T19:49:38.258851+0000","last_fullsized":"2024-05-08T19:49:38.258851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2324","last_scrub_stamp":"2024-05-08T19:49:38.258825+0000","last_deep_scrub":"26'2324","last_deep_scrub_stamp":"2024-05-08T19:49:38.258825+0000","last_clean_scrub_stamp":"2024-05-08T19:49:38.258825+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:29.627638+0000","scrub_duration":0.001776417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'2354","reported_seq":2394,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:22.790482+0000","last_change":"2024-05-08T19:49:22.790482+0000","last_active":"2024-05-08T19:49:22.790482+0000","last_peered":"2024-05-08T19:49:22.790482+0000","last_clean":"2024-05-08T19:49:22.790482+0000","last_became_active":"2024-05-08T19:22:20.451209+0000","last_became_peered":"2024-05-08T19:22:20.451209+0000","last_unstale":"2024-05-08T19:49:22.790482+0000","last_undegraded":"2024-05-08T19:49:22.790482+0000","last_fullsized":"2024-05-08T19:49:22.790482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2354","last_scrub_stamp":"2024-05-08T19:49:22.790353+0000","last_deep_scrub":"26'2354","last_deep_scrub_stamp":"2024-05-08T19:49:22.790353+0000","last_clean_scrub_stamp":"2024-05-08T19:49:22.790353+0000","objects_scrubbed":0,"log_size":2354,"log_dups_size":0,"ondisk_log_size":2354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:10.729582+0000","scrub_duration":0.0053609419999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'2352","reported_seq":2392,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T19:49:01.519510+0000","last_change":"2024-05-08T19:49:01.519510+0000","last_active":"2024-05-08T19:49:01.519510+0000","last_peered":"2024-05-08T19:49:01.519510+0000","last_clean":"2024-05-08T19:49:01.519510+0000","last_became_active":"2024-05-08T19:22:20.461097+0000","last_became_peered":"2024-05-08T19:22:20.461097+0000","last_unstale":"2024-05-08T19:49:01.519510+0000","last_undegraded":"2024-05-08T19:49:01.519510+0000","last_fullsized":"2024-05-08T19:49:01.519510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2352","last_scrub_stamp":"2024-05-08T19:49:01.519370+0000","last_deep_scrub":"26'2352","last_deep_scrub_stamp":"2024-05-08T19:49:01.519370+0000","last_clean_scrub_stamp":"2024-05-08T19:49:01.519370+0000","objects_scrubbed":0,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:19.809313+0000","scrub_duration":0.001891829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18592,"num_read_kb":1141288,"num_write":194903,"num_write_kb":30181748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230906,"ondisk_log_size":230906,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2442,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148135,"ondisk_log_size":148135,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64782,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":241252722,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":2935,"num_read_kb":17425,"num_write":211935,"num_write_kb":1497715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":983922,"num_omap_keys":1498,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":323821568,"data_stored":482505444,"data_compressed":47939648,"data_compressed_allocated":70770688,"data_compressed_original":229515264,"omap_allocated":0,"internal_metadata":0},"log_size":196256,"ondisk_log_size":196256,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575183,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":901808,"kb_used_data":36392,"kb_used_omap":1,"kb_used_meta":865406,"kb_avail":93470032,"statfs":{"total":96636764160,"available":95713312768,"internally_reserved":0,"allocated":37265408,"data_stored":58267643,"data_compressed":5895427,"data_compressed_allocated":8474624,"data_compressed_original":29650944,"omap_allocated":1588,"internal_metadata":886176204},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":1.5580000000000001,"15min":1.456},"min":{"1min":0.36899999999999999,"5min":0.216,"15min":0.20699999999999999},"max":{"1min":0.78000000000000003,"5min":26.544,"15min":26.544},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":1.593,"15min":1.7509999999999999},"min":{"1min":0.51500000000000001,"5min":0.27800000000000002,"15min":0.223},"max":{"1min":0.77100000000000002,"5min":26.713999999999999,"15min":26.713999999999999},"last":0.56699999999999995}]},{"osd":1,"last update":"Wed May 8 19:49:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":1.667,"15min":1.96},"min":{"1min":0.45700000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.84599999999999997,"5min":14.557,"15min":32.259999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":1.6459999999999999,"15min":1.599},"min":{"1min":0.371,"5min":0.26300000000000001,"15min":0.251},"max":{"1min":0.79500000000000004,"5min":13.712999999999999,"15min":36.018000000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Wed May 8 19:49:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":1.671,"15min":1.496},"min":{"1min":0.39500000000000002,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":0.70799999999999996,"5min":13.635,"15min":13.635},"last":0.443},{"interface":"front","average":{"1min":0.58199999999999996,"5min":1.867,"15min":1.796},"min":{"1min":0.41499999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.88200000000000001,"5min":19.469999999999999,"15min":19.469999999999999},"last":0.52100000000000002}]},{"osd":3,"last update":"Wed May 8 19:49:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":2.073,"15min":1.873},"min":{"1min":0.39700000000000002,"5min":0.34200000000000003,"15min":0.29299999999999998},"max":{"1min":0.80300000000000005,"5min":38.195,"15min":38.195},"last":0.624},{"interface":"front","average":{"1min":0.61399999999999999,"5min":1.627,"15min":1.7889999999999999},"min":{"1min":0.45400000000000001,"5min":0.33800000000000002,"15min":0.30599999999999999},"max":{"1min":0.79700000000000004,"5min":14.134,"15min":26.501999999999999},"last":0.45400000000000001}]},{"osd":4,"last update":"Wed May 8 19:49:57 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":1.8839999999999999,"15min":1.6519999999999999},"min":{"1min":0.36299999999999999,"5min":0.26600000000000001,"15min":0.26100000000000001},"max":{"1min":0.59699999999999998,"5min":37.356000000000002,"15min":37.356000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":2.113,"15min":1.716},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.253},"max":{"1min":0.55100000000000005,"5min":31.786000000000001,"15min":31.786000000000001},"last":0.503}]},{"osd":5,"last update":"Wed May 8 19:49:57 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":1.8,"15min":1.7629999999999999},"min":{"1min":0.34599999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69999999999999996,"5min":29.346,"15min":35.156999999999996},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":1.415,"15min":1.331},"min":{"1min":0.41899999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.746,"5min":10.848000000000001,"15min":32.988999999999997},"last":0.54600000000000004}]},{"osd":6,"last update":"Wed May 8 19:49:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":1.383,"15min":1.4299999999999999},"min":{"1min":0.36099999999999999,"5min":0.315,"15min":0.308},"max":{"1min":0.72999999999999998,"5min":13.763,"15min":16.077999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":1.7270000000000001,"15min":1.5649999999999999},"min":{"1min":0.38400000000000001,"5min":0.308,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":28.535,"15min":28.535},"last":0.65800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575182,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1085188,"kb_used_data":49212,"kb_used_omap":1,"kb_used_meta":1035966,"kb_avail":93286652,"statfs":{"total":96636764160,"available":95525531648,"internally_reserved":0,"allocated":50393088,"data_stored":74750809,"data_compressed":7372511,"data_compressed_allocated":10829824,"data_compressed_original":35360768,"omap_allocated":1593,"internal_metadata":1060829639},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":1.9470000000000001,"15min":1.4810000000000001},"min":{"1min":0.27200000000000002,"5min":0.192,"15min":0.192},"max":{"1min":3.5470000000000002,"5min":17.488,"15min":17.488},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.679,"5min":2.9009999999999998,"15min":1.962},"min":{"1min":0.313,"5min":0.26400000000000001,"15min":0.245},"max":{"1min":12.345000000000001,"5min":37.295999999999999,"15min":37.295999999999999},"last":0.69299999999999995}]},{"osd":1,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":2.8010000000000002,"15min":1.954},"min":{"1min":0.28100000000000003,"5min":0.26200000000000001,"15min":0.22800000000000001},"max":{"1min":24.649999999999999,"5min":24.649999999999999,"15min":24.649999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.3400000000000001,"5min":2.6840000000000002,"15min":1.9219999999999999},"min":{"1min":0.313,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":12.154999999999999,"5min":37.521000000000001,"15min":37.521000000000001},"last":0.81699999999999995}]},{"osd":2,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":2.867,"15min":1.931},"min":{"1min":0.41799999999999998,"5min":0.313,"15min":0.247},"max":{"1min":6.9130000000000003,"5min":23.952999999999999,"15min":23.952999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":2.359,"5min":2.528,"15min":1.786},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.255},"max":{"1min":24.614999999999998,"5min":24.614999999999998,"15min":24.614999999999998},"last":0.76600000000000001}]},{"osd":3,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":2.448,"15min":2.0150000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.25800000000000001},"max":{"1min":8.3719999999999999,"5min":21.975000000000001,"15min":43.082999999999998},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.512,"5min":2.8460000000000001,"15min":2.177},"min":{"1min":0.437,"5min":0.35299999999999998,"15min":0.30399999999999999},"max":{"1min":7.4329999999999998,"5min":23.859000000000002,"15min":43.872999999999998},"last":0.77900000000000003}]},{"osd":4,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":2.6269999999999998,"15min":2.363},"min":{"1min":0.27800000000000002,"5min":0.26500000000000001,"15min":0.26200000000000001},"max":{"1min":7.4500000000000002,"5min":22.302,"15min":111.04900000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.6020000000000001,"5min":2.7730000000000001,"15min":1.8169999999999999},"min":{"1min":0.32200000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.8319999999999999,"5min":28.757999999999999,"15min":28.757999999999999},"last":0.52900000000000003}]},{"osd":5,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":3.161,"5min":2.492,"15min":1.776},"min":{"1min":0.311,"5min":0.309,"15min":0.251},"max":{"1min":24.550999999999998,"5min":24.550999999999998,"15min":39.134},"last":0.54600000000000004},{"interface":"front","average":{"1min":4.7690000000000001,"5min":3.1259999999999999,"15min":2.2879999999999998},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":89.531999999999996,"5min":89.531999999999996,"15min":89.531999999999996},"last":0.62}]},{"osd":7,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":2.609,"5min":2.7389999999999999,"15min":1.7529999999999999},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":27.448,"5min":27.448,"15min":27.448},"last":0.65000000000000002},{"interface":"front","average":{"1min":2.274,"5min":1.9610000000000001,"15min":1.5609999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":24.588999999999999,"5min":24.588999999999999,"15min":24.588999999999999},"last":0.63500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575182,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1188576,"kb_used_data":52632,"kb_used_omap":1,"kb_used_meta":1135934,"kb_avail":93183264,"statfs":{"total":96636764160,"available":95419662336,"internally_reserved":0,"allocated":53895168,"data_stored":78944601,"data_compressed":7659770,"data_compressed_allocated":11517952,"data_compressed_original":36741120,"omap_allocated":1594,"internal_metadata":1163196870},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":1.1200000000000001,"15min":1.1539999999999999},"min":{"1min":0.22600000000000001,"5min":0.20499999999999999,"15min":0.186},"max":{"1min":3.996,"5min":11.619999999999999,"15min":27.282},"last":0.45400000000000001},{"interface":"front","average":{"1min":2.6859999999999999,"5min":1.952,"15min":1.2290000000000001},"min":{"1min":0.245,"5min":0.217,"15min":0.186},"max":{"1min":18.614000000000001,"5min":18.614000000000001,"15min":18.614000000000001},"last":0.39700000000000002}]},{"osd":2,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":3.923,"5min":2.0310000000000001,"15min":1.3129999999999999},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20699999999999999},"max":{"1min":40.337000000000003,"5min":40.337000000000003,"15min":40.337000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.423,"5min":1.3280000000000001,"15min":1.026},"min":{"1min":0.28599999999999998,"5min":0.23400000000000001,"15min":0.216},"max":{"1min":12.145,"5min":18.058,"15min":18.058},"last":0.55700000000000005}]},{"osd":3,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.6659999999999999,"15min":1.2689999999999999},"min":{"1min":0.27900000000000003,"5min":0.23599999999999999,"15min":0.23000000000000001},"max":{"1min":12.364000000000001,"5min":18.024999999999999,"15min":18.024999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.9470000000000001,"5min":1.4850000000000001,"15min":1.3999999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.216},"max":{"1min":12.01,"5min":12.01,"15min":44.454999999999998},"last":0.51700000000000002}]},{"osd":4,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":4.0629999999999997,"5min":2.548,"15min":2.0139999999999998},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.27900000000000003},"max":{"1min":40.384999999999998,"5min":40.384999999999998,"15min":40.384999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.978,"5min":1.8740000000000001,"15min":1.829},"min":{"1min":0.38300000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":17.760999999999999,"5min":17.844999999999999,"15min":41.939},"last":0.61499999999999999}]},{"osd":5,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.9630000000000001,"5min":2.089,"15min":1.609},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.313},"max":{"1min":11.967000000000001,"5min":27.727,"15min":27.727},"last":0.80300000000000005},{"interface":"front","average":{"1min":4.1150000000000002,"5min":2.4489999999999998,"15min":1.887},"min":{"1min":0.38800000000000001,"5min":0.33900000000000002,"15min":0.318},"max":{"1min":40.292000000000002,"5min":40.292000000000002,"15min":40.292000000000002},"last":0.70599999999999996}]},{"osd":6,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":2.1859999999999999,"15min":1.78},"min":{"1min":0.375,"5min":0.375,"15min":0.314},"max":{"1min":12.039999999999999,"5min":33.189999999999998,"15min":33.189999999999998},"last":0.84199999999999997},{"interface":"front","average":{"1min":4.1340000000000003,"5min":3.2949999999999999,"15min":2.2509999999999999},"min":{"1min":0.42799999999999999,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":40.362000000000002,"5min":40.362000000000002,"15min":40.362000000000002},"last":0.73599999999999999}]},{"osd":7,"last update":"Wed May 8 19:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.897,"5min":1.7490000000000001,"15min":1.4370000000000001},"min":{"1min":0.442,"5min":0.36399999999999999,"15min":0.35899999999999999},"max":{"1min":13.084,"5min":17.890000000000001,"15min":17.890000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.6579999999999999,"5min":2.306,"15min":1.7929999999999999},"min":{"1min":0.44400000000000001,"5min":0.40600000000000003,"15min":0.36099999999999999},"max":{"1min":12.683,"5min":21.039999999999999,"15min":21.039999999999999},"last":0.86599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575182,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":805416,"kb_used_data":34464,"kb_used_omap":1,"kb_used_meta":770942,"kb_avail":93566424,"statfs":{"total":96636764160,"available":95812018176,"internally_reserved":0,"allocated":35291136,"data_stored":54073395,"data_compressed":5457884,"data_compressed_allocated":7987200,"data_compressed_original":26951680,"omap_allocated":1593,"internal_metadata":789445063},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":1.78,"5min":1.756,"15min":1.74},"min":{"1min":0.29699999999999999,"5min":0.189,"15min":0.185},"max":{"1min":12.462,"5min":22.343,"15min":37.991999999999997},"last":0.499},{"interface":"front","average":{"1min":0.91500000000000004,"5min":1.4910000000000001,"15min":1.2769999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":7.0229999999999997,"5min":20.382000000000001,"15min":21.954000000000001},"last":0.44600000000000001}]},{"osd":2,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.236,"15min":1.1080000000000001},"min":{"1min":0.316,"5min":0.22600000000000001,"15min":0.20899999999999999},"max":{"1min":12.42,"5min":17.687999999999999,"15min":17.687999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":1.3140000000000001,"15min":1.1830000000000001},"min":{"1min":0.255,"5min":0.23200000000000001,"15min":0.20899999999999999},"max":{"1min":4.5739999999999998,"5min":20.419,"15min":22.026},"last":0.40899999999999997}]},{"osd":3,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":1.726,"5min":2.1589999999999998,"15min":1.75},"min":{"1min":0.28000000000000003,"5min":0.22,"15min":0.192},"max":{"1min":8.8569999999999993,"5min":34.515000000000001,"15min":34.515000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":1.7010000000000001,"5min":2.4500000000000002,"15min":1.6399999999999999},"min":{"1min":0.35599999999999998,"5min":0.27600000000000002,"15min":0.22600000000000001},"max":{"1min":12.364000000000001,"5min":85.606999999999999,"15min":85.606999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":6.7450000000000001,"5min":3.5499999999999998,"15min":2.5},"min":{"1min":0.40999999999999998,"5min":0.29399999999999998,"15min":0.28199999999999997},"max":{"1min":60.851999999999997,"5min":60.851999999999997,"15min":66.331999999999994},"last":0.60599999999999998},{"interface":"front","average":{"1min":6.1539999999999999,"5min":3.6699999999999999,"15min":2.6040000000000001},"min":{"1min":0.48399999999999999,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":67.194000000000003,"5min":67.194000000000003,"15min":67.194000000000003},"last":0.70599999999999996}]},{"osd":5,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":3.4670000000000001,"5min":2.157,"15min":1.708},"min":{"1min":0.46999999999999997,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":21.18,"5min":21.18,"15min":21.981000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.829,"5min":1.792,"15min":1.601},"min":{"1min":0.34100000000000003,"5min":0.32400000000000001,"15min":0.30599999999999999},"max":{"1min":7.907,"5min":14.019,"15min":25.446999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":2.702,"5min":3.234,"15min":2.1789999999999998},"min":{"1min":0.54300000000000004,"5min":0.373,"15min":0.318},"max":{"1min":16.640000000000001,"5min":82.542000000000002,"15min":82.542000000000002},"last":0.753},{"interface":"front","average":{"1min":2.6589999999999998,"5min":2.1339999999999999,"15min":2.0129999999999999},"min":{"1min":0.45900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":16.056000000000001,"5min":25.914999999999999,"15min":25.914999999999999},"last":0.65400000000000003}]},{"osd":7,"last update":"Wed May 8 19:49:16 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.9179999999999999,"15min":1.9870000000000001},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":4.5339999999999998,"5min":20.445,"15min":26.669},"last":0.76200000000000001},{"interface":"front","average":{"1min":3.145,"5min":2.028,"15min":1.8700000000000001},"min":{"1min":0.42499999999999999,"5min":0.38400000000000001,"15min":0.33100000000000002},"max":{"1min":17.495000000000001,"5min":17.495000000000001,"15min":20.146000000000001},"last":0.73899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575183,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":729616,"kb_used_data":40712,"kb_used_omap":1,"kb_used_meta":688894,"kb_avail":93642224,"statfs":{"total":96636764160,"available":95889637376,"internally_reserved":0,"allocated":41689088,"data_stored":58833997,"data_compressed":5586562,"data_compressed_allocated":8433664,"data_compressed_original":25743360,"omap_allocated":1594,"internal_metadata":705427910},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":1.466,"15min":1.1579999999999999},"min":{"1min":0.22,"5min":0.186,"15min":0.16900000000000001},"max":{"1min":3.419,"5min":15.834,"15min":21.475999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.3089999999999999,"15min":1.23},"min":{"1min":0.214,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":11.121,"5min":14.374000000000001,"15min":30.434999999999999},"last":0.39700000000000002}]},{"osd":1,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":2.133,"5min":1.954,"15min":1.655},"min":{"1min":0.23200000000000001,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":9.391,"5min":24.190000000000001,"15min":25.550000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":2.0179999999999998,"5min":1.2390000000000001,"15min":1.137},"min":{"1min":0.30399999999999999,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":9.3539999999999992,"5min":9.3539999999999992,"15min":20.591000000000001},"last":0.43099999999999999}]},{"osd":3,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":2.6259999999999999,"5min":2.3959999999999999,"15min":1.835},"min":{"1min":0.251,"5min":0.23400000000000001,"15min":0.21099999999999999},"max":{"1min":21.16,"5min":34.598999999999997,"15min":34.598999999999997},"last":0.34499999999999997},{"interface":"front","average":{"1min":2.5289999999999999,"5min":2.5619999999999998,"15min":1.7749999999999999},"min":{"1min":0.26500000000000001,"5min":0.23799999999999999,"15min":0.20399999999999999},"max":{"1min":14.199999999999999,"5min":20.491,"15min":25.827000000000002},"last":0.45800000000000002}]},{"osd":4,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":1.8069999999999999,"5min":2.1890000000000001,"15min":2.371},"min":{"1min":0.373,"5min":0.32700000000000001,"15min":0.31900000000000001},"max":{"1min":12.004,"5min":15.936,"15min":67.506},"last":0.621},{"interface":"front","average":{"1min":2.7400000000000002,"5min":2.3519999999999999,"15min":2.5630000000000002},"min":{"1min":0.45600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":14.445,"5min":14.445,"15min":111.973},"last":0.76200000000000001}]},{"osd":5,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":3.5390000000000001,"5min":2.1360000000000001,"15min":1.77},"min":{"1min":0.39800000000000002,"5min":0.318,"15min":0.308},"max":{"1min":19.506,"5min":19.506,"15min":37.496000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":2.786,"5min":2.1880000000000002,"15min":1.7989999999999999},"min":{"1min":0.39600000000000002,"5min":0.33700000000000002,"15min":0.32600000000000001},"max":{"1min":11.926,"5min":34.545000000000002,"15min":45.997999999999998},"last":0.746}]},{"osd":6,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":3.2879999999999998,"5min":2.6070000000000002,"15min":2.1709999999999998},"min":{"1min":0.45700000000000002,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":15.334,"5min":29.954999999999998,"15min":68.453000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":2.7789999999999999,"5min":2.4660000000000002,"15min":2.0790000000000002},"min":{"1min":0.45300000000000001,"5min":0.34899999999999998,"15min":0.34300000000000003},"max":{"1min":16.204000000000001,"5min":16.204000000000001,"15min":63.966000000000001},"last":0.58399999999999996}]},{"osd":7,"last update":"Wed May 8 19:49:05 2024","interfaces":[{"interface":"back","average":{"1min":3.661,"5min":2.2370000000000001,"15min":2.0750000000000002},"min":{"1min":0.45100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":24.030000000000001,"5min":24.030000000000001,"15min":32.700000000000003},"last":0.79900000000000004},{"interface":"front","average":{"1min":2.758,"5min":2.3799999999999999,"15min":2.173},"min":{"1min":0.501,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.946,"5min":29.881,"15min":32.840000000000003},"last":0.77900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575182,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1179244,"kb_used_data":51492,"kb_used_omap":1,"kb_used_meta":1127742,"kb_avail":93192596,"statfs":{"total":96636764160,"available":95429218304,"internally_reserved":0,"allocated":52727808,"data_stored":79806189,"data_compressed":8205315,"data_compressed_allocated":12034048,"data_compressed_original":39284736,"omap_allocated":1591,"internal_metadata":1154808265},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.4870000000000001,"15min":1.173},"min":{"1min":0.22700000000000001,"5min":0.20300000000000001,"15min":0.184},"max":{"1min":10.606999999999999,"5min":24.539999999999999,"15min":24.539999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":2.1059999999999999,"5min":1.5309999999999999,"15min":1.5760000000000001},"min":{"1min":0.218,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":30.457000000000001,"5min":30.457000000000001,"15min":95.932000000000002},"last":0.40699999999999997}]},{"osd":1,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":2.8069999999999999,"5min":2.8809999999999998,"15min":2.1989999999999998},"min":{"1min":0.20399999999999999,"5min":0.20300000000000001,"15min":0.193},"max":{"1min":31.254999999999999,"5min":44.308,"15min":44.308},"last":0.27600000000000002},{"interface":"front","average":{"1min":1.597,"5min":1.954,"15min":1.367},"min":{"1min":0.27600000000000002,"5min":0.23300000000000001,"15min":0.22},"max":{"1min":13.927,"5min":38.054000000000002,"15min":38.054000000000002},"last":0.35499999999999998}]},{"osd":2,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":2.2890000000000001,"5min":2.052,"15min":1.645},"min":{"1min":0.26300000000000001,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":31.277999999999999,"5min":31.277999999999999,"15min":31.277999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":1.726,"5min":1.2629999999999999,"15min":1.1839999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26700000000000002},"max":{"1min":13.897,"5min":17.364000000000001,"15min":17.364000000000001},"last":0.437}]},{"osd":4,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":1.768,"5min":1.9850000000000001,"15min":1.7150000000000001},"min":{"1min":0.31900000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":18.422999999999998,"5min":18.960000000000001,"15min":19.16},"last":0.54300000000000004},{"interface":"front","average":{"1min":3.0640000000000001,"5min":2.4780000000000002,"15min":2.2210000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.26700000000000002},"max":{"1min":31.201000000000001,"5min":31.201000000000001,"15min":31.201000000000001},"last":0.42699999999999999}]},{"osd":5,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":3.0880000000000001,"5min":2.0760000000000001,"15min":2.0630000000000002},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32200000000000001},"max":{"1min":31.155999999999999,"5min":31.155999999999999,"15min":33.436999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":1.641,"5min":1.8340000000000001,"15min":1.6599999999999999},"min":{"1min":0.38400000000000001,"5min":0.33300000000000002,"15min":0.32000000000000001},"max":{"1min":10.579000000000001,"5min":17.329000000000001,"15min":17.329000000000001},"last":0.52700000000000002}]},{"osd":6,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":2.0779999999999998,"15min":2.0339999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":10.48,"5min":25.329000000000001,"15min":30.588000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":2.1030000000000002,"5min":2.0249999999999999,"15min":1.8999999999999999},"min":{"1min":0.40799999999999997,"5min":0.34599999999999997,"15min":0.33900000000000002},"max":{"1min":16.077000000000002,"5min":18.803000000000001,"15min":23.318999999999999},"last":0.58299999999999996}]},{"osd":7,"last update":"Wed May 8 19:49:15 2024","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.7210000000000001,"15min":1.8440000000000001},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.34699999999999998},"max":{"1min":13.25,"5min":18.841999999999999,"15min":19.116},"last":0.61099999999999999},{"interface":"front","average":{"1min":3.1549999999999998,"5min":2.4830000000000001,"15min":2.1419999999999999},"min":{"1min":0.41799999999999998,"5min":0.38800000000000001,"15min":0.36399999999999999},"max":{"1min":31.23,"5min":31.23,"15min":33.505000000000003},"last":0.56200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834575182,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":925352,"kb_used_data":24096,"kb_used_omap":1,"kb_used_meta":901246,"kb_avail":93446488,"statfs":{"total":96636764160,"available":95689203712,"internally_reserved":0,"allocated":24674304,"data_stored":37862603,"data_compressed":4009381,"data_compressed_allocated":5820416,"data_compressed_original":19185664,"omap_allocated":1594,"internal_metadata":922876358},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":2.593,"15min":1.7430000000000001},"min":{"1min":0.27200000000000002,"5min":0.21199999999999999,"15min":0.20899999999999999},"max":{"1min":10.792,"5min":21.062999999999999,"15min":45.375},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.587,"5min":1.919,"15min":1.74},"min":{"1min":0.29699999999999999,"5min":0.23100000000000001,"15min":0.188},"max":{"1min":12.551,"5min":12.551,"15min":35.765000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":2.4350000000000001,"5min":2.859,"15min":2.113},"min":{"1min":0.28100000000000003,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":14.561999999999999,"5min":22.718,"15min":29.928000000000001},"last":0.626},{"interface":"front","average":{"1min":1.9830000000000001,"5min":2.9420000000000002,"15min":1.7829999999999999},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.248},"max":{"1min":18.433,"5min":21.103000000000002,"15min":23.634},"last":0.55200000000000005}]},{"osd":2,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":2.4710000000000001,"5min":2.7029999999999998,"15min":1.873},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.27600000000000002},"max":{"1min":12.27,"5min":30.512,"15min":30.512},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.4370000000000001,"5min":3.8959999999999999,"15min":2.1600000000000001},"min":{"1min":0.32100000000000001,"5min":0.27400000000000002,"15min":0.26300000000000001},"max":{"1min":10.868,"5min":82.847999999999999,"15min":82.847999999999999},"last":0.65400000000000003}]},{"osd":3,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.875,"15min":1.6120000000000001},"min":{"1min":0.32600000000000001,"5min":0.26600000000000001,"15min":0.23899999999999999},"max":{"1min":8.4359999999999999,"5min":11.970000000000001,"15min":22.555},"last":0.59999999999999998},{"interface":"front","average":{"1min":2.9870000000000001,"5min":3.0230000000000001,"15min":2.0950000000000002},"min":{"1min":0.379,"5min":0.35699999999999998,"15min":0.308},"max":{"1min":24.347000000000001,"5min":24.347000000000001,"15min":26.259},"last":0.66800000000000004}]},{"osd":5,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":4.0620000000000003,"15min":2.1600000000000001},"min":{"1min":0.29999999999999999,"5min":0.28299999999999997,"15min":0.246},"max":{"1min":12.558999999999999,"5min":82.918999999999997,"15min":82.918999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":1.774,"5min":2.4780000000000002,"15min":1.8879999999999999},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":12.051,"5min":25.120000000000001,"15min":25.120000000000001},"last":0.45500000000000002}]},{"osd":6,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":2.3969999999999998,"15min":1.7649999999999999},"min":{"1min":0.317,"5min":0.313,"15min":0.252},"max":{"1min":12.365,"5min":18.141999999999999,"15min":20.562999999999999},"last":0.437},{"interface":"front","average":{"1min":1.744,"5min":3.6560000000000001,"15min":2.3180000000000001},"min":{"1min":0.36099999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":16.669,"5min":83.643000000000001,"15min":83.643000000000001},"last":0.47599999999999998}]},{"osd":7,"last update":"Wed May 8 19:49:02 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.988,"15min":1.7769999999999999},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":11.795999999999999,"5min":19.021999999999998,"15min":25.878},"last":0.54000000000000004},{"interface":"front","average":{"1min":2.4580000000000002,"5min":2.4300000000000002,"15min":1.863},"min":{"1min":0.441,"5min":0.308,"15min":0.27800000000000002},"max":{"1min":12.334,"5min":22.75,"15min":22.75},"last":0.56299999999999994}]}]},{"osd":5,"up_from":13,"seq":55834575182,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":957096,"kb_used_data":29536,"kb_used_omap":1,"kb_used_meta":927550,"kb_avail":93414744,"statfs":{"total":96636764160,"available":95656697856,"internally_reserved":0,"allocated":30244864,"data_stored":42056871,"data_compressed":3817580,"data_compressed_allocated":5763072,"data_compressed_original":17743872,"omap_allocated":1594,"internal_metadata":949811654},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.9319999999999999,"15min":1.349},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":12.286,"5min":19.097999999999999,"15min":19.097999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.5289999999999999,"5min":2.1339999999999999,"15min":1.579},"min":{"1min":0.27300000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":9.9350000000000005,"5min":21.416,"15min":21.416},"last":0.56000000000000005}]},{"osd":1,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.8200000000000001,"15min":1.6699999999999999},"min":{"1min":0.309,"5min":0.29199999999999998,"15min":0.249},"max":{"1min":11.445,"5min":16.515000000000001,"15min":19.581},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.6000000000000001,"15min":1.337},"min":{"1min":0.28699999999999998,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":13.266999999999999,"5min":16.492999999999999,"15min":16.492999999999999},"last":0.78300000000000003}]},{"osd":2,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.397,"15min":1.4430000000000001},"min":{"1min":0.34200000000000003,"5min":0.27300000000000002,"15min":0.25700000000000001},"max":{"1min":9.9290000000000003,"5min":9.9290000000000003,"15min":21.186},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.022,"5min":1.363,"15min":1.284},"min":{"1min":0.26700000000000002,"5min":0.26200000000000001,"15min":0.25700000000000001},"max":{"1min":6.2400000000000002,"5min":8.4160000000000004,"15min":22.353999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.9379999999999999,"15min":1.6599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.29699999999999999},"max":{"1min":11.137,"5min":16.324999999999999,"15min":17.103999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.458,"5min":2.0739999999999998,"15min":1.7390000000000001},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.29899999999999999},"max":{"1min":8.5920000000000005,"5min":18.798999999999999,"15min":23.224},"last":0.71999999999999997}]},{"osd":4,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.9350000000000001,"15min":1.548},"min":{"1min":0.29699999999999999,"5min":0.25,"15min":0.20799999999999999},"max":{"1min":6.2000000000000002,"5min":19.018999999999998,"15min":28.724},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.21,"5min":2.105,"15min":1.6499999999999999},"min":{"1min":0.317,"5min":0.28100000000000003,"15min":0.22800000000000001},"max":{"1min":6.7229999999999999,"5min":25.466999999999999,"15min":25.466999999999999},"last":0.497}]},{"osd":6,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.869,"15min":1.5640000000000001},"min":{"1min":0.32800000000000001,"5min":0.28699999999999998,"15min":0.23899999999999999},"max":{"1min":7.7210000000000001,"5min":20.969999999999999,"15min":21.294},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.4390000000000001,"5min":2.125,"15min":1.518},"min":{"1min":0.39700000000000002,"5min":0.34599999999999997,"15min":0.24199999999999999},"max":{"1min":6.1660000000000004,"5min":23.731000000000002,"15min":23.731000000000002},"last":0.63}]},{"osd":7,"last update":"Wed May 8 19:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.8029999999999999,"15min":1.4790000000000001},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.29299999999999998},"max":{"1min":5.6920000000000002,"5min":21.462,"15min":30.076000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":1.474,"15min":1.306},"min":{"1min":0.39400000000000002,"5min":0.36699999999999999,"15min":0.26100000000000001},"max":{"1min":4.6609999999999996,"5min":14.316000000000001,"15min":21.257000000000001},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32391,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34947072,"data_stored":53369286,"data_compressed":5425493,"data_compressed_allocated":7942144,"data_compressed_original":26378240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53616640,"data_stored":78830860,"data_compressed":7659770,"data_compressed_allocated":11517952,"data_compressed_original":36741120,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41410560,"data_stored":58720256,"data_compressed":5586562,"data_compressed_allocated":8433664,"data_compressed_original":25743360,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":52449280,"data_stored":79692448,"data_compressed":8205315,"data_compressed_allocated":12034048,"data_compressed_original":39284736,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24395776,"data_stored":37748862,"data_compressed":4009381,"data_compressed_allocated":5820416,"data_compressed_original":19185664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29966336,"data_stored":41943130,"data_compressed":3817580,"data_compressed_allocated":5763072,"data_compressed_original":17743872,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50114560,"data_stored":74637068,"data_compressed":7372511,"data_compressed_allocated":10829824,"data_compressed_original":35360768,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36921344,"data_stored":57563534,"data_compressed":5863036,"data_compressed_allocated":8429568,"data_compressed_original":29077504,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T19:50:03.891 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T19:50:04.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.058+0000 7f32130fb700 1 Processor -- start 2024-05-08T19:50:04.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.058+0000 7f32130fb700 1 -- start start 2024-05-08T19:50:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.059+0000 7f32130fb700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f320c152130 0x7f320c154de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.059+0000 7f32130fb700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f320c0c0770 0x7f320c155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.059+0000 7f32130fb700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320c0716a0 con 0x7f320c157f80 2024-05-08T19:50:04.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.059+0000 7f32130fb700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f320c0c3a40 con 0x7f320c0c0770 2024-05-08T19:50:04.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.059+0000 7f32130fb700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320c0c11f0 con 0x7f320c152130 2024-05-08T19:50:04.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.059+0000 7f320bfff700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f320c0c0770 0x7f320c155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.059+0000 7f320bfff700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f320c0c0770 0x7f320c155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44116/0 (socket says 172.21.15.47:44116) 2024-05-08T19:50:04.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.059+0000 7f320bfff700 1 -- 172.21.15.47:0/1344102869 learned_addr learned my addr 172.21.15.47:0/1344102869 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:50:04.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.059+0000 7f3210e97700 1 --2- 172.21.15.47:0/1344102869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f320c152130 0x7f320c154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.059+0000 7f320bfff700 1 -- 172.21.15.47:0/1344102869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f320c152130 msgr2=0x7f320c154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:04.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.059+0000 7f320bfff700 1 --2- 172.21.15.47:0/1344102869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f320c152130 0x7f320c154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.059+0000 7f320bfff700 1 -- 172.21.15.47:0/1344102869 >> v1:172.21.15.177:6789/0 conn(0x7f320c157f80 legacy=0x7f320c158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:04.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.059+0000 7f320bfff700 1 -- 172.21.15.47:0/1344102869 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320c06b470 con 0x7f320c0c0770 2024-05-08T19:50:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.060+0000 7f320bfff700 1 --2- 172.21.15.47:0/1344102869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f320c0c0770 0x7f320c155320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f31f80098f0 tx=0x7f31f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221887b8688b0975 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.060+0000 7f320b7fe700 1 -- 172.21.15.47:0/1344102869 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f8004230 con 0x7f320c0c0770 2024-05-08T19:50:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.060+0000 7f320b7fe700 1 -- 172.21.15.47:0/1344102869 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f8004390 con 0x7f320c0c0770 2024-05-08T19:50:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.060+0000 7f320b7fe700 1 -- 172.21.15.47:0/1344102869 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f80036a0 con 0x7f320c0c0770 2024-05-08T19:50:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.060+0000 7f32130fb700 1 -- 172.21.15.47:0/1344102869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f320c0c0770 msgr2=0x7f320c155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.060+0000 7f32130fb700 1 --2- 172.21.15.47:0/1344102869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f320c0c0770 0x7f320c155320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f31f80098f0 tx=0x7f31f8009c00 comp rx=0 tx=0).stop 2024-05-08T19:50:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.060+0000 7f32130fb700 1 -- 172.21.15.47:0/1344102869 shutdown_connections 2024-05-08T19:50:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.060+0000 7f32130fb700 1 --2- 172.21.15.47:0/1344102869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f320c152130 0x7f320c154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.060+0000 7f32130fb700 1 --2- 172.21.15.47:0/1344102869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f320c0c0770 0x7f320c155320 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.060+0000 7f32130fb700 1 -- 172.21.15.47:0/1344102869 >> 172.21.15.47:0/1344102869 conn(0x7f320c0c7120 msgr2=0x7f320c0c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.060+0000 7f32130fb700 1 -- 172.21.15.47:0/1344102869 shutdown_connections 2024-05-08T19:50:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.060+0000 7f32130fb700 1 -- 172.21.15.47:0/1344102869 wait complete. 2024-05-08T19:50:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.061+0000 7f32130fb700 1 Processor -- start 2024-05-08T19:50:04.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.062+0000 7f32130fb700 1 -- start start 2024-05-08T19:50:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.062+0000 7f32130fb700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f320c0c0770 0x7f320c157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.062+0000 7f32130fb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f320c152130 0x7f320c1eab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.062+0000 7f32130fb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f320c157f80 0x7f320c153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.062+0000 7f32130fb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c1eb070 con 0x7f320c157f80 2024-05-08T19:50:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.062+0000 7f32130fb700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c157d10 con 0x7f320c152130 2024-05-08T19:50:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.062+0000 7f32130fb700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320c157750 con 0x7f320c0c0770 2024-05-08T19:50:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.062+0000 7f3211698700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f320c157f80 0x7f320c153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.062+0000 7f3211698700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f320c157f80 0x7f320c153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44126/0 (socket says 172.21.15.47:44126) 2024-05-08T19:50:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.062+0000 7f3211698700 1 -- 172.21.15.47:0/1751356728 learned_addr learned my addr 172.21.15.47:0/1751356728 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:50:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.063+0000 7f3211698700 1 -- 172.21.15.47:0/1751356728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f320c0c0770 msgr2=0x7f320c157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.063+0000 7f3211698700 1 --2- 172.21.15.47:0/1751356728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f320c0c0770 0x7f320c157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.063+0000 7f3211698700 1 -- 172.21.15.47:0/1751356728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f320c152130 msgr2=0x7f320c1eab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.063+0000 7f3211698700 1 --2- 172.21.15.47:0/1751356728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f320c152130 0x7f320c1eab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.063+0000 7f3211698700 1 -- 172.21.15.47:0/1751356728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f8009550 con 0x7f320c157f80 2024-05-08T19:50:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.063+0000 7f3211698700 1 --2- 172.21.15.47:0/1751356728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f320c157f80 0x7f320c153ac0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f320400b970 tx=0x7f320400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.063+0000 7f32097fa700 1 -- 172.21.15.47:0/1751356728 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320400c9b0 con 0x7f320c157f80 2024-05-08T19:50:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.063+0000 7f32097fa700 1 -- 172.21.15.47:0/1751356728 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320400cb10 con 0x7f320c157f80 2024-05-08T19:50:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.063+0000 7f32130fb700 1 -- 172.21.15.47:0/1751356728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320c157a30 con 0x7f320c157f80 2024-05-08T19:50:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.063+0000 7f32097fa700 1 -- 172.21.15.47:0/1751356728 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204014440 con 0x7f320c157f80 2024-05-08T19:50:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.063+0000 7f32130fb700 1 -- 172.21.15.47:0/1751356728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320c156010 con 0x7f320c157f80 2024-05-08T19:50:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.064+0000 7f32130fb700 1 -- 172.21.15.47:0/1751356728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320c156230 con 0x7f320c157f80 2024-05-08T19:50:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.064+0000 7f32097fa700 1 -- 172.21.15.47:0/1751356728 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f320401d3b0 con 0x7f320c157f80 2024-05-08T19:50:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.065+0000 7f32097fa700 1 --2- 172.21.15.47:0/1751356728 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f31f006ac90 0x7f31f006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.065+0000 7f32097fa700 1 -- 172.21.15.47:0/1751356728 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3204089320 con 0x7f320c157f80 2024-05-08T19:50:04.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.065+0000 7f3210e97700 1 --2- 172.21.15.47:0/1751356728 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f31f006ac90 0x7f31f006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.066+0000 7f3210e97700 1 --2- 172.21.15.47:0/1751356728 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f31f006ac90 0x7f31f006d150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f32000097f0 tx=0x7f3200008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:04.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.070+0000 7f32097fa700 1 -- 172.21.15.47:0/1751356728 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f32040541d0 con 0x7f320c157f80 2024-05-08T19:50:04.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.279+0000 7f32130fb700 1 -- 172.21.15.47:0/1751356728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f320c04ec60 con 0x7f320c157f80 2024-05-08T19:50:04.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.282+0000 7f32097fa700 1 -- 172.21.15.47:0/1751356728 <== mon.0 v2:172.21.15.47:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f32040541d0 con 0x7f320c157f80 2024-05-08T19:50:04.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.283+0000 7f32097fa700 1 -- 172.21.15.47:0/1751356728 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f32040577f0 con 0x7f320c157f80 2024-05-08T19:50:04.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.285+0000 7f32130fb700 1 -- 172.21.15.47:0/1751356728 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f31f006ac90 msgr2=0x7f31f006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:04.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.285+0000 7f32130fb700 1 --2- 172.21.15.47:0/1751356728 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f31f006ac90 0x7f31f006d150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f32000097f0 tx=0x7f3200008040 comp rx=0 tx=0).stop 2024-05-08T19:50:04.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.285+0000 7f32130fb700 1 -- 172.21.15.47:0/1751356728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f320c157f80 msgr2=0x7f320c153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:04.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.285+0000 7f32130fb700 1 --2- 172.21.15.47:0/1751356728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f320c157f80 0x7f320c153ac0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f320400b970 tx=0x7f320400bd30 comp rx=0 tx=0).stop 2024-05-08T19:50:04.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.285+0000 7f32130fb700 1 -- 172.21.15.47:0/1751356728 shutdown_connections 2024-05-08T19:50:04.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.285+0000 7f32130fb700 1 --2- 172.21.15.47:0/1751356728 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f31f006ac90 0x7f31f006d150 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.285+0000 7f32130fb700 1 --2- 172.21.15.47:0/1751356728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f320c157f80 0x7f320c153ac0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.285+0000 7f32130fb700 1 --2- 172.21.15.47:0/1751356728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f320c0c0770 0x7f320c157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.285+0000 7f32130fb700 1 --2- 172.21.15.47:0/1751356728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f320c152130 0x7f320c1eab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.285+0000 7f32130fb700 1 -- 172.21.15.47:0/1751356728 >> 172.21.15.47:0/1751356728 conn(0x7f320c0c7120 msgr2=0x7f320c1583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:04.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.286+0000 7f32130fb700 1 -- 172.21.15.47:0/1751356728 shutdown_connections 2024-05-08T19:50:04.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.286+0000 7f32130fb700 1 -- 172.21.15.47:0/1751356728 wait complete. 2024-05-08T19:50:04.288 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T19:50:04.289 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T19:50:04.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.424+0000 7f5104d35700 1 Processor -- start 2024-05-08T19:50:04.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.424+0000 7f5104d35700 1 -- start start 2024-05-08T19:50:04.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.425+0000 7f5104d35700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000c1d90 0x7f51000c2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.425+0000 7f5104d35700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f51000c2b10 0x7f51000a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.425+0000 7f5104d35700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51000c3690 con 0x7f51000a89f0 2024-05-08T19:50:04.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.425+0000 7f5104d35700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51000c3970 con 0x7f51000c2b10 2024-05-08T19:50:04.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.425+0000 7f5104d35700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5100154d00 con 0x7f51000c1d90 2024-05-08T19:50:04.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.425+0000 7f50fdd9b700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f51000c2b10 0x7f51000a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.425+0000 7f50fdd9b700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f51000c2b10 0x7f51000a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44140/0 (socket says 172.21.15.47:44140) 2024-05-08T19:50:04.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.425+0000 7f50fdd9b700 1 -- 172.21.15.47:0/710824140 learned_addr learned my addr 172.21.15.47:0/710824140 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:50:04.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.425+0000 7f50fe59c700 1 --2- 172.21.15.47:0/710824140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000c1d90 0x7f51000c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.425+0000 7f50fdd9b700 1 -- 172.21.15.47:0/710824140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000c1d90 msgr2=0x7f51000c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:04.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.425+0000 7f50fdd9b700 1 --2- 172.21.15.47:0/710824140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000c1d90 0x7f51000c2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.425+0000 7f50fdd9b700 1 -- 172.21.15.47:0/710824140 >> v1:172.21.15.177:6789/0 conn(0x7f51000a89f0 legacy=0x7f510014ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:04.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.425+0000 7f50fdd9b700 1 -- 172.21.15.47:0/710824140 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5100154fe0 con 0x7f51000c2b10 2024-05-08T19:50:04.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.426+0000 7f50fdd9b700 1 --2- 172.21.15.47:0/710824140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51000c2b10 0x7f51000a84b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009920 tx=0x7f50f0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa08d081a9414589 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:04.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.426+0000 7f50fd59a700 1 -- 172.21.15.47:0/710824140 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f0004230 con 0x7f51000c2b10 2024-05-08T19:50:04.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.426+0000 7f50fd59a700 1 -- 172.21.15.47:0/710824140 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f50f0004390 con 0x7f51000c2b10 2024-05-08T19:50:04.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.426+0000 7f50fd59a700 1 -- 172.21.15.47:0/710824140 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f0009e70 con 0x7f51000c2b10 2024-05-08T19:50:04.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.426+0000 7f5104d35700 1 -- 172.21.15.47:0/710824140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51000c2b10 msgr2=0x7f51000a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:04.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.426+0000 7f5104d35700 1 --2- 172.21.15.47:0/710824140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51000c2b10 0x7f51000a84b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009920 tx=0x7f50f0009c30 comp rx=0 tx=0).stop 2024-05-08T19:50:04.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.426+0000 7f5104d35700 1 -- 172.21.15.47:0/710824140 shutdown_connections 2024-05-08T19:50:04.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.426+0000 7f5104d35700 1 --2- 172.21.15.47:0/710824140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000c1d90 0x7f51000c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.426+0000 7f5104d35700 1 --2- 172.21.15.47:0/710824140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51000c2b10 0x7f51000a84b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.426+0000 7f5104d35700 1 -- 172.21.15.47:0/710824140 >> 172.21.15.47:0/710824140 conn(0x7f51000c3c20 msgr2=0x7f51000c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:04.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.426+0000 7f5104d35700 1 -- 172.21.15.47:0/710824140 shutdown_connections 2024-05-08T19:50:04.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.427+0000 7f5104d35700 1 -- 172.21.15.47:0/710824140 wait complete. 2024-05-08T19:50:04.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.428+0000 7f5104d35700 1 Processor -- start 2024-05-08T19:50:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.428+0000 7f5104d35700 1 -- start start 2024-05-08T19:50:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f5104d35700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51000c1d90 0x7f51001e8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f5104d35700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000c2b10 0x7f5100071810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f5104d35700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5100153ef0 0x7f51001eb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f5104d35700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51001e83e0 con 0x7f51000c1d90 2024-05-08T19:50:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f5104d35700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5100154930 con 0x7f5100153ef0 2024-05-08T19:50:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f5104d35700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510014d970 con 0x7f51000c2b10 2024-05-08T19:50:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f50fe59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51000c1d90 0x7f51001e8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f50fe59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51000c1d90 0x7f51001e8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44144/0 (socket says 172.21.15.47:44144) 2024-05-08T19:50:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f50fe59c700 1 -- 172.21.15.47:0/3806745884 learned_addr learned my addr 172.21.15.47:0/3806745884 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:50:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f50fed9d700 1 --2- 172.21.15.47:0/3806745884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5100153ef0 0x7f51001eb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f50fdd9b700 1 --2- 172.21.15.47:0/3806745884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000c2b10 0x7f5100071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f50fe59c700 1 -- 172.21.15.47:0/3806745884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000c2b10 msgr2=0x7f5100071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f50fe59c700 1 --2- 172.21.15.47:0/3806745884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000c2b10 0x7f5100071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f50fe59c700 1 -- 172.21.15.47:0/3806745884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5100153ef0 msgr2=0x7f51001eb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f50fe59c700 1 --2- 172.21.15.47:0/3806745884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5100153ef0 0x7f51001eb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.429+0000 7f50fe59c700 1 -- 172.21.15.47:0/3806745884 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f0009550 con 0x7f51000c1d90 2024-05-08T19:50:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.430+0000 7f50fe59c700 1 --2- 172.21.15.47:0/3806745884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51000c1d90 0x7f51001e8e20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f50f400c820 tx=0x7f50f400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.430+0000 7f50eeffd700 1 -- 172.21.15.47:0/3806745884 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f4011800 con 0x7f51000c1d90 2024-05-08T19:50:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.430+0000 7f50eeffd700 1 -- 172.21.15.47:0/3806745884 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f50f4011960 con 0x7f51000c1d90 2024-05-08T19:50:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.430+0000 7f50eeffd700 1 -- 172.21.15.47:0/3806745884 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f4011d30 con 0x7f51000c1d90 2024-05-08T19:50:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.430+0000 7f5104d35700 1 -- 172.21.15.47:0/3806745884 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51001eb2f0 con 0x7f51000c1d90 2024-05-08T19:50:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.430+0000 7f5104d35700 1 -- 172.21.15.47:0/3806745884 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51001e85d0 con 0x7f51000c1d90 2024-05-08T19:50:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.431+0000 7f5104d35700 1 -- 172.21.15.47:0/3806745884 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510004ec60 con 0x7f51000c1d90 2024-05-08T19:50:04.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.431+0000 7f50eeffd700 1 -- 172.21.15.47:0/3806745884 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f50f4018360 con 0x7f51000c1d90 2024-05-08T19:50:04.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.432+0000 7f50eeffd700 1 --2- 172.21.15.47:0/3806745884 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f50e006ac90 0x7f50e006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.432+0000 7f50eeffd700 1 -- 172.21.15.47:0/3806745884 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f50f4089730 con 0x7f51000c1d90 2024-05-08T19:50:04.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.432+0000 7f50fdd9b700 1 --2- 172.21.15.47:0/3806745884 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f50e006ac90 0x7f50e006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.432+0000 7f50fdd9b700 1 --2- 172.21.15.47:0/3806745884 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f50e006ac90 0x7f50e006d150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009130 tx=0x7f50f0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:04.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.436+0000 7f50eeffd700 1 -- 172.21.15.47:0/3806745884 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f50f4054550 con 0x7f51000c1d90 2024-05-08T19:50:04.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.696+0000 7f5104d35700 1 -- 172.21.15.47:0/3806745884 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f510014bce0 con 0x7f51000c1d90 2024-05-08T19:50:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.697+0000 7f50eeffd700 1 -- 172.21.15.47:0/3806745884 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f50f4057b70 con 0x7f51000c1d90 2024-05-08T19:50:04.687 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:50:04.687 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3927983771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3927983771},{"type":"v1","addr":"172.21.15.47:6833","nonce":3927983771}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/201830514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":201830514},{"type":"v1","addr":"172.21.15.47:6835","nonce":201830514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1266001461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1266001461},{"type":"v1","addr":"172.21.15.177:6836","nonce":1266001461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T19:22:20.424727+0000","modified":"2024-05-08T19:22:42.943964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/2990594738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2990594738},{"type":"v1","addr":"172.21.15.177:6837","nonce":2990594738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T19:50:04.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.699+0000 7f5104d35700 1 -- 172.21.15.47:0/3806745884 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f50e006ac90 msgr2=0x7f50e006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:04.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.699+0000 7f5104d35700 1 --2- 172.21.15.47:0/3806745884 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f50e006ac90 0x7f50e006d150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009130 tx=0x7f50f0008030 comp rx=0 tx=0).stop 2024-05-08T19:50:04.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.699+0000 7f5104d35700 1 -- 172.21.15.47:0/3806745884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51000c1d90 msgr2=0x7f51001e8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:04.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.699+0000 7f5104d35700 1 --2- 172.21.15.47:0/3806745884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51000c1d90 0x7f51001e8e20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f50f400c820 tx=0x7f50f400cbe0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.699+0000 7f5104d35700 1 -- 172.21.15.47:0/3806745884 shutdown_connections 2024-05-08T19:50:04.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.699+0000 7f5104d35700 1 --2- 172.21.15.47:0/3806745884 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f50e006ac90 0x7f50e006d150 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.699+0000 7f5104d35700 1 --2- 172.21.15.47:0/3806745884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51000c1d90 0x7f51001e8e20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.699+0000 7f5104d35700 1 --2- 172.21.15.47:0/3806745884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5100153ef0 0x7f51001eb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.699+0000 7f5104d35700 1 --2- 172.21.15.47:0/3806745884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51000c2b10 0x7f5100071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.699+0000 7f5104d35700 1 -- 172.21.15.47:0/3806745884 >> 172.21.15.47:0/3806745884 conn(0x7f51000c3c20 msgr2=0x7f510014c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:04.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.699+0000 7f5104d35700 1 -- 172.21.15.47:0/3806745884 shutdown_connections 2024-05-08T19:50:04.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.699+0000 7f5104d35700 1 -- 172.21.15.47:0/3806745884 wait complete. 2024-05-08T19:50:04.691 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-05-08T19:50:04.702 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T19:50:04.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.838+0000 7fa3a2d01700 1 Processor -- start 2024-05-08T19:50:04.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.838+0000 7fa3a2d01700 1 -- start start 2024-05-08T19:50:04.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.839+0000 7fa3a2d01700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa39c152130 0x7fa39c158920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.839+0000 7fa3a2d01700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39c06f400 con 0x7fa39c06e890 2024-05-08T19:50:04.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.839+0000 7fa3a2d01700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39c0c4570 con 0x7fa39c0702a0 2024-05-08T19:50:04.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.839+0000 7fa3a2d01700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0c2830 con 0x7fa39c152130 2024-05-08T19:50:04.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.839+0000 7fa3a129e700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa39c06e890 0x7fa39c06ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44196/0 (socket says 172.21.15.47:44196) 2024-05-08T19:50:04.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.839+0000 7fa3a129e700 1 -- 172.21.15.47:0/1813600437 learned_addr learned my addr 172.21.15.47:0/1813600437 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:50:04.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.839+0000 7fa3a0a9d700 1 --2- 172.21.15.47:0/1813600437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa39c152130 0x7fa39c158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053095053 0 0) 0x7fa39c06f400 con 0x7fa39c06e890 2024-05-08T19:50:04.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa38c0035b0 con 0x7fa39c06e890 2024-05-08T19:50:04.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575029735 0 0) 0x7fa39c0c4570 con 0x7fa39c0702a0 2024-05-08T19:50:04.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa39c06f400 con 0x7fa39c0702a0 2024-05-08T19:50:04.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1403368316 0 0) 0x7fa38c0035b0 con 0x7fa39c06e890 2024-05-08T19:50:04.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa39c152130 msgr2=0x7fa39c158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:04.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 --2- 172.21.15.47:0/1813600437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa39c152130 0x7fa39c158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 >> v1:172.21.15.177:6789/0 conn(0x7fa39c0702a0 legacy=0x7fa39c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:04.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c0c4850 con 0x7fa39c06e890 2024-05-08T19:50:04.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7fa3940019f0 con 0x7fa39c06e890 2024-05-08T19:50:04.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 >> v1:172.21.15.47:6789/0 conn(0x7fa39c06e890 legacy=0x7fa39c06ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:04.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 --2- 172.21.15.47:0/1813600437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa38c003bc0 0x7fa38c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 --2- 172.21.15.47:0/1813600437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa39c152130 0x7fa38c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 --2- 172.21.15.47:0/1813600437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa38c004d90 0x7fa38c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c00bac0 con 0x7fa38c004d90 2024-05-08T19:50:04.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c00bc00 con 0x7fa38c003bc0 2024-05-08T19:50:04.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c00bdc0 con 0x7fa39c152130 2024-05-08T19:50:04.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa3a129e700 1 --2- 172.21.15.47:0/1813600437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa38c004d90 0x7fa38c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa3a0a9d700 1 --2- 172.21.15.47:0/1813600437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa38c003bc0 0x7fa38c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa39bfff700 1 --2- 172.21.15.47:0/1813600437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa39c152130 0x7fa38c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa3a129e700 1 -- 172.21.15.47:0/1813600437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa39c152130 msgr2=0x7fa38c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:04.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa3a129e700 1 --2- 172.21.15.47:0/1813600437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa39c152130 0x7fa38c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa3a129e700 1 -- 172.21.15.47:0/1813600437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa38c003bc0 msgr2=0x7fa38c003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:04.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa3a129e700 1 --2- 172.21.15.47:0/1813600437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa38c003bc0 0x7fa38c003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.840+0000 7fa3a129e700 1 -- 172.21.15.47:0/1813600437 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c0035b0 con 0x7fa38c004d90 2024-05-08T19:50:04.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.841+0000 7fa3a129e700 1 --2- 172.21.15.47:0/1813600437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa38c004d90 0x7fa38c005210 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa39400a710 tx=0x7fa38c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90704c10b764cdf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:04.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.841+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940072d0 con 0x7fa38c004d90 2024-05-08T19:50:04.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.841+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa394007430 con 0x7fa38c004d90 2024-05-08T19:50:04.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.841+0000 7fa39b7fe700 1 -- 172.21.15.47:0/1813600437 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394007800 con 0x7fa38c004d90 2024-05-08T19:50:04.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.841+0000 7fa3a2d01700 1 -- 172.21.15.47:0/1813600437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa38c004d90 msgr2=0x7fa38c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:04.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.841+0000 7fa3a2d01700 1 --2- 172.21.15.47:0/1813600437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa38c004d90 0x7fa38c005210 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa39400a710 tx=0x7fa38c005880 comp rx=0 tx=0).stop 2024-05-08T19:50:04.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.841+0000 7fa3a129e700 1 -- 172.21.15.47:0/1813600437 reap_dead start 2024-05-08T19:50:04.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.841+0000 7fa3a2d01700 1 -- 172.21.15.47:0/1813600437 shutdown_connections 2024-05-08T19:50:04.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.841+0000 7fa3a2d01700 1 -- 172.21.15.47:0/1813600437 >> 172.21.15.47:0/1813600437 conn(0x7fa39c072dd0 msgr2=0x7fa39c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:04.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.841+0000 7fa3a2d01700 1 -- 172.21.15.47:0/1813600437 shutdown_connections 2024-05-08T19:50:04.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.841+0000 7fa3a2d01700 1 -- 172.21.15.47:0/1813600437 wait complete. 2024-05-08T19:50:04.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.843+0000 7fa3a2d01700 1 Processor -- start 2024-05-08T19:50:04.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.843+0000 7fa3a2d01700 1 -- start start 2024-05-08T19:50:04.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.843+0000 7fa3a2d01700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa39c1edcf0 0x7fa39c153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.843+0000 7fa3a2d01700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa39c154c80 0x7fa39c0aa360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.843+0000 7fa3a2d01700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa39c1ee0d0 0x7fa39c143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.843+0000 7fa3a2d01700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c1541c0 con 0x7fa39c154c80 2024-05-08T19:50:04.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.843+0000 7fa3a2d01700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c1552c0 con 0x7fa39c1edcf0 2024-05-08T19:50:04.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.843+0000 7fa3a2d01700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c1531e0 con 0x7fa39c1ee0d0 2024-05-08T19:50:04.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa39bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa39c154c80 0x7fa39c0aa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa39bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa39c154c80 0x7fa39c0aa360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44150/0 (socket says 172.21.15.47:44150) 2024-05-08T19:50:04.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa39bfff700 1 -- 172.21.15.47:0/2193069189 learned_addr learned my addr 172.21.15.47:0/2193069189 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:50:04.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa39bfff700 1 -- 172.21.15.47:0/2193069189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa39c1ee0d0 msgr2=0x7fa39c143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:04.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa3a129e700 1 --2- 172.21.15.47:0/2193069189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa39c1ee0d0 0x7fa39c143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa39bfff700 1 --2- 172.21.15.47:0/2193069189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa39c1ee0d0 0x7fa39c143de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa39bfff700 1 -- 172.21.15.47:0/2193069189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa39c1edcf0 msgr2=0x7fa39c153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:04.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa3a0a9d700 1 --2- 172.21.15.47:0/2193069189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa39c1edcf0 0x7fa39c153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa39bfff700 1 --2- 172.21.15.47:0/2193069189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa39c1edcf0 0x7fa39c153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:04.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa39bfff700 1 -- 172.21.15.47:0/2193069189 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c155560 con 0x7fa39c154c80 2024-05-08T19:50:04.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa39bfff700 1 --2- 172.21.15.47:0/2193069189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa39c154c80 0x7fa39c0aa360 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa38800f8b0 tx=0x7fa38800fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:04.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa3997fa700 1 -- 172.21.15.47:0/2193069189 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38800fe50 con 0x7fa39c154c80 2024-05-08T19:50:04.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa3997fa700 1 -- 172.21.15.47:0/2193069189 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa3880052e0 con 0x7fa39c154c80 2024-05-08T19:50:04.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa3a2d01700 1 -- 172.21.15.47:0/2193069189 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39c153480 con 0x7fa39c154c80 2024-05-08T19:50:04.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa3997fa700 1 -- 172.21.15.47:0/2193069189 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388003680 con 0x7fa39c154c80 2024-05-08T19:50:04.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.844+0000 7fa3a2d01700 1 -- 172.21.15.47:0/2193069189 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39c06cbf0 con 0x7fa39c154c80 2024-05-08T19:50:04.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.845+0000 7fa3a2d01700 1 -- 172.21.15.47:0/2193069189 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39c1539a0 con 0x7fa39c154c80 2024-05-08T19:50:04.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.846+0000 7fa3997fa700 1 -- 172.21.15.47:0/2193069189 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa3880037e0 con 0x7fa39c154c80 2024-05-08T19:50:04.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.846+0000 7fa3997fa700 1 --2- 172.21.15.47:0/2193069189 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa38006ac90 0x7fa38006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:04.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.846+0000 7fa3997fa700 1 -- 172.21.15.47:0/2193069189 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa3880896d0 con 0x7fa39c154c80 2024-05-08T19:50:04.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.846+0000 7fa3a0a9d700 1 --2- 172.21.15.47:0/2193069189 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa38006ac90 0x7fa38006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:04.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.847+0000 7fa3a0a9d700 1 --2- 172.21.15.47:0/2193069189 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa38006ac90 0x7fa38006d150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa390009aa0 tx=0x7fa390008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:04.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:04.851+0000 7fa3997fa700 1 -- 172.21.15.47:0/2193069189 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa39c1539a0 con 0x7fa39c154c80 2024-05-08T19:50:05.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.105+0000 7fa3a2d01700 1 -- 172.21.15.47:0/2193069189 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa39c1539a0 con 0x7fa39c154c80 2024-05-08T19:50:05.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.105+0000 7fa3997fa700 1 -- 172.21.15.47:0/2193069189 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7fa39c1539a0 con 0x7fa39c154c80 2024-05-08T19:50:05.096 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:50:05.096 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3927983771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3927983771},{"type":"v1","addr":"172.21.15.47:6833","nonce":3927983771}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/201830514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":201830514},{"type":"v1","addr":"172.21.15.47:6835","nonce":201830514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1266001461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1266001461},{"type":"v1","addr":"172.21.15.177:6836","nonce":1266001461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T19:22:20.424727+0000","modified":"2024-05-08T19:22:42.943964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/2990594738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2990594738},{"type":"v1","addr":"172.21.15.177:6837","nonce":2990594738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T19:50:05.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.107+0000 7fa3a2d01700 1 -- 172.21.15.47:0/2193069189 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa38006ac90 msgr2=0x7fa38006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:05.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.107+0000 7fa3a2d01700 1 --2- 172.21.15.47:0/2193069189 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa38006ac90 0x7fa38006d150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa390009aa0 tx=0x7fa390008040 comp rx=0 tx=0).stop 2024-05-08T19:50:05.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.107+0000 7fa3a2d01700 1 -- 172.21.15.47:0/2193069189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa39c154c80 msgr2=0x7fa39c0aa360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:05.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.107+0000 7fa3a2d01700 1 --2- 172.21.15.47:0/2193069189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa39c154c80 0x7fa39c0aa360 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa38800f8b0 tx=0x7fa38800fc70 comp rx=0 tx=0).stop 2024-05-08T19:50:05.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.107+0000 7fa3a2d01700 1 -- 172.21.15.47:0/2193069189 shutdown_connections 2024-05-08T19:50:05.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.107+0000 7fa3a2d01700 1 --2- 172.21.15.47:0/2193069189 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa38006ac90 0x7fa38006d150 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.107+0000 7fa3a2d01700 1 --2- 172.21.15.47:0/2193069189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa39c1ee0d0 0x7fa39c143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.107+0000 7fa3a2d01700 1 --2- 172.21.15.47:0/2193069189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa39c1edcf0 0x7fa39c153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.107+0000 7fa3a2d01700 1 --2- 172.21.15.47:0/2193069189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa39c154c80 0x7fa39c0aa360 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.107+0000 7fa3a2d01700 1 -- 172.21.15.47:0/2193069189 >> 172.21.15.47:0/2193069189 conn(0x7fa39c072dd0 msgr2=0x7fa39c0c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:05.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.107+0000 7fa3a2d01700 1 -- 172.21.15.47:0/2193069189 shutdown_connections 2024-05-08T19:50:05.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.107+0000 7fa3a2d01700 1 -- 172.21.15.47:0/2193069189 wait complete. 2024-05-08T19:50:05.099 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-05-08T19:50:05.110 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T19:50:05.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.246+0000 7fa64bcc6700 1 Processor -- start 2024-05-08T19:50:05.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.246+0000 7fa64bcc6700 1 -- start start 2024-05-08T19:50:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.247+0000 7fa64bcc6700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa6440a9bc0 0x7fa6440a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.247+0000 7fa64bcc6700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa644154930 0x7fa64406a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.247+0000 7fa64bcc6700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6440c2be0 con 0x7fa644152150 2024-05-08T19:50:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.247+0000 7fa64bcc6700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa644158ed0 con 0x7fa6440a9bc0 2024-05-08T19:50:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.247+0000 7fa64bcc6700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa644158330 con 0x7fa644154930 2024-05-08T19:50:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.247+0000 7fa649261700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa6440a9bc0 0x7fa6440a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.247+0000 7fa649a62700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa644152150 0x7fa6441587c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44198/0 (socket says 172.21.15.47:44198) 2024-05-08T19:50:05.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.247+0000 7fa649a62700 1 -- 172.21.15.47:0/2931265812 learned_addr learned my addr 172.21.15.47:0/2931265812 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:50:05.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.247+0000 7fa649261700 1 --2- 172.21.15.47:0/2931265812 >> v2:172.21.15.47:3300/0 conn(0x7fa6440a9bc0 0x7fa6440a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44158/0 (socket says 172.21.15.47:44158) 2024-05-08T19:50:05.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.247+0000 7fa64a263700 1 --2- 172.21.15.47:0/2931265812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa644154930 0x7fa64406a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:05.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.248+0000 7fa649261700 1 -- 172.21.15.47:0/2931265812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa644154930 msgr2=0x7fa64406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:05.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.248+0000 7fa649261700 1 --2- 172.21.15.47:0/2931265812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa644154930 0x7fa64406a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.248+0000 7fa649261700 1 -- 172.21.15.47:0/2931265812 >> v1:172.21.15.47:6789/0 conn(0x7fa644152150 legacy=0x7fa6441587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:05.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.248+0000 7fa649261700 1 -- 172.21.15.47:0/2931265812 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa644154de0 con 0x7fa6440a9bc0 2024-05-08T19:50:05.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.248+0000 7fa64a263700 1 --2- 172.21.15.47:0/2931265812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa644154930 0x7fa64406a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:50:05.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.248+0000 7fa648a60700 1 -- 172.21.15.47:0/2931265812 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234562544 0 0) 0x7fa6440c2be0 con 0x7fa644152150 2024-05-08T19:50:05.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.248+0000 7fa649261700 1 --2- 172.21.15.47:0/2931265812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6440a9bc0 0x7fa6440a84b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa640009820 tx=0x7fa640009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc2907d602e5bee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:05.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.248+0000 7fa648a60700 1 -- 172.21.15.47:0/2931265812 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640005e30 con 0x7fa6440a9bc0 2024-05-08T19:50:05.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.248+0000 7fa648a60700 1 -- 172.21.15.47:0/2931265812 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa640006030 con 0x7fa6440a9bc0 2024-05-08T19:50:05.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.248+0000 7fa648a60700 1 -- 172.21.15.47:0/2931265812 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640006400 con 0x7fa6440a9bc0 2024-05-08T19:50:05.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.249+0000 7fa64bcc6700 1 -- 172.21.15.47:0/2931265812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6440a9bc0 msgr2=0x7fa6440a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:05.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.249+0000 7fa64bcc6700 1 --2- 172.21.15.47:0/2931265812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6440a9bc0 0x7fa6440a84b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa640009820 tx=0x7fa640009b30 comp rx=0 tx=0).stop 2024-05-08T19:50:05.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.249+0000 7fa64bcc6700 1 -- 172.21.15.47:0/2931265812 shutdown_connections 2024-05-08T19:50:05.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.249+0000 7fa64bcc6700 1 --2- 172.21.15.47:0/2931265812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa644154930 0x7fa64406a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.249+0000 7fa64bcc6700 1 --2- 172.21.15.47:0/2931265812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6440a9bc0 0x7fa6440a84b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.249+0000 7fa64bcc6700 1 -- 172.21.15.47:0/2931265812 >> 172.21.15.47:0/2931265812 conn(0x7fa6440c3c20 msgr2=0x7fa6440c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:05.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.249+0000 7fa64bcc6700 1 -- 172.21.15.47:0/2931265812 shutdown_connections 2024-05-08T19:50:05.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.249+0000 7fa64bcc6700 1 -- 172.21.15.47:0/2931265812 wait complete. 2024-05-08T19:50:05.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.250+0000 7fa64bcc6700 1 Processor -- start 2024-05-08T19:50:05.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.250+0000 7fa64bcc6700 1 -- start start 2024-05-08T19:50:05.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.250+0000 7fa64bcc6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6440a9bc0 0x7fa6441575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:05.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.250+0000 7fa64bcc6700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa644152150 0x7fa6441ea250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:05.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa64bcc6700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa644154930 0x7fa6441ea790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:05.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa64bcc6700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa644151a00 con 0x7fa6440a9bc0 2024-05-08T19:50:05.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa64bcc6700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6441eacd0 con 0x7fa644152150 2024-05-08T19:50:05.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa64bcc6700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa644149410 con 0x7fa644154930 2024-05-08T19:50:05.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa649a62700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6440a9bc0 0x7fa6441575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:05.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa649a62700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6440a9bc0 0x7fa6441575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44160/0 (socket says 172.21.15.47:44160) 2024-05-08T19:50:05.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa649a62700 1 -- 172.21.15.47:0/2203980594 learned_addr learned my addr 172.21.15.47:0/2203980594 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:50:05.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa649a62700 1 -- 172.21.15.47:0/2203980594 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa644154930 msgr2=0x7fa6441ea790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:05.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa649a62700 1 --2- 172.21.15.47:0/2203980594 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa644154930 0x7fa6441ea790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa649a62700 1 -- 172.21.15.47:0/2203980594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa644152150 msgr2=0x7fa6441ea250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:05.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa649a62700 1 --2- 172.21.15.47:0/2203980594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa644152150 0x7fa6441ea250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa649a62700 1 -- 172.21.15.47:0/2203980594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa640009430 con 0x7fa6440a9bc0 2024-05-08T19:50:05.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa649a62700 1 --2- 172.21.15.47:0/2203980594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6440a9bc0 0x7fa6441575e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa63400c750 tx=0x7fa63400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:05.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa63a7fc700 1 -- 172.21.15.47:0/2203980594 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634004c80 con 0x7fa6440a9bc0 2024-05-08T19:50:05.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa63a7fc700 1 -- 172.21.15.47:0/2203980594 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa634004e00 con 0x7fa6440a9bc0 2024-05-08T19:50:05.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa64bcc6700 1 -- 172.21.15.47:0/2203980594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa644151440 con 0x7fa6440a9bc0 2024-05-08T19:50:05.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa63a7fc700 1 -- 172.21.15.47:0/2203980594 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634007330 con 0x7fa6440a9bc0 2024-05-08T19:50:05.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.251+0000 7fa64bcc6700 1 -- 172.21.15.47:0/2203980594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6441490a0 con 0x7fa6440a9bc0 2024-05-08T19:50:05.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.252+0000 7fa64bcc6700 1 -- 172.21.15.47:0/2203980594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa644148f00 con 0x7fa6440a9bc0 2024-05-08T19:50:05.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.253+0000 7fa63a7fc700 1 -- 172.21.15.47:0/2203980594 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa634007490 con 0x7fa6440a9bc0 2024-05-08T19:50:05.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.253+0000 7fa63a7fc700 1 --2- 172.21.15.47:0/2203980594 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa62806ac90 0x7fa62806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:05.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.253+0000 7fa63a7fc700 1 -- 172.21.15.47:0/2203980594 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa634089540 con 0x7fa6440a9bc0 2024-05-08T19:50:05.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.253+0000 7fa649261700 1 --2- 172.21.15.47:0/2203980594 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa62806ac90 0x7fa62806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:05.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.254+0000 7fa649261700 1 --2- 172.21.15.47:0/2203980594 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa62806ac90 0x7fa62806d150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa640009820 tx=0x7fa640010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:05.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.258+0000 7fa63a7fc700 1 -- 172.21.15.47:0/2203980594 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa644148f00 con 0x7fa6440a9bc0 2024-05-08T19:50:05.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.466+0000 7fa64bcc6700 1 -- 172.21.15.47:0/2203980594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa644148f00 con 0x7fa6440a9bc0 2024-05-08T19:50:05.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.467+0000 7fa63a7fc700 1 -- 172.21.15.47:0/2203980594 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18267 (secure 0 0 0) 0x7fa644148f00 con 0x7fa6440a9bc0 2024-05-08T19:50:05.458 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-08T19:50:05.458 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"e1596084-137b-43d3-b844-c72a72dda1f6","created":"2024-05-08T19:22:04.029686+0000","modified":"2024-05-08T19:23:11.040286+0000","last_up_change":"2024-05-08T19:22:14.845939+0000","last_in_change":"2024-05-08T19:22:07.373402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T19:22:15.923832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T19:22:18.529792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T19:22:19.389797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T19:22:22.474001+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae9558d2-ca2c-4353-9301-2d6c9b86d611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":46996},{"type":"v1","addr":"172.21.15.47:6801","nonce":46996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":46996},{"type":"v1","addr":"172.21.15.47:6803","nonce":46996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":46996},{"type":"v1","addr":"172.21.15.47:6807","nonce":46996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":46996},{"type":"v1","addr":"172.21.15.47:6805","nonce":46996}]},"public_addr":"172.21.15.47:6801/46996","cluster_addr":"172.21.15.47:6803/46996","heartbeat_back_addr":"172.21.15.47:6807/46996","heartbeat_front_addr":"172.21.15.47:6805/46996","state":["exists","up"]},{"osd":1,"uuid":"c1307abe-84aa-4318-a7ac-ab160837cdc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":46998},{"type":"v1","addr":"172.21.15.47:6817","nonce":46998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":46998},{"type":"v1","addr":"172.21.15.47:6819","nonce":46998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":46998},{"type":"v1","addr":"172.21.15.47:6823","nonce":46998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":46998},{"type":"v1","addr":"172.21.15.47:6821","nonce":46998}]},"public_addr":"172.21.15.47:6817/46998","cluster_addr":"172.21.15.47:6819/46998","heartbeat_back_addr":"172.21.15.47:6823/46998","heartbeat_front_addr":"172.21.15.47:6821/46998","state":["exists","up"]},{"osd":2,"uuid":"7dab0cc2-4a0f-49a6-8031-7fdbe14ea56b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":46997},{"type":"v1","addr":"172.21.15.47:6809","nonce":46997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":46997},{"type":"v1","addr":"172.21.15.47:6811","nonce":46997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":46997},{"type":"v1","addr":"172.21.15.47:6815","nonce":46997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":46997},{"type":"v1","addr":"172.21.15.47:6813","nonce":46997}]},"public_addr":"172.21.15.47:6809/46997","cluster_addr":"172.21.15.47:6811/46997","heartbeat_back_addr":"172.21.15.47:6815/46997","heartbeat_front_addr":"172.21.15.47:6813/46997","state":["exists","up"]},{"osd":3,"uuid":"1ce4b524-8dff-4475-a125-996e3ff9605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":47010},{"type":"v1","addr":"172.21.15.47:6825","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":47010},{"type":"v1","addr":"172.21.15.47:6827","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":47010},{"type":"v1","addr":"172.21.15.47:6831","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":47010},{"type":"v1","addr":"172.21.15.47:6829","nonce":47010}]},"public_addr":"172.21.15.47:6825/47010","cluster_addr":"172.21.15.47:6827/47010","heartbeat_back_addr":"172.21.15.47:6831/47010","heartbeat_front_addr":"172.21.15.47:6829/47010","state":["exists","up"]},{"osd":4,"uuid":"07369d33-83c0-41d5-92f1-fabe56b1dcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":47187},{"type":"v1","addr":"172.21.15.177:6804","nonce":47187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":47187},{"type":"v1","addr":"172.21.15.177:6808","nonce":47187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":47187},{"type":"v1","addr":"172.21.15.177:6815","nonce":47187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":47187},{"type":"v1","addr":"172.21.15.177:6812","nonce":47187}]},"public_addr":"172.21.15.177:6804/47187","cluster_addr":"172.21.15.177:6808/47187","heartbeat_back_addr":"172.21.15.177:6815/47187","heartbeat_front_addr":"172.21.15.177:6812/47187","state":["exists","up"]},{"osd":5,"uuid":"d3891ee2-21e5-4f56-82a5-b08944cc3624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":47198},{"type":"v1","addr":"172.21.15.177:6822","nonce":47198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":47198},{"type":"v1","addr":"172.21.15.177:6825","nonce":47198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":47198},{"type":"v1","addr":"172.21.15.177:6831","nonce":47198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6827","nonce":47198},{"type":"v1","addr":"172.21.15.177:6828","nonce":47198}]},"public_addr":"172.21.15.177:6822/47198","cluster_addr":"172.21.15.177:6825/47198","heartbeat_back_addr":"172.21.15.177:6831/47198","heartbeat_front_addr":"172.21.15.177:6828/47198","state":["exists","up"]},{"osd":6,"uuid":"82dbda35-f252-4da5-82fa-cd4bf03f8968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":47188},{"type":"v1","addr":"172.21.15.177:6801","nonce":47188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6803","nonce":47188},{"type":"v1","addr":"172.21.15.177:6805","nonce":47188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6811","nonce":47188},{"type":"v1","addr":"172.21.15.177:6813","nonce":47188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":47188},{"type":"v1","addr":"172.21.15.177:6809","nonce":47188}]},"public_addr":"172.21.15.177:6801/47188","cluster_addr":"172.21.15.177:6805/47188","heartbeat_back_addr":"172.21.15.177:6813/47188","heartbeat_front_addr":"172.21.15.177:6809/47188","state":["exists","up"]},{"osd":7,"uuid":"8e14290d-32fd-4c1f-ad2a-fd6481f683cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":47211},{"type":"v1","addr":"172.21.15.177:6817","nonce":47211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":47211},{"type":"v1","addr":"172.21.15.177:6819","nonce":47211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":47211},{"type":"v1","addr":"172.21.15.177:6829","nonce":47211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":47211},{"type":"v1","addr":"172.21.15.177:6823","nonce":47211}]},"public_addr":"172.21.15.177:6817/47211","cluster_addr":"172.21.15.177:6819/47211","heartbeat_back_addr":"172.21.15.177:6829/47211","heartbeat_front_addr":"172.21.15.177:6823/47211","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.275929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.539673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.466097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.652157+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.604088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.597704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.562593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:22:12.576027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T19:50:05.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.470+0000 7fa64bcc6700 1 -- 172.21.15.47:0/2203980594 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa62806ac90 msgr2=0x7fa62806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:05.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.470+0000 7fa64bcc6700 1 --2- 172.21.15.47:0/2203980594 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa62806ac90 0x7fa62806d150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa640009820 tx=0x7fa640010000 comp rx=0 tx=0).stop 2024-05-08T19:50:05.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.470+0000 7fa64bcc6700 1 -- 172.21.15.47:0/2203980594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6440a9bc0 msgr2=0x7fa6441575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:05.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.470+0000 7fa64bcc6700 1 --2- 172.21.15.47:0/2203980594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6440a9bc0 0x7fa6441575e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa63400c750 tx=0x7fa63400cb10 comp rx=0 tx=0).stop 2024-05-08T19:50:05.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.470+0000 7fa64bcc6700 1 -- 172.21.15.47:0/2203980594 shutdown_connections 2024-05-08T19:50:05.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.470+0000 7fa64bcc6700 1 --2- 172.21.15.47:0/2203980594 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa62806ac90 0x7fa62806d150 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.470+0000 7fa64bcc6700 1 --2- 172.21.15.47:0/2203980594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6440a9bc0 0x7fa6441575e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.470+0000 7fa64bcc6700 1 --2- 172.21.15.47:0/2203980594 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa644154930 0x7fa6441ea790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.470+0000 7fa64bcc6700 1 --2- 172.21.15.47:0/2203980594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa644152150 0x7fa6441ea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.470+0000 7fa64bcc6700 1 -- 172.21.15.47:0/2203980594 >> 172.21.15.47:0/2203980594 conn(0x7fa6440c3c20 msgr2=0x7fa64414cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:05.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.470+0000 7fa64bcc6700 1 -- 172.21.15.47:0/2203980594 shutdown_connections 2024-05-08T19:50:05.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.470+0000 7fa64bcc6700 1 -- 172.21.15.47:0/2203980594 wait complete. 2024-05-08T19:50:05.473 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T19:50:05.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.610+0000 7f84b9533700 1 Processor -- start 2024-05-08T19:50:05.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.610+0000 7f84b9533700 1 -- start start 2024-05-08T19:50:05.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.610+0000 7f84b9533700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f84b4071c00 0x7f84b4071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:05.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.610+0000 7f84b9533700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b414e7b0 0x7f84b414ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:05.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.610+0000 7f84b9533700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b4070dd0 con 0x7f84b4152080 2024-05-08T19:50:05.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.610+0000 7f84b9533700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b40c1160 con 0x7f84b4071c00 2024-05-08T19:50:05.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.610+0000 7f84b9533700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40717a0 con 0x7f84b414e7b0 2024-05-08T19:50:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.611+0000 7f84b2ffd700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f84b4071c00 0x7f84b4071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.611+0000 7f84b2ffd700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f84b4071c00 0x7f84b4071260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44172/0 (socket says 172.21.15.47:44172) 2024-05-08T19:50:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.611+0000 7f84b2ffd700 1 -- 172.21.15.47:0/2967616886 learned_addr learned my addr 172.21.15.47:0/2967616886 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:50:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.611+0000 7f84b37fe700 1 --2- 172.21.15.47:0/2967616886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b414e7b0 0x7f84b414ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.611+0000 7f84b2ffd700 1 -- 172.21.15.47:0/2967616886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b414e7b0 msgr2=0x7f84b414ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.611+0000 7f84b2ffd700 1 --2- 172.21.15.47:0/2967616886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b414e7b0 0x7f84b414ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.611+0000 7f84b2ffd700 1 -- 172.21.15.47:0/2967616886 >> v1:172.21.15.177:6789/0 conn(0x7f84b4152080 legacy=0x7f84b406c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.611+0000 7f84b2ffd700 1 -- 172.21.15.47:0/2967616886 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b40c0e80 con 0x7f84b4071c00 2024-05-08T19:50:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.611+0000 7f84b2ffd700 1 --2- 172.21.15.47:0/2967616886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b4071c00 0x7f84b4071260 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f84a400bb90 tx=0x7f84a400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b8ba4c0cbc0f29 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.611+0000 7f84b1ffb700 1 -- 172.21.15.47:0/2967616886 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a400dd10 con 0x7f84b4071c00 2024-05-08T19:50:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.611+0000 7f84b1ffb700 1 -- 172.21.15.47:0/2967616886 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f84a400de70 con 0x7f84b4071c00 2024-05-08T19:50:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.611+0000 7f84b1ffb700 1 -- 172.21.15.47:0/2967616886 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4004250 con 0x7f84b4071c00 2024-05-08T19:50:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.612+0000 7f84b9533700 1 -- 172.21.15.47:0/2967616886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b4071c00 msgr2=0x7f84b4071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.612+0000 7f84b9533700 1 --2- 172.21.15.47:0/2967616886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b4071c00 0x7f84b4071260 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f84a400bb90 tx=0x7f84a400bea0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.612+0000 7f84b9533700 1 -- 172.21.15.47:0/2967616886 shutdown_connections 2024-05-08T19:50:05.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.612+0000 7f84b9533700 1 --2- 172.21.15.47:0/2967616886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b414e7b0 0x7f84b414ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.612+0000 7f84b9533700 1 --2- 172.21.15.47:0/2967616886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b4071c00 0x7f84b4071260 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.612+0000 7f84b9533700 1 -- 172.21.15.47:0/2967616886 >> 172.21.15.47:0/2967616886 conn(0x7f84b406a9c0 msgr2=0x7f84b406ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:05.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.612+0000 7f84b9533700 1 -- 172.21.15.47:0/2967616886 shutdown_connections 2024-05-08T19:50:05.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.612+0000 7f84b9533700 1 -- 172.21.15.47:0/2967616886 wait complete. 2024-05-08T19:50:05.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.613+0000 7f84b9533700 1 Processor -- start 2024-05-08T19:50:05.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.613+0000 7f84b9533700 1 -- start start 2024-05-08T19:50:05.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b9533700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b4071c00 0x7f84b40ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:05.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b9533700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b414e7b0 0x7f84b41e9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:05.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b9533700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b4152080 0x7f84b4145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:05.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b9533700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b41ea450 con 0x7f84b4071c00 2024-05-08T19:50:05.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b9533700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b414bc30 con 0x7f84b414e7b0 2024-05-08T19:50:05.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b9533700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b414a630 con 0x7f84b4152080 2024-05-08T19:50:05.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b4071c00 0x7f84b40ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:05.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b2ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b4071c00 0x7f84b40ab5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44180/0 (socket says 172.21.15.47:44180) 2024-05-08T19:50:05.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b2ffd700 1 -- 172.21.15.47:0/692678719 learned_addr learned my addr 172.21.15.47:0/692678719 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:50:05.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b37fe700 1 --2- 172.21.15.47:0/692678719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b4152080 0x7f84b4145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:05.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b27fc700 1 --2- 172.21.15.47:0/692678719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b414e7b0 0x7f84b41e9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:05.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b2ffd700 1 -- 172.21.15.47:0/692678719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b4152080 msgr2=0x7f84b4145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:05.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b2ffd700 1 --2- 172.21.15.47:0/692678719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b4152080 0x7f84b4145560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b2ffd700 1 -- 172.21.15.47:0/692678719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b414e7b0 msgr2=0x7f84b41e9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:05.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b2ffd700 1 --2- 172.21.15.47:0/692678719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b414e7b0 0x7f84b41e9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.614+0000 7f84b2ffd700 1 -- 172.21.15.47:0/692678719 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a400b7f0 con 0x7f84b4071c00 2024-05-08T19:50:05.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.615+0000 7f84b2ffd700 1 --2- 172.21.15.47:0/692678719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b4071c00 0x7f84b40ab5f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f84b4067640 tx=0x7f84a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:05.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.615+0000 7f849b7fe700 1 -- 172.21.15.47:0/692678719 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4003c30 con 0x7f84b4071c00 2024-05-08T19:50:05.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.615+0000 7f849b7fe700 1 -- 172.21.15.47:0/692678719 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f84a4003d90 con 0x7f84b4071c00 2024-05-08T19:50:05.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.615+0000 7f84b9533700 1 -- 172.21.15.47:0/692678719 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b40ac360 con 0x7f84b4071c00 2024-05-08T19:50:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.615+0000 7f849b7fe700 1 -- 172.21.15.47:0/692678719 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4010690 con 0x7f84b4071c00 2024-05-08T19:50:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.615+0000 7f84b9533700 1 -- 172.21.15.47:0/692678719 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b414b5e0 con 0x7f84b4071c00 2024-05-08T19:50:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.616+0000 7f84b9533700 1 -- 172.21.15.47:0/692678719 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b4067320 con 0x7f84b4071c00 2024-05-08T19:50:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.616+0000 7f849b7fe700 1 -- 172.21.15.47:0/692678719 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f84a40193f0 con 0x7f84b4071c00 2024-05-08T19:50:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.617+0000 7f849b7fe700 1 --2- 172.21.15.47:0/692678719 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f84a006ac90 0x7f84a006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:05.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.617+0000 7f849b7fe700 1 -- 172.21.15.47:0/692678719 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f84a408b4b0 con 0x7f84b4071c00 2024-05-08T19:50:05.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.617+0000 7f84b27fc700 1 --2- 172.21.15.47:0/692678719 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f84a006ac90 0x7f84a006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:05.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.618+0000 7f84b27fc700 1 --2- 172.21.15.47:0/692678719 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f84a006ac90 0x7f84a006d150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f84b4150f90 tx=0x7f84a80090e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:05.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.621+0000 7f849b7fe700 1 -- 172.21.15.47:0/692678719 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f84a4056360 con 0x7f84b4071c00 2024-05-08T19:50:05.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.877+0000 7f84b9533700 1 -- 172.21.15.47:0/692678719 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f84b4152510 con 0x7f84b4071c00 2024-05-08T19:50:05.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.887+0000 7f849b7fe700 1 -- 172.21.15.47:0/692678719 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f84b4152510 con 0x7f84b4071c00 2024-05-08T19:50:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.890+0000 7f84b9533700 1 -- 172.21.15.47:0/692678719 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f84a006ac90 msgr2=0x7f84a006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.890+0000 7f84b9533700 1 --2- 172.21.15.47:0/692678719 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f84a006ac90 0x7f84a006d150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f84b4150f90 tx=0x7f84a80090e0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.890+0000 7f84b9533700 1 -- 172.21.15.47:0/692678719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b4071c00 msgr2=0x7f84b40ab5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.890+0000 7f84b9533700 1 --2- 172.21.15.47:0/692678719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b4071c00 0x7f84b40ab5f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f84b4067640 tx=0x7f84a4004750 comp rx=0 tx=0).stop 2024-05-08T19:50:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.890+0000 7f84b9533700 1 -- 172.21.15.47:0/692678719 shutdown_connections 2024-05-08T19:50:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.890+0000 7f84b9533700 1 --2- 172.21.15.47:0/692678719 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f84a006ac90 0x7f84a006d150 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.890+0000 7f84b9533700 1 --2- 172.21.15.47:0/692678719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b4071c00 0x7f84b40ab5f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.890+0000 7f84b9533700 1 --2- 172.21.15.47:0/692678719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84b4152080 0x7f84b4145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.890+0000 7f84b9533700 1 --2- 172.21.15.47:0/692678719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b414e7b0 0x7f84b41e9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:05.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.890+0000 7f84b9533700 1 -- 172.21.15.47:0/692678719 >> 172.21.15.47:0/692678719 conn(0x7f84b406a9c0 msgr2=0x7f84b40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:05.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.890+0000 7f84b9533700 1 -- 172.21.15.47:0/692678719 shutdown_connections 2024-05-08T19:50:05.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:05.890+0000 7f84b9533700 1 -- 172.21.15.47:0/692678719 wait complete. 2024-05-08T19:50:05.881 INFO:teuthology.orchestra.run.smithi047.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T19:50:05.892 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T19:50:06.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.030+0000 7f07dfd8d700 1 Processor -- start 2024-05-08T19:50:06.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.030+0000 7f07dfd8d700 1 -- start start 2024-05-08T19:50:06.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.031+0000 7f07dfd8d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07d80c0af0 0x7f07d8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:06.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.031+0000 7f07dfd8d700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d8155a40 con 0x7f07d806b720 2024-05-08T19:50:06.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.031+0000 7f07dfd8d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d8154c80 con 0x7f07d8158a70 2024-05-08T19:50:06.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.031+0000 7f07dfd8d700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d8159010 con 0x7f07d80c0af0 2024-05-08T19:50:06.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.031+0000 7f07ddb29700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f07d806b720 0x7f07d80c2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44204/0 (socket says 172.21.15.47:44204) 2024-05-08T19:50:06.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.031+0000 7f07ddb29700 1 -- 172.21.15.47:0/1588268548 learned_addr learned my addr 172.21.15.47:0/1588268548 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:50:06.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.031+0000 7f07dd328700 1 --2- 172.21.15.47:0/1588268548 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07d80c0af0 0x7f07d8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:06.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.031+0000 7f07dcb27700 1 -- 172.21.15.47:0/1588268548 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848315616 0 0) 0x7f07d8155a40 con 0x7f07d806b720 2024-05-08T19:50:06.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.031+0000 7f07dcb27700 1 -- 172.21.15.47:0/1588268548 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c40035b0 con 0x7f07d806b720 2024-05-08T19:50:06.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dcb27700 1 -- 172.21.15.47:0/1588268548 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 48949235 0 0) 0x7f07c40035b0 con 0x7f07d806b720 2024-05-08T19:50:06.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dcb27700 1 -- 172.21.15.47:0/1588268548 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07d80c0af0 msgr2=0x7f07d8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:06.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dcb27700 1 --2- 172.21.15.47:0/1588268548 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07d80c0af0 0x7f07d8071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:06.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dcb27700 1 -- 172.21.15.47:0/1588268548 >> v1:172.21.15.177:6789/0 conn(0x7f07d8158a70 legacy=0x7f07d80723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:06.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dcb27700 1 -- 172.21.15.47:0/1588268548 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d8154f60 con 0x7f07d806b720 2024-05-08T19:50:06.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dcb27700 1 -- 172.21.15.47:0/1588268548 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f07cc001670 con 0x7f07d806b720 2024-05-08T19:50:06.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dcb27700 1 -- 172.21.15.47:0/1588268548 >> v1:172.21.15.47:6789/0 conn(0x7f07d806b720 legacy=0x7f07d80c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:06.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dcb27700 1 --2- 172.21.15.47:0/1588268548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c4003a30 0x7f07c4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:06.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dcb27700 1 --2- 172.21.15.47:0/1588268548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07c4004850 0x7f07c4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:06.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dcb27700 1 --2- 172.21.15.47:0/1588268548 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07d80c0af0 0x7f07c4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:06.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dcb27700 1 -- 172.21.15.47:0/1588268548 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d8159010 con 0x7f07c4004850 2024-05-08T19:50:06.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dcb27700 1 -- 172.21.15.47:0/1588268548 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c400bac0 con 0x7f07c4003a30 2024-05-08T19:50:06.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dcb27700 1 -- 172.21.15.47:0/1588268548 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c400bc30 con 0x7f07d80c0af0 2024-05-08T19:50:06.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dd328700 1 --2- 172.21.15.47:0/1588268548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07c4004850 0x7f07c4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:06.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07ddb29700 1 --2- 172.21.15.47:0/1588268548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c4003a30 0x7f07c4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:06.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07de32a700 1 --2- 172.21.15.47:0/1588268548 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07d80c0af0 0x7f07c4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:06.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dd328700 1 -- 172.21.15.47:0/1588268548 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07d80c0af0 msgr2=0x7f07c4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:06.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dd328700 1 --2- 172.21.15.47:0/1588268548 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07d80c0af0 0x7f07c4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:06.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dd328700 1 -- 172.21.15.47:0/1588268548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c4003a30 msgr2=0x7f07c4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:06.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dd328700 1 --2- 172.21.15.47:0/1588268548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c4003a30 0x7f07c4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:06.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dd328700 1 -- 172.21.15.47:0/1588268548 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c40035b0 con 0x7f07c4004850 2024-05-08T19:50:06.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dd328700 1 --2- 172.21.15.47:0/1588268548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07c4004850 0x7f07c4004cd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009b30 tx=0x7f07c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74eff460979f92a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:06.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.032+0000 7f07dcb27700 1 -- 172.21.15.47:0/1588268548 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400e660 con 0x7f07c4004850 2024-05-08T19:50:06.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.033+0000 7f07dcb27700 1 -- 172.21.15.47:0/1588268548 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f07d400e7c0 con 0x7f07c4004850 2024-05-08T19:50:06.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.033+0000 7f07dcb27700 1 -- 172.21.15.47:0/1588268548 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400eb50 con 0x7f07c4004850 2024-05-08T19:50:06.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.033+0000 7f07dfd8d700 1 -- 172.21.15.47:0/1588268548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07c4004850 msgr2=0x7f07c4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:06.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.033+0000 7f07dfd8d700 1 --2- 172.21.15.47:0/1588268548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07c4004850 0x7f07c4004cd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009b30 tx=0x7f07c4005880 comp rx=0 tx=0).stop 2024-05-08T19:50:06.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.033+0000 7f07de32a700 1 -- 172.21.15.47:0/1588268548 reap_dead start 2024-05-08T19:50:06.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.033+0000 7f07dfd8d700 1 -- 172.21.15.47:0/1588268548 shutdown_connections 2024-05-08T19:50:06.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.033+0000 7f07dfd8d700 1 -- 172.21.15.47:0/1588268548 >> 172.21.15.47:0/1588268548 conn(0x7f07d806a9c0 msgr2=0x7f07d806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:06.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.033+0000 7f07dfd8d700 1 -- 172.21.15.47:0/1588268548 shutdown_connections 2024-05-08T19:50:06.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.033+0000 7f07dfd8d700 1 -- 172.21.15.47:0/1588268548 wait complete. 2024-05-08T19:50:06.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.034+0000 7f07dfd8d700 1 Processor -- start 2024-05-08T19:50:06.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.034+0000 7f07dfd8d700 1 -- start start 2024-05-08T19:50:06.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.035+0000 7f07dfd8d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07c4004850 0x7f07d8157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:06.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.035+0000 7f07dfd8d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07d8151590 0x7f07d81e71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:06.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.035+0000 7f07dfd8d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07d8099a50 0x7f07d81e7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:06.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.035+0000 7f07dfd8d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d80accf0 con 0x7f07d8099a50 2024-05-08T19:50:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.035+0000 7f07dfd8d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d81e7c70 con 0x7f07d8151590 2024-05-08T19:50:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.035+0000 7f07dfd8d700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d81542e0 con 0x7f07c4004850 2024-05-08T19:50:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.035+0000 7f07de32a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07d8099a50 0x7f07d81e7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.035+0000 7f07de32a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07d8099a50 0x7f07d81e7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44194/0 (socket says 172.21.15.47:44194) 2024-05-08T19:50:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.035+0000 7f07de32a700 1 -- 172.21.15.47:0/8442710 learned_addr learned my addr 172.21.15.47:0/8442710 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:50:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.035+0000 7f07dd328700 1 --2- 172.21.15.47:0/8442710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07d8151590 0x7f07d81e71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.035+0000 7f07ddb29700 1 --2- 172.21.15.47:0/8442710 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07c4004850 0x7f07d8157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.035+0000 7f07de32a700 1 -- 172.21.15.47:0/8442710 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07c4004850 msgr2=0x7f07d8157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.036+0000 7f07de32a700 1 --2- 172.21.15.47:0/8442710 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07c4004850 0x7f07d8157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.036+0000 7f07de32a700 1 -- 172.21.15.47:0/8442710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07d8151590 msgr2=0x7f07d81e71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.036+0000 7f07de32a700 1 --2- 172.21.15.47:0/8442710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07d8151590 0x7f07d81e71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.036+0000 7f07de32a700 1 -- 172.21.15.47:0/8442710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d80aca50 con 0x7f07d8099a50 2024-05-08T19:50:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.036+0000 7f07de32a700 1 --2- 172.21.15.47:0/8442710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07d8099a50 0x7f07d81e7730 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f07d806f9a0 tx=0x7f07d000d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.036+0000 7f07ca7fc700 1 -- 172.21.15.47:0/8442710 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d000db40 con 0x7f07d8099a50 2024-05-08T19:50:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.036+0000 7f07ca7fc700 1 -- 172.21.15.47:0/8442710 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f07d000dca0 con 0x7f07d8099a50 2024-05-08T19:50:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.036+0000 7f07dfd8d700 1 -- 172.21.15.47:0/8442710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d8154000 con 0x7f07d8099a50 2024-05-08T19:50:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.036+0000 7f07ca7fc700 1 -- 172.21.15.47:0/8442710 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0003a00 con 0x7f07d8099a50 2024-05-08T19:50:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.036+0000 7f07dfd8d700 1 -- 172.21.15.47:0/8442710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d8158150 con 0x7f07d8099a50 2024-05-08T19:50:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.037+0000 7f07dfd8d700 1 -- 172.21.15.47:0/8442710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d8153e60 con 0x7f07d8099a50 2024-05-08T19:50:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.037+0000 7f07ca7fc700 1 -- 172.21.15.47:0/8442710 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f07d0003b60 con 0x7f07d8099a50 2024-05-08T19:50:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.038+0000 7f07ca7fc700 1 --2- 172.21.15.47:0/8442710 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f07bc06ac90 0x7f07bc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.038+0000 7f07ca7fc700 1 -- 172.21.15.47:0/8442710 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f07d00899e0 con 0x7f07d8099a50 2024-05-08T19:50:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.038+0000 7f07ddb29700 1 --2- 172.21.15.47:0/8442710 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f07bc06ac90 0x7f07bc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.038+0000 7f07ddb29700 1 --2- 172.21.15.47:0/8442710 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f07bc06ac90 0x7f07bc06d150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f07cc001050 tx=0x7f07cc000f80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:06.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.042+0000 7f07ca7fc700 1 -- 172.21.15.47:0/8442710 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f07d8153e60 con 0x7f07d8099a50 2024-05-08T19:50:06.090 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-05-08T19:50:06.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.300+0000 7f07dfd8d700 1 -- 172.21.15.47:0/8442710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f07d81ead70 con 0x7f07d8099a50 2024-05-08T19:50:06.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.889+0000 7f07ca7fc700 1 -- 172.21.15.47:0/8442710 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f07d81ead70 con 0x7f07d8099a50 2024-05-08T19:50:06.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.892+0000 7f07dfd8d700 1 -- 172.21.15.47:0/8442710 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f07bc06ac90 msgr2=0x7f07bc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:06.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.892+0000 7f07dfd8d700 1 --2- 172.21.15.47:0/8442710 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f07bc06ac90 0x7f07bc06d150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f07cc001050 tx=0x7f07cc000f80 comp rx=0 tx=0).stop 2024-05-08T19:50:06.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.892+0000 7f07dfd8d700 1 -- 172.21.15.47:0/8442710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07d8099a50 msgr2=0x7f07d81e7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:06.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.892+0000 7f07dfd8d700 1 --2- 172.21.15.47:0/8442710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07d8099a50 0x7f07d81e7730 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f07d806f9a0 tx=0x7f07d000d660 comp rx=0 tx=0).stop 2024-05-08T19:50:06.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.892+0000 7f07dfd8d700 1 -- 172.21.15.47:0/8442710 shutdown_connections 2024-05-08T19:50:06.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.892+0000 7f07dfd8d700 1 --2- 172.21.15.47:0/8442710 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f07bc06ac90 0x7f07bc06d150 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:06.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.892+0000 7f07dfd8d700 1 --2- 172.21.15.47:0/8442710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07d8099a50 0x7f07d81e7730 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:06.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.892+0000 7f07dfd8d700 1 --2- 172.21.15.47:0/8442710 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07c4004850 0x7f07d8157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:06.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.892+0000 7f07dfd8d700 1 --2- 172.21.15.47:0/8442710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07d8151590 0x7f07d81e71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:06.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.892+0000 7f07dfd8d700 1 -- 172.21.15.47:0/8442710 >> 172.21.15.47:0/8442710 conn(0x7f07d806a9c0 msgr2=0x7f07d8152d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:06.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.892+0000 7f07dfd8d700 1 -- 172.21.15.47:0/8442710 shutdown_connections 2024-05-08T19:50:06.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:06.892+0000 7f07dfd8d700 1 -- 172.21.15.47:0/8442710 wait complete. 2024-05-08T19:50:06.897 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T19:50:07.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.042+0000 7fefa32b1700 1 Processor -- start 2024-05-08T19:50:07.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.042+0000 7fefa32b1700 1 -- start start 2024-05-08T19:50:07.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.043+0000 7fefa32b1700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fef9c155070 0x7fef9c160230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:07.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.043+0000 7fefa32b1700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c158930 con 0x7fef9c0c1b20 2024-05-08T19:50:07.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.043+0000 7fefa32b1700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0c2380 con 0x7fef9c0c1f00 2024-05-08T19:50:07.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.043+0000 7fefa32b1700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c0c2840 con 0x7fef9c155070 2024-05-08T19:50:07.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.043+0000 7fefa104d700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fef9c0c1b20 0x7fef9c13d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44218/0 (socket says 172.21.15.47:44218) 2024-05-08T19:50:07.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.043+0000 7fefa104d700 1 -- 172.21.15.47:0/2801439619 learned_addr learned my addr 172.21.15.47:0/2801439619 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:50:07.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.043+0000 7fefa184e700 1 --2- 172.21.15.47:0/2801439619 >> v2:172.21.15.177:3300/0 conn(0x7fef9c155070 0x7fef9c160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:07.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.043+0000 7fef8ffff700 1 -- 172.21.15.47:0/2801439619 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450698376 0 0) 0x7fef9c158930 con 0x7fef9c0c1b20 2024-05-08T19:50:07.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.043+0000 7fef8ffff700 1 -- 172.21.15.47:0/2801439619 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef880035b0 con 0x7fef9c0c1b20 2024-05-08T19:50:07.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.043+0000 7fefa184e700 1 -- 172.21.15.47:0/2801439619 >> v1:172.21.15.177:6789/0 conn(0x7fef9c0c1f00 legacy=0x7fef9c154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:07.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.043+0000 7fef8ffff700 1 -- 172.21.15.47:0/2801439619 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1889664556 0 0) 0x7fef880035b0 con 0x7fef9c0c1b20 2024-05-08T19:50:07.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.043+0000 7fefa184e700 1 -- 172.21.15.47:0/2801439619 >> v1:172.21.15.47:6789/0 conn(0x7fef9c0c1b20 legacy=0x7fef9c13d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:07.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.043+0000 7fefa184e700 1 -- 172.21.15.47:0/2801439619 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c13e1e0 con 0x7fef9c155070 2024-05-08T19:50:07.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.044+0000 7fefa184e700 1 --2- 172.21.15.47:0/2801439619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef9c155070 0x7fef9c160230 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fef94009d90 tx=0x7fef9400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daccd6b09115d171 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:07.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.044+0000 7fef8ffff700 1 -- 172.21.15.47:0/2801439619 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9400e070 con 0x7fef9c155070 2024-05-08T19:50:07.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.044+0000 7fef8ffff700 1 -- 172.21.15.47:0/2801439619 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fef94003a20 con 0x7fef9c155070 2024-05-08T19:50:07.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.044+0000 7fef8ffff700 1 -- 172.21.15.47:0/2801439619 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90001670 con 0x7fef9c155070 2024-05-08T19:50:07.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.044+0000 7fefa32b1700 1 -- 172.21.15.47:0/2801439619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef9c155070 msgr2=0x7fef9c160230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:07.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.044+0000 7fefa32b1700 1 --2- 172.21.15.47:0/2801439619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef9c155070 0x7fef9c160230 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fef94009d90 tx=0x7fef9400b330 comp rx=0 tx=0).stop 2024-05-08T19:50:07.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.044+0000 7fefa32b1700 1 -- 172.21.15.47:0/2801439619 shutdown_connections 2024-05-08T19:50:07.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.044+0000 7fefa32b1700 1 --2- 172.21.15.47:0/2801439619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef9c155070 0x7fef9c160230 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:07.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.044+0000 7fefa32b1700 1 -- 172.21.15.47:0/2801439619 >> 172.21.15.47:0/2801439619 conn(0x7fef9c0c3c20 msgr2=0x7fef9c0c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:07.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.044+0000 7fefa32b1700 1 -- 172.21.15.47:0/2801439619 shutdown_connections 2024-05-08T19:50:07.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.044+0000 7fefa32b1700 1 -- 172.21.15.47:0/2801439619 wait complete. 2024-05-08T19:50:07.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.045+0000 7fefa32b1700 1 Processor -- start 2024-05-08T19:50:07.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.046+0000 7fefa32b1700 1 -- start start 2024-05-08T19:50:07.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.046+0000 7fefa32b1700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef9c0c1b20 0x7fef9c1ede30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:07.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.046+0000 7fefa32b1700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fef9c0c1f00 0x7fef9c13b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:07.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.046+0000 7fefa32b1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef9c155070 0x7fef9c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:07.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.046+0000 7fefa32b1700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c1ed3c0 con 0x7fef9c155070 2024-05-08T19:50:07.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.046+0000 7fefa32b1700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c153340 con 0x7fef9c0c1b20 2024-05-08T19:50:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.046+0000 7fefa32b1700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c1ed630 con 0x7fef9c0c1f00 2024-05-08T19:50:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.046+0000 7fefa184e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef9c155070 0x7fef9c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.046+0000 7fefa184e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef9c155070 0x7fef9c06d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44196/0 (socket says 172.21.15.47:44196) 2024-05-08T19:50:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.046+0000 7fefa184e700 1 -- 172.21.15.47:0/1937040644 learned_addr learned my addr 172.21.15.47:0/1937040644 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:50:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.047+0000 7fefa084c700 1 --2- 172.21.15.47:0/1937040644 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fef9c0c1f00 0x7fef9c13b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.047+0000 7fefa184e700 1 -- 172.21.15.47:0/1937040644 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fef9c0c1f00 msgr2=0x7fef9c13b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.047+0000 7fefa184e700 1 --2- 172.21.15.47:0/1937040644 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fef9c0c1f00 0x7fef9c13b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.047+0000 7fefa104d700 1 --2- 172.21.15.47:0/1937040644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef9c0c1b20 0x7fef9c1ede30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.047+0000 7fefa184e700 1 -- 172.21.15.47:0/1937040644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef9c0c1b20 msgr2=0x7fef9c1ede30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.047+0000 7fefa184e700 1 --2- 172.21.15.47:0/1937040644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef9c0c1b20 0x7fef9c1ede30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.047+0000 7fefa184e700 1 -- 172.21.15.47:0/1937040644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef94009a70 con 0x7fef9c155070 2024-05-08T19:50:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.047+0000 7fefa104d700 1 --2- 172.21.15.47:0/1937040644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef9c0c1b20 0x7fef9c1ede30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:50:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.047+0000 7fefa184e700 1 --2- 172.21.15.47:0/1937040644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef9c155070 0x7fef9c06d270 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fef9400b370 tx=0x7fef94004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.047+0000 7fef8dffb700 1 -- 172.21.15.47:0/1937040644 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94004760 con 0x7fef9c155070 2024-05-08T19:50:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.047+0000 7fef8dffb700 1 -- 172.21.15.47:0/1937040644 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fef940048c0 con 0x7fef9c155070 2024-05-08T19:50:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.047+0000 7fefa32b1700 1 -- 172.21.15.47:0/1937040644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c1ed910 con 0x7fef9c155070 2024-05-08T19:50:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.047+0000 7fef8dffb700 1 -- 172.21.15.47:0/1937040644 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9401b660 con 0x7fef9c155070 2024-05-08T19:50:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.047+0000 7fefa32b1700 1 -- 172.21.15.47:0/1937040644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c13b800 con 0x7fef9c155070 2024-05-08T19:50:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.048+0000 7fefa32b1700 1 -- 172.21.15.47:0/1937040644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c0c16d0 con 0x7fef9c155070 2024-05-08T19:50:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.049+0000 7fef8dffb700 1 -- 172.21.15.47:0/1937040644 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fef9401b7c0 con 0x7fef9c155070 2024-05-08T19:50:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.049+0000 7fef8dffb700 1 --2- 172.21.15.47:0/1937040644 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fef8006ac90 0x7fef8006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.049+0000 7fef8dffb700 1 -- 172.21.15.47:0/1937040644 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fef9408af80 con 0x7fef9c155070 2024-05-08T19:50:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.049+0000 7fefa104d700 1 --2- 172.21.15.47:0/1937040644 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fef8006ac90 0x7fef8006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:07.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.050+0000 7fefa104d700 1 --2- 172.21.15.47:0/1937040644 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fef8006ac90 0x7fef8006d150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fef90007960 tx=0x7fef90009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:07.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.054+0000 7fef8dffb700 1 -- 172.21.15.47:0/1937040644 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fef94055d40 con 0x7fef9c155070 2024-05-08T19:50:07.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.260+0000 7fefa32b1700 1 -- 172.21.15.47:0/1937040644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef9c158da0 con 0x7fef9c155070 2024-05-08T19:50:07.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.892+0000 7fef8dffb700 1 -- 172.21.15.47:0/1937040644 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fef9c158da0 con 0x7fef9c155070 2024-05-08T19:50:07.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.899+0000 7fefa32b1700 1 -- 172.21.15.47:0/1937040644 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fef8006ac90 msgr2=0x7fef8006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:07.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.899+0000 7fefa32b1700 1 --2- 172.21.15.47:0/1937040644 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fef8006ac90 0x7fef8006d150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fef90007960 tx=0x7fef90009040 comp rx=0 tx=0).stop 2024-05-08T19:50:07.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.899+0000 7fefa32b1700 1 -- 172.21.15.47:0/1937040644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef9c155070 msgr2=0x7fef9c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:07.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.899+0000 7fefa32b1700 1 --2- 172.21.15.47:0/1937040644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef9c155070 0x7fef9c06d270 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fef9400b370 tx=0x7fef94004ad0 comp rx=0 tx=0).stop 2024-05-08T19:50:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.900+0000 7fefa32b1700 1 -- 172.21.15.47:0/1937040644 shutdown_connections 2024-05-08T19:50:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.900+0000 7fefa32b1700 1 --2- 172.21.15.47:0/1937040644 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fef8006ac90 0x7fef8006d150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.900+0000 7fefa32b1700 1 --2- 172.21.15.47:0/1937040644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef9c155070 0x7fef9c06d270 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.900+0000 7fefa32b1700 1 --2- 172.21.15.47:0/1937040644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef9c0c1b20 0x7fef9c1ede30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.900+0000 7fefa32b1700 1 --2- 172.21.15.47:0/1937040644 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fef9c0c1f00 0x7fef9c13b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.900+0000 7fefa32b1700 1 -- 172.21.15.47:0/1937040644 >> 172.21.15.47:0/1937040644 conn(0x7fef9c0c3c20 msgr2=0x7fef9c13bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.900+0000 7fefa32b1700 1 -- 172.21.15.47:0/1937040644 shutdown_connections 2024-05-08T19:50:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:07.900+0000 7fefa32b1700 1 -- 172.21.15.47:0/1937040644 wait complete. 2024-05-08T19:50:07.892 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' removed 2024-05-08T19:50:07.910 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T19:50:08.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.064+0000 7fa9d5dd8700 1 Processor -- start 2024-05-08T19:50:08.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.065+0000 7fa9d5dd8700 1 -- start start 2024-05-08T19:50:08.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.065+0000 7fa9d5dd8700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9d0150300 0x7fa9d00a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:08.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.065+0000 7fa9d5dd8700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa9d00c1b20 0x7fa9d00c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:08.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.065+0000 7fa9d5dd8700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d01532f0 con 0x7fa9d006ac30 2024-05-08T19:50:08.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.065+0000 7fa9d5dd8700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d00aac10 con 0x7fa9d00c1b20 2024-05-08T19:50:08.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.065+0000 7fa9d5dd8700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d00c2510 con 0x7fa9d0150300 2024-05-08T19:50:08.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.065+0000 7fa9cf7fe700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa9d006ac30 0x7fa9d014fbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60448/0 (socket says 172.21.15.47:60448) 2024-05-08T19:50:08.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.065+0000 7fa9cf7fe700 1 -- 172.21.15.47:0/391739564 learned_addr learned my addr 172.21.15.47:0/391739564 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:50:08.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.066+0000 7fa9ceffd700 1 --2- 172.21.15.47:0/391739564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9d0150300 0x7fa9d00a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:08.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.066+0000 7fa9cffff700 1 --2- 172.21.15.47:0/391739564 >> v2:172.21.15.177:3300/0 conn(0x7fa9d00c1b20 0x7fa9d00c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:08.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.066+0000 7fa9ce7fc700 1 -- 172.21.15.47:0/391739564 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302494916 0 0) 0x7fa9d01532f0 con 0x7fa9d006ac30 2024-05-08T19:50:08.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.066+0000 7fa9ce7fc700 1 -- 172.21.15.47:0/391739564 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9b80035b0 con 0x7fa9d006ac30 2024-05-08T19:50:08.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.066+0000 7fa9ce7fc700 1 -- 172.21.15.47:0/391739564 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1870577631 0 0) 0x7fa9b80035b0 con 0x7fa9d006ac30 2024-05-08T19:50:08.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.066+0000 7fa9ceffd700 1 -- 172.21.15.47:0/391739564 >> v2:172.21.15.177:3300/0 conn(0x7fa9d00c1b20 msgr2=0x7fa9d00c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.066+0000 7fa9ceffd700 1 --2- 172.21.15.47:0/391739564 >> v2:172.21.15.177:3300/0 conn(0x7fa9d00c1b20 0x7fa9d00c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.066+0000 7fa9ceffd700 1 -- 172.21.15.47:0/391739564 >> v1:172.21.15.47:6789/0 conn(0x7fa9d006ac30 legacy=0x7fa9d014fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.066+0000 7fa9ceffd700 1 -- 172.21.15.47:0/391739564 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d01529c0 con 0x7fa9d0150300 2024-05-08T19:50:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.066+0000 7fa9cffff700 1 --2- 172.21.15.47:0/391739564 >> v2:172.21.15.177:3300/0 conn(0x7fa9d00c1b20 0x7fa9d00c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:50:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.066+0000 7fa9ceffd700 1 --2- 172.21.15.47:0/391739564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9d0150300 0x7fa9d00a9db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009840 tx=0x7fa9c4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6020441bcc2f6d4b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.066+0000 7fa9ce7fc700 1 -- 172.21.15.47:0/391739564 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0001670 con 0x7fa9d0150300 2024-05-08T19:50:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.066+0000 7fa9ce7fc700 1 -- 172.21.15.47:0/391739564 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa9c4004030 con 0x7fa9d0150300 2024-05-08T19:50:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.066+0000 7fa9ce7fc700 1 -- 172.21.15.47:0/391739564 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c40043e0 con 0x7fa9d0150300 2024-05-08T19:50:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.067+0000 7fa9d5dd8700 1 -- 172.21.15.47:0/391739564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9d0150300 msgr2=0x7fa9d00a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.067+0000 7fa9d5dd8700 1 --2- 172.21.15.47:0/391739564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9d0150300 0x7fa9d00a9db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009840 tx=0x7fa9c4009b50 comp rx=0 tx=0).stop 2024-05-08T19:50:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.067+0000 7fa9d5dd8700 1 -- 172.21.15.47:0/391739564 shutdown_connections 2024-05-08T19:50:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.067+0000 7fa9d5dd8700 1 --2- 172.21.15.47:0/391739564 >> v2:172.21.15.177:3300/0 conn(0x7fa9d00c1b20 0x7fa9d00c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.067+0000 7fa9d5dd8700 1 --2- 172.21.15.47:0/391739564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9d0150300 0x7fa9d00a9db0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.067+0000 7fa9d5dd8700 1 -- 172.21.15.47:0/391739564 >> 172.21.15.47:0/391739564 conn(0x7fa9d00c3c20 msgr2=0x7fa9d00c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.067+0000 7fa9d5dd8700 1 -- 172.21.15.47:0/391739564 shutdown_connections 2024-05-08T19:50:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.067+0000 7fa9d5dd8700 1 -- 172.21.15.47:0/391739564 wait complete. 2024-05-08T19:50:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.068+0000 7fa9d5dd8700 1 Processor -- start 2024-05-08T19:50:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.068+0000 7fa9d5dd8700 1 -- start start 2024-05-08T19:50:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9d5dd8700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9d006ac30 0x7fa9d01ea450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9d5dd8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9d00c1b20 0x7fa9d014a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9d5dd8700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9d0150300 0x7fa9d01ee260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9d5dd8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d01ea990 con 0x7fa9d00c1b20 2024-05-08T19:50:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9d5dd8700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d00c5470 con 0x7fa9d006ac30 2024-05-08T19:50:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9d5dd8700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d00c4eb0 con 0x7fa9d0150300 2024-05-08T19:50:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9ceffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9d00c1b20 0x7fa9d014a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9ceffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9d00c1b20 0x7fa9d014a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56838/0 (socket says 172.21.15.47:56838) 2024-05-08T19:50:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9ceffd700 1 -- 172.21.15.47:0/1443783197 learned_addr learned my addr 172.21.15.47:0/1443783197 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:50:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9cffff700 1 --2- 172.21.15.47:0/1443783197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9d0150300 0x7fa9d01ee260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9cf7fe700 1 --2- 172.21.15.47:0/1443783197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9d006ac30 0x7fa9d01ea450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9ceffd700 1 -- 172.21.15.47:0/1443783197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9d0150300 msgr2=0x7fa9d01ee260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9ceffd700 1 --2- 172.21.15.47:0/1443783197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9d0150300 0x7fa9d01ee260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9ceffd700 1 -- 172.21.15.47:0/1443783197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9d006ac30 msgr2=0x7fa9d01ea450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9ceffd700 1 --2- 172.21.15.47:0/1443783197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9d006ac30 0x7fa9d01ea450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.069+0000 7fa9ceffd700 1 -- 172.21.15.47:0/1443783197 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c8009a70 con 0x7fa9d00c1b20 2024-05-08T19:50:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.070+0000 7fa9ceffd700 1 --2- 172.21.15.47:0/1443783197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9d00c1b20 0x7fa9d014a370 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400a010 tx=0x7fa9c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.070+0000 7fa9b7fff700 1 -- 172.21.15.47:0/1443783197 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4003ca0 con 0x7fa9d00c1b20 2024-05-08T19:50:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.070+0000 7fa9b7fff700 1 -- 172.21.15.47:0/1443783197 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa9c401f070 con 0x7fa9d00c1b20 2024-05-08T19:50:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.070+0000 7fa9d5dd8700 1 -- 172.21.15.47:0/1443783197 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c40094a0 con 0x7fa9d00c1b20 2024-05-08T19:50:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.070+0000 7fa9b7fff700 1 -- 172.21.15.47:0/1443783197 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4011890 con 0x7fa9d00c1b20 2024-05-08T19:50:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.070+0000 7fa9d5dd8700 1 -- 172.21.15.47:0/1443783197 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d01eda60 con 0x7fa9d00c1b20 2024-05-08T19:50:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.071+0000 7fa9d5dd8700 1 -- 172.21.15.47:0/1443783197 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d0153760 con 0x7fa9d00c1b20 2024-05-08T19:50:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.071+0000 7fa9b7fff700 1 -- 172.21.15.47:0/1443783197 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa9c40119f0 con 0x7fa9d00c1b20 2024-05-08T19:50:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.072+0000 7fa9b7fff700 1 --2- 172.21.15.47:0/1443783197 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa9bc06ac90 0x7fa9bc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.072+0000 7fa9b7fff700 1 -- 172.21.15.47:0/1443783197 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7fa9c4021070 con 0x7fa9d00c1b20 2024-05-08T19:50:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.075+0000 7fa9cf7fe700 1 --2- 172.21.15.47:0/1443783197 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa9bc06ac90 0x7fa9bc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.079+0000 7fa9cf7fe700 1 --2- 172.21.15.47:0/1443783197 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa9bc06ac90 0x7fa9bc06d150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0148820 tx=0x7fa9c0007ba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.079+0000 7fa9b7fff700 1 -- 172.21.15.47:0/1443783197 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa9d0153760 con 0x7fa9d00c1b20 2024-05-08T19:50:08.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.384+0000 7fa9d5dd8700 1 -- 172.21.15.47:0/1443783197 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa9d0153760 con 0x7fa9d00c1b20 2024-05-08T19:50:08.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.898+0000 7fa9b7fff700 1 -- 172.21.15.47:0/1443783197 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa9d0153760 con 0x7fa9d00c1b20 2024-05-08T19:50:08.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.902+0000 7fa9d5dd8700 1 -- 172.21.15.47:0/1443783197 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa9bc06ac90 msgr2=0x7fa9bc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:08.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.902+0000 7fa9d5dd8700 1 --2- 172.21.15.47:0/1443783197 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa9bc06ac90 0x7fa9bc06d150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0148820 tx=0x7fa9c0007ba0 comp rx=0 tx=0).stop 2024-05-08T19:50:08.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.902+0000 7fa9d5dd8700 1 -- 172.21.15.47:0/1443783197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9d00c1b20 msgr2=0x7fa9d014a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:08.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.902+0000 7fa9d5dd8700 1 --2- 172.21.15.47:0/1443783197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9d00c1b20 0x7fa9d014a370 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400a010 tx=0x7fa9c4004750 comp rx=0 tx=0).stop 2024-05-08T19:50:08.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.904+0000 7fa9d5dd8700 1 -- 172.21.15.47:0/1443783197 shutdown_connections 2024-05-08T19:50:08.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.904+0000 7fa9d5dd8700 1 --2- 172.21.15.47:0/1443783197 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7fa9bc06ac90 0x7fa9bc06d150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:08.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.904+0000 7fa9d5dd8700 1 --2- 172.21.15.47:0/1443783197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9d0150300 0x7fa9d01ee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:08.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.904+0000 7fa9d5dd8700 1 --2- 172.21.15.47:0/1443783197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9d006ac30 0x7fa9d01ea450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:08.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.904+0000 7fa9d5dd8700 1 --2- 172.21.15.47:0/1443783197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9d00c1b20 0x7fa9d014a370 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:08.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.904+0000 7fa9d5dd8700 1 -- 172.21.15.47:0/1443783197 >> 172.21.15.47:0/1443783197 conn(0x7fa9d00c3c20 msgr2=0x7fa9d00a96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:08.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.906+0000 7fa9d5dd8700 1 -- 172.21.15.47:0/1443783197 shutdown_connections 2024-05-08T19:50:08.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:08.909+0000 7fa9d5dd8700 1 -- 172.21.15.47:0/1443783197 wait complete. 2024-05-08T19:50:08.907 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' removed 2024-05-08T19:50:08.929 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-08T19:50:09.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.087+0000 7f59c776d700 1 Processor -- start 2024-05-08T19:50:09.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.087+0000 7f59c776d700 1 -- start start 2024-05-08T19:50:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.088+0000 7f59c776d700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f59c0152230 0x7f59c00c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.088+0000 7f59c776d700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c00c2fc0 con 0x7f59c00c62b0 2024-05-08T19:50:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.088+0000 7f59c776d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c0152610 con 0x7f59c0070470 2024-05-08T19:50:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.088+0000 7f59c776d700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c00c3e20 con 0x7f59c0152230 2024-05-08T19:50:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.088+0000 7f59c5d0a700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f59c00c62b0 0x7f59c00c14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60450/0 (socket says 172.21.15.47:60450) 2024-05-08T19:50:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.088+0000 7f59c5d0a700 1 -- 172.21.15.47:0/872495935 learned_addr learned my addr 172.21.15.47:0/872495935 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-08T19:50:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.088+0000 7f59c5509700 1 --2- 172.21.15.47:0/872495935 >> v2:172.21.15.177:3300/0 conn(0x7f59c0152230 0x7f59c00c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.088+0000 7f59b3fff700 1 -- 172.21.15.47:0/872495935 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752214624 0 0) 0x7f59c00c2fc0 con 0x7f59c00c62b0 2024-05-08T19:50:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59b3fff700 1 -- 172.21.15.47:0/872495935 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59ac0035b0 con 0x7f59c00c62b0 2024-05-08T19:50:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59b3fff700 1 -- 172.21.15.47:0/872495935 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2624170404 0 0) 0x7f59ac0035b0 con 0x7f59c00c62b0 2024-05-08T19:50:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59b3fff700 1 -- 172.21.15.47:0/872495935 >> v2:172.21.15.177:3300/0 conn(0x7f59c0152230 msgr2=0x7f59c00c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59b3fff700 1 --2- 172.21.15.47:0/872495935 >> v2:172.21.15.177:3300/0 conn(0x7f59c0152230 0x7f59c00c2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59b3fff700 1 -- 172.21.15.47:0/872495935 >> v1:172.21.15.177:6789/0 conn(0x7f59c0070470 legacy=0x7f59c00c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59b3fff700 1 -- 172.21.15.47:0/872495935 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c00702a0 con 0x7f59c00c62b0 2024-05-08T19:50:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59b3fff700 1 -- 172.21.15.47:0/872495935 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2395059324 0 0) 0x7f59b80019f0 con 0x7f59c00c62b0 2024-05-08T19:50:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59b3fff700 1 -- 172.21.15.47:0/872495935 >> v1:172.21.15.47:6789/0 conn(0x7f59c00c62b0 legacy=0x7f59c00c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59b3fff700 1 --2- 172.21.15.47:0/872495935 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59ac003a00 0x7f59ac003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59b3fff700 1 --2- 172.21.15.47:0/872495935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59ac004850 0x7f59ac004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59b3fff700 1 --2- 172.21.15.47:0/872495935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac005210 0x7f59ac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59b3fff700 1 -- 172.21.15.47:0/872495935 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac00c080 con 0x7f59ac005210 2024-05-08T19:50:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59b3fff700 1 -- 172.21.15.47:0/872495935 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac00c1f0 con 0x7f59ac004850 2024-05-08T19:50:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59b3fff700 1 -- 172.21.15.47:0/872495935 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac00c3b0 con 0x7f59ac003a00 2024-05-08T19:50:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59c5d0a700 1 --2- 172.21.15.47:0/872495935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac005210 0x7f59ac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59c4d08700 1 --2- 172.21.15.47:0/872495935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59ac004850 0x7f59ac004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59c5d0a700 1 -- 172.21.15.47:0/872495935 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59ac003a00 msgr2=0x7f59ac003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59c5d0a700 1 --2- 172.21.15.47:0/872495935 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59ac003a00 0x7f59ac003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59c5d0a700 1 -- 172.21.15.47:0/872495935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59ac004850 msgr2=0x7f59ac004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T19:50:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59c5d0a700 1 --2- 172.21.15.47:0/872495935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59ac004850 0x7f59ac004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59c5d0a700 1 -- 172.21.15.47:0/872495935 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac0035b0 con 0x7f59ac005210 2024-05-08T19:50:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59c4d08700 1 --2- 172.21.15.47:0/872495935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59ac004850 0x7f59ac004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:50:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59c5d0a700 1 -- 172.21.15.47:0/872495935 reap_dead start 2024-05-08T19:50:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.089+0000 7f59c5d0a700 1 --2- 172.21.15.47:0/872495935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac005210 0x7f59ac00ba10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f59b800a830 tx=0x7f59ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec526248f81f88a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.090+0000 7f59b3fff700 1 -- 172.21.15.47:0/872495935 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b800a2f0 con 0x7f59ac005210 2024-05-08T19:50:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.090+0000 7f59b3fff700 1 -- 172.21.15.47:0/872495935 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f59b8012620 con 0x7f59ac005210 2024-05-08T19:50:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.090+0000 7f59b3fff700 1 -- 172.21.15.47:0/872495935 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80129f0 con 0x7f59ac005210 2024-05-08T19:50:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.090+0000 7f59c776d700 1 -- 172.21.15.47:0/872495935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac005210 msgr2=0x7f59ac00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.090+0000 7f59c776d700 1 --2- 172.21.15.47:0/872495935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac005210 0x7f59ac00ba10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f59b800a830 tx=0x7f59ac005880 comp rx=0 tx=0).stop 2024-05-08T19:50:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.090+0000 7f59c776d700 1 -- 172.21.15.47:0/872495935 shutdown_connections 2024-05-08T19:50:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.090+0000 7f59c776d700 1 --2- 172.21.15.47:0/872495935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac005210 0x7f59ac00ba10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.090+0000 7f59c776d700 1 -- 172.21.15.47:0/872495935 >> 172.21.15.47:0/872495935 conn(0x7f59c006b1b0 msgr2=0x7f59c00a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.090+0000 7f59c776d700 1 -- 172.21.15.47:0/872495935 shutdown_connections 2024-05-08T19:50:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.090+0000 7f59c776d700 1 -- 172.21.15.47:0/872495935 wait complete. 2024-05-08T19:50:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.092+0000 7f59c776d700 1 Processor -- start 2024-05-08T19:50:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.092+0000 7f59c776d700 1 -- start start 2024-05-08T19:50:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.092+0000 7f59c776d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac005210 0x7f59c0150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.092+0000 7f59c776d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c01514f0 0x7f59c014ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.092+0000 7f59c776d700 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c0155e80 0x7f59c0156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.092+0000 7f59c776d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c014cf50 con 0x7f59ac005210 2024-05-08T19:50:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.092+0000 7f59c776d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c01ea750 con 0x7f59c01514f0 2024-05-08T19:50:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.092+0000 7f59c776d700 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c0158eb0 con 0x7f59c0155e80 2024-05-08T19:50:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.092+0000 7f59c5509700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac005210 0x7f59c0150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.093+0000 7f59c5509700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac005210 0x7f59c0150fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56852/0 (socket says 172.21.15.47:56852) 2024-05-08T19:50:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.093+0000 7f59c5509700 1 -- 172.21.15.47:0/3223495924 learned_addr learned my addr 172.21.15.47:0/3223495924 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-08T19:50:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.093+0000 7f59c4d08700 1 --2- 172.21.15.47:0/3223495924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c01514f0 0x7f59c014ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.093+0000 7f59c5d0a700 1 --2- 172.21.15.47:0/3223495924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c0155e80 0x7f59c0156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.093+0000 7f59c5509700 1 -- 172.21.15.47:0/3223495924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c0155e80 msgr2=0x7f59c0156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.093+0000 7f59c5509700 1 --2- 172.21.15.47:0/3223495924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c0155e80 0x7f59c0156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.093+0000 7f59c5509700 1 -- 172.21.15.47:0/3223495924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c01514f0 msgr2=0x7f59c014ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.093+0000 7f59c5509700 1 --2- 172.21.15.47:0/3223495924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c01514f0 0x7f59c014ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.093+0000 7f59c5509700 1 -- 172.21.15.47:0/3223495924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c01e9e40 con 0x7f59ac005210 2024-05-08T19:50:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.093+0000 7f59c5509700 1 --2- 172.21.15.47:0/3223495924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac005210 0x7f59c0150fb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f59b400e870 tx=0x7f59b400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.093+0000 7f59b1ffb700 1 -- 172.21.15.47:0/3223495924 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4013680 con 0x7f59ac005210 2024-05-08T19:50:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.093+0000 7f59b1ffb700 1 -- 172.21.15.47:0/3223495924 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f59b40137e0 con 0x7f59ac005210 2024-05-08T19:50:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.093+0000 7f59b1ffb700 1 -- 172.21.15.47:0/3223495924 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4013bb0 con 0x7f59ac005210 2024-05-08T19:50:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.093+0000 7f59c776d700 1 -- 172.21.15.47:0/3223495924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c01ee130 con 0x7f59ac005210 2024-05-08T19:50:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.093+0000 7f59c776d700 1 -- 172.21.15.47:0/3223495924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c01ea3e0 con 0x7f59ac005210 2024-05-08T19:50:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.094+0000 7f59c776d700 1 -- 172.21.15.47:0/3223495924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c004ec60 con 0x7f59ac005210 2024-05-08T19:50:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.095+0000 7f59b1ffb700 1 -- 172.21.15.47:0/3223495924 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f59b4013d10 con 0x7f59ac005210 2024-05-08T19:50:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.095+0000 7f59b1ffb700 1 --2- 172.21.15.47:0/3223495924 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f59a406ac90 0x7f59a406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:50:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.095+0000 7f59b1ffb700 1 -- 172.21.15.47:0/3223495924 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f59b40891b0 con 0x7f59ac005210 2024-05-08T19:50:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.095+0000 7f59c4d08700 1 --2- 172.21.15.47:0/3223495924 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f59a406ac90 0x7f59a406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:50:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.096+0000 7f59c4d08700 1 --2- 172.21.15.47:0/3223495924 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f59a406ac90 0x7f59a406d150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f59c0151ad0 tx=0x7f59bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:50:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.100+0000 7f59b1ffb700 1 -- 172.21.15.47:0/3223495924 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f59b40543d0 con 0x7f59ac005210 2024-05-08T19:50:09.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:09.321+0000 7f59c776d700 1 -- 172.21.15.47:0/3223495924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f59c00c6090 con 0x7f59ac005210 2024-05-08T19:50:10.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:10.078+0000 7f59b1ffb700 1 -- 172.21.15.47:0/3223495924 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f59b40579f0 con 0x7f59ac005210 2024-05-08T19:50:10.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:10.084+0000 7f59c776d700 1 -- 172.21.15.47:0/3223495924 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f59a406ac90 msgr2=0x7f59a406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:10.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:10.084+0000 7f59c776d700 1 --2- 172.21.15.47:0/3223495924 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f59a406ac90 0x7f59a406d150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f59c0151ad0 tx=0x7f59bc009040 comp rx=0 tx=0).stop 2024-05-08T19:50:10.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:10.084+0000 7f59c776d700 1 -- 172.21.15.47:0/3223495924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac005210 msgr2=0x7f59c0150fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:50:10.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:10.084+0000 7f59c776d700 1 --2- 172.21.15.47:0/3223495924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac005210 0x7f59c0150fb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f59b400e870 tx=0x7f59b400eb80 comp rx=0 tx=0).stop 2024-05-08T19:50:10.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:10.084+0000 7f59c776d700 1 -- 172.21.15.47:0/3223495924 shutdown_connections 2024-05-08T19:50:10.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:10.084+0000 7f59c776d700 1 --2- 172.21.15.47:0/3223495924 >> [v2:172.21.15.177:6832/46523,v1:172.21.15.177:6833/46523] conn(0x7f59a406ac90 0x7f59a406d150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:10.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:10.084+0000 7f59c776d700 1 --2- 172.21.15.47:0/3223495924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ac005210 0x7f59c0150fb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:10.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:10.084+0000 7f59c776d700 1 --2- 172.21.15.47:0/3223495924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c0155e80 0x7f59c0156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:10.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:10.084+0000 7f59c776d700 1 --2- 172.21.15.47:0/3223495924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c01514f0 0x7f59c014ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:50:10.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:10.084+0000 7f59c776d700 1 -- 172.21.15.47:0/3223495924 >> 172.21.15.47:0/3223495924 conn(0x7f59c006b1b0 msgr2=0x7f59c014bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:50:10.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:10.099+0000 7f59c776d700 1 -- 172.21.15.47:0/3223495924 shutdown_connections 2024-05-08T19:50:10.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-08T19:50:10.106+0000 7f59c776d700 1 -- 172.21.15.47:0/3223495924 wait complete. 2024-05-08T19:50:10.102 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data_ec' removed 2024-05-08T19:50:10.132 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T19:50:10.132 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-08T19:50:10.132 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:10.163 INFO:tasks.ceph.mds.a:Stopped 2024-05-08T19:50:10.163 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-08T19:50:10.163 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:10.223 INFO:tasks.ceph.mds.c:Stopped 2024-05-08T19:50:10.223 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T19:50:10.223 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:10.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-05-08T19:50:12.665 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:50:12.668 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:50:16.325 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T19:50:16.326 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T19:50:16.326 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:16.337 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T19:50:16.337 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T19:50:16.338 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T19:50:16.338 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:16.418 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T19:50:16.418 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T19:50:16.418 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:16.512 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T19:50:16.512 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T19:50:16.512 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:16.579 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T19:50:16.579 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T19:50:16.579 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:16.665 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T19:50:16.665 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-08T19:50:16.665 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:16.755 INFO:tasks.ceph.osd.4:Stopped 2024-05-08T19:50:16.755 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-08T19:50:16.755 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:16.837 INFO:tasks.ceph.osd.5:Stopped 2024-05-08T19:50:16.837 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-08T19:50:16.837 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:16.925 INFO:tasks.ceph.osd.6:Stopped 2024-05-08T19:50:16.925 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-08T19:50:16.925 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:16.995 INFO:tasks.ceph.osd.7:Stopped 2024-05-08T19:50:16.995 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T19:50:16.995 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-08T19:50:16.995 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:17.019 INFO:tasks.ceph.mgr.y:Stopped 2024-05-08T19:50:17.019 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T19:50:17.019 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:17.044 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T19:50:17.044 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T19:50:17.044 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T19:50:17.044 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:17.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-05-08T19:50:17.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-05-08T19:50:17.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-05-08T19:50:17.070 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T19:50:17.071 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T19:50:17.071 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:17.094 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T19:50:17.095 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T19:50:17.095 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T19:50:17.146 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T19:50:17.146 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T19:50:17.146 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-05-08T19:50:17.204 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-08T19:50:17.204 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T19:50:17.665 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-08T19:50:17.665 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T19:50:17.800 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-08T19:50:17.800 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T19:50:17.911 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-08T19:50:17.911 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T19:50:18.025 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi177.front.sepia.ceph.com 2024-05-08T19:50:18.025 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-08T19:50:18.833 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi177.front.sepia.ceph.com 2024-05-08T19:50:18.834 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-08T19:50:18.923 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi177.front.sepia.ceph.com 2024-05-08T19:50:18.924 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-08T19:50:19.018 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi177.front.sepia.ceph.com 2024-05-08T19:50:19.019 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-08T19:50:19.121 INFO:tasks.ceph:Archiving mon data... 2024-05-08T19:50:19.122 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697948/data/mon.a.tgz 2024-05-08T19:50:19.123 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-05-08T19:50:19.156 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.tksnSeOTyb 2024-05-08T19:50:19.156 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.tksnSeOTyb 2024-05-08T19:50:19.318 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.tksnSeOTyb 2024-05-08T19:50:19.461 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.tksnSeOTyb is 332KB 2024-05-08T19:50:19.557 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.tksnSeOTyb 2024-05-08T19:50:19.575 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697948/data/mon.b.tgz 2024-05-08T19:50:19.575 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-05-08T19:50:19.605 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.jxQOwV8fTy 2024-05-08T19:50:19.606 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.jxQOwV8fTy 2024-05-08T19:50:19.760 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.jxQOwV8fTy 2024-05-08T19:50:19.873 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.jxQOwV8fTy is 337KB 2024-05-08T19:50:19.970 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.jxQOwV8fTy 2024-05-08T19:50:19.987 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697948/data/mon.c.tgz 2024-05-08T19:50:19.987 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-05-08T19:50:20.043 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.uu7C63qi5V 2024-05-08T19:50:20.043 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.uu7C63qi5V 2024-05-08T19:50:20.167 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.uu7C63qi5V 2024-05-08T19:50:20.254 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.uu7C63qi5V is 337KB 2024-05-08T19:50:20.323 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.uu7C63qi5V 2024-05-08T19:50:20.339 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T19:50:20.339 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T19:50:20.342 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T19:50:20.406 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-05-08T19:50:20.406 DEBUG:teuthology.orchestra.run.smithi047:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-08T19:50:20.425 DEBUG:teuthology.orchestra.run.smithi177:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-08T19:50:20.456 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-08T19:50:20.474 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-08T19:50:20.480 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T19:50:20.482 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697948/remote/smithi047/crash 2024-05-08T19:50:20.482 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T19:50:20.534 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697948/remote/smithi177/crash 2024-05-08T19:50:20.535 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T19:50:20.562 INFO:tasks.ceph:Shutting down logrotate 2024-05-08T19:50:20.562 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:50:20.580 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T19:50:20.653 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T19:50:20.707 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T19:50:20.739 INFO:tasks.ceph:Compressing logs... 2024-05-08T19:50:20.739 DEBUG:teuthology.orchestra.run.smithi047:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T19:50:20.741 DEBUG:teuthology.orchestra.run.smithi177:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T19:50:22.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-05-08T19:50:22.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-05-08T19:57:24.151 INFO:tasks.ceph:Archiving logs... 2024-05-08T19:57:24.151 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697948/remote/smithi047/log 2024-05-08T19:57:24.153 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T19:58:15.507 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697948/remote/smithi177/log 2024-05-08T19:58:15.508 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T20:00:24.204 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T20:00:24.213 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T20:00:24.214 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T20:00:24.217 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T20:00:24.304 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T20:00:24.313 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T20:00:24.313 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T20:00:24.316 DEBUG:teuthology.orchestra.run.smithi177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T20:00:24.332 INFO:teuthology.orchestra.run.smithi047.stderr:bash: ntpq: command not found 2024-05-08T20:00:24.334 INFO:teuthology.orchestra.run.smithi177.stderr:bash: ntpq: command not found 2024-05-08T20:00:24.354 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T20:00:24.354 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-05-08T20:00:24.354 INFO:teuthology.orchestra.run.smithi177.stdout:^* hv01.front.sepia.ceph.com 3 6 377 55 +877us[ +862us] +/- 51ms 2024-05-08T20:00:24.354 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 -1060us[-1060us] +/- 52ms 2024-05-08T20:00:24.354 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 +362us[ +362us] +/- 93ms 2024-05-08T20:00:24.354 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T20:00:24.369 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T20:00:24.369 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-05-08T20:00:24.369 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 +838us[ +832us] +/- 51ms 2024-05-08T20:00:24.369 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 -1109us[-1115us] +/- 52ms 2024-05-08T20:00:24.369 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 +298us[ +292us] +/- 93ms 2024-05-08T20:00:24.370 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T20:00:24.370 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T20:00:24.380 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T20:00:24.381 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T20:00:24.398 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T20:00:24.497 DEBUG:teuthology.orchestra.run.smithi177:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T20:00:24.579 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T20:00:24.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:00:24.613 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T20:00:24.644 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:00:24.644 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T20:00:24.662 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T20:00:24.671 INFO:teuthology.task.internal:Duration was 3111.547409 seconds 2024-05-08T20:00:24.672 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T20:00:24.688 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T20:00:24.688 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T20:00:24.691 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T20:00:24.758 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T20:00:24.764 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T20:00:25.094 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T20:00:25.095 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-05-08T20:00:25.095 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T20:00:25.119 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi177.front.sepia.ceph.com 2024-05-08T20:00:25.119 DEBUG:teuthology.orchestra.run.smithi177:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T20:00:25.147 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T20:00:25.147 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T20:00:25.162 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T20:00:25.237 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T20:00:25.238 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T20:00:25.240 DEBUG:teuthology.orchestra.run.smithi177:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T20:00:25.324 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T20:00:25.334 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T20:00:25.335 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T20:00:25.386 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T20:00:25.445 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T20:00:25.455 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T20:00:25.458 DEBUG:teuthology.orchestra.run.smithi177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T20:00:25.494 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = core 2024-05-08T20:00:25.494 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-05-08T20:00:25.525 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T20:00:25.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:00:25.582 DEBUG:teuthology.orchestra.run.smithi177:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T20:00:25.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:00:25.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T20:00:25.609 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T20:00:25.609 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697948/remote/smithi047 2024-05-08T20:00:25.610 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T20:00:25.664 DEBUG:teuthology.misc:Transferring archived files from smithi177:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:02:00-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697948/remote/smithi177 2024-05-08T20:00:25.664 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T20:00:25.704 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T20:00:25.704 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T20:00:25.706 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T20:00:25.754 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T20:00:25.764 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T20:00:25.764 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T20:00:25.774 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T20:00:25.774 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T20:00:25.776 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T20:00:25.791 INFO:teuthology.orchestra.run.smithi047.stdout: 262175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 20:00 /home/ubuntu/cephtest 2024-05-08T20:00:25.811 INFO:teuthology.orchestra.run.smithi177.stdout: 262179 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 20:00 /home/ubuntu/cephtest 2024-05-08T20:00:25.812 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T20:00:25.822 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T20:00:25.846 INFO:teuthology.run:Summary data: description: fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} duration: 3111.547409057617 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-08T20:00:25.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T20:00:25.926 INFO:teuthology.run:pass